Last modified: 2014-10-29 17:09:43 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T74295, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 72295 - Raw webrequest partitions for 2014-10-20T10/1H not marked successful
Raw webrequest partitions for 2014-10-20T10/1H not marked successful
Status: RESOLVED FIXED
Product: Analytics
Classification: Unclassified
Refinery (Other open bugs)
unspecified
All All
: Unprioritized normal
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks: 72252
  Show dependency treegraph
 
Reported: 2014-10-21 09:27 UTC by christian
Modified: 2014-10-29 17:09 UTC (History)
7 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description christian 2014-10-21 09:27:16 UTC
The bits partition [1] for 2014-10-20T02/1H has not been marked
successful.

What happened?


[1]
_________________________________________________________________
qchris@stat1002 // jobs: 0 // time: 09:04:05 // exit code: 0
cwd: ~
~/cluster-scripts/dump_webrequest_status.sh 
  +------------------+--------+--------+--------+--------+
  | Date             |  bits  | mobile |  text  | upload |
  +------------------+--------+--------+--------+--------+
[...]
  | 2014-10-20T08/1H |    .   |    .   |    .   |    .   |    
  | 2014-10-20T09/1H |    .   |    .   |    .   |    .   |    
  | 2014-10-20T10/1H |    X   |    .   |    .   |    .   |    
  | 2014-10-20T11/1H |    .   |    .   |    .   |    .   |    
  | 2014-10-20T12/1H |    .   |    .   |    .   |    .   |    
[...]
  +------------------+--------+--------+--------+--------+


Statuses:

  . --> Partition is ok
  M --> Partition manually marked ok
  X --> Partition is not ok (duplicates, missing, or nulls)
Comment 1 christian 2014-10-21 09:38:38 UTC
The affected period is 10:37:16--10:37:20, which nicely matches the
manual kafka leader re-election from 10:38.

Mismatching data is minimal:

  +----------------------------+-----------+--------------+
  | Host                       | # missing | # duplicates |
  +----------------------------+-----------+--------------+
  | cp3019.esams.wikimedia.org |         0 |          252 |
  | cp3020.esams.wikimedia.org |         0 |          252 |
  | cp3021.esams.wikimedia.org |       525 |            0 |
  | cp4004.ulsfo.wmnet         |       220 |            0 |
  +----------------------------+-----------+--------------+

Total worth of mismatched data <<1 second.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links