Last modified: 2014-10-06 12:28:00 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T72600, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 70600 - "Age of unreviewed changesets by affiliation" shows negative number of changesets
"Age of unreviewed changesets by affiliation" shows negative number of change...
Status: PATCH_TO_REVIEW
Product: Analytics
Classification: Unclassified
Tech community metrics (Other open bugs)
unspecified
All All
: High normal
: ---
Assigned To: Nobody - You can work on this!
http://korma.wmflabs.org/browser/gerr...
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-09-09 08:26 UTC by Quim Gil
Modified: 2014-10-06 12:28 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Quim Gil 2014-09-09 08:26:08 UTC
In "Age of unreviewed changesets by affiliation" at http://korma.wmflabs.org/browser/gerrit_review_queue.html, the popup window shows the number of patches counted in the median for each affiliation. However, many of the numbers provided are negative, which doesn't make any sense.

I had already reported via email that those numbers looked very low considering the amount of changesets uploaded every month. This was when the numbers were still positive. Seeing negative values suggests that there is indeed something wrong there.
Comment 1 Quim Gil 2014-09-09 08:26:59 UTC
Marking High importance because I would really like to leave the Gerrit Review Queue page absolutely clean.
Comment 2 Quim Gil 2014-09-09 09:32:23 UTC
In fact, this graph should show the media age of their most recent uploads, just like we did with "Age of open changesets" and "Ranking of repositories".

Finally, could you change "scr_review_time_pending_ReviewsWaitingForReviewer_days_acc_median" for a human readable string, please?
Comment 3 Alvaro 2014-09-10 12:23:50 UTC
Ok, the new metric (upload) is generated also for companies, so we can move to this metric and then, fix the number of open issues per company using this new metric.

The new metric has already a human label, so the other error will be fixed also. 

As soon as it is available I will update this ticket.
Comment 4 Alvaro 2014-09-11 08:12:08 UTC
Quim, problem fixed. Now the pending number per company is right. The problem was that we are showing the new net pending per month, not the total pendings.
Comment 5 Quim Gil 2014-09-11 09:41:58 UTC
Now there are no negative numbers, but they still look low. For August we have:

Unknown: 66 
Wikimedia Foundation: 55
Independent: 123
Wikimedia Deutschland: 29
TOTAL: 273

However, according to "Volume of open changesets", in August there are 765 waiting for review. 

765 - 273 = 492

Where are these 492 changesets missing?

By the way, now we have "scr_review_time_pending_upload_ReviewsWaitingForReviewer_days_acc_median", which is still not very readable.
Comment 6 Quim Gil 2014-09-28 20:50:29 UTC
Álvaro, when do you think we will have a solution for this problem? This is the last bug in http://korma.wmflabs.org/browser/gerrit_review_queue.html stopping me from promoting this page widely.
Comment 7 Alvaro 2014-09-29 04:44:10 UTC
I plan to review all labels and help texts today and next, work on this issue. So expect a solution, or an explanation of the numbers, next two days!

Cheers
Comment 8 Alvaro 2014-09-29 15:17:53 UTC
Quim, the number of reviews now show the correct number. 

The main problem was that there are new identities not linked to Unknown.

With this fixed the numbers are much closer.

We have changed the metric for affiliations to "Time from last patchset". Is it ok or you prefer "Time from submission"?

With this metric:

Unknown: 666
WMF: 36
Independent: 10
WMD: 55
WikiWorks: 0

total: 767.

According to the above graph, "Time from last patchset" number of revisions should be 816. For other dates the error is less.

A deeper analysis could be done, but I am pretty confident the data is correct.
Comment 9 Quim Gil 2014-09-29 17:27:28 UTC
Progress!

It is strange to find so many Unknown. Any developer with a @wikimedia.org email address is a WMF employee. Any developer with a @wikimedia.de address is a WMDE employee. Are we applying these rules?
Comment 10 Alvaro 2014-10-06 03:20:46 UTC
Quim, reviewed the mapping, now we have:

Unknown 479
WMF 206
Individual 124 
WMD 8
Wikia 26

total: 843.

We need to improve the mapping to have less Unknown people in any case.
Comment 11 Quim Gil 2014-10-06 12:28:00 UTC
Thanks. Hm, after this change, Wikia has a very different line from all the rest. Are we still looking at "waiting for reviewer"? If so, this is worth looking at. Before there was a link to the raw data, but now I can't find it. Could you paste somewhere the gerrit change numbers that are open and owned by Wikia?

Also, if you paste a list of the unknown at https://www.mediawiki.org/wiki/Talk:Community_metrics , we will help identifying the affiliation of these contributors.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links