Last modified: 2013-10-23 20:40:30 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T56469, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 54469 - Bugzilla data scanned for tech metrics must be aligned with repos scanned
Bugzilla data scanned for tech metrics must be aligned with repos scanned
Status: RESOLVED FIXED
Product: Analytics
Classification: Unclassified
Tech community metrics (Other open bugs)
unspecified
All All
: Normal major
: ---
Assigned To: Quim Gil
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-09-23 16:05 UTC by Quim Gil
Modified: 2013-10-23 20:40 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Quim Gil 2013-09-23 16:05:56 UTC
Currently http://korma.wmflabs.org/browser/its-repos.html shows that the Bugzilla products scanned are MediaWiki, All extensions, VisualEditor and Parsoid. However, this list must be in sync with http://korma.wmflabs.org/browser/scm-repos.html - which in turn is synced with https://wikitech.wikimedia.org/wiki/Key_Wikimedia_software_projects

Let's update that wiki page with the relevant products / components. A 100% match is probably impossible, but a 90% (or so) should be feasible.
Comment 1 Quim Gil 2013-09-23 16:12:01 UTC
Álvaro, can MetricsGrimoire scan only specific components of a Bugzilla product? The reason to ask is that, ideally, we wouldn't scan the whole MediaWiki Extension product but only the relevant components.
Comment 2 Alvaro 2013-09-26 08:36:44 UTC
Yes Quim, we can scan only components.
Comment 3 Alvaro 2013-10-14 14:25:30 UTC
Quim, for the Bugzilla components mapping, do you have some plan in mind for gathering the info from Wikimedia Community? Maybe we can start doing the mapping of the more clear components, but it there is a complete process to cover all of them, much better!
Comment 4 Andre Klapper 2013-10-14 15:34:03 UTC
(If there is something I can specifically help with as Bugzilla admin, please tell me what I need to do for you folks.)
Comment 5 Quim Gil 2013-10-14 17:52:44 UTC
Andre, if you could point to the Bugzilla product/component of each project at https://wikitech.wikimedia.org/wiki/Key_Wikimedia_software_projects that would be perfect!
Comment 6 Andre Klapper 2013-10-17 15:55:23 UTC
I guess we all know that there are no clear 1:1 mapping is possible, but instead 1:n or n:1. I just hope to avoid n:n. :)


[[wikitech:Key_Wikimedia_software_projects]] -- Bugzilla product > component


==Analytics==
analytics/kraken                 --  Analytics > Kraken
analytics/webstatscollector      --  Datasets > Webstatscollector
analytics/wikimetrics            --  Analytics > Wikimetrics
analytics/wikistats              --  Analytics > Wikistats
github.com/wikimedia/limn        --  Analytics > Limn
analytics/*                      --  Analytics > General/Unknown
==Mobile apps==
apps/android/commons 
github.com/wikimedia/Commons-iOS --  Commons App > iOS (iPhone or iPad)
github.com/wikimedia/WikipediaMobile  --  Wikipedia App
github.com/wikimedia/WikipediaMobileFirefoxOS  --  Wikipedia App
github.com/wikimedia/WLMMobile   -- Wiki Loves Monuments > Mobile
==Integration==
*                                --  Wikimedia > Continuous integration
==Operations==
Hard to define, mostly in rt.wikimedia.org, some in Bugzilla under "Wikimedia > General" with keyword "ops".
operations/dns                   --  Wikimedia > DNS
operations/software/otrs         --  Wikimedia > OTRS
==Wikimedia==
====Bugzilla====
wikimedia/bugzilla/modifications --  Wikimedia > Bugzilla
wikimedia/bugzilla/triagescripts --  Wikimedia > Bugzilla
wikimedia/bugzilla/wikibugs      --  Wikimedia > wikibugs IRC bot
====Communication====
wikimedia/communications/WMBlog  --  Wikimedia > Blog
====Fundraising====
Mostly using CiviCRM; related components in Bugzilla are:
                             --  MediaWiki extensions > FundraiserLandingPage
                                 --  MediaWiki extensions > FundraiserPortal
                                 --  Wikimedia > Fundraising Misc.
                                 --  Wikimedia > Fundraising Requirements
==MediaWiki misc==
mediawiki/php/FastStringSearch
    mediawiki/php/NativePreprocessor
    mediawiki/php/luasandbox     --  MediaWiki extensions > Scribunto
    mediawiki/php/wikidiff2      --  MediaWiki extensions > wikidiff2
mediawiki/tools/code-utils       --  Tools > code-utils
mediawiki/tools/mwdumper         --  Tools > mw-dumper
==Pywikibot==
pywikibot/*                      --  Pywikibot > *
==Other==
mediawiki/vagrant                --  MediaWiki-Vagrant > *
labs/toollabs                    --  Wikimedia Labs > tools
openzim                          --  openZIM > *
qa/browsertests                  --  Wikimedia > Quality Assurance
==Core Extensions==
Don't want to spend too much time going through the list and syncing with https://bugzilla.wikimedia.org/editcomponents.cgi?product=MediaWiki%20extensions however noteworthy naming differences from the top of my head:

PageTriage                       --  MediaWiki extensions > PageCuration
Parsoid                          --  Parsoid > *
SyntaxHighlight_GeSHi     --  MediaWiki extensions > SyntaxHighlight (GeSHi)
VisualEditor                     --  VisualEditor > *
Wikibase                         --  MediaWiki extensions > WikidataRepo
Comment 7 Alvaro 2013-10-21 11:07:58 UTC
Ok guys, is this ready to start downloading all those bugzilla product and components and adding them to the korma browser?
Comment 8 Quim Gil 2013-10-21 15:50:07 UTC
Yes!
Comment 9 Alvaro 2013-10-23 09:19:59 UTC
Great, I have programmed for adding to the report the next repos:

Analytics > Kraken: https://bugzilla.wikimedia.org/buglist.cgi?product=analytics&component=kraken&list_id=243545
Datasets > Webstatscollector: https://bugzilla.wikimedia.org/buglist.cgi?product=datasets&component=Webstatscollector&list_id=243568
Analytics > Wikimetrics https://bugzilla.wikimedia.org/buglist.cgi?product=analytics&component=wikimetrics
Analytics > Wikistats https://bugzilla.wikimedia.org/buglist.cgi?product=analytics&component=wikistats
Analytics > Limn https://bugzilla.wikimedia.org/buglist.cgi?product=analytics&component=limn
Analytics > General/Unknown https://bugzilla.wikimedia.org/buglist.cgi?product=Analytics&component=General%2FUnknown
Commons App > iOS (iPhone or iPad) https://bugzilla.wikimedia.org/buglist.cgi?product=Commons%20App&component=iOS%20%28iPhone%20or%20iPad%29
Wikipedia App https://bugzilla.wikimedia.org/buglist.cgi?product=wikipedia%20app
Wiki Loves Monuments > Mobile https://bugzilla.wikimedia.org/buglist.cgi?product=Wiki%20Loves%20Monuments&component=Mobile
Wikimedia > Continuous integration https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=Continuous%20integration
Wikimedia > DNS https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=dns
Wikimedia > OTRS https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=otrs
Wikimedia > Bugzilla https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=bugzilla
Wikimedia > wikibugs IRC bot https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=wikibugs%20IRC%20bot
Wikimedia > Blog https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=blog
Wikimedia > Fundraising: Misc. https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=Fundraising%3A%20Misc.
Wikimedia > Fundraising: Requirements https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=Fundraising%3A%20Requirements
Tools > code-utils https://bugzilla.wikimedia.org/buglist.cgi?product=tools&component=code-utils
Tools > mw-dumper https://bugzilla.wikimedia.org/buglist.cgi?product=tools&component=mwdumper
Pywikibot > * https://bugzilla.wikimedia.org/buglist.cgi?product=Pywikibot
MediaWiki-Vagrant > * https://bugzilla.wikimedia.org/buglist.cgi?product=MediaWiki-Vagrant
Wikimedia Labs > tools https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia%20labs&component=tools
openZIM > * https://bugzilla.wikimedia.org/buglist.cgi?product=openZIM
Wikimedia > Quality Assurance https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=quality%20assurance

I have checked all of them and works. So tomorrow you should have the new info.
Comment 10 Alvaro 2013-10-23 17:32:45 UTC
Ok guys, you have the viz in:

http://korma.wmflabs.org/browser/its-repos.html
Comment 11 Quim Gil 2013-10-23 20:40:30 UTC
(In reply to comment #6)
> ==Core Extensions==
> Don't want to spend too much time going through the list and syncing with
> https://bugzilla.wikimedia.org/editcomponents.
> cgi?product=MediaWiki%20extensions
> however noteworthy naming differences from the top of my head:

Currently korma lists all the extensions in a single project. This is good enough for now, but for the Bugzilla Response Time KPI [1] we will need to be more precise:

* Including only the key projects.
* Treating each component separately, just like we do with code repos.

[1] https://www.mediawiki.org/wiki/Community_metrics#Bugzilla_response_time

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links