Last modified: 2014-10-18 00:14:04 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T74173, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 72173 - VE instrumentation is not showing up in databases
VE instrumentation is not showing up in databases
Status: NEW
Product: Analytics
Classification: Unclassified
EventLogging (Other open bugs)
unspecified
All All
: Unprioritized normal
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-10-17 03:39 UTC by Toby Negrin
Modified: 2014-10-18 00:14 UTC (History)
11 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Toby Negrin 2014-10-17 03:39:46 UTC
VE has a variety of schemas[1] that are not correctly feeding into the EL databases. They need assistance in figuring out what's happening.

Dario suspects that the events are failing validation.

[1] https://meta.wikimedia.org/w/index.php?title=Special%3ASearch&profile=advanced&search=VisualEditor&fulltext=Search&ns470=1&profile=advanced
Comment 1 Dan Andreescu 2014-10-17 16:57:17 UTC
No new events are coming in for schemas like VisualEditor%:

zsub vanadium.eqiad.wmnet:8600 | grep '"schema": "VisualEditor'

But at least two of the events used to validate at some point at the end of 2013, beginning of 2014:

mysql:research@analytics-store.eqiad.wmnet [log]> select min(timestamp), max(timestamp) from VisualEditorDOMSaved_6063754;
+----------------+----------------+
| min(timestamp) | max(timestamp) |
+----------------+----------------+
| 20131016202600 | 20131121114538 |
+----------------+----------------+
1 row in set (0.00 sec)

mysql:research@analytics-store.eqiad.wmnet [log]> select min(timestamp), max(timestamp) from VisualEditorDOMRetrieved_5961496;
+----------------+----------------+
| min(timestamp) | max(timestamp) |
+----------------+----------------+
| 20131010222635 | 20140128212543 |
+----------------+----------------+
1 row in set (0.00 sec)

The most likely explanation is that the events are no longer emitted, as we don't see them in the raw stream.  So, in short, look around 20131121114538 and 20140128212543 to see what changed in your instrumentation.  We're setting up a meeting to discuss further, but feel free to comment here too.
Comment 2 Roan Kattouw 2014-10-17 21:23:52 UTC
Turns out EventLogging's mw.track subscriber is broken, and VisualEditor was using it for no good reason. I'll port VE to use EL directly, but there are other uses of mw.track and those are probably broken too:

resources/lib/jquery/jquery.migrate.js:65:mw.track( "jquery.migrate", key || "unknown" );
resources/src/mediawiki/mediawiki.js:567:mw.track( 'mw.deprecate', key );
resources/src/mediawiki/mediawiki.js:572:mw.track( 'mw.deprecate', key );
Comment 3 Roan Kattouw 2014-10-17 23:42:07 UTC
(In reply to Roan Kattouw from comment #2)
> Turns out EventLogging's mw.track subscriber is broken, and VisualEditor was
> using it for no good reason. I'll port VE to use EL directly, but there are
> other uses of mw.track and those are probably broken too:
> 
> resources/lib/jquery/jquery.migrate.js:65:mw.track( "jquery.migrate", key ||
> "unknown" );
> resources/src/mediawiki/mediawiki.js:567:mw.track( 'mw.deprecate', key );
> resources/src/mediawiki/mediawiki.js:572:mw.track( 'mw.deprecate', key );

ACTUALLY... the WikimediaEvents extension includes subscribers for both ve.* events and for these two. So they DO end up in EventLogging, just not via EventLogging's subscriber. It looks like nothing is just EventLogging's subscriber, which only subscribes to things starting with 'event.*'

The schemas used by WikimediaEvents are:
ve.* --> Schema:TimingData
jquery.migrate --> Schema:JQMigrateUsage
mw.deprecate --> Schema:DeprecatedUsage
Comment 4 nuria 2014-10-18 00:14:04 UTC
Roan.. can you clarify a bit your last comment? me no comprendo.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links