Last modified: 2014-04-16 21:35:43 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T63961, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 61961 - Pickle Serialization is hiding design flaws, change to JSON
Pickle Serialization is hiding design flaws, change to JSON
Status: NEW
Product: Analytics
Classification: Unclassified
Wikimetrics (Other open bugs)
unspecified
All All
: Normal normal
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-02-26 21:21 UTC by Dan Andreescu
Modified: 2014-04-16 21:35 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Dan Andreescu 2014-02-26 21:21:57 UTC
Bug 60289 suggested to move away from pickle for security reasons.  We tried doing that and it uncovered several design flaws with the ReportNode structure.  Here are a few:

* A cohort instance was serialized to the queue for absolutely no reason.
* The ReportNode tree is created before serialization, then serialized to the queue.  When we moved to jsonpickle, this failed due to WTForms fields not deserializing properly.  Changing RunReport to create the tree in an overloaded run method is easy, but changing the tests that depend on parse_requests is hard.
* The ValidateCohort report node needs to be changed if we change where the tree is created, since it needs access to the request context to validate CSRF.


For these reasons, we want to make changing to json serialization a lower priority issue.  We can fix Bug 60289 by deploying the puppet module on the production instance of wikimetrics, because that module doesn't run the queue as root.  Once that's done, we can turn off C_FORCE_ROOT.  At a later date, we should deal with this serialization issue though, and the underlying design flaws.
Comment 1 Bingle 2014-02-27 19:57:14 UTC
Prioritization and scheduling of this bug is tracked on Mingle card https://wikimedia.mingle.thoughtworks.com/projects/analytics/cards/cards/1463

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links