Last modified: 2014-07-31 20:12:08 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T70534, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 68534 - QueuePool pool_size limit should be configurable
QueuePool pool_size limit should be configurable
Status: RESOLVED FIXED
Product: Analytics
Classification: Unclassified
Wikimetrics (Other open bugs)
unspecified
All All
: Unprioritized normal
: ---
Assigned To: Nobody - You can work on this!
u=Kevin c=EEVS p=0 s=2014-07-24
:
Depends on: 68825
Blocks:
  Show dependency treegraph
 
Reported: 2014-07-24 21:17 UTC by Dan Andreescu
Modified: 2014-07-31 20:12 UTC (History)
7 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Dan Andreescu 2014-07-24 21:17:37 UTC
Error message that led to discovery of the problem:

Problem creating child report: QueuePool limit of size 5 overflow 10 reached, connection timed out, timeout 30

Two problems were found:

* Celery concurrency configuration was broken: https://github.com/wikimedia/operations-puppet-wikimetrics/blob/master/manifests/init.pp#L87
* SQLAlchemy default connection pool configuration was being used, which has a pool of 5 connections.  This is much lower than we need
Comment 1 Gerrit Notification Bot 2014-07-24 21:20:55 UTC
Change 149123 had a related patch set uploaded by Milimetric:
Improve connection pool configurability

https://gerrit.wikimedia.org/r/149123
Comment 2 Gerrit Notification Bot 2014-07-24 21:29:51 UTC
Change 149126 had a related patch set uploaded by Milimetric:
Make pool size configurable

https://gerrit.wikimedia.org/r/149126
Comment 3 Gerrit Notification Bot 2014-07-24 21:30:10 UTC
Change 149127 had a related patch set uploaded by Milimetric:
Use new configurable pool sizes

https://gerrit.wikimedia.org/r/149127
Comment 4 Gerrit Notification Bot 2014-07-25 08:58:13 UTC
Change 149123 merged by jenkins-bot:
Improve connection pool configurability

https://gerrit.wikimedia.org/r/149123
Comment 5 Gerrit Notification Bot 2014-07-25 14:12:27 UTC
Change 149126 merged by Ottomata:
Make pool size configurable

https://gerrit.wikimedia.org/r/149126
Comment 6 Gerrit Notification Bot 2014-07-25 14:17:40 UTC
Change 149127 merged by Ottomata:
Use wikimetrics' new configurable pool sizes

https://gerrit.wikimedia.org/r/149127

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links