Last modified: 2014-04-07 14:03:11 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T53447, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 51447 - Jenkins: Store build output in a static storage and wipe from Jenkins build history
Jenkins: Store build output in a static storage and wipe from Jenkins build h...
Status: NEW
Product: Wikimedia
Classification: Unclassified
Continuous integration (Other open bugs)
wmf-deployment
All All
: Normal enhancement (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-07-16 16:29 UTC by Krinkle
Modified: 2014-04-07 14:03 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Krinkle 2013-07-16 16:29:32 UTC
Openstack is already doing this. There's probably a plugin for Zuul or Jenkins that can do this.

When we activate it we'll need to make sure we update the links jenkins-bot outputs from Zuul to Gerrit to point to these static files instead of the urls in Jenkins.

And when update the Jenkins configuration to store no or a very limited build history.
Comment 1 Gerrit Notification Bot 2013-07-24 20:22:07 UTC
Change 75637 had a related patch set uploaded by Hashar:
publish-console.py script

https://gerrit.wikimedia.org/r/75637
Comment 2 Gerrit Notification Bot 2013-07-24 20:22:45 UTC
Change 75632 had a related patch set uploaded by Hashar:
contint: python dependency for publish-console.py

https://gerrit.wikimedia.org/r/75632
Comment 3 Gerrit Notification Bot 2013-07-24 20:23:10 UTC
Change 74424 had a related patch set uploaded by Hashar:
experimental HTML console publishing

https://gerrit.wikimedia.org/r/74424
Comment 4 Antoine "hashar" Musso (WMF) 2013-07-24 20:25:56 UTC
I have sprinted a python script to let us fetch the HTML console and publish it under /srv/org/wikimedia/integration/logs

The scheme is looking like:

 /12/74312,5/mediawiki-core-regression-phpcs-HEAD-1447/console.html

12 is the last two bytes of the Gerrit change number

URL vary by patchset number with a comma, might want a sub directory though to make it easier to browse all patchsets of a change.

The directory can later host debug log files and tests results.  We can do that with Jenkins artifact publishing.
Comment 5 Gerrit Notification Bot 2013-08-08 08:08:50 UTC
Change 75632 merged by Dzahn:
contint: python dependency for publish-console.py

https://gerrit.wikimedia.org/r/75632
Comment 6 Antoine "hashar" Musso (WMF) 2013-11-18 23:52:59 UTC
I compressed the old console log via gzip (Jenkins supports reading compressed logs).  That give out some space.

I am busy with release/QA things right now, so unassigning bug from myself.
Comment 7 Gerrit Notification Bot 2013-11-26 13:38:03 UTC
Change 74424 abandoned by Hashar:
experimental HTML console publishing

Reason:
no use for now.

https://gerrit.wikimedia.org/r/74424
Comment 8 Gerrit Notification Bot 2013-11-26 13:38:10 UTC
Change 75637 abandoned by Hashar:
publish-console.py script

Reason:
no use for now.

https://gerrit.wikimedia.org/r/75637
Comment 9 Antoine "hashar" Musso (WMF) 2014-04-07 14:03:11 UTC
Zuul upstream now supports passing Swift related informations to the jobs: http://ci.openstack.org/zuul/zuul.html#swift

Needs a wrapper / post build task in the jobs though.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links