Last modified: 2014-08-21 13:36:23 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T52112, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 50112 - Zuul: project-templates override defined project jobs
Zuul: project-templates override defined project jobs
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Continuous integration (Other open bugs)
wmf-deployment
All All
: Low normal (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-06-24 16:29 UTC by Antoine "hashar" Musso (WMF)
Modified: 2014-08-21 13:36 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2013-06-24 16:29:30 UTC
The project-template feature I wrote is bugged. It was supposed to merge defined jobs with the one defined by a template but it is overwriting them:

Example:

  - name: mediawiki/tools/release
    check-voter:
      - mw-tools-release-phplint
    template:
      - name: 'python-lint'
        prefix: 'mw-tools-release'

That will only generate the jobs from the template and discard the phplint job.

The root cause is in Zuul scheduler:

  # Finally merge the expansion with whatever has been already
  # defined for this project
  config_project.update(expanded)

dict.update() does not do a recursive merge. We need a new function that will recursively merge all values being dicts.
Comment 1 Gerrit Notification Bot 2013-06-24 16:32:57 UTC
Related URL: https://gerrit.wikimedia.org/r/70199 (Gerrit Change Ib4371a26c7ea86711beb70800356a899805fd7ed)
Comment 2 Antoine "hashar" Musso (WMF) 2013-11-13 20:12:45 UTC
Low priority, there is a workaround. Will revisit Zuul bugs once we upgraded production to the latest version of Zuul (that will happen by the end of November).
Comment 3 Antoine "hashar" Musso (WMF) 2013-12-18 16:27:34 UTC
This is being worked on by upstream at https://review.openstack.org/#/c/62498
Comment 4 Antoine "hashar" Musso (WMF) 2014-08-21 13:36:23 UTC
The upstream change has been merged in and our Zuul version now includes it.  We already have a few project using that feature (template + jobs being added).

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links