Last modified: 2013-09-19 19:08:30 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T52695, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 50695 - [OPS] Zuul: make zuul commits available to Jenkins slaves
[OPS] Zuul: make zuul commits available to Jenkins slaves
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Continuous integration (Other open bugs)
wmf-deployment
All All
: High enhancement (vote)
: ---
Assigned To: Nobody - You can work on this!
: ops
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-07-03 21:11 UTC by Antoine "hashar" Musso (WMF)
Modified: 2013-09-19 19:08 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2013-07-03 21:11:29 UTC
When jobs are run on the gallium server, they can access the Zuul merges by fetching from /srv/ssd/zuul/git

A slave on a remote host will not be able to do so :/


We could either:

- make the /srv/ssd/zuul/git repo available to other slaves over http
- enable Zuul to push its references back to Gerrit under refs/zuul
Comment 1 Gerrit Notification Bot 2013-08-01 10:00:38 UTC
Change 71968 had a related patch set uploaded by Hashar:
contint: publish Zuul git repositories

https://gerrit.wikimedia.org/r/71968
Comment 2 Antoine "hashar" Musso (WMF) 2013-08-01 10:01:13 UTC
Pending OPS review.
Comment 3 Andre Klapper 2013-08-22 15:26:27 UTC
(In reply to comment #1)
> https://gerrit.wikimedia.org/r/71968

Patch still awaiting review by ops.
Comment 4 Antoine "hashar" Musso (WMF) 2013-08-29 14:56:05 UTC
Still awaiting ops.
Comment 5 Gerrit Notification Bot 2013-08-30 13:35:51 UTC
Change 71968 merged by Mark Bergsma:
contint: publish Zuul git repositories

https://gerrit.wikimedia.org/r/71968
Comment 6 Antoine "hashar" Musso (WMF) 2013-08-30 14:22:12 UTC
Patch merged in. The apache rules had to be tweaked with - https://gerrit.wikimedia.org/r/81930 

Tests:


From a Jenkins slave:

hashar@lanthanum:/tmp$ git clone http://integration.wikimedia.org/zuul/git/sartoris
Cloning into 'sartoris'...
remote: Counting objects: 546, done.
remote: Compressing objects: 100% (251/251), done.
remote: Total 546 (delta 297), reused 499 (delta 269)
Receiving objects: 100% (546/546), 88.86 KiB, done.
Resolving deltas: 100% (297/297), done.
hashar@lanthanum:/tmp$ 


From Gallium (Jenkins master and slave):

hashar@gallium:/tmp$ git clone http://integration.wikimedia.org/zuul/git/sartoris
Cloning into 'sartoris'...
remote: Counting objects: 546, done.
remote: Compressing objects: 100% (251/251), done.
remote: Total 546 (delta 297), reused 499 (delta 269)
Receiving objects: 100% (546/546), 88.86 KiB, done.
Resolving deltas: 100% (297/297), done.
hashar@gallium:/tmp$ 

From a remote host:

amusso@aeriale:/tmp$ git clone http://integration.wikimedia.org/zuul/git/sartoris
Cloning into 'sartoris'...
fatal: unable to access 'http://integration.wikimedia.org/zuul/git/sartoris/': The requested URL returned error: 403
amusso@aeriale:/tmp$ 


The 403 is working as expected.
Comment 7 Gerrit Notification Bot 2013-09-04 15:46:12 UTC
Change 82625 had a related patch set uploaded by Hashar:
contint: publish Zuul git over git protocol

https://gerrit.wikimedia.org/r/82625
Comment 8 Antoine "hashar" Musso (WMF) 2013-09-04 15:47:03 UTC
git-http-backend is bugged and hangs whenever we attempt to clone huge repositories. That is bug 53683.

Instead, we can use git daemon which does not have the issue. https://gerrit.wikimedia.org/r/82625
Comment 9 Gerrit Notification Bot 2013-09-18 17:25:10 UTC
Change 82625 merged by Akosiaris:
contint: publish Zuul git over git protocol

https://gerrit.wikimedia.org/r/82625
Comment 10 Antoine "hashar" Musso (WMF) 2013-09-19 19:08:30 UTC
And that is working for me now.  I even started migrated some jobs to use the git protocol.  Thank you Alexandros!

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links