Last modified: 2014-10-24 18:00:29 UTC
per Antoine: Have labs ops raise our quota of cpu/mem/disk then create a bunch of 1 CPU slaves dedicated to browser tests if sauce is 10 VM, we can go with 10 more CPU in labs project and 10 dedicaed jenkins slaves. They are fairly easy to setup
Moving to 'infrastructure' component. Have to poke Andrew / Marc-André to figure out whether the quota for the 'integration' project can be raised to let us create all those additional VM. I have no clue what kind of stress it is going to cause on labs hardware pool. We might have to allocate some budget to throw more hardware to the labs infrastructure supporting all the instances.
What are your current quotas, and what do you need them raised to? It should be much of a problem in any case, overprovisioning of CPUs works fine and doesn't much matter unless all the VMs are maxing out their processors at the same time.
Um... shouldn't. shouldn't be much of a problem.
The current quotas are: Cores: 25/30 RAM: 51200/102400 Floating IPs: 0/0 Instances: 9/12 Security Groups: 0/10 Ref: https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=displayquotas&projectname=integration For the context, we are now running one browser test max per instance. Currently that means only three jobs run in parallel out of 40 or 50 jobs to run, some very long. During our weekly meeting, Chris proposed to have moaaar instances created so we can run more jobs in parallel. We have 5 CPU left, if we can get the # of instances bumped to 9 + 5 = 14, that will let us create 5 m1.small (1 CPU, 2GB RAM, 20GB disk). We can raise the CPU and # of instances by 5 later on if we need to double the number of browser tests executors.
Or we can just bump core to 40 and instances to 20. Giving us some more room. Andrew: if you need budget to throw more hardware, I am sure we can get some since beta / CI are heavily relying on the labs infrastructure now.
More hardware coming: https://rt.wikimedia.org/Ticket/Display.html?id=8244
I created two extra slaves last month. Bringing us to a total of eight. 4 Ubuntu Precise, 4 Ubuntu Trusty.
