Last modified: 2014-09-10 12:16:58 UTC
The tests are often hardcoded to use a specific site, even when this isnt necessary. e.g. most of site_tests are generic tests which could work on any site (including a localhost site). As the travis-ci builds are now run against three different sites in the config, changing these tests to use the config selected site increases the variability of the testing achieved. However the tests also need to be able to be run with a different site selected to that of the config. i.e. config = ar.wikipedia & testsite = en.wikipedia , config = en.wikipedia & testsite = ar.wikipedia, and all other combinations which might be helpful in showing a gnarly bug.
First hack at it. https://gerrit.wikimedia.org/r/#/c/151408/ Before this is closed, we'll need specific unittest classes to indicate how transportable the tests are, something like: https://gerrit.wikimedia.org/r/#/c/138225/
https://gerrit.wikimedia.org/r/#/c/151604/
