Last modified: 2014-05-23 17:48:14 UTC
The code updater on beta apparently delete files from time to time which cause much havoc on the cluster. Example: PHP fatal error in /data/project/apache/common-local/php-master/includes/AutoLoader.php line 1157: require() [<a href='function.require'>function.require</a>]: Failed opening required '/data/project/apache/common-local/php-master/extensions/Echo/Hooks.php' (include_path=' /data/project/apache/common-local/phpmaster/extensions/TimedMediaHandler/handlers/OggHandler/PEAR/File_Ogg :/usr/local/apache/common-local/php-master:/usr/local/lib/php:/usr/share/php') The script doing the code update is in operations/puppet.git and is files/misc/beta/wmf-beta-autoupdate . It does roughly: cd /path/to/mediawiki && git pull cd /path/to/extensions && git pull cd /path/to/extensions && git submodule update --init It must lost connection with the NFS server from time to time :(
Upping severity just because this breaks the beta cluster and it sucks that we have to first assume "oh, git failed" :/
I found out this afternoon that my git version (1.8 something) let us force a checkout of each submodule which would potentially make sure all paths are fine. But we cant do that with the git version we have in labs. The script is in operations/puppet.git ./files/misc/beta/wmf-beta-autoupdate.py
Antoine and Greg, is this still valid? I haven't heard about this issue since we moved into eqiad.
That was most certainly some issue with git/ pmtpa NFS server. For some reason some files would be deleted. I haven't spot that with the scap process so I guess we can close this bug. Thanks for the ping Bryan.
