Last modified: 2014-06-02 14:52:20 UTC
Every day hourly page views per article are compiled into a daily aggregate. Copying those to public server fails since about three weeks. Reported by Alex Druk on stat1002: rsync -arv --include=*.bz2 /a/dammit.lt/pagecounts/merged/* dataset1001.wikimedia.org::pagecounts-ez/merged/ -> sending incremental file list 2014/2014-05/ rsync: failed to set times on "/merged/2014/2014-05" (in pagecounts-ez): Operation not permitted (1) 2014/2014-05/pagecounts-2014-05-08.bz2 2014/2014-05/pagecounts-2014-05-09.bz2 rsync: mkstemp "/merged/2014/2014-05/.pagecounts-2014-05-08.bz2.eU3wlT" (in pagecounts-ez) failed: Permission denied (13) rsync: mkstemp "/merged/2014/2014-05/.pagecounts-2014-05-09.bz2.bnuHOD" (in pagecounts-ez) failed: Permission denied (13) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1070) [sender=3.0.9] sent 1383092175 bytes received 86 bytes 110647380.88 bytes/sec total size is 739815873882 speedup is 534.90
As this bug seems to be about copying the existing files 2014-05-{08,09} over to the public server, and bug 65978 had a fix that looks like it could fix that issue as well, I'll wait if the 2014-05-{08,09} files get synced over during the night. (But it will not fix the older bug 65627 which is about files in general)
Erik managed to check, and apparently, the fix for bug 65978 did not help here.
Rsync module uid was changed to datasets user in https://gerrit.wikimedia.org/r/#/c/132458/, but files at that location on dataset1001 were not chowned to datasets, which meant the datasets user could not write files into those directories. Fixed!
