Last modified: 2014-02-04 11:57:59 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T62318, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 60318 - importImages.php broken on cluster
importImages.php broken on cluster
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Media storage (Other open bugs)
wmf-deployment
All All
: High normal (vote)
: ---
Assigned To: Aaron Schulz
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-01-22 01:41 UTC by Sam Reed (reedy)
Modified: 2014-02-04 11:57 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Sam Reed (reedy) 2014-01-22 01:41:45 UTC
reedy@tin:/tmp/uploads$ sudo -u apache mwscript importImages.php --wiki=commonswiki --user="Jdforrester_(WMF)" /tmp/uploads
Import Images

Importing linux.conf.au 2014 - VisualEditor presentation.ogv...PHP Warning:  fopen(/tmp/uploads/linux.conf.au 2014 - VisualEditor presentation.ogv): failed to open stream: Permission denied in /a/common/php-1.23wmf10/includes/filebackend/SwiftFileBackend.php on line 278

Warning: fopen(/tmp/uploads/linux.conf.au 2014 - VisualEditor presentation.ogv): failed to open stream: Permission denied in /a/common/php-1.23wmf10/includes/filebackend/SwiftFileBackend.php on line 278
done.

Found: 1
Added: 1
reedy@tin:/tmp/uploads$


The added is a lie. The upload didn't complete, it's a 404

https://upload.wikimedia.org/wikipedia/commons/e/ea/Linux.conf.au_2014_-_VisualEditor_presentation.ogv

404 Not Found

The resource could not be found.

File not found: /v1/AUTH_mw/wikipedia-commons-local-public.ea/e/ea/Linux.conf.au_2014_-_VisualEditor_presentation.ogv
Comment 1 Sam Reed (reedy) 2014-01-22 04:17:46 UTC
If I chmod 777 it, I can upload it :/
Comment 2 Aaron Schulz 2014-01-31 23:37:30 UTC
I don't see any way around getting errors when trying to upload files as a user that can't see them. What exactly is this about?
Comment 3 Sam Reed (reedy) 2014-02-03 18:54:43 UTC
(In reply to comment #2)
> I don't see any way around getting errors when trying to upload files as a
> user
> that can't see them. What exactly is this about?

The behaviour changed at some point (I didn't have to change file permissions before). But even with read for everyone on /tmp/uploads, it doesn't work with errors.

There is a related error that the uploads apparently succeed, even though they weren't imported.


reedy@tin:/tmp/uploads$ sudo -u apache mwscript importImages.php --wiki=commonswiki --user="Odder" /tmp/uploads
Import Images

Importing 2014 State Of The Union Address Enhanced.webm...PHP Warning:  fopen(/tmp/uploads/2014 State Of The Union Address Enhanced.webm): failed to open stream: Permission denied in /a/common/php-1.23wmf11/includes/filebackend/SwiftFileBackend.php on line 278

Warning: fopen(/tmp/uploads/2014 State Of The Union Address Enhanced.webm): failed to open stream: Permission denied in /a/common/php-1.23wmf11/includes/filebackend/SwiftFileBackend.php on line 278
done.
Importing 2013-10-05 President Obama's Weekly Address.webm...PHP Warning:  fopen(/tmp/uploads/2013-10-05 President Obama's Weekly Address.webm): failed to open stream: Permission denied in /a/common/php-1.23wmf11/includes/filebackend/SwiftFileBackend.php on line 278

Warning: fopen(/tmp/uploads/2013-10-05 President Obama's Weekly Address.webm): failed to open stream: Permission denied in /a/common/php-1.23wmf11/includes/filebackend/SwiftFileBackend.php on line 278
done.
Importing 2013-10-12 President Obama's Weekly Address.webm...PHP Warning:  fopen(/tmp/uploads/2013-10-12 President Obama's Weekly Address.webm): failed to open stream: Permission denied in /a/common/php-1.23wmf11/includes/filebackend/SwiftFileBackend.php on line 278

Warning: fopen(/tmp/uploads/2013-10-12 President Obama's Weekly Address.webm): failed to open stream: Permission denied in /a/common/php-1.23wmf11/includes/filebackend/SwiftFileBackend.php on line 278
done.

Found: 3
Added: 3
reedy@tin:/tmp/uploads$ ls -al
total 2404792
drwxrwxrwx  2 reedy wikidev      4096 Feb  3 18:47 .
drwxrwxrwt 46 root  root        12288 Feb  3 18:46 ..
-rw-rw-r--  1 reedy wikidev      1255 Feb  1 14:50 2013-10-05 President Obama's Weekly Address.txt
-rw-rw-r--  1 reedy wikidev 163504321 Jan 27 22:13 2013-10-05 President Obama's Weekly Address.webm
-rw-rw-r--  1 reedy wikidev      1197 Feb  1 14:52 2013-10-12 President Obama's Weekly Address.txt
-rw-rw-r--  1 reedy wikidev 158637780 Feb  1 14:34 2013-10-12 President Obama's Weekly Address.webm
-rw-rw-r--  1 reedy wikidev       884 Jan 31 16:26 2014 State Of The Union Address Enhanced.txt
-rw-rw-r--  1 reedy wikidev 909068945 Jan 30 19:37 2014 State Of The Union Address Enhanced.webm
-rw-r--r--  1 reedy wikidev 909060459 Feb  3 18:45 SOTU.tar.gz
-rw-r--r--  1 reedy wikidev 322185685 Feb  3 18:46 WeeklyAddresses.tar.gz
reedy@tin:/tmp/uploads$
reedy@tin:/tmp/uploads$
reedy@tin:/tmp/uploads$
reedy@tin:/tmp/uploads$
reedy@tin:/tmp/uploads$
reedy@tin:/tmp/uploads$ chmod 777 *
reedy@tin:/tmp/uploads$ rm *.gz
reedy@tin:/tmp/uploads$ ls -al
total 1202392
drwxrwxrwx  2 reedy wikidev      4096 Feb  3 18:52 .
drwxrwxrwt 46 root  root        12288 Feb  3 18:50 ..
-rwxrwxrwx  1 reedy wikidev      1255 Feb  1 14:50 2013-10-05 President Obama's Weekly Address.txt
-rwxrwxrwx  1 reedy wikidev 163504321 Jan 27 22:13 2013-10-05 President Obama's Weekly Address.webm
-rwxrwxrwx  1 reedy wikidev      1197 Feb  1 14:52 2013-10-12 President Obama's Weekly Address.txt
-rwxrwxrwx  1 reedy wikidev 158637780 Feb  1 14:34 2013-10-12 President Obama's Weekly Address.webm
-rwxrwxrwx  1 reedy wikidev       884 Jan 31 16:26 2014 State Of The Union Address Enhanced.txt
-rwxrwxrwx  1 reedy wikidev 909068945 Jan 30 19:37 2014 State Of The Union Address Enhanced.webm
reedy@tin:/tmp/uploads$ sudo -u apache mwscript importImages.php --wiki=commonswiki --user="Odder" /tmp/uploads
Import Images

Importing 2014 State Of The Union Address Enhanced.webm...done.
Importing 2013-10-05 President Obama's Weekly Address.webm...done.
Importing 2013-10-12 President Obama's Weekly Address.webm...done.

Found: 3
Added: 3
reedy@tin:/tmp/uploads$
Comment 4 Gerrit Notification Bot 2014-02-03 20:31:53 UTC
Change 110993 had a related patch set uploaded by Aaron Schulz:
Use "rb" instead of "rb+" for Swift store operation handles

https://gerrit.wikimedia.org/r/110993
Comment 5 Gerrit Notification Bot 2014-02-03 23:08:01 UTC
Change 111111 had a related patch set uploaded by Aaron Schulz:
Fixes and cleanups to FileOpBatch

https://gerrit.wikimedia.org/r/111111
Comment 6 Gerrit Notification Bot 2014-02-03 23:16:11 UTC
Change 111111 merged by jenkins-bot:
Fixes and cleanups to FileOpBatch

https://gerrit.wikimedia.org/r/111111
Comment 7 Gerrit Notification Bot 2014-02-03 23:17:05 UTC
Change 111115 had a related patch set uploaded by Aaron Schulz:
Use "rb" instead of "rb+" for Swift store operation handles

https://gerrit.wikimedia.org/r/111115
Comment 8 Gerrit Notification Bot 2014-02-03 23:17:19 UTC
Change 111116 had a related patch set uploaded by Aaron Schulz:
Fixes and cleanups to FileOpBatch

https://gerrit.wikimedia.org/r/111116
Comment 9 Gerrit Notification Bot 2014-02-03 23:25:06 UTC
Change 110993 merged by jenkins-bot:
Use "rb" instead of "rb+" for Swift store operation handles

https://gerrit.wikimedia.org/r/110993
Comment 10 Gerrit Notification Bot 2014-02-03 23:26:01 UTC
Change 111115 merged by jenkins-bot:
Use "rb" instead of "rb+" for Swift store operation handles

https://gerrit.wikimedia.org/r/111115
Comment 11 Gerrit Notification Bot 2014-02-03 23:31:31 UTC
Change 111116 merged by Aaron Schulz:
Fixes and cleanups to FileOpBatch

https://gerrit.wikimedia.org/r/111116

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links