Last modified: 2013-05-29 08:58:43 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T47945, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 45945 - Gluster on Wikimedia Labs reporting 'Read-only file system'
Gluster on Wikimedia Labs reporting 'Read-only file system'
Status: RESOLVED FIXED
Product: Wikimedia Labs
Classification: Unclassified
bots (Other open bugs)
unspecified
All All
: Unprioritized major
: ---
Assigned To: Ryan Lane
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-03-09 21:48 UTC by Damian Z
Modified: 2013-05-29 08:58 UTC (History)
4 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Damian Z 2013-03-09 21:48:54 UTC
A number of directories on the project storage on bots-4 where reporting 'Read-only file system'.

The filesystem was not read only, other directories on the filesystem where writable and a re-mount didn't fix it.

The directories where:
touch: cannot touch `alch_bot/abc238579257235': Read-only file system
touch: cannot touch `aleph/abc238579257235': Read-only file system
touch: cannot touch `backups/abc238579257235': Read-only file system
touch: cannot touch `boteas/abc238579257235': Read-only file system
touch: cannot touch `cluebotng/abc238579257235': Read-only file system
touch: cannot touch `daahbot/abc238579257235': Read-only file system
touch: cannot touch `dschwen/abc238579257235': Read-only file system
touch: cannot touch `johnflbot/abc238579257235': Read-only file system
touch: cannot touch `legoktm/abc238579257235': Read-only file system
touch: cannot touch `madman/abc238579257235': Read-only file system
touch: cannot touch `mysql/abc238579257235': Read-only file system
touch: cannot touch `petrb/abc238579257235': Read-only file system
touch: cannot touch `rschen7754/abc238579257235': Read-only file system
touch: cannot touch `scripts/abc238579257235': Read-only file system
touch: cannot touch `wmib/abc238579257235': Read-only file system

After rebooting the instance these directories are now writable again, however certain directories appear to be corrupt.

drtrigon@bots-4:/data/project/DrTrigonBot$ svn up
svn: Can't open file 'pywikipedia/.svn/text-base/bot_control.py.svn-base': Input/output error

drtrigon@bots-4:/data/project/DrTrigonBot$ ls -lra pywikipedia/.svn/text-base/bot_control.py.svn-base
ls: cannot access pywikipedia/.svn/text-base/bot_control.py.svn-base: Input/output error
drtrigon@bots-4:/data/project/DrTrigonBot$ ls -lra pywikipedia/.svn/text-base/
ls: cannot access pywikipedia/.svn/text-base/checkimages.py.svn-base: No such file or directory
ls: cannot access pywikipedia/.svn/text-base/template.py.svn-base: No such file or directory
ls: cannot access pywikipedia/.svn/text-base/ndashredir.py.svn-base: No such file or directory
ls: cannot access pywikipedia/.svn/text-base/bot_control.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/fixing_redirects.py.svn-base: No such file or directory
ls: cannot access pywikipedia/.svn/text-base/commonscat.py.svn-base: No such file or directory
ls: cannot access pywikipedia/.svn/text-base/catimages.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/interwiki.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/add_text.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/cosmetic_changes.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/followlive.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/BeautifulSoup.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/catlib.py.svn-base: No such file or directory
ls: cannot access pywikipedia/.svn/text-base/pagefromfile.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/subster.py.svn-base: No such file or directory
ls: cannot access pywikipedia/.svn/text-base/articlenos.py.svn-base: No such file or directory
ls: cannot access pywikipedia/.svn/text-base/category_redirect.py.svn-base: No such file or directory
ls: cannot access pywikipedia/.svn/text-base/query.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/commons_link.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/basic.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/wikipedia.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/family.py.svn-base: Input/output error
ls: cannot access pywikipedia/.svn/text-base/version.py.svn-base: Input/output error
total 1783
-r--r--r-- 1 drtrigon svn  17090 2012-10-06 19:04 xmlreader.py.svn-base
-r--r--r-- 1 drtrigon svn  49592 2012-10-06 19:03 wiktionary.py.svn-base
-r--r--r-- 1 drtrigon svn   2288 2012-10-06 19:03 wikipediatools.py.svn-base
?????????? ? ?        ?        ?                ? wikipedia.py.svn-base
-r--r--r-- 1 drtrigon svn   6025 2012-10-06 19:04 wikicomserver.py.svn-base
-r--r--r-- 1 drtrigon svn  45519 2013-01-02 00:00 welcome.py.svn-base
-r--r--r-- 1 drtrigon svn  35275 2013-01-01 23:59 weblinkchecker.py.svn-base
-r--r--r-- 1 drtrigon svn   6592 2012-12-26 22:47 watchlist.py.svn-base
-r--r--r-- 1 drtrigon svn   5528 2012-12-26 22:46 warnfile.py.svn-base
?????????? ? ?        ?        ?                ? version.py.svn-base
-r--r--r-- 1 drtrigon svn   4967 2012-10-06 19:04 us-states.py.svn-base
-r--r--r-- 1 drtrigon svn  23755 2012-12-26 22:47 userlib.py.svn-base
-r--r--r-- 1 drtrigon svn  19572 2012-10-06 19:03 upload.py.svn-base
-r--r--r-- 1 drtrigon svn   4153 2013-01-01 23:59 unusedfiles.py.svn-base
-r--r--r-- 1 drtrigon svn   7457 2012-10-06 19:03 unlink.py.svn-base
-r--r--r-- 1 drtrigon svn    865 2012-10-06 19:03 udp-log.py.svn-base
-r--r--r-- 1 drtrigon svn   3215 2012-10-06 19:03 touch.py.svn-base
-r--r--r-- 1 drtrigon svn   6708 2012-10-06 19:03 titletranslate.py.svn-base
-r--r--r-- 1 drtrigon svn   2917 2013-03-09 21:35 testfamily.py.svn-base
?????????? ? ?        ?        ?                ? template.py.svn-base
-r--r--r-- 1 drtrigon svn   5650 2013-01-05 20:43 templatecount.py.svn-base
-r--r--r-- 1 drtrigon svn   3831 2012-10-06 19:03 tag_nowcommons.py.svn-base
-r--r--r-- 1 drtrigon svn  23780 2012-10-06 19:03 table2wiki.py.svn-base
-r--r--r-- 1 drtrigon svn  70856 2013-01-14 19:22 sum_disc.py.svn-base
?????????? ? ?        ?        ?                ? subster.py.svn-base
-r--r--r-- 1 drtrigon svn   5866 2013-01-10 17:25 subster_irc.py.svn-base
-r--r--r-- 1 drtrigon svn   6433 2013-01-01 23:59 statistics_in_wikitable.py.svn-base
-r--r--r-- 1 drtrigon svn  62411 2013-01-01 23:59 standardize_notes.py.svn-base
-r--r--r-- 1 drtrigon svn   3042 2012-10-06 19:03 standardize_interwiki.py.svn-base
-r--r--r-- 1 drtrigon svn   1709 2012-10-06 19:04 splitwarning.py.svn-base
-r--r--r-- 1 drtrigon svn  20412 2012-10-06 19:03 spellcheck.py.svn-base
-r--r--r-- 1 drtrigon svn  32443 2013-01-01 23:59 speedy_delete.py.svn-base
-r--r--r-- 1 drtrigon svn   4687 2012-10-06 19:03 spamremove.py.svn-base
-r--r--r-- 1 drtrigon svn  49605 2012-10-06 19:03 solve_disambiguation.py.svn-base
-r--r--r-- 1 drtrigon svn   3394 2012-10-06 19:04 simple_family.py.svn-base
-r--r--r-- 1 drtrigon svn    113 2012-10-06 19:04 setup.cfg.svn-base
-r--r--r-- 1 drtrigon svn  12146 2013-01-01 23:59 selflink.py.svn-base
-r--r--r-- 1 drtrigon svn   7290 2012-10-06 19:03 saveHTML.py.svn-base
-r--r--r-- 1 drtrigon svn   4178 2012-12-26 22:46 revertbot.py.svn-base
-r--r--r-- 1 drtrigon svn  42382 2012-12-26 22:47 replace.py.svn-base
-r--r--r-- 1 drtrigon svn  34751 2013-01-12 23:09 reflinks.py.svn-base
-r--r--r-- 1 drtrigon svn  34782 2012-12-26 22:47 redirect.py.svn-base
-r--r--r-- 1 drtrigon svn    159 2012-10-06 19:03 README.svn-base
-r--r--r-- 1 drtrigon svn   3034 2012-12-26 22:47 rcsort.py.svn-base
-r--r--r-- 1 drtrigon svn   2187 2012-10-06 19:04 rciw.py.svn-base
?????????? ? ?        ?        ?                ? query.py.svn-base
-r--r--r-- 1 drtrigon svn  11199 2013-01-01 23:59 protect.py.svn-base
-r--r--r-- 1 drtrigon svn   7142 2012-10-06 19:04 piper.py.svn-base
-r--r--r-- 1 drtrigon svn  17626 2012-10-06 19:03 patrol.py.svn-base
-r--r--r-- 1 drtrigon svn   7882 2013-03-09 21:35 parserfunctioncount.py.svn-base
-r--r--r-- 1 drtrigon svn  16287 2012-10-06 19:03 panoramiopicker.py.svn-base
-r--r--r-- 1 drtrigon svn   3508 2013-01-01 23:59 pageimport.py.svn-base
-r--r--r-- 1 drtrigon svn  52055 2013-01-01 23:59 pagegenerators.py.svn-base
?????????? ? ?        ?        ?                ? pagefromfile.py.svn-base
-r--r--r-- 1 drtrigon svn   2125 2013-02-01 20:44 overcat_simple_filter.py.svn-base
-r--r--r-- 1 drtrigon svn  18613 2013-01-05 20:43 nowcommons.py.svn-base
-r--r--r-- 1 drtrigon svn  24169 2013-01-01 23:59 noreferences.py.svn-base
?????????? ? ?        ?        ?                ? ndashredir.py.svn-base
-r--r--r-- 1 drtrigon svn   4930 2012-10-06 19:03 mysql_autoconnection.py.svn-base
-r--r--r-- 1 drtrigon svn  11556 2013-01-05 20:43 movepages.py.svn-base
-r--r--r-- 1 drtrigon svn   6626 2012-10-06 19:03 misspelling.py.svn-base
-r--r--r-- 1 drtrigon svn   6413 2012-10-06 19:04 match_images.py.svn-base
-r--r--r-- 1 drtrigon svn  11028 2012-10-06 19:03 makecat.py.svn-base
-r--r--r-- 1 drtrigon svn   2967 2012-10-06 19:03 maintcont.py.svn-base
-r--r--r-- 1 drtrigon svn   3497 2012-10-06 19:03 maintainer.py.svn-base
-r--r--r-- 1 drtrigon svn  11697 2012-12-26 22:47 lonelypages.py.svn-base
-r--r--r-- 1 drtrigon svn  17755 2012-10-06 19:03 login.py.svn-base
-r--r--r-- 1 drtrigon svn   3049 2012-10-06 19:04 logindata.py.svn-base
-r--r--r-- 1 drtrigon svn   2023 2012-12-26 22:47 LICENSE.svn-base
-r--r--r-- 1 drtrigon svn  37070 2012-10-06 19:03 isbn.py.svn-base
?????????? ? ?        ?        ?                ? interwiki.py.svn-base
-r--r--r-- 1 drtrigon svn   5896 2012-10-06 19:03 interwiki_graph.py.svn-base
-r--r--r-- 1 drtrigon svn   5096 2012-10-06 19:04 inline_images.py.svn-base
-r--r--r-- 1 drtrigon svn  48513 2013-01-02 00:00 imageuncat.py.svn-base
-r--r--r-- 1 drtrigon svn  17129 2012-12-26 22:47 imagetransfer.py.svn-base
-r--r--r-- 1 drtrigon svn  17102 2013-01-01 23:59 imagerecat.py.svn-base
-r--r--r-- 1 drtrigon svn   7631 2012-10-06 19:03 image.py.svn-base
-r--r--r-- 1 drtrigon svn   4237 2012-10-06 19:03 imageharvest.py.svn-base
-r--r--r-- 1 drtrigon svn  39325 2012-12-26 22:47 imagecopy_self.py.svn-base
-r--r--r-- 1 drtrigon svn  20731 2012-10-06 19:03 imagecopy.py.svn-base
-r--r--r-- 1 drtrigon svn  16847 2013-01-01 23:59 gui.py.svn-base
-r--r--r-- 1 drtrigon svn    851 2012-10-06 19:03 get.py.svn-base
-r--r--r-- 1 drtrigon svn   4738 2012-10-06 19:04 generate_user_files.py.svn-base
-r--r--r-- 1 drtrigon svn  11721 2013-01-14 19:22 generate_family_file.py.svn-base
?????????? ? ?        ?        ?                ? followlive.py.svn-base
-r--r--r-- 1 drtrigon svn  23692 2012-12-26 22:47 flickrripper.py.svn-base
?????????? ? ?        ?        ?                ? fixing_redirects.py.svn-base
-r--r--r-- 1 drtrigon svn  34263 2012-12-26 22:47 fixes.py.svn-base
-r--r--r-- 1 drtrigon svn  25381 2013-01-01 23:59 featured.py.svn-base
?????????? ? ?        ?        ?                ? family.py.svn-base
-r--r--r-- 1 drtrigon svn   1484 2012-10-06 19:03 extract_wikilinks.py.svn-base
-r--r--r-- 1 drtrigon svn   7073 2012-10-06 19:04 editarticle.py.svn-base
-r--r--r-- 1 drtrigon svn   1057 2012-10-06 19:04 dtbext_maintenance.sh.svn-base
-r--r--r-- 1 drtrigon svn  68139 2012-10-06 19:03 Doxyfile.svn-base
-r--r--r-- 1 drtrigon svn   8900 2012-10-06 19:03 djvutext.py.svn-base
-r--r--r-- 1 drtrigon svn   4542 2012-10-06 19:03 diskcache.py.svn-base
-r--r--r-- 1 drtrigon svn   7011 2012-12-26 22:47 disambredir.py.svn-base
-r--r--r-- 1 drtrigon svn    366 2012-10-06 19:02 delinker.py.svn-base
-r--r--r-- 1 drtrigon svn   6479 2012-10-06 19:03 delete.py.svn-base
-r--r--r-- 1 drtrigon svn   5121 2012-10-06 19:04 deledpimage.py.svn-base
-r--r--r-- 1 drtrigon svn 120031 2012-12-26 22:47 date.py.svn-base
-r--r--r-- 1 drtrigon svn  11977 2013-02-01 20:44 data_ingestion.py.svn-base
-r--r--r-- 1 drtrigon svn   1810 2012-10-06 19:04 daemonize.py.svn-base
-r--r--r-- 1 drtrigon svn   2665 2012-10-06 19:04 create_categories.py.svn-base
?????????? ? ?        ?        ?                ? cosmetic_changes.py.svn-base
-r--r--r-- 1 drtrigon svn  43803 2013-01-01 23:59 copyright.py.svn-base
-r--r--r-- 1 drtrigon svn  10089 2012-10-06 19:03 copyright_put.py.svn-base
-r--r--r-- 1 drtrigon svn   6000 2012-10-06 19:03 copyright_clean.py.svn-base
-r--r--r-- 1 drtrigon svn  19448 2012-12-26 22:47 CONTENTS.svn-base
-r--r--r-- 1 drtrigon svn  25382 2013-01-12 23:09 config.py.svn-base
?????????? ? ?        ?        ?                ? commons_link.py.svn-base
?????????? ? ?        ?        ?                ? commonscat.py.svn-base
-r--r--r-- 1 drtrigon svn   3836 2012-10-06 19:04 commons_category_redirect.py.svn-base
-r--r--r-- 1 drtrigon svn  12180 2013-01-15 18:25 clean_sandbox.py.svn-base
?????????? ? ?        ?        ?                ? checkimages.py.svn-base
-r--r--r-- 1 drtrigon svn   7268 2012-10-06 19:03 cfd.py.svn-base
-r--r--r-- 1 drtrigon svn   4003 2012-10-06 19:03 censure.py.svn-base
?????????? ? ?        ?        ?                ? catlib.py.svn-base
?????????? ? ?        ?        ?                ? catimages.py.svn-base
?????????? ? ?        ?        ?                ? category_redirect.py.svn-base
-r--r--r-- 1 drtrigon svn  43329 2013-01-12 23:09 category.py.svn-base
-r--r--r-- 1 drtrigon svn   3519 2012-10-06 19:02 catall.py.svn-base
-r--r--r-- 1 drtrigon svn  31146 2013-01-02 00:00 casechecker.py.svn-base
-r--r--r-- 1 drtrigon svn   3871 2012-10-06 19:03 capitalize_redirects.py.svn-base
-r--r--r-- 1 drtrigon svn   5730 2012-12-26 22:47 botlist.py.svn-base
?????????? ? ?        ?        ?                ? bot_control.py.svn-base
-r--r--r-- 1 drtrigon svn  13138 2012-10-06 19:04 blockreview.py.svn-base
-r--r--r-- 1 drtrigon svn  21663 2013-01-01 23:59 blockpageschecker.py.svn-base
?????????? ? ?        ?        ?                ? BeautifulSoup.py.svn-base
?????????? ? ?        ?        ?                ? basic.py.svn-base
?????????? ? ?        ?        ?                ? articlenos.py.svn-base
-r--r--r-- 1 drtrigon svn  23564 2013-01-02 00:00 archivebot.py.svn-base
-r--r--r-- 1 drtrigon svn  20585 2013-01-01 23:59 apispec.py.svn-base
?????????? ? ?        ?        ?                ? add_text.py.svn-base
drwxr-xr-x 6 drtrigon svn    152 2013-03-09 21:46 ..
drwxr-xr-x 2 drtrigon svn  16384 2013-03-09 21:35 .

There are a number of directories (mostly .svn) in the same state, I suspect these are from the gluster issues last week.
Comment 1 Ryan Lane 2013-04-30 15:52:39 UTC
Is this still occurring?
Comment 2 Peter Bena 2013-05-29 08:58:43 UTC
I think not

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links