Last modified: 2013-06-07 21:25:18 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T49990, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 47990 - Maintenance script to permanently delete files
Maintenance script to permanently delete files
Status: RESOLVED FIXED
Product: MediaWiki
Classification: Unclassified
Maintenance scripts (Other open bugs)
1.22.0
All All
: Normal enhancement (vote)
: ---
Assigned To: Aaron Schulz
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-05-02 11:14 UTC by Faidon Liambotis
Modified: 2013-06-07 21:25 UTC (History)
7 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Faidon Liambotis 2013-05-02 11:14:52 UTC
Some times the ops team gets requests to permanently delete files. What has traditionally happened, is an ops team member gets the request, usually asks for an "upload.wikimedia.org" URL instead of a File:[...] URL and uses the swift command-line to eradicate the file from the deleted container. I've also heard reports of cleaning up thumbs that weren't previously deleted by MediaWiki, although I haven't seen this myself.

This is tedious and manual work and not all ops people have Swift domain knowledge. The requests usually come in as urgent, so it'd be nice to not have to figure out details (e.g. this time: Ceph) while handling the request.

Therefore, it'd be nice if there was a maintenance script that:
a) Takes a File:[...] as input,
b) Verifies that the file is "deleted" on the wiki,
c) Deletes it from the -deleted.NN container on every file backend,
d) Cleans up possibly generated thumbs, just in case.
e) Optionally resend cache purges?
Comment 1 p858snake 2013-05-02 12:21:55 UTC
Without checking, I believe there is a maintaince script already that will do (A) and (B) and remove any old revisions of the file as well. That could be expanded on/used in conjunction with another script.
Comment 2 Philippe Beaudette 2013-05-02 17:31:03 UTC
FWIW, from the LCA perspective, this could be hugely helpful.  I hate having to bother engineering over these, because I know they're a pain.  It would be ideal if there were something that accepted input from people in the staff group, for instance, and executed that.  Alternatively, just something that would make the process easier for engineering would be welcomed by me.

pb
Comment 3 p858snake 2013-05-03 00:06:52 UTC
(In reply to comment #2)
> ... It would be
> ideal if there were something that accepted input from people in the staff
> group, for instance, and executed that.  Alternatively, just something that
> would make the process easier for engineering would be welcomed by me.

If it's opened up, It might also be worth while putting some logging in it so it goes to a [private] log file, just so who did what, when and why is recorded.
Comment 4 Philippe Beaudette 2013-05-03 00:18:43 UTC
That's an extremely good point.
Comment 5 Gerrit Notification Bot 2013-05-07 00:07:21 UTC
Related URL: https://gerrit.wikimedia.org/r/62549 (Gerrit Change I2fcc2b2c3e92cd851c38f947de6756a982cf194d)

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links