Last modified: 2012-08-03 08:21:51 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T40084, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 38084 - get rid of deployment-nfs-memc
get rid of deployment-nfs-memc
Status: VERIFIED FIXED
Product: Wikimedia Labs
Classification: Unclassified
deployment-prep (beta) (Other open bugs)
unspecified
All All
: Low normal
: ---
Assigned To: Antoine "hashar" Musso (WMF)
:
Depends on:
Blocks: 36646
  Show dependency treegraph
 
Reported: 2012-06-29 15:20 UTC by Antoine "hashar" Musso (WMF)
Modified: 2012-08-03 08:21 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2012-06-29 15:20:05 UTC
The deployment-nfs-memc had a layer of file abstraction which is not that much needed. Labs provide a project storage:

projectstorage.pmtpa.wmnet:/deployment-prep-project

/data/project is an auto mount to it.

Currently our boxes have 
deployment-nfs-memc:/mnt/export/upload /mnt/upload6
deployment-nfs-memc:/mnt/export/apache /usr/local/apache

So we want to copy the data from the NFS instance to /deployment-prep-project then rewrite the puppet class to use that.
Comment 1 Antoine "hashar" Musso (WMF) 2012-07-12 13:51:37 UTC
I have created the /data/project/upload6 directory and did an rsync:

root@deployment-nfs-memc:/data/project/upload6#

rsync -a --progress --inplace /mnt/export/upload6 /data/project/upload6
Comment 2 Antoine "hashar" Musso (WMF) 2012-07-12 14:31:18 UTC
 https://gerrit.wikimedia.org/r/15545
Comment 3 Antoine "hashar" Musso (WMF) 2012-07-18 15:06:21 UTC
Patchset 6 ends up adding symbolic link to /data/project subdirs. Pending ops review / submit.
Comment 4 Peter Bena 2012-07-18 15:51:31 UTC
ok, you know that instance is used as memcache server? :)
Comment 5 Peter Bena 2012-07-18 15:52:35 UTC
ah, it's not
Comment 6 Antoine "hashar" Musso (WMF) 2012-07-26 13:49:12 UTC
Gerrit change #15545 was merged. I had to do some manual changes though but that will be fine for new instances.

/mnt/thumbs and /mnt/upload6 are now symbolic links to /data/project/thumbs /data/project/upload6.

In a similar fashion, /usr/local/apache is a symbolic link to /data/project/apache


So that is a huge step. Now we have to cleanup what is left of nfs-memc :D
Comment 7 Antoine "hashar" Musso (WMF) 2012-07-26 14:10:33 UTC
I am moving all data from deployment-nfs-memc:/mnt/export to /data/project/deployment-nfs-memc_mnt-export_backup so I guess we will be able to shutdown the instance after that and eventually delete it one day.

Need to check with Petr if there is anything of importance left in this instance that I might not be aware of.
Comment 8 Jan Gerber 2012-07-26 19:30:15 UTC
jobrunner and bastion still mount deployment-nfs possibly others.
Comment 9 Antoine "hashar" Musso (WMF) 2012-07-30 12:46:41 UTC
I have deleted bastion and in the process of recreating it (bug 38777).  jobrunner06 looks fine.
Comment 10 Antoine "hashar" Musso (WMF) 2012-07-30 12:48:37 UTC
I have shutdown deployment-nfs-memc for a while, will see if it is still needed around or if we can safely delete it
Comment 11 Antoine "hashar" Musso (WMF) 2012-07-31 09:40:53 UTC
Assuming fixed, keeping the instance around but will delete it eventually.
Comment 12 Antoine "hashar" Musso (WMF) 2012-08-03 08:21:51 UTC
I am deleting the instance now. All its data from /mnt/export are under /data/project now.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links