How to Clean up Old Data
I'm trying to figure out how to reduce the data stored on the galaxy server. I came across this page and it looks like data will get deleted if the history element gets deleted but I can't tell if this happens automatically or if I need to cron these scripts: http://wiki.galaxyproject.org/Admin/Config/Performance/Purge%20Histories%20a... Is there anything else I can do to clean up unused data? Also is there a way a user can keep her history around as a record of what was done and be able to rerun it later, but still delete the actual data? Thanks, Greg
Hi Greg,
I'm trying to figure out how to reduce the data stored on the galaxy server.
I came across this page and it looks like data will get deleted if the history element gets deleted but I can't tell if this happens automatically or if I need to cron these scripts: http://wiki.galaxyproject.org/Admin/Config/Performance/Purge%20Histories%20a...
Is there anything else I can do to clean up unused data?
No that should be sufficient. You need to run python cleanup_datasets.py universe_wsgi.ini -d 60 with the different parameters ... -1 -2 -3 .... It will not happen automatically, i recommend you to set up a cron job that runs every week. You also may want to change the -d 60 to something less than 60.
Also is there a way a user can keep her history around as a record of what was done and be able to rerun it later, but still delete the actual data?
I don't think that is possible at the moment. Cheers, Bjoern
Thanks,
Greg ___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at:
Thanks. Could I have a look at what your cron job looks like? -Greg On Mon, Mar 11, 2013 at 11:58 AM, Björn Grüning <bjoern.gruening@pharmazie.uni-freiburg.de> wrote:
Hi Greg,
I'm trying to figure out how to reduce the data stored on the galaxy server.
I came across this page and it looks like data will get deleted if the history element gets deleted but I can't tell if this happens automatically or if I need to cron these scripts: http://wiki.galaxyproject.org/Admin/Config/Performance/Purge%20Histories%20a...
Is there anything else I can do to clean up unused data?
No that should be sufficient. You need to run
python cleanup_datasets.py universe_wsgi.ini -d 60
with the different parameters ... -1 -2 -3 .... It will not happen automatically, i recommend you to set up a cron job that runs every week. You also may want to change the -d 60 to something less than 60.
Also is there a way a user can keep her history around as a record of what was done and be able to rerun it later, but still delete the actual data?
I don't think that is possible at the moment. Cheers, Bjoern
Thanks,
Greg ___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at:
participants (2)
-
Björn Grüning -
greg