Hello,
I am trying to come up with a number for our local galaxy storage requirements when we go live (This is an installation for research at our university).
I checked out the survey that was done a while back for the GalaxyAdmins. It seems that the bigger installations have allocated about 200TB for their installation.
It would be of great help to me if I can get some feedback on storage used by local galaxy installations. If possible please use the following format:
Total capacity: Used capacity: Storage Technology: Comments:
Thank you all very much. -Raj
Raj,
maybe others have a different view on this but I think just throwing you a number is quite useless. It all depends on YOUR data storage strategy/policy. How long can researchers store/use their data. What are their maxed quota...Is it backuped elsewhere, how many users. Is it public.... what kind of data (eukaryote genome sequencing or RNA seq projects....or small viral bacterial genomes).
We have a public server with limited resource mainly to display our own tools. It's getting used more and more within the university.... we started at 2T but quickly encountered storage problems. we now moved to 8T. But have to say our data is mainly of microbial origin.
Good luck on the config.
Alex
________________________________________ Van: galaxy-dev-bounces@lists.bx.psu.edu [galaxy-dev-bounces@lists.bx.psu.edu] namens Raj Ayyampalayam [raj76@uga.edu] Verzonden: donderdag 30 mei 2013 7:34 To: galaxy-dev@lists.bx.psu.edu List Onderwerp: [galaxy-dev] Storage question for Galaxy-Admins
Hello,
I am trying to come up with a number for our local galaxy storage requirements when we go live (This is an installation for research at our university).
I checked out the survey that was done a while back for the GalaxyAdmins. It seems that the bigger installations have allocated about 200TB for their installation.
It would be of great help to me if I can get some feedback on storage used by local galaxy installations. If possible please use the following format:
Total capacity: Used capacity: Storage Technology: Comments:
Thank you all very much. -Raj
___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
Raj,
I agree with the points Alex made. It would be much easier to start small and then work your way up.
I recently setup galaxy for our HPC cluster for the entire school of medicine. Its only a few ~month into our setup but we are currently using ~300GB of storage. This is part of our larger cluster storage pool of 600TB.
We use the gluster filesystem across 6 storage nodes. We are trying fhgfs and other file systems as well (lustre, ceph, etc).
If you have any other questions, feel free to ask. -Adam
-- Adam Brenner Computer Science, Undergraduate Student Donald Bren School of Information and Computer Sciences
Research Computing Support Office of Information Technology http://www.oit.uci.edu/rcs/
University of California, Irvine www.ics.uci.edu/~aebrenne/ aebrenne@uci.edu
On Wed, May 29, 2013 at 10:34 PM, Raj Ayyampalayam raj76@uga.edu wrote:
Hello,
I am trying to come up with a number for our local galaxy storage requirements when we go live (This is an installation for research at our university).
I checked out the survey that was done a while back for the GalaxyAdmins. It seems that the bigger installations have allocated about 200TB for their installation.
It would be of great help to me if I can get some feedback on storage used by local galaxy installations. If possible please use the following format:
Total capacity: Used capacity: Storage Technology: Comments:
Thank you all very much. -Raj
Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
galaxy-dev@lists.galaxyproject.org
-
Adam Brenner -
Bossers, Alex -
Raj Ayyampalayam