Hi, If we upload data and then import the data into libraries, how is that data then accessed when running a tool in the cloud. For example if we have hundreds of template files that we need to analyse the data, and we have a tool that is instantiated on a number of nodes in the clous, is the data in the libraries copied to each node? Or is the data access via nfs, symbolic link or some other method? Thanks Neil
Hi Niel, I'm assuming the data uploaded to a library on a galaxy cloudman instance. In that case, all the data that's uploaded to a data library (or a history) goes on an nfs-exported file system and is thus available to all the worker nodes. Cheers, Enis On Wed, Oct 24, 2012 at 3:51 PM, <Neil.Burdett@csiro.au> wrote:
Hi, If we upload data and then import the data into libraries, how is that data then accessed when running a tool in the cloud. For example if we have hundreds of template files that we need to analyse the data, and we have a tool that is instantiated on a number of nodes in the clous, is the data in the libraries copied to each node? Or is the data access via nfs, symbolic link or some other method?
Thanks Neil ___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at:
Thanks for the information. Much appreciated Neil From: Enis Afgan [mailto:eafgan@emory.edu] Sent: Thursday, 25 October 2012 7:38 AM To: Burdett, Neil (ICT Centre, Herston - RBWH) Cc: galaxy-dev@lists.bx.psu.edu Subject: Re: [galaxy-dev] Importing files into Libraries Hi Niel, I'm assuming the data uploaded to a library on a galaxy cloudman instance. In that case, all the data that's uploaded to a data library (or a history) goes on an nfs-exported file system and is thus available to all the worker nodes. Cheers, Enis On Wed, Oct 24, 2012 at 3:51 PM, <Neil.Burdett@csiro.au<mailto:Neil.Burdett@csiro.au>> wrote: Hi, If we upload data and then import the data into libraries, how is that data then accessed when running a tool in the cloud. For example if we have hundreds of template files that we need to analyse the data, and we have a tool that is instantiated on a number of nodes in the clous, is the data in the libraries copied to each node? Or is the data access via nfs, symbolic link or some other method? Thanks Neil ___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
participants (2)
-
Enis Afgan
-
Neil.Burdett@csiro.au