Hi Mo,<br><br><div class="gmail_quote">On Wed, Apr 18, 2012 at 4:53 AM, Mohammad Heydarian <span dir="ltr">&lt;<a href="mailto:mheydar1@jhmi.edu">mheydar1@jhmi.edu</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

Hello,<div>I am new to cloud computing and am trying to use the Galaxy cloudman service through Amazon to analyse NGS data. I have a couple of questions regarding data transfer:</div><div><br></div><div>If I am running an EC2 instance, with an EBS volume attached, how can I retrieve the data from the EBS volume? </div>

</blockquote><div>If the data is not accessible via Galaxy (in which case you can use the Save icon for a given dataset in your History), you will need to scp the files over to your local instance. A command like the following should work:</div>

<div><br></div><div>[local] $ scp -i &lt;path to private key&gt; ubuntu@ec2-&lt;rest of instance DNS&gt;:&lt;path to files (see below)&gt; &lt;path on your local machine&gt;</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

<div>In addition, how do I view what files are in the EBS volume? </div></blockquote><div>If using CloudMan to setup a data volume, all the user data will be stored under /mnt/galaxyData/. There will be more directories there with the Galaxy ones under the &#39;files&#39; subdir.</div>

<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>Can I send the data to an S3 bucket? And how would I move data from the S3 bucket to a fresh EC2 instance?</div>

</blockquote><div>This needs to be done manually via ec2 tools, a combnation of boto and pyhton or a combination of scp and a GUI tools such as cyberduck.</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">


<div><br></div><div>Assuming I can store my files on EBS (or S3), what is the best way to download them? </div></blockquote><div>From EBS, you must use scp; from S3 you can use the AWS console or a 3rd party tool (cyberduck)</div>

<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>Can I set up a ftp transfer to (quickly) download my potentially very large files?</div></blockquote>
<div>
CloudMan sets up an FTP server on the instance for use with Galaxy (<a href="http://wiki.g2.bx.psu.edu/FTPUpload">http://wiki.g2.bx.psu.edu/FTPUpload</a>). For downloading files, you could probably leverage that server but it&#39;s likely to take some playing around with (here are instructions mirrored on the cloud instance that may be useful <a href="http://wiki.g2.bx.psu.edu/Admin/Config/Upload%20via%20FTP">http://wiki.g2.bx.psu.edu/Admin/Config/Upload%20via%20FTP</a>).</div>

<div><br></div><div>Hope this clears up some of your questions,</div><div>Enis</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><br></div><div>Many thanks for any insight and direction!</div>


<div><br></div><div><br clear="all">Cheers, <div>Mo Heydarian<br><br></div>
</div>
<br>___________________________________________________________<br>
Please keep all replies on the list by using &quot;reply all&quot;<br>
in your mail client.  To manage your subscriptions to this<br>
and other Galaxy lists, please use the interface at:<br>
<br>
  <a href="http://lists.bx.psu.edu/" target="_blank">http://lists.bx.psu.edu/</a><br></blockquote></div><br>