Hello, I have some questions about the Join and Sort tools in Galaxy. How are they implemented? Just the standard unix sort and join? I have a quite large tab file (~1,5 million lines), I want to join with a somewhat smaller file (~20 000 lines). How long will this approximately take? Is there a way to view the progress? Can I gain performance if do a sort on the column I want to join? thx, Felix
Hi Felix, You are correct, the Sort & Join functions are unix based. Even so, sorting before joining is not required and will not make the Join tool run faster. Actual performance will depend on the size the data and the current server load. If a tool job (any) is taking what seems to be a very long time, please try a re-run. If it is still a problem, feel free to send a shared linked to your history and we can take a look to make certain nothing server-side is going on. A method to allow direct user tracking of progress is something the team has been discussing for some time. It is great idea and is on our priority list. Thanks for using Galaxy! Best, Jen Galaxy team On 2/24/11 1:32 AM, Felix Hammer wrote:
Hello, I have some questions about the Join and Sort tools in Galaxy. How are they implemented? Just the standard unix sort and join?
I have a quite large tab file (~1,5 million lines), I want to join with a somewhat smaller file (~20 000 lines).
How long will this approximately take? Is there a way to view the progress? Can I gain performance if do a sort on the column I want to join? thx, Felix
_______________________________________________ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list:
http://lists.bx.psu.edu/listinfo/galaxy-dev
To manage your subscriptions to this and other Galaxy lists, please use the interface at:
-- Jennifer Jackson http://usegalaxy.org http://galaxyproject.org
participants (2)
-
Felix Hammer
-
Jennifer Jackson