Library dataset upload
Hi. In our local install of Galaxy there is a small change to the code that allows upload of novoindex binary files (from the novoalign program) in a similar fashion to ab1 and scf files. This works fine with the data upload tool. There have been multiple changes to the library dataset upload methods in recent releases and I have lost track of which files are responsible for library dataset upload and checking these binary file types. Could someone please outline how this differs to the normal upload process and which which scripts are used. Many thanks Shaun Webb -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
SHAUN WEBB wrote:
In our local install of Galaxy there is a small change to the code that allows upload of novoindex binary files (from the novoalign program) in a similar fashion to ab1 and scf files. This works fine with the data upload tool.
There have been multiple changes to the library dataset upload methods in recent releases and I have lost track of which files are responsible for library dataset upload and checking these binary file types.
Could someone please outline how this differs to the normal upload process and which which scripts are used.
Hi Shaun, Galaxy's Upload tool was formerly not really a tool - all the processing happened in one of the web threads, which could be very costly for the web process itself and cause proxy timeouts if processing the upload took too long. This processing has now been moved to a standalone tool, tools/data_source/upload.py. --nate
participants (2)
-
Nate Coraor -
SHAUN WEBB