- galaxy-dev - lists.galaxyproject.org

Galaxy unhandled exception checking jobs error
by Ravi Alla 03 Apr '14

03 Apr '14

Hi guys, I keep getting an error everytime I start up the galaxy server. I am guessing this has to do with a job that galaxy is trying to resume and cannot find. galaxy.jobs.runners ERROR 2014-04-02 09:31:10,889 Unhandled exception checking active jobs Traceback (most recent call last): File "/srv/www/galaxy/source/galaxy-dist/lib/galaxy/jobs/runners/__init__.py", line 366, in monitor self.check_watched_items() File "/srv/www/galaxy/source/galaxy-dist/lib/galaxy/jobs/runners/pbs.py", line 363, in check_watched_items ( failures, statuses ) = self.check_all_jobs() File "/srv/www/galaxy/source/galaxy-dist/lib/galaxy/jobs/runners/pbs.py", line 452, in check_all_jobs c = pbs.pbs_connect( pbs_server_name ) TypeError: in method 'pbs_connect', argument 1 of type 'char *' Because of this error I cannot get any other jobs to run either. They just sit queued on the cluster. Any ideas? Thanks

2 4

Re: [galaxy-dev] Problems submitting using PBS Pro 12.1
by Nate Coraor 03 Apr '14

03 Apr '14

Hi Luca, Could you send your job_conf.xml please? Also, is there any chance that you modified run.sh to set DRMAA_LIBRARY_PATH there (which would override what you set on the command line)? --nate On Thu, Apr 3, 2014 at 9:17 AM, Luca Toldo <lucatoldo(a)gmail.com> wrote: > Dear All, > after having discovered the mess in which I was, and the incomplete PBS > client installation, I've done the following: > > *1) PBS Pro* > a) removed the incomplete pbs installation that I had > b) downloaded the latest version from vendor > c) installed it in //usr/pbs > d) configured > e) tested it --> worked well > > *2) drma-pbs* > a) downloaded version 1.0.17 > b) compiled it (./configure --with-pbs=/usr/pbs ) without any problem > c) installed it in /usr/local/lib > > 3) modified DRMAA_LIBRARY_PATH=/usr/local/lib/libdrmaa.so > 4) sh run.sh --stop > 5) sh run.sh --daemon > > Unfortunately, however when I launch a new job I always get the error > message > > galaxy.jobs DEBUG 2014-04-03 15:13:44,306 (261) Working directory for job > is: /opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261 > galaxy.jobs.handler DEBUG 2014-04-03 15:13:44,321 (261) Dispatching to > drmaa runner > galaxy.jobs DEBUG 2014-04-03 15:13:44,434 (261) Persisting job > destination (destination id: pbs_default) > galaxy.jobs.handler INFO 2014-04-03 15:13:44,474 (261) Job dispatched > galaxy.tools.deps DEBUG 2014-04-03 15:13:44,659 Building dependency shell > command for dependency 'clustalw2' > galaxy.tools.deps WARNING 2014-04-03 15:13:44,660 Failed to resolve > dependency on 'clustalw2', ignoring > galaxy.jobs.runners.drmaa DEBUG 2014-04-03 15:13:45,050 (261) submitting > file > /opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/galaxy_261.sh > galaxy.jobs.runners.drmaa DEBUG 2014-04-03 15:13:45,050 (261) command is: > python /opt/ngs/bin/galaxy-dist/tools/rgenetics/rgClustalw.py -i > "/data/imgt.fasta" -o > "/opt/ngs/bin/galaxy-dist/database/files/000/dataset_340.dat" -s "ALIGNED" > -l "/opt/ngs/bin/galaxy-dist/database/files/000/dataset_341.dat" -t > "Clustal_run" -d "DNA" -f "CLUSTAL"; return_code=$?; cd > /opt/ngs/bin/galaxy-dist; /opt/ngs/bin/galaxy-dist/set_metadata.sh > ./database/files > /opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261 . > /opt/ngs/bin/galaxy-dist/universe_wsgi.ini > /opt/ngs/bin/galaxy-dist/database/tmp/tmpq4Rmdl > /opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/galaxy.json > /opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/metadata_in_HistoryDatasetAssociation_347_GsBRYB,/opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/metadata_kwds_HistoryDatasetAssociation_347_dFD5t0,/opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/metadata_out_HistoryDatasetAssociation_347_k0zCP6,/opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/metadata_results_HistoryDatasetAssociation_347_4LVIFs,,/opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/metadata_override_HistoryDatasetAssociation_347_jKfp0r > /opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/metadata_in_HistoryDatasetAssociation_348_Fyy0tJ,/opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/metadata_kwds_HistoryDatasetAssociation_348_9vWiO3,/opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/metadata_out_HistoryDatasetAssociation_348_HL3EIj,/opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/metadata_results_HistoryDatasetAssociation_348_s1gqxk,,/opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/metadata_override_HistoryDatasetAssociation_348_hyQkDF; > sh -c "exit $return_code" > > galaxy.jobs.runners ERROR 2014-04-03 15:13:45,051 (261) Unhandled > exception calling queue_job > Traceback (most recent call last): > File "/opt/ngs/bin/galaxy-dist/lib/galaxy/jobs/runners/__init__.py", > line 62, in run_next > method(arg) > File "/opt/ngs/bin/galaxy-dist/lib/galaxy/jobs/runners/drmaa.py", line > 150, in queue_job > external_job_id = self.ds.runJob(jt) > File > "/opt/ngs/bin/galaxy-dist/eggs/drmaa-0.6-py2.6.egg/drmaa/__init__.py", line > 331, in runJob > _h.c(_w.drmaa_run_job, jid, _ct.sizeof(jid), jobTemplate) > File > "/opt/ngs/bin/galaxy-dist/eggs/drmaa-0.6-py2.6.egg/drmaa/helpers.py", line > 213, in c > return f(*(args + (error_buffer, sizeof(error_buffer)))) > File > "/opt/ngs/bin/galaxy-dist/eggs/drmaa-0.6-py2.6.egg/drmaa/errors.py", line > 90, in error_check > raise _ERRORS[code-1]("code %s: %s" % (code, error_buffer.value)) > InvalidAttributeValueException: code 14: Illegal attribute or resource > value: Illegal attribute or resource value > > If from the commandline I do > > qsub -q NGSq > /opt/ngs/bin/galaxy-dist/database/job_working_directory/000/261/galaxy_261.sh > > then > > I get 1695145.servername > > ... > > What can I do now ? > >

1 0

Re: [galaxy-dev] [galaxy-bugs] Galaxy modules deployment
by Martin Čech 03 Apr '14

03 Apr '14

Hello, it is great you want to share tools with others through Galaxy, thank you! We call added software a 'Galaxy tool'. You can start by reading the tool basics in this page: https://wiki.galaxyproject.org/Admin/Tools and then you can browse through wiki where the vast of information about tool creation is available through tutorials. What you want is to 'wrap' your software for use within Galaxy with an XML file (sometimes called 'tool definition file' or 'wrapper') that will define the interactions of Galaxy and your software and the user interface of the tool page in Galaxy. You develop the tool first on your local Galaxy and then after it is working there you can submit your tool to the Tool Shed (Galaxy's appstore - https://wiki.galaxyproject.org/ToolShed) After your tool is in the Tool Shed it can be installed by any Galaxy worldwide. If you have any questions just ask in the dev-list mailing list (CCed in this conversation). Martin, Galaxy team On Thu, Apr 3, 2014 at 12:36 AM, <uthay(a)bioinfo.sastra.edu> wrote: > Dear Sir/Mam, > > As a part of our project work, we have developed some Bioinformatics > modules such as finding interactions for protein, displaying the contacts. > We are interested in deploying our modules in your Galaxy platform. Is that > possible? If so, what is the procedure? Can you guide us? > > Regards, > M. Udayakumar, > Dept. of Bioinformatics, > SASTRA University, > Thanjavur,Tamil Nadu, INDIA. > > >

1 0

exported Workflows can contain full-path information
by Björn Grüning 03 Apr '14

03 Apr '14

Hi, if you export workflows it can happen that your *.ga file contains full-path informations to the chromosome len file. For example try to export the "mergeCols1" or the "trimmer" tool. The field chromInfo will have a full path attached. I don't think that will cause any harm, but it would be nice to omit this information. Trello Card is here: https://trello.com/c/TNUvq8X3 Ciao, Bjoern

1 0

restarting multiple web workers
by Langhorst, Brad 03 Apr '14

03 Apr '14

Hi, I’m using the multiple web server stuff described here: https://wiki.galaxyproject.org/Admin/Config/Performance/Scaling that seems to address the responsiveness issues i see when many users are active. However, when i add a new tool - it does not alway show up (only for one of the workers maybe?) Right now I’m restarting, but this costs a minute or two of downtime as the server starts up. Has anyone experimented with rolling restarts of web server processes? Alternatively, has anyone found a good way to speed up the startup process? Thanks! Brad -- Bradley W. Langhorst, Ph.D. Applications and Product Development Scientist

3 2

Select Random Lines - Not Working
by Unmesh Jadhav 03 Apr '14

03 Apr '14

Hello, I am trying to Select Random Lines (10million out of 39 million in a bed file) using the Galaxy tool and the tool is not responding for more than almost 12 hrs now. I have used this tool before for similar jobs and it has performed really well and fast. I would really appreciate if you could suggest how we handle this. Thank you, Unmesh

1 0

ENA SRA data retrieval with Cloudman
by Mohammad Heydarian 03 Apr '14

03 Apr '14

Hi Cloudman Development Team, I noticed on the most recent Cloudman release (revision 11219:5c789ab4144a<http://bitbucket.org/galaxy/galaxy-dist/changesets/5c789ab4144a>) that there is no option to "Get Data" from the ENA SRA. We've found that retrieving large (fastq) data sets from public databases into Galaxy/Cloudman is the most convenient from the ENA SRA option in the "Get Data" menu. Will this option be coming back, or is the ENA SRA option permanently removed? Cheers, Mo Heydarian

2 4

label element
by Jun Fan 03 Apr '14

03 Apr '14

Hi all, It seems that the recent release does not support label element anymore, i.e. no sub-section with the section title displayed in grey. Is there any alternative way to organize the tool under one big section? Best regards! Jun

2 1

Problems submitting using PBS Pro 12.1
by Luca Toldo 02 Apr '14

02 Apr '14

Dear all, SUSE SLE 11 SP 1, with PBS Pro 12.1 client delivers galaxy.jobs.runners ERROR 2014-04-02 18:28:43,740 (249) Unhandled exception calling queue_job Traceback (most recent call last): File "/opt/ngs/bin/galaxy-dist/lib/galaxy/jobs/runners/__init__.py", line 62, in run_next method(arg) File "/opt/ngs/bin/galaxy-dist/lib/galaxy/jobs/runners/drmaa.py", line 151, in queue_job external_job_id = self.ds.runJob(jt) File "/opt/ngs/bin/galaxy-dist/eggs/drmaa-0.6-py2.6.egg/drmaa/__init__.py", line 331, in runJob _h.c(_w.drmaa_run_job, jid, _ct.sizeof(jid), jobTemplate) File "/opt/ngs/bin/galaxy-dist/eggs/drmaa-0.6-py2.6.egg/drmaa/helpers.py", line 213, in c return f(*(args + (error_buffer, sizeof(error_buffer)))) File "/opt/ngs/bin/galaxy-dist/eggs/drmaa-0.6-py2.6.egg/drmaa/errors.py", line 90, in error_check raise _ERRORS[code-1]("code %s: %s" % (code, error_buffer.value)) InvalidAttributeValueException: code 14: Illegal attribute or resource value: Illegal attribute or resource value If I do qsub -q NGSq /opt/ngs/bin/galaxy-dist/database/job_working_directory/000/249/galaxy_249.sh however the qsub returns 12345.myserver and the corresponding qstat | grep -i galaxy 12345.myserver galaxy_249.sh galaxy 00:00:00 E NGSq Is the above error message perhaps related with a) PBS 12.1 b) drmaa-0.7-py2.6.egg I am trying to compile pbs-drmaa-1.0.17 but there are problems ... any advice ? any alternative ? Thanks luca

3 6

snpEff and FASTQ Summary Statistics errors
by Wang, Xiaofei 02 Apr '14

02 Apr '14

Dear there, When I used SnpEff in local galaxy instance, I got an error: Exception in thread "main" java.lang.UnsupportedClassVersionError: ca/mcgill/mcb/pcingola/snpSift/SnpSift : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.j Also, when I used the FASTQ Summary Statistics, I got an error like this: Traceback (most recent call last): File "/Users/...../softwares/shed_tools/toolshed.g2.bx.psu.edu/repos/devteam/fastq_stats/9b7b4e0ca9db/fastq_stats/fastq_stats.py", line 48, in if __name__ == "__main__": main() File "/Users/... I tried to google and solve them by myself. But I really do not know how to do that. Could anybody give me some clue? Thanks a lot for your help!

1 0