- galaxy-dev - lists.galaxyproject.org

Re: [galaxy-dev] 回复： IOError: [Errno 28] No space left on device
by Ross 19 Dec '12

19 Dec '12

Looks to me like tmpfs is full and maybe too small. http://wiki.galaxyproject.org/Admin/Config/Performance/Cluster?highlight=%2… suggests setting $TEMP= somewhere sensible. But that's not always enough depending on the third party executables you're running so you might want a bigger /tmpfs too. On Wed, Dec 19, 2012 at 6:52 PM, 泽蔡 <caizexi123(a)yahoo.com.cn> wrote: > Hi Ross, > > Filesystem 1K-blocks Used Available Use% Mounted on > /dev/sda1 90717816 89796388 0 100% / > tmpfs 66070064 372 66069692 1% /dev/shm > /dev/sdb1 1968618280 199800 1868418484 1% /copy > /dev/sdb2 7336174008 3759366732 3204151100 54% /home > > Then how shall I do? > > Best regard! > > *发件人：* Ross <ross.lazarus(a)gmail.com> > *收件人：* 泽蔡 <caizexi123(a)yahoo.com.cn> > *发送日期：* 2012年12月19日, 星期三, 2:30 下午 > *主题:* Re: [galaxy-dev] IOError: [Errno 28] No space left on device > > Possibly not enough space left on the volume being used for temporary > files. > > What does > df > show? > > > > On Wed, Dec 19, 2012 at 4:42 PM, 泽蔡 <caizexi123(a)yahoo.com.cn> wrote: > > Hi all, > > When I added a dataset in the Manage data libraries, galaxy reported some > erros. Anyone knows what's wrong? > > Miscellaneous information: Traceback (most recent call last): File > "/home/caizexi/usr/galaxy/tools/data_source/upload.py", line 384, in > __main__() File "/home/caizexi/usr/galaxy/tools/data_source/upload.py", > line 373, in __main__ add_file( dataset, registry, js > Job Standard Error > Traceback (most recent call last): > File "/home/caizexi/usr/galaxy/tools/data_source/upload.py", line 384, > in > __main__() > File "/home/caizexi/usr/galaxy/tools/data_source/upload.py", line 373, > in __main__ > add_file( dataset, registry, json_file, output_path ) > File "/home/caizexi/usr/galaxy/tools/data_source/upload.py", line 270, > in add_file > line_count, converted_path = sniff.convert_newlines( dataset.path, > in_place=in_place ) > File "/home/caizexi/usr/galaxy/lib/galaxy/datatypes/sniff.py", line 99, > in convert_newlines > fp.write( "%s\n" % line.rstrip( "\r\n" ) ) > IOError: [Errno 28] No space left on device > error > Database/Build: ? > Number of data lines: None > > Best regards > > > >

1 0

IOError: [Errno 28] No space left on device
by 泽蔡 19 Dec '12

19 Dec '12

Hi all, When I added a dataset in the Manage data libraries, galaxy reported some erros. Anyone knows what's wrong? Miscellaneous information: Traceback (most recent call last): File "/home/caizexi/usr/galaxy/tools/data_source/upload.py", line 384, in __main__() File "/home/caizexi/usr/galaxy/tools/data_source/upload.py", line 373, in __main__ add_file( dataset, registry, js Job Standard Error Traceback (most recent call last): File "/home/caizexi/usr/galaxy/tools/data_source/upload.py", line 384, in __main__() File "/home/caizexi/usr/galaxy/tools/data_source/upload.py", line 373, in __main__ add_file( dataset, registry, json_file, output_path ) File "/home/caizexi/usr/galaxy/tools/data_source/upload.py", line 270, in add_file line_count, converted_path = sniff.convert_newlines( dataset.path, in_place=in_place ) File "/home/caizexi/usr/galaxy/lib/galaxy/datatypes/sniff.py", line 99, in convert_newlines fp.write( "%s\n" % line.rstrip( "\r\n" ) ) IOError: [Errno 28] No space left on device error Database/Build: ? Number of data lines: None Best regards

1 0

MACS not found
by Alfonso Garrido-Lecca 19 Dec '12

19 Dec '12

Hello, I am new in using galaxy on the cloud. I am trying to analyze my ChIP-seq data. However, when I try to run the MACS peak calling algorithm on my BAM files I get an error message saying "MACS: not found". Any ideas? thanks!

2 1

Re: [galaxy-dev] Galaxy users on virtual machine
by Oleksandr Moskalenko 18 Dec '12

18 Dec '12

We're using ldap authentication on our cluster, so our /etc/passwd files don't have any user data and the credentials are returned by ldap. You will have to adjust this to your situation. You can rsync /etc/passwd from elsewhere or fiddle with PAM to work something out for your key-based setup. Sorry, I don't have more insight into that part. Regards, Alex On Dec 18, 2012, at 2:27 PM, cganote(a)iu.edu wrote: > Hi Alex, > > I see what you are saying, but I think our situations are slightly different. > The line > self.__user_system_pwent = pwd.getpwnam(job.user.email.split('@')[0] ) > *does* return the correct username, however, that user is not present in the Virtual machine that is running Galaxy, so when the job runner calls for pwd.getpwuid(), there is nothing there. By the way, the VM uses key authentication only, not passwords. > > The problem I think I'm having is that the /etc/passwd file I want to use is located on the cluster, not on the virtual machine. I'm not sure if I can just copy that file over. How else can I get ahold of the uid of the user who cannot log in to the machine Galaxy is running on? > > Thanks for the help, > > Carrie Ganote

1 0

Re: [galaxy-dev] Galaxy users on virtual machine
by Ganote, Carrie L 18 Dec '12

18 Dec '12

Hi Alex, I see what you are saying, but I think our situations are slightly different. The line self.__user_system_pwent = pwd.getpwnam(job.user.email.split('@')[0] ) *does* return the correct username, however, that user is not present in the Virtual machine that is running Galaxy, so when the job runner calls for pwd.getpwuid(), there is nothing there. By the way, the VM uses key authentication only, not passwords. The problem I think I'm having is that the /etc/passwd file I want to use is located on the cluster, not on the virtual machine. I'm not sure if I can just copy that file over. How else can I get ahold of the uid of the user who cannot log in to the machine Galaxy is running on? Thanks for the help, Carrie Ganote __________________________________________________________________________________ Hi Carrie, I run a crontab job every 5 minutes that repopulates the galaxy database with the real user names we use instead of the email style user names by updating the galaxy_user.username column. Then, I patch jobs/__init__.py as follows: # self.__user_system_pwent = pwd.getpwnam( job.user.email.split('@')[0] ) self.__user_system_pwent = pwd.getpwnam( job.user.username ) Regards, Alex

1 0

Working with compressed files
by Fenglou Mao 18 Dec '12

18 Dec '12

Is Galaxy capable of working with compressed files such as *.fastq.gz? Thanks, Fenglou

2 1

question of galaxy on cloud
by Sun, Wenping [USA] 18 Dec '12

18 Dec '12

Dear Galaxy members, I am new to galaxy and just installed galaxy on aws cloud. I am testing how it works and have the following question below: 1. If I upload dataset with url, where the data location after uploading? 2. How many Gb space from root of instance would be more efficient to run galaxy? If root space does not matter, what else would affect the overall performance? 3. I tried to test bowtie2 with the dataset I uploaded, however, the window for reference genome is very narrow and nothing can be selected. When I omit that option to execute bowtie2, galaxy give error message for requesting reference genome. I am using hg19, should I upload myself? 4. Same error happen for me to run fastqc --- the reference genome selection window is way too narrow and nothing can be selected I really appreciate your inputs and helps! Kind regards, Kathryn

1 0

Galaxy users on virtual machine
by Ganote, Carrie L 18 Dec '12

18 Dec '12

Hi all, Right now I have drmaa running with Torque. I have a virtual machine with Galaxy installed on it, a filesystem mounted on the virtual machine that holds the dataset info, and a cluster that runs big jobs and also has access to the mounted filesystem. When running Galaxy as a real user, I get an error because the real user has no pwd listing in the virtual machine. In this entry <http://dev.list.galaxyproject.org/Different-User-with-Torque-td4655833.html…> there is mention of galaxy_user.username; where is that and how is it populated? I use kerberos to authenticate through apache. Any clues appreciated! Here's the dump: galaxy.jobs ERROR 2012-12-18 11:29:01,871 (989) Failed to change ownership of /Filesystem/job_working_directory/000/989, making world-writable instead Traceback (most recent call last): File "/Prefix/galaxy-dist/lib/galaxy/jobs/__init__.py", line 893, in change_ownership_for_run self._change_ownership( self.user_system_pwent[0], str( self.user_system_pwent[3] ) ) TypeError: 'NoneType' object is unsubscriptable galaxy.jobs.runners.drmaa ERROR 2012-12-18 11:29:01,928 Uncaught exception queueing job Traceback (most recent call last): File "/Prefix/galaxy-dist/lib/galaxy/jobs/runners/drmaa.py", line 145, in run_next self.queue_job( obj ) File "/Prefix/galaxy-dist/lib/galaxy/jobs/runners/drmaa.py", line 237, in queue_job log.debug( '(%s) submitting with credentials: %s [uid: %s]' % ( galaxy_id_tag, job_wrapper.user_system_pwent[0], job_wrapper.user_system_pwent[2] ) ) TypeError: 'NoneType' object is unsubscriptable Carrie Ganote

2 1

Parallelism tags and Best practices.
by James 17 Dec '12

17 Dec '12

Hi All, I was wondering how to add parrelism tags based on best practices recommended by the tool providers. E.g with IMPUTE at the moment split the file into region size that is recommended by the tool providers and then run each section sequentially. Would it be possibly to add it into the job splitters so that it splits based on megabase distance and not just merely breaking the file into a equal amount of lines. Cheers James.

1 0

Toolshed install 404
by Kyle Ellrott 17 Dec '12

17 Dec '12

Is anybody else getting 404 errors during toolshed installs? My instance is trying to access " http://toolshed.g2.bx.psu.edu/repository/get_readme_files?name=synapse_inte…" and gets a 404. Kyle

2 1