Just created a new database again and tried it -- Seems like it worked ! Complete migration as far as I can tell:
Tables_in_galaxy-new |
---|
cloud_image |
cloud_instance |
cloud_provider |
cloud_snapshot |
cloud_store |
cloud_uci |
cloud_user_credentials |
dataset |
dataset_permissions |
dataset_tag_association |
default_history_permissions |
default_user_permissions |
event |
form_definition |
form_definition_current |
form_values |
galaxy_group |
galaxy_session |
galaxy_session_to_history |
galaxy_user |
group_role_association |
history |
history_annotation_association |
history_dataset_association |
history_dataset_association_annotation_association |
history_dataset_association_display_at_authorizati... |
history_dataset_association_tag_association |
history_tag_association |
history_user_share_association |
implicitly_converted_dataset_association |
job |
job_external_output_metadata |
job_parameter |
job_to_input_dataset |
job_to_output_dataset |
job_to_output_library_dataset |
library |
library_dataset |
library_dataset_dataset_association |
library_dataset_dataset_association_permissions |
library_dataset_dataset_info_association |
library_dataset_permissions |
library_folder |
library_folder_info_association |
library_folder_permissions |
library_info_association |
library_permissions |
metadata_file |
migrate_version |
page |
page_revision |
page_tag_association |
page_user_share_association |
request |
request_event |
request_type |
role |
sample |
sample_event |
sample_state |
stored_workflow |
stored_workflow_annotation_association |
stored_workflow_menu_entry |
stored_workflow_tag_association |
stored_workflow_user_share_connection |
tag |
user_action |
user_address |
user_group_association |
user_preference |
user_role_association |
validation_error |
visualization |
visualization_revision |
workflow |
workflow_step |
workflow_step_annotation_association |
workflow_step_connection |
workflow_step_tag_association |
workflow_tag_association |
Hi Nate,Sorry I had an empty database set the first time (which was giving me the revision error):Part of my problem has been trying to convert the db from sqlite to mysql -- the closest I got using scripts was 40 tables in the database:
dataset dataset_permissions default_history_permissions default_user_permissions event form_definition_current galaxy_group galaxy_session galaxy_session_to_history galaxy_user group_role_association history history_dataset_association history_user_share_association implicitly_converted_dataset_association job job_external_output_metadata job_parameter job_to_input_dataset job_to_output_dataset library library_dataset library_dataset_dataset_association library_dataset_dataset_association_permissions library_dataset_permissions library_folder library_folder_permissions library_permissions metadata_file migrate_version role stored_workflow stored_workflow_menu_entry stored_workflow_user_share_connection user_group_association user_role_association validation_error workflow workflow_step workflow_step_connection When I try to run it linked to the above database I get the following error:galaxy.model.migrate.check DEBUG 2010-02-19 13:42:18,987 MySQL_python egg successfully loaded for mysql dialectTraceback (most recent call last):File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/lib/galaxy/web/buildapp.py", line 61, in app_factoryapp = UniverseApplication( global_conf = global_conf, **kwargs )File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/lib/galaxy/app.py", line 28, in __init__create_or_verify_database( db_url, self.config.database_engine_options )File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/lib/galaxy/model/migrate/check.py", line 102, in create_or_verify_database% ( db_schema.version, migrate_repository.versions.latest ) )Exception: Your database has version '22' but this code expects version '39'. Please backup your database and then migrate the schema by running 'sh manage_db.sh upgrade'.So when I try to run the manage_db.sh I get:22 -> 23...Migration script to add columns for tracking whether pages are deleted andpublicly accessible.Traceback (most recent call last):File "./scripts/manage_db.py", line 45, in <module>main( repository='lib/galaxy/model/migrate', url=db_url )File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/eggs/py2.5-noplatform/sqlalchemy_migrate-0.5.4-py2.5.egg/migrate/versioning/shell.py", line 150, in mainret = command_func(**kwargs)File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/eggs/py2.5-noplatform/sqlalchemy_migrate-0.5.4-py2.5.egg/migrate/versioning/api.py", line 221, in upgradereturn _migrate(url, repository, version, upgrade=True, err=err, **opts)File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/eggs/py2.5-noplatform/sqlalchemy_migrate-0.5.4-py2.5.egg/migrate/versioning/api.py", line 349, in _migrateschema.runchange(ver, change, changeset.step)File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/eggs/py2.5-noplatform/sqlalchemy_migrate-0.5.4-py2.5.egg/migrate/versioning/schema.py", line 184, in runchangechange.run(self.engine, step)File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/eggs/py2.5-noplatform/sqlalchemy_migrate-0.5.4-py2.5.egg/migrate/versioning/script/py.py", line 101, in runfunc()File "lib/galaxy/model/migrate/versions/0023_page_published_and_deleted_columns.py", line 20, in upgradePage_table = Table( "page", metadata, autoload=True )File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/eggs/py2.5-noplatform/SQLAlchemy-0.5.6_dev_r6498-py2.5.egg/sqlalchemy/schema.py", line 108, in __call__return type.__call__(self, name, metadata, *args, **kwargs)File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/eggs/py2.5-noplatform/SQLAlchemy-0.5.6_dev_r6498-py2.5.egg/sqlalchemy/schema.py", line 236, in __init___bind_or_error(metadata).reflecttable(self, include_columns=include_columns)File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/eggs/py2.5-noplatform/SQLAlchemy-0.5.6_dev_r6498-py2.5.egg/sqlalchemy/engine/base.py", line 1265, in reflecttableself.dialect.reflecttable(conn, table, include_columns)File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/eggs/py2.5-noplatform/SQLAlchemy-0.5.6_dev_r6498-py2.5.egg/sqlalchemy/databases/mysql.py", line 1664, in reflecttablesql = self._show_create_table(connection, table, charset)File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/eggs/py2.5-noplatform/SQLAlchemy-0.5.6_dev_r6498-py2.5.egg/sqlalchemy/databases/mysql.py", line 1835, in _show_create_tableraise exc.NoSuchTableError(full_name)sqlalchemy.exc.NoSuchTableError: pageI guess my problem all along is not having the full table schema for use in mySQL.Rgds,Roy WeckiewiczOn Fri, Feb 19, 2010 at 1:33 PM, Nate Coraor <nate@bx.psu.edu> wrote:
Roy Weckiewicz wrote:Hi Roy,
Thanks again Nate,
I just tried the one you sent me - it seems I just have a database revision issue:
Traceback (most recent call last):
File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/lib/galaxy/web/buildapp.py", line 61, in app_factory
app = UniverseApplication( global_conf = global_conf, **kwargs )
File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/lib/galaxy/app.py", line 28, in __init__
create_or_verify_database( db_url, self.config.database_engine_options )
File "/Users/rsw3284/Downloads/galaxy-0c07212afc00/lib/galaxy/model/migrate/check.py", line 72, in create_or_verify_database
raise Exception( "Your database is older than hg revision 1464:c7acaa1bb88f and will need to be updated manually" )
Exception: Your database is older than hg revision 1464:c7acaa1bb88f and will need to be updated manually
Is this the database you converted from sqlite? Does it include the 'migrate_version' table? Could you paste the output of 'SHOW TABLES;'?
Thanks,
Rgds,
Roy Weckiewicz
On Fri, Feb 19, 2010 at 1:28 PM, Nate Coraor <nate@bx.psu.edu <mailto:nate@bx.psu.edu>> wrote:
Roy Weckiewicz wrote:
What's strange is that eventhough the file name on the egg is
MySQL*fat-ucs2.egg the error still reports the file in question
as MySQL*fat.egg -- I've tried renaming the egg to match the
original file, but it didn't seem to make a difference.
Furthermore, when I run.sh, the program will create a directory
in home called .python-eggs/ containing the _MySQL.so file,
among other things - Will I have to add a different URL to the
eggs.ini to keep it from re-downloading the old file?
Ah, sorry, that egg relies on some uncommitted patches. I've
rebuilt it using a clean checkout, could you try this one instead?:
http://www.bx.psu.edu/~nate/galaxy/MySQL_python-1.2.2_5.0.67_static-py2.5-macosx-10.3-fat.egg
Thanks,
--nate
--
Roy Weckiewicz
Texas A&M University
--
Roy Weckiewicz
Texas A&M University