Hi all,
we are going to deploy galaxy on ~okeanos cloud ( okeanos.grnet.gr ). We have already developed a working storage backend for our object store system ( https://github.com/galaxyproject/galaxy/pull/3611 ).
Now we focus on how to make Galaxy run instances/tasks on our VMs and I would like some advice on how to approach this issue.
What we need is a (potentially large) Galaxy deployment with the ability to run workflows of dockerized "tasks". Each task should run on a provisioned VM on our cloud. There are many tools out there to let us automate VM provisioning, managing docker clusters, scaling, as well as monitoring and accounting, and we want to provide all of these features to our partners in European Academia.
The question is, how does Galaxy communicate with a cluster manager like Apache Mesos or Docker swarm? Any other tools I should look into, which are known to work with Galaxy? Will we have to drill into Galaxy code base to provide these features?
Thank you in advance for you suggestions,
Stavros Sachtouris developer @ www.grnet.gr