October 2023 - Esg-wp4 - lists.galaxyproject.org

ESG WP4 meeting: Thursday 2nd Nov, 10am CET
by Sebastian Luna-Valero 31 Oct '23

31 Oct '23

Hello ESG WP4! A kind reminder that we have moved our monthly meeting from tomorrow Wed 1st Nov to the following day: Thu 2nd Nov. I take the opportunity to set a few points of discussion ahead of the meeting so we can have a more fruitful discussion on Thursday. T4.1: - Enable BYOC in Galaxy without admin intervention. Action: plan next steps [ALU-FR] - Add new ARC cluster deployment at UiO to connect it with DIRAC v8 using tokens. [UiO] - Automate deployment of ARC with Infrastructure Manager like we did with Pulsar? [UiO, EGI] T4.2: - Test geolocation https://github.com/galaxyproject/galaxy/issues/16370 [VIB, ALU-FR, EGI] - Progress with object store in OneData [AGH-UST] T4.3: - Progress on Metascheduler for TPV as a service https://github.com/usegalaxy-eu/tpv-metascheduler-api [ALU-FR, EGI, VIB] - Profiling of sites. Discuss next steps [ALU-FR, EGI, UiO] - Visual approach to show jobs floating through Europe (between instances of Galaxy and Pulsar). [CESNET] BSC, UB, and INFN are also part of WP4 but we need to define specific tasks. Do BSC, UB and INFN have suggestions on what to contribute in WP4? Best regards, Sebastian -- Sebastian Luna-Valero (he/him/his) | Cloud Community Support Specialist | EGI Foundation (Amsterdam, The Netherlands) W: www.egi.eu | E: sebastian.luna.valero(a)egi.eu | Twitter: SLunaValero EGI: Advanced Computing for Research The EGI Foundation is ISO 9001:2015 and ISO/IEC 20000-1:2018 certified

1 1

T4.3: Changes in the implementation of meta scheduling in Galaxy
by Sebastian Luna-Valero 10 Oct '23

10 Oct '23

Dear All, During the ESG annual meeting in Freiburg we discussed more in detail about the meta scheduling implementation. So far we have been discussing adding this to DIRAC. However, the UseGalaxy.eu team felt that it would be better to create a separate API endpoint for the meta scheduling (specifically using https://fastapi.tiangolo.com/ and https://www.openapis.org/) We all agreed this is a better approach. Also, we discussed that TPV has a global overview of all destinations in Galaxy, and DIRAC only sees the Compute Elements under a Virtual Organistaion. Specifically, this is where the scheduling happens in TPV, after it has filtered out all the candidate destinations for a given job (tool): https://github.com/usegalaxy-eu/infrastructure-playbook/blob/master/files/g… It is that part of the code that will call the new API endpoint to return the best destination. We informally discussed that @paul.degeest@psb.vib-ugent.be <paul.degeest(a)psb.vib-ugent.be> will contact David Lopez (UseGalaxy.eu) to get started with the FastAPI implementation. @Abdulrahman Azab <abdulrahman.azab(a)usit.uio.no> will be contributing his code for the meta scheduling. I assume that the best first step is to create a GitHub repository under https://github.com/usegalaxy-eu so we can then point interested people to it? I have added this to our shared T4.3 document: https://docs.google.com/document/d/1YGWsyXlIkyBD_vpkwrWD6HUxdRC1zL6RcdyV2M1… Please let me know if there are any questions. Best regards, Sebastian -- Sebastian Luna-Valero (he/him/his) | Cloud Community Support Specialist | EGI Foundation (Amsterdam, The Netherlands) W: www.egi.eu | E: sebastian.luna.valero(a)egi.eu | Twitter: SLunaValero EGI: Advanced Computing for Research The EGI Foundation is ISO 9001:2015 and ISO/IEC 20000-1:2018 certified

2 1

Updated invitation with note: ESG WP4 Monthly meeting @ Thu 2023-11-02 10:00 - 11:00 (CET) (esg-wp4@lists.galaxyproject.org)
by enol.fernandez＠egi.eu 09 Oct '23

09 Oct '23

This event has been updated with a note: "Move it one day to avoid the bank holiday on Nov 1st" Changed: Time ESG WP4 Monthly meeting Thursday 2023-11-02 ⋅ 10:00 – 11:00 Central European Time - Amsterdam Attachments EuroScienceGateway WP4 meeting notes https://docs.google.com/document/d/1ztTmfn5dMlN_IEE7MUvtJLZAb8fQIiM7k98kNYL… WP4: Building blocks for a sustainable operating model https://drive.google.com/drive/folders/1UJlv_2amIb9Y5P8QCTINklJXn5WJHMo- EuroScienceGateway WP4 monthly meetingRolling notes document: EuroScienceGateway WP4 meeting notesDrive folder: WP4: Building blocks for a sustainable operating model──────────Enol Fernández (EGI Foundation) is inviting you to a scheduled Zoom meeting.Join Zoom Meetinghttps://us02web.zoom.us/j/83095358997?pwd=YUNBME1rNFdXUjA3SGdvdVpGS3hJZz09Meeting ID: 830 9535 8997Passcode: 795646────────── Organiser Enol Fernández enol.fernandez(a)egi.eu Reply for esg-wp4(a)lists.galaxyproject.org and view more details https://calendar.google.com/calendar/event?action=VIEW&eid=NmM4Y2I3MjgwZmMw… Your attendance is optional. ~~//~~ Invitation from Google Calendar: https://calendar.google.com/calendar/ You are receiving this email because you are an attendee of the event. To stop receiving future updates for this event, decline this event. Forwarding this invitation could allow any recipient to send a response to the organiser, be added to the guest list, invite others regardless of their own invitation status or modify your RSVP. Learn more https://support.google.com/calendar/answer/37135#forwarding

1 0

Next WP4 meeting - move to Nov 2nd 10.00 CET
by Enol Fernández 09 Oct '23

09 Oct '23

Dear all, As Nov 1st is a bank holiday in several countries, I propose to move our next meeting to the following day, at the same time: Nov 2nd 10.00. If there are too many people that cannot make it, we shall find a better alternative, but let's try with this first :) I'm updating the calendar invite as well. Regards Enol -- Enol Fernández (he/him) | Cloud Solutions Manager | EGI Foundation (Amsterdam, The Netherlands) www.egi.eu | enol.fernandez(a)egi.eu | +31 (0)6 1541 1698 | Skype: enol.fernandez.egi | Twitter: @enolfc EGI: Advanced Computing for Research The EGI Foundation is ISO 9001:2015 and ISO/IEC 20000-1:2018 certified

1 0

Updated invitation: ESG WP4 Monthly meeting @ Monthly from 10:00 to 11:00 on the first Wednesday (CET) (esg-wp4@lists.galaxyproject.org)
by enol.fernandez＠egi.eu 06 Oct '23

06 Oct '23

This event has been updated ESG WP4 Monthly meeting Monthly from 10:00 to 11:00 on the first Wednesday Central European Time - Amsterdam Attachments EuroScienceGateway WP4 meeting notes https://docs.google.com/document/d/1ztTmfn5dMlN_IEE7MUvtJLZAb8fQIiM7k98kNYL… WP4: Building blocks for a sustainable operating model https://drive.google.com/drive/folders/1UJlv_2amIb9Y5P8QCTINklJXn5WJHMo- EuroScienceGateway WP4 monthly meetingRolling notes document: EuroScienceGateway WP4 meeting notesDrive folder: WP4: Building blocks for a sustainable operating model──────────Enol Fernández (EGI Foundation) is inviting you to a scheduled Zoom meeting.Join Zoom Meetinghttps://us02web.zoom.us/j/83095358997?pwd=YUNBME1rNFdXUjA3SGdvdVpGS3hJZz09Meeting ID: 830 9535 8997Passcode: 795646────────── Organiser Enol Fernández enol.fernandez(a)egi.eu Reply for esg-wp4(a)lists.galaxyproject.org and view more details https://calendar.google.com/calendar/event?action=VIEW&eid=NmM4Y2I3MjgwZmMw… Your attendance is optional. ~~//~~ Invitation from Google Calendar: https://calendar.google.com/calendar/ You are receiving this email because you are an attendee of the event. To stop receiving future updates for this event, decline this event. Forwarding this invitation could allow any recipient to send a response to the organiser, be added to the guest list, invite others regardless of their own invitation status or modify your RSVP. Learn more https://support.google.com/calendar/answer/37135#forwarding

1 0

Updated invitation: ESG WP4 Monthly meeting @ Monthly from 10:00 to 11:00 on the first Wednesday (CET) (esg-wp4@lists.galaxyproject.org)
by enol.fernandez＠egi.eu 06 Oct '23

06 Oct '23

This event has been updated ESG WP4 Monthly meeting Monthly from 10:00 to 11:00 on the first Wednesday Central European Time - Amsterdam Attachments EuroScienceGateway WP4 meeting notes https://docs.google.com/document/d/1ztTmfn5dMlN_IEE7MUvtJLZAb8fQIiM7k98kNYL… WP4: Building blocks for a sustainable operating model https://drive.google.com/drive/folders/1UJlv_2amIb9Y5P8QCTINklJXn5WJHMo- EuroScienceGateway WP4 monthly meetingRolling notes document: EuroScienceGateway WP4 meeting notesDrive folder: WP4: Building blocks for a sustainable operating model──────────Enol Fernández (EGI Foundation) is inviting you to a scheduled Zoom meeting.Join Zoom Meetinghttps://us02web.zoom.us/j/83095358997?pwd=YUNBME1rNFdXUjA3SGdvdVpGS3hJZz09Meeting ID: 830 9535 8997Passcode: 795646────────── Organiser Enol Fernández enol.fernandez(a)egi.eu Reply for esg-wp4(a)lists.galaxyproject.org and view more details https://calendar.google.com/calendar/event?action=VIEW&eid=NmM4Y2I3MjgwZmMw… Your attendance is optional. ~~//~~ Invitation from Google Calendar: https://calendar.google.com/calendar/ You are receiving this email because you are an attendee of the event. To stop receiving future updates for this event, decline this event. Forwarding this invitation could allow any recipient to send a response to the organiser, be added to the guest list, invite others regardless of their own invitation status or modify your RSVP. Learn more https://support.google.com/calendar/answer/37135#forwarding

1 0