[Gmn-participants] Best Practices for Handling Large Datasets in Galaxy Workflows?

Hello GMN participants,

I’ve recently started working with some pretty large datasets in Galaxy, and I’m running into performance issues with certain workflows. Specifically, the data is in the range of hundreds of GB, and it’s causing slowdowns and sometimes errors during processing. https://leveldevildash.com/ What are some of the best practices for optimizing Galaxy workflows when dealing with large datasets? Are there particular tools or strategies within Galaxy that could help manage or process such large files more efficiently? I’d also appreciate any tips on adjusting resource allocation or parallel processing to speed things up.

Thanks in advance for any insights!