Processing large-scale genomics data efficiently is a monumental task, often hindered by high costs and resource allocation challenges. This blog dives into an innovative system designed to optimize genomics workflows by minimizing out-of-memory failures—a critical bottleneck in such operations. Through a combination of scalable benchmarking tools and a failure-aware scheduler, researchers are unlocking new possibilities for resource efficiency and reliability. Leveraging insights from Chameleon, this solution paves the way for groundbreaking advancements in genomic data processing.

Facing network issues, floating IP shortages, or login troubles on Chameleon? This blog post highlights the top challenges users encountered over the past year and shares practical tips and tricks to resolve them quickly. Learn how to tackle firewall misconfigurations, manage floating IPs efficiently, troubleshoot login errors, and more. Save time and streamline your Chameleon experience!

Season's Greetings from the Chameleon Team!

As the year draws to a close we want to thank you for another fabulous year of innovative ideas and exciting resaerch. May your holidays be magical and joyful, and the New Year full of exciting adventures! 

As in the years before, the Chameleon Help Desk will be on snooze (make sure to get your tickets in by the 20th!) but we will make up for it by continuing our Chameleon for Christmas "double lease" tradition -- between 19th and 22nd (inclusive) you can make 14 day leases -- and this does include GPUs! …

To provide support to our users, we are piloting by appointment Chameleon Office Hours. The first session will be on December 13, 2024, from 10:00-11:00 am and 2:30-3:30 pm Central time. Office hours appointments can be scheduled for 20 minute intervals, at least 8 hours in advance. To schedule an appointment, see this link.

As always, if you need help outside of this time, please contact our help desk. Additionally, you can find useful information about Chameleon on our blog, in our documentation, and on YouTube.

This month we have presentations from the 5th Chameleon User Meeting on practical reproducibility, and lots of housekeeping on Chameleon. These include improvements to IP availability, and fixes to the core testbed, Trovi, and CHI@Edge.

Learn how researcher Redwan Khan uses Chameleon to develop FedCaSe, an innovative framework that tackles the challenges of distributed machine learning across diverse edge devices. This groundbreaking research demonstrates up to 29x improvement in client participation and 81x better data access efficiency, paving the way for more accessible and efficient AI systems.

Join Chameleon at SC24 in Atlanta from November 17-20, 2024, as we showcase our contributions to advancing high-performance computing research. From hands-on tutorials to a workshop on reproducibility, BoF sessions, and REU student presentations, we invite you to explore Chameleon’s role in driving innovation. Don’t miss our integration with SCinet and FABRIC, opening new collaboration opportunities. For more details or to connect with our team, visit us at SC24!

Running distributed applications across multiple nodes is a common need in scientific computing, but setting up MPI clusters can be challenging, especially in cloud environments. In this post, we'll explore a template for creating MPI clusters on Chameleon that handles the key configuration steps automatically, letting you focus on your research rather than infrastructure setup.

We’re excited to announce the full agenda for the upcoming Community Workshop on Practical Reproducibility in HPC, taking place on November 18, 2024, at Terminus 330 in Atlanta, GA. Visit the workshop website for complete details.

This month, we have updated appliances including Ubuntu 24.04! We also have Trovi dashboard updates and fixes to ARM64 nodes at CHI@TACC.