Happy New Year! We’ve had a busy 2024 with new hardware and many system improvements! In our changelog today we note a couple of nits that slid under the wire in the last year and propose important changes to our virtualized offering – please, read carefully we are asking for your feedback to make sure that those innovations don’t interfere with your ability to use the system for your experiments.
Reducing Workflow Failures with Chameleon’s Scalable Research Platform
-
Dec. 30, 2024
by -
Aaditya Mankar
Processing large-scale genomics data efficiently is a monumental task, often hindered by high costs and resource allocation challenges. This blog dives into an innovative system designed to optimize genomics workflows by minimizing out-of-memory failures—a critical bottleneck in such operations. Through a combination of scalable benchmarking tools and a failure-aware scheduler, researchers are unlocking new possibilities for resource efficiency and reliability. Leveraging insights from Chameleon, this solution paves the way for groundbreaking advancements in genomic data processing.
Chameleon Support: Top Issue Areas and How to Resolve Them
-
Dec. 18, 2024
by -
Marc Richardson
Facing network issues, floating IP shortages, or login troubles on Chameleon? This blog post highlights the top challenges users encountered over the past year and shares practical tips and tricks to resolve them quickly. Learn how to tackle firewall misconfigurations, manage floating IPs efficiently, troubleshoot login errors, and more. Save time and streamline your Chameleon experience!
Updates on Chameleon during the winter break
-
Dec. 13, 2024
by -
Kate Keahey
Season's Greetings from the Chameleon Team!
As the year draws to a close we want to thank you for another fabulous year of innovative ideas and exciting resaerch. May your holidays be magical and joyful, and the New Year full of exciting adventures!
As in the years before, the Chameleon Help Desk will be on snooze (make sure to get your tickets in by the 20th!) but we will make up for it by continuing our Chameleon for Christmas "double lease" tradition -- between 19th and 22nd (inclusive) you can make 14 day leases -- and this does include GPUs! …
To provide support to our users, we are piloting by appointment Chameleon Office Hours. The first session will be on December 13, 2024, from 10:00-11:00 am and 2:30-3:30 pm Central time. Office hours appointments can be scheduled for 20 minute intervals, at least 8 hours in advance. To schedule an appointment, see this link.
As always, if you need help outside of this time, please contact our help desk. Additionally, you can find useful information about Chameleon on our blog, in our documentation, and on YouTube.
This month we have presentations from the 5th Chameleon User Meeting on practical reproducibility, and lots of housekeeping on Chameleon. These include improvements to IP availability, and fixes to the core testbed, Trovi, and CHI@Edge.
Optimizing Federated Learning for Heterogeneous Edge Devices
Learn how researcher Redwan Khan uses Chameleon to develop FedCaSe, an innovative framework that tackles the challenges of distributed machine learning across diverse edge devices. This groundbreaking research demonstrates up to 29x improvement in client participation and 81x better data access efficiency, paving the way for more accessible and efficient AI systems.
Read on to see what we'll be up to during SC24 week! Nov. 17 to 20
Join Chameleon at SC24 in Atlanta from November 17-20, 2024, as we showcase our contributions to advancing high-performance computing research. From hands-on tutorials to a workshop on reproducibility, BoF sessions, and REU student presentations, we invite you to explore Chameleon’s role in driving innovation. Don’t miss our integration with SCinet and FABRIC, opening new collaboration opportunities. For more details or to connect with our team, visit us at SC24!
Simplifying Distributed Computing Setup with Jupyter, Ansible, and Python
-
Nov. 18, 2024
by -
Michael Sherman
Running distributed applications across multiple nodes is a common need in scientific computing, but setting up MPI clusters can be challenging, especially in cloud environments. In this post, we'll explore a template for creating MPI clusters on Chameleon that handles the key configuration steps automatically, letting you focus on your research rather than infrastructure setup.