EuroCC@Greece announced the 9th Course of HPC Training Series with the subject “Running LLMs on HPC: Transformers, Inference & Deployment”, that took place online on January 17th, 2025.

Presentation languages: Greek and English

Audience:

• Data scientists and machine learning engineers.
• NLP researchers and practitioners.
• HPC system administrators and engineers.
• Developers exploring Hugging Face Transformers and RAG.
• Academic researchers working on language modeling projects.
• Professionals interested in training or deploying LLMs on HPC.
• Organizations planning to adopt HPC for AI workloads.

Description: This course focused on Large Language Models running on High-Performance Computing systems. Participants gained a foundational understanding of the Hugging Face Transformers library, embeddings’ models, and of Retrieval-Augmented Generation. They discovered how to effectively set up an inference server on HPC systems as well as a deployment process and limitations. Training of the Greek LLM Meltemi was also be presented. This seminar included hands-on sessions where users were able to run the provided code.

The Course’s presentation material can be found here.

You may find the Course’s available recordings in the dedicated playlist here.