{"id":18798,"date":"2025-01-09T14:16:24","date_gmt":"2025-01-09T12:16:24","guid":{"rendered":"https:\/\/grnet.gr\/?p=18798"},"modified":"2025-01-29T16:35:00","modified_gmt":"2025-01-29T14:35:00","slug":"euroccgreece-hpc-training-series-course-9-running-llms-on-hpc-transformers-inference-deployment-on-january-17th-2025","status":"publish","type":"post","link":"https:\/\/grnet.gr\/en\/2025\/01\/09\/euroccgreece-hpc-training-series-course-9-running-llms-on-hpc-transformers-inference-deployment-on-january-17th-2025\/","title":{"rendered":"EuroCC@Greece HPC Training Series &#8211; Course 9 \u201cRunning LLMs on HPC: Transformers, Inference &#038; Deployment\u201d, on January 17th, 2025"},"content":{"rendered":"<p style=\"font-weight: 400;\">EuroCC@Greece announced the 9th Course of HPC Training Series with the subject \u201cRunning LLMs on HPC: Transformers, Inference &amp; Deployment\u201d, that took place online on January 17th, 2025.<\/p>\n<p style=\"font-weight: 400;\"><strong>Presentation languages<\/strong>: Greek and English<\/p>\n<p style=\"font-weight: 400;\"><strong>Audience<\/strong>:<\/p>\n<ul style=\"font-weight: 400;\">\n<li>Data scientists and machine learning engineers.<\/li>\n<li>NLP researchers and practitioners.<\/li>\n<li>HPC system administrators and engineers.<\/li>\n<li>Developers exploring Hugging Face Transformers and RAG.<\/li>\n<li>Academic researchers working on language modeling projects.<\/li>\n<li>Professionals interested in training or deploying LLMs on HPC.<\/li>\n<li>Organizations planning to adopt HPC for AI workloads.<\/li>\n<\/ul>\n<p style=\"font-weight: 400;\"><strong>Description<\/strong>: This course focused on Large Language Models running on High-Performance Computing systems. Participants gained a foundational understanding of the Hugging Face Transformers library, embeddings\u2019 models, and of Retrieval-Augmented Generation. They discovered how to effectively set up an inference server on HPC systems as well as a deployment process and limitations. Training of the Greek LLM Meltemi was also be presented. This seminar included hands-on sessions where users were able to run the provided code.<\/p>\n<p style=\"font-weight: 400;\">The Course\u2019s presentation material can be found <strong><a href=\"https:\/\/events.grnet.gr\/event\/158\/timetable\/\">here<\/a><\/strong><strong>.<\/strong><\/p>\n<p style=\"font-weight: 400;\">You may find the Course\u2019s available recordings in the dedicated playlist <strong><a href=\"https:\/\/youtube.com\/playlist?list=PLDXx3HYfIJMpcWaC-3NLJVBVRTSU-jIPg&amp;si=bnq6mBOdtDYBoI2k\">here<\/a><\/strong><strong>.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>EuroCC@Greece announced the 9th Course of HPC Training Series with the subject \u201cRunning LLMs on HPC: Transformers, Inference &amp; Deployment\u201d, that took place online on January 17th, 2025. Presentation languages: Greek and English Audience: Data scientists and machine learning engineers. NLP researchers and practitioners. HPC system administrators and engineers. Developers exploring Hugging Face Transformers and [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":18890,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[294,355,490],"tags":[],"class_list":["post-18798","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-events-en","category-news-en","category-news_en-en"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/posts\/18798","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/comments?post=18798"}],"version-history":[{"count":5,"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/posts\/18798\/revisions"}],"predecessor-version":[{"id":18892,"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/posts\/18798\/revisions\/18892"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/media\/18890"}],"wp:attachment":[{"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/media?parent=18798"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/categories?post=18798"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/grnet.gr\/en\/wp-json\/wp\/v2\/tags?post=18798"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}