Description: This seminar introduces techniques for AI/ML inference on HPCMP machines, including multi-GPU/multi-node model loading, performance optimizations and inference servers. Examples mostly involve LLMs but many of the same techniques and optimizations are also relevant for non-LLM applications.

Presenter(s): Calvin Anderson, PhD, GDIT / PET Location: Webcast Date: June 24, 2025

Controlled by: DoD HPCMP Controlled by: PET Program CUI Category: OPSEC Limited Dissemination Control: FEDCON POC: Mr. Ronald Hedgepeth, pet@hpc.mil

---

CUI