Description: This training event will introduce techniques for AI/ML inference on HPCMP machines, including multi-GPU/multi-node model loading, performance optimizations and inference servers. Attendees will have first access to two distributed inference servers assembled by PET. Examples will mostly involve LLMs but many of the same techniques and optimizations are also relevant for non-LLM applications.

CUI