Description: HPC workflows may use and create large amounts of data, which can be a challenge to manage. Managing data involves:

• Uploading and saving it for use
• Staging it when needed
• Compressing data to save space and ease copying it
• Saving data given quota and time limits on HPC file systems

This seminar covers methods of saving and aggregating many files into archive files, compressing these, transporting these, and using the HPC archive file system. Goals include doing these quickly while reducing storage use. Using the transfer queue and automating data handling speed HPC workflows, while reducing data size speeds downloading data to their local systems.

Presenter(s): Dr. Bob Donnelly, GDIT / PET Location: Webcast Date & Time: December 10, 2024, 2:00p - 3:30p ET

Controlled by: DoD HPCMP Controlled by: PET Program CUI Category: OPSEC Limited Dissemination Control: FEDCON POC: Mr. Ronald Hedgepeth, pet@hpc.mil

---

CUI