Presentation

· Contributors · Organizations · Search Program · My Schedule · Happening Now · Maps

Modeling Parallel Programs Using Large Language Models

DescriptionIn the past year a large number of large language model (LLM) based tools for software development have been released. These tools have the capability to assist developers with many of the difficulties that arise from the ever-growing complexity in the software stack. As we enter the exascale era, with a diverse set of emerging hardware and programming paradigms, developing, optimizing, and maintaining parallel software is becoming burdensome for developers. While LLM-based coding tools have been instrumental in revolutionizing software development, mainstream models are not designed, trained, or tested on High Performance Computing (HPC) problems. We present a LLM fine-tuned on HPC data and demonstrate its effectiveness in HPC code generation, OpenMP parallelization, and performance modeling.

Authors

Daniel Nichols

University of Maryland

Aniruddha Marathe

Lawrence Livermore National Laboratory (LLNL)