ASTRA-sim is a distributed AI system simulator. It models the end-to-end software and hardware stack of modern AI systems - encompassing workload scheduling, collective communication algorithms, and hardware architectures (compute/memory/network). Through a suite of APIs, it enables plug-and-play of external open/proprietary components for modeling different parts of the AI system. This provides end-to-end multi-fidelity simulation capabilities for aiding in design and deployment of next-generation distributed AI systems.

Here is a concise visual summary of ASTRA-sim, showing its layers and APIs:

For a comprehensive understanding of the tool, and to gain insights into its capabilities, please visit our website.

For information on how to use ASTRA-sim, please visit our Wiki.

ASTRA-sim accepts MLCommons Chakra Execution Traces as workload-layer inputs. For details, please visit Chakra Github.

ASTRA-sim is currently at version 2.0. The previous version, ASTRA-sim 1.0, is available in the ASTRA-sim-1.0 branch.

We encourage community contributions to ASTRA-sim via PRs.

For any questions about using ASTRA-sim, you can email the ASTRA-sim User Mailing List: [email protected]

To join the mailing list, please fill out the following form: https://forms.gle/18KVS99SG3k9CGXm6

We appreciate your interest and support in ASTRA-sim!