MUSA AI Tensor Engine

MATE(MUSA AI Tensor Engine) is a centralized library for Generative AI.

Installation

Requirements

MUSA Toolkits: 4.3.4 or later

TorchMUSA: 2.7.1 or later

Architecutre: Pinghu(MP31)

Install From Source

git clone git@github.com:MooreThreads/mate.git --recursive
cd mate
pip install --no-build-isolation . -v

Build From Source

git clone git@github.com:MooreThreads/mate.git --recursive
cd mate
python -m build --wheel --no-isolation

Build Docs

After installing mate, run the following commands:

pip install sphinx furo
cd mate/docs
make html

Acknowledgement

Mate is inspired by FlashInfer, FlashAttention, cutlass, FlashMLA and DeepGemm projects.