Name		Name	Last commit message	Last commit date
Latest commit History 28 Commits
figure		figure
.gitignore		.gitignore
README.md		README.md
base.py		base.py
moe_projection.py		moe_projection.py
projection.ipynb		projection.ipynb

Repository files navigation

projection

Command

simpily run
```
python moe_projection.py
```
use projection.ipynb

Example

Mixtral-8x7B

Notes

Currently only with single card, will support multi-card / multi-node.
Only cover Mixtral-8x7B, will cover more.

About

No description, website, or topics provided.

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 87.9%
Python 12.1%