最終更新:2025-01-21 (火) 21:22:20 (17d)
Pulsar2
Top / Pulsar2
https://pulsar2-docs.readthedocs.io/en/latest/index.html#
概要
- Pulsar2 is an all-in-one new generation neural network compiler independently developed by Axera, That is, conversion, quantification, compilation, and heterogeneous are four-in-one to achieve the fast and efficient deployment requirements of deep learning neural network models.
- In-depth customization and optimization have been carried out for the characteristics of the new generation of AX6? and M7? series chips (AX630C, AX620AV200?, AX620Q?, AX650A?, AX650N, M76H?), giving full play to the computing power of the on-chip heterogeneous computing unit (CPU+NPU) to improve the performance of the neural network model. Product deployment efficiency.
対応
Pulsar2/バージョン
ModelZoo?
AX-Samples
https://pan.baidu.com/s/1cnMeqsD-hErlRZlBDDvuoA?pwd=oey4#list/path=/
https://drive.google.com/drive/folders/1JY59vOFS2qxI8TkVIZ0pHfxHMfKPW5PS
Google Driveの新しいやつ
Pulsar2/Windows
主な機能
- The core function of the Pulsar2 tool chain is to compile the .onnx model into an .axmodel model that the chip can parse and run.
GitHub
.onnxを変換できるか調べるスクリプト
使い方
https://pulsar2-docs.readthedocs.io/en/latest/user_guides_quick/quick_start_prepare.html
https://pulsar2-docs.readthedocs.io/en/latest/user_guides_quick/quick_start_ax620e.html
実行
- ツールチェーンをダウンロードしてDockerで動かす
sudo docker load -i ax_pulsar2_3.2.tar.gz [sudo] password for user: 4089092a81de: Loading layer [==================================================>] 2.543GB/2.543GB 5f70bf18a086: Loading layer [==================================================>] 1.024kB/1.024kB 718edeaf80dc: Loading layer [==================================================>] 101.4MB/101.4MB d1ec0087b4f6: Loading layer [==================================================>] 3.072kB/3.072kB 88c3e689c163: Loading layer [==================================================>] 12.8kB/12.8kB 16e637c29268: Loading layer [==================================================>] 1.513MB/1.513MB Loaded image: pulsar2:3.2
sudo docker run -it --net host --rm -v $PWD:/data pulsar2:3.2
コマンド
- pulsar2
- pulsar2 build
- pulsar2 run?
LLM
Platforms Applicable
Verified Models
- Llama 2、Llama 3、Llama 3.2
- TinyLlama-1.1B
- Qwen1.5、Qwen2、Qwen2.5
- Phi2?、Phi3?
- MiniCPM、MiniCPM-V 2.0?
- SmolLM?
- ChatGLM3
- OpenBuddy