• 本文
• リロード
• 差分
• バックアップ
• 名前変更
• リファラ
• 新規ページ
• 編集

Module LLM

Module LLM/モデル

Top / Module LLM / モデル

機能別のメモ

• Module LLM/音声合成
• Module LLM/音声認識

変換

• Pulsar2

ファイル

• .axmodel - Pulsar2
• .ncnn.bin?
• pnnx.ncnn.bin?
• .onnx

場所

モデルの設定ファイル

• Module LLM/Ubuntu/opt/m5stack/data/models

M5_LLM_ubuntu_v1.3_20241203-mini

• モデル (たぶん)		Module LLM/Ubuntu/パッケージ
  MeloTTS	Module LLM/Ubuntu/opt/m5stack/data/models/mode_melotts-zh-cn.json?	llm-melotts-zh-cn
  Qwen2.5-0.5B-Instruct	Module LLM/Ubuntu/opt/m5stack/data/models/mode_qwen2.5-0.5B-prefill-20e.json	llm-qwen2.5-0.5b-prefill-20e
  sherpa-ncnn	Module LLM/Ubuntu/opt/m5stack/data/models/mode_sherpa-ncnn-streaming-zipformer-20M-2023-02-17.json?	llm-sherpa-ncnn-streaming-zipformer-20m-2023-02-17?
  sherpa-ncnn	Module LLM/Ubuntu/opt/m5stack/data/models/mode_sherpa-ncnn-streaming-zipformer-zh-14M-2023-02-23.json?	llm-sherpa-ncnn-streaming-zipformer-zh-14m-2023-02-23?
  sherpa-onnx	Module LLM/Ubuntu/opt/m5stack/data/models/mode_sherpa-onnx-kws-zipformer-gigaspeech-3.3M-2024-01-01.json?	llm-sherpa-onnx-kws-zipformer-gigaspeech-3.3m-2024-01-01?
  sherpa-onnx	Module LLM/Ubuntu/opt/m5stack/data/models/mode_sherpa-onnx-kws-zipformer-wenetspeech-3.3M-2024-01-01.json?	llm-sherpa-onnx-kws-zipformer-wenetspeech-3.3m-2024-01-01?
  SummerTTS	Module LLM/Ubuntu/opt/m5stack/data/models/mode_single-speaker-english-fast.json?	llm-single-speaker-english-fast
  SummerTTS	Module LLM/Ubuntu/opt/m5stack/data/models/mode_single-speaker-fast.json?	llm-single-speaker-fast
  YOLO11? (yolo11n-pose?)	Module LLM/Ubuntu/opt/m5stack/data/models/mode_yolo11n-pose.json?	llm-yolo11n-pose?
  YOLO11? (yolo11n-seg?)	Module LLM/Ubuntu/opt/m5stack/data/models/mode_yolo11n-seg.json?	llm-yolo11n-seg?
  YOLO11? (yolo11n?)	Module LLM/Ubuntu/opt/m5stack/data/models/mode_yolo11n.json?

M5_LLM_ubuntu_v1.0_20241024 (初期ファーム)

• sherpa-ncnn	Module LLM/Ubuntu/opt/m5stack/data/models/asr.json
  sherpa-ncnn	Module LLM/Ubuntu/opt/m5stack/data/models/asr_en.json
  sherpa-onnx	Module LLM/Ubuntu/opt/m5stack/data/models/kws.json
  sherpa-onnx	Module LLM/Ubuntu/opt/m5stack/data/models/kws_en.json
  Qwen2.5-0.5B-Instruct	Module LLM/Ubuntu/opt/m5stack/data/models/qwen2.5-0.5B.json
  SummerTTS	Module LLM/Ubuntu/opt/m5stack/data/models/tts.json
  SummerTTS	Module LLM/Ubuntu/opt/m5stack/data/models/tts_en.json

• 実際のモデルファイル
  • Module LLM/Ubuntu/opt/m5stack/data/asr_en_model?
  • Module LLM/Ubuntu/opt/m5stack/data/asr_model?
  • Module LLM/Ubuntu/opt/m5stack/data/audio?
  • Module LLM/Ubuntu/opt/m5stack/data/kws_en_model?
  • Module LLM/Ubuntu/opt/m5stack/data/kws_model?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-0.5B-prefill-20e
  • Module LLM/Ubuntu/opt/m5stack/data/tts_en_model?
  • Module LLM/Ubuntu/opt/m5stack/data/tts_model?

Module LLM/Ubuntu/更新パッケージ

• 第1弾 (StackFlow 1.3/データver:0.2)

  モデル (たぶん)
  InternVL2-1B?	llm-internvl2-1B-ax630c_0.2-m5stack1_arm64.deb?	894MB
  Llama 3.2 1B	llm-llama3.2-1B-prefill-ax630c_0.2-m5stack1_arm64.deb	1.41GB
  openbuddy-llama3.2-1b-v23.1-131k	llm-openbuddy-llama3.2-1B-ax630c_0.2-m5stack1_arm64.deb	1.40GB
  sherpa-onnx	llm-sherpa-onnx-kws-zipformer-gigaspeech-3.3M-2024-01-01_0.3-m5stack1_arm64.deb?	4.7MB
  sherpa-onnx	llm-sherpa-onnx-kws-zipformer-wenetspeech-3.3M-2024-01-01_0.3-m5stack1_arm64.deb?	4.0MB
  Depth Anything	llm-depth-anything_1.3-m5stack1_arm64.deb?	2.64MB

• 第2弾 (StackFlow 1.4/データver:0.3)

  モデル (たぶん)
  YOLO11? (yolo11n-hand-pose?)	llm-yolo11n-hand-pose_0.3-m5stack1_arm64.deb?
  YOLO11? (yolo11n-pose?)	llm-yolo11n-pose_0.3-m5stack1_arm64.deb?
  Qwen2.5-Coder-0.5B?	llm-qwen2.5-coder-0.5B-ax630c_0.2-m5stack1_arm64.deb?	644MB
  InternVL2_5-1B?	llm-internvl2.5-1B-ax630c_0.3-m5stack1_arm64.deb?	916MB
  MeloTTS	llm-melotts_1.4-m5stack1_arm64.deb?
  Qwen2.5-1.5B-Instruct	llm-qwen2.5-1.5B-ax630c_0.3-m5stack1_arm64.deb	1.63GB

Module LLM/モデル/LLM

ユニット

Module LLM/ユニット/SYS?

• set module working parameters and retrieve module operation information.

Module LLM/ユニット/AUDIO

• control the system sound card, access microphone audio, and playback sound.

Module LLM/ユニット/KWS?

• keyword detection

  Module LLM/Ubuntu/opt/m5stack/data/models/kws.json	sherpa-onnx-kws-zipformer-wenetspeech-3.3M-2024-01-01
  Module LLM/Ubuntu/opt/m5stack/data/models/kws.json	sherpa-onnx-kws-zipformer-gigaspeech-3.3M-2024-01-01

Module LLM/ユニット/ASR?

• converting speech to text.

  Module LLM/Ubuntu/opt/m5stack/data/models/asr.json	sherpa-ncnn-streaming-zipformer-zh-14M-2023-02-23
  Module LLM/Ubuntu/opt/m5stack/data/models/asr_en.json	sherpa-ncnn-streaming-zipformer-20M-2023-02-17

Module LLM/ユニット/LLM

• generate responses based on input text.

  Module LLM/Ubuntu/opt/m5stack/data/models/qwen2.5-0.5B.json

  qwen2.5-0.5b? (qwen2.5-0.5B-prefill-20e)

Module LLM/モデル/qwen2.5-0.5b

• llm-qwen2.5-0.5b

Module LLM/モデル/OpenBuddy (テスト中？)

Module LLM/ユニット/TTS

• converting text to speech.

  Module LLM/Ubuntu/opt/m5stack/data/models/tts.json	single_speaker_fast
  Module LLM/Ubuntu/opt/m5stack/data/models/tts_en.json	single_speaker_english_fast

• たぶんSummerTTS

M5ModuleLLM.llm.setup

• model: qwen2.5-0.5b?

トークナイザ

• Module LLM/Ubuntu/opt/m5stack/scripts/text2token.py

Module LLM/Ubuntu/更新パッケージを作成しているスクリプト

• https://github.com/m5stack/StackFlow/blob/main/projects/llm_framework/tools/llm_pack.py
• https://github.com/m5stack/StackFlow/blob/dev/projects/llm_framework/tools/llm_pack.py

• llm-audio-en-us
• llm-audio-zh-cn
• llm-sherpa-ncnn-streaming-zipformer-20M-2023-02-17
• llm-sherpa-ncnn-streaming-zipformer-zh-14M-2023-02-23?
• llm-sherpa-onnx-kws-zipformer-gigaspeech-3.3M-2024-01-01?
• llm-sherpa-onnx-kws-zipformer-wenetspeech-3.3M-2024-01-01?
• llm-qwen2.5-0.5B-prefill-20e?
• llm-qwen2.5-1.5B-ax630c?
• llm-single-speaker-english-fast
• llm-single-speaker-fast
• llm-melotts-zh-cn
• llm-yolo11n?
• llm-yolo11n-pose?
• llm-yolo11n-hand-pose?
• llm-yolo11n-seg?
• llm-qwen2.5-coder-0.5B-ax630c?
• llm-llama3.2-1B-prefill-ax630c?
• llm-openbuddy-llama3.2-1B-ax630c?
• llm-internvl2.5-1B-ax630c?
• llm-depth-anything-ax630c?
• llm-whisper-tiny?
• llm-silero-vad?

関連

• Pulsar2/モデル
• Pulsar2/LLM