• 本文
• リロード
• 差分
• バックアップ
• 名前変更
• リファラ
• 新規ページ
• 編集

Module LLM

StackFlow

Top / StackFlow

https://github.com/m5stack/StackFlow

Module LLM/ユニット

• https://github.com/m5stack/StackFlow/tree/main/projects/llm_framework

  Module LLM/llm-audio	Audio unit, providing system audio support.
  Module LLM/llm-kws?	Keyword detection unit, providing keyword wakeup service.
  Module LLM/llm-asr?	Speech-to-text unit, providing speech-to-text service.
  Module LLM/llm-llm	Large model unit, providing AI large model inference service.
  Module LLM/llm-melotts?	NPU-accelerated TTS unit, providing text-to-speech and playback service.
  Module LLM/llm-tts?	CPU-computed TTS unit, providing text-to-speech and playback service.

StackFlow/パッケージ

lib-llm

• Module LLM/Ubuntu/opt/m5stack/lib
• Module LLM/Ubuntu/opt/m5stack/share
• Module LLM/Ubuntu/opt/m5stack/scripts?
• Module LLM/Ubuntu/usr/local/lib/python3.10/dist-packages

llm-sys

依存

sherpa

• https://github.com/m5stack/StackFlow/tree/main/projects/llm_framework/include/sherpa
  • sherpa-ncnn
  • sherpa-onnx

ONNX Runtime

SentencePiece

eventpp?

zmq? (libzmq)