最終更新:2025-01-17 (金) 16:24:25 (7d)  

llm-qwen2.5-1.5B-ax630c_0.3-m5stack1_arm64.deb
Top / llm-qwen2.5-1.5B-ax630c_0.3-m5stack1_arm64.deb

M5ModuleLLM (Arduinoのライブラリの修正)

  • https://github.com/m5stack/M5Module-LLM/blob/main/src/api/api_llm.cpp#L50 の
  • ApiLlm?::setupの中でやっている_module_msg->sendCmdAndWaitToTakeMsg?のタイムアウトが10秒になっていて、llm.setup時にllm_work_idを取得するのにタイムアウトしてしまっているため、タイムアウト時間を延ばす 
        _module_msg->sendCmdAndWaitToTakeMsg(
        cmd.c_str(), request_id,
        [&llm_work_id](ResponseMsg_t& msg) {
            // Copy work id
            llm_work_id = msg.work_id;
        },
-        10000);
+        60000);
  • 書き換えるファイルの場所
    • %USERPROFILE%\Documents\Arduino\libraries\M5ModuleLLM\src\api\api_llm.cpp
↑

トークナイザ

  • Module LLM/Ubuntu/opt/m5stack/scripts/qwen2.5-1.5B-ax630c_tokenizer.py? (lib-llm_1.4-m5stack1_arm64.deb)
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/tokenizer?
↑

中身

  • Module LLM/Ubuntu/opt/m5stack/data
  • Module LLM/Ubuntu/opt/m5stack/data/models
  • Module LLM/Ubuntu/opt/m5stack/data/models/mode_qwen2.5-1.5B-ax630c.json
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/hashes.txt?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/model.embed_tokens.weight.bfloat16.bin?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l0_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l10_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l11_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l12_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l13_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l14_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l15_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l16_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l17_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l18_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l19_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l1_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l20_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l21_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l22_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l23_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l24_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l25_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l26_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l27_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l2_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l3_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l4_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l5_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l6_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l7_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l8_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_p128_l9_together.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/qwen2_post.axmodel?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/tokenizer?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/tokenizer/config.json?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/tokenizer/configuration.json?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/tokenizer/generation_config.json?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/tokenizer/tokenizer.json?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/tokenizer/tokenizer_config.json?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/tokenizer/vocab.json?
  • Module LLM/Ubuntu/opt/m5stack/data/qwen2.5-1.5B-ax630c/version?



検索：