最終更新:2024-04-05 (金) 11:10:04 (13d)  

RWKV
Top / RWKV

Parallelizable RNN with Transformer-level LLM Performance

ルワクフ (pronounced RwaKuv?)

https://www.rwkv.com/

https://wiki.rwkv.com/

https://github.com/BlinkDL/RWKV-LM

プロジェクト

RWKV-Runner?

  • RWKV GUI with one-click install and API for v4 v5 v6

RWKV pip package

  • Official RWKV pip package for v4 v5 v6

RWKV-server?

  • Fast GPU inference server (nvidia/amd/intel) for v4 v5 v6

rwkv.cpp

  • Fast CPU/cuBLAS/CLBlast inference, int4/int8/fp16/fp32 for v4 v5

RWKV-LM?

  • Training RWKV v4 v5 v6

nanoRWKV?

  • Simple training, for any GPU / CPU

バージョン

RWKV-6?

RWKV-5

RWKV-4

  • 0.4B?14B?

関連