Skip to content

Releases: BlinkDL/RWKV-LM

RWKV-v5

16 Dec 10:44
@BlinkDL BlinkDL
5.00
9eabe76
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
RWKV-v5 Latest
Latest

stable release for rwkv v5

Assets 2

RWKV-v4neo

06 Dec 00:28
@BlinkDL BlinkDL
4.00
a39a175
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
RWKV-v4neo

Just a stable release.

Assets 2

RWKV v2 - RNN with Transformer Performance

25 Mar 17:20
@BlinkDL BlinkDL
2.00
88e921b
Compare
Choose a tag to compare
RWKV v2 - RNN with Transformer Performance

Attached model : ctx1024-layer6-emb512 on enwik8 with 1.65 dev perplexity (0.72 BPC)

Assets 3

0.02

25 Aug 15:05
@BlinkDL BlinkDL
0.02
619ed00
Compare
Choose a tag to compare
0.02

v0.02 with RWKV, MHA_shift, MHA_rotary, MHA_pro, and time-shift mixing.

Assets 2

0.01

13 Aug 15:58
@BlinkDL BlinkDL
0.01
3b9005e
Compare
Choose a tag to compare
0.01

first release with RWKV, MHA_rotary, MHA_pro, and time-shift mixing.

Assets 2