Welcome to RWKV-LM Discussions!

[BlinkDL]

👋 Welcome!

We’re using Discussions as a place to connect with other members of our community. We hope that you:

• Ask questions you’re wondering about.
• Share ideas.
• Engage with other community members.
• Welcome others and are open-minded. Remember that this is a community we
  build together 💪.

To get started, comment below with an introduction of yourself and tell us about what you do with this community.

[pfeatherstone]

How do you reckon this model compares to RMT ?

[PicoCreator]

Unfortunately, without a model we can 1:1 compare on similar training dataset (ie. enwiki / the pile). There is no way of knowing as of now.

PS: its generally better to ask such questions on our discord - https://discord.gg/bDSBUMeFpc

[pfeatherstone]

Ah ok. There is an implementation

[wisdoms6969]

D