Skip to content

Releases: imcaspar/gpt2-ml

V1.0 Release

29 May 05:06
0140917
Compare
Choose a tag to compare
  • new 1.5B GPT2 pretrained Chinese model ( ~30G corpus, 22w steps )
  • dependencies upgrade
  • change vocab to CLUEVocab ( with some modifies )
  • some bugfixes

GPT2-ML First Pubilc Release

06 Nov 05:48
Compare
Choose a tag to compare

With this release comes the 1.5B pretrained model ( ~15G corpus, 10w steps )