Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
mheinzinger authored Jun 2, 2022
1 parent 6a680c3 commit 82a268e
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion Fine-Tuning/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
Important Notes:
----------------
1. This are examples for fine-tuning the whole pretrained models, and not feature extraction.
0. The notebooks are only for illustrative purposes; mind that ProtT5 outperformed ProtBert in all our benchmarks [use-cases](https://github.com/agemagician/ProtTrans#-use-cases)
1. These are examples for fine-tuning the whole pretrained models, and not feature extraction.
2. If you are intersted on using feature extraction as mentioned on the paper, please refer to the [embeding section](https://github.com/agemagician/ProtTrans/tree/master/Embedding) .
3. You must not freeze the pretrained models, otherwise, you will get worse results.
4. Applying hyperparameter search (learning rate, seed, number of epochs, etc.) should give you better results than the mentioned results.
Expand Down

0 comments on commit 82a268e

Please sign in to comment.