bug -object has no attribute 'lm_head'-

[LeonardRanaldi]

I am testing the BioGPT model with your visualizer. After completing the configuration, I have the following bug: AttributeError: 'BioGptForCausalLM' object has no attribute 'lm_head'

[jalammar]

"lm_head" is a hardcodeed name of the layer at the end of the model. It likely has a different name in bioGPT

[jalammar]

In your local version of the code, try replacing self.model.lm_head here:

ecco/src/ecco/lm.py

Line 399 in 0ef61c5

'lm_head': self.model.lm_head,

It seems BioGPT uses the name self.model.output_projection. Try using it instead of self.model.lm_head