Model stability problem

[Xinjie-Wei]

Hi!
Thank you for the great work. I used the mobilevit blocks for my model to low level task. at begin it has good performance , but I get different performance when I run it once again. my model is stable if I remove the mobilevit blocks. Do you know what problem would make the model instability, I use following basic parameter:
max_lr:1e-4
min_lr:1e-6
optim
name: adamw
scheduler:
name: "cosine"
in_channels:96
transformer_dim : 144
ffn_dim = 288
n_transformer_blocks=2

[Xinjie-Wei]

mobilevit blocks num_heads is 4 would be too small?

[sacmehta]

How many epochs are you training?

[Xinjie-Wei]

epochs=3000