T.E.D.D. 1140 XXL

T.E.D.D. 1104 S: 138M Parameters. 1.6GB

Hyper Parameters

control_mode: keyboard
cnn_model_name: efficientnet_v2_l
pretrained_cnn: true
encoder_type: transformer
embedded_size: 896
nhead: 8
num_layers_encoder: 4
learning_rate: 1e-05
optimizer_name: adafactor
scheduler_name: cosine
warmup_factor: 0.05
max_epochs: 20
batch_size: 32
mask_prob: 0.2
dropout_cnn_out: 0.3
dropout_encoder: 0.1
dropout_encoder_features: 0.3
positional_embeddings_dropout: 0.1
weight_decay: 1e-3

Accuracy in the test datasets:

	Time	Weather	Micro-Acc K@1	Micro-Acc k@3	Macro-Acc K@1
City	🌞	☀️	53.2	84.4	46.2
City	🌞	☔	51.4	83.4	46.3
City	🌛	☀️	54.3	85.6	46.3
City	🌛	☔	47.3	82.3	49.9
Highway	🌞	☀️	72.7	97.7	40.6
Highway	🌞	☔	70.6	99.3	39.6
Highway	🌛	☀️	77.9	99.3	45.7
Highway	🌛	☔	70.9	97.6	30.8

The release includes the best epoch in the development set and the last epoch.