Code

Add DINOv2 model#334

Code

Merged

jonatanklosko merged 35 commits intoelixir-nx:mainelixir-nx/bumblebee:mainfrom joelpaulkoch:DinoV2joelpaulkoch/bumblebee:DinoV2Copy head branch name to clipboardFeb 21, 2024

+952-73

Commits

Commits on Feb 6, 2024

• Add BitFeaturizer

  joelpaulkoch

  committed
  91cce58

  Copy full SHA for 91cce58

• Refactor to pipeline

  joelpaulkoch

  committed
  434b854

  Copy full SHA for 434b854

• Add test for BitFeaturizer

  joelpaulkoch

  committed
  bb016ef

  Copy full SHA for bb016ef

Commits on Feb 7, 2024

• Base version of DINOv2, with pooling

  joelpaulkoch

  committed
  981920a

  Copy full SHA for 981920a

Commits on Feb 8, 2024

• Interpolate positional encodings

  joelpaulkoch

  committed
  e0b635d

  Copy full SHA for e0b635d

• Rename variables

  joelpaulkoch

  committed
  397f79c

  Copy full SHA for 397f79c

• Return hidden_states as feature map

  joelpaulkoch

  committed
  6cb14fe

  Copy full SHA for 6cb14fe

Commits on Feb 9, 2024

• Apply layernorm and reshape feature maps

  joelpaulkoch

  committed
  3fc47e3

  Copy full SHA for 3fc47e3

• Image classification with dinov2

  joelpaulkoch

  committed
  6acadf8

  Copy full SHA for 6acadf8

• Update tests

  joelpaulkoch

  committed
  04e679f

  Copy full SHA for 04e679f

• Remove comments

  joelpaulkoch

  committed
  f695c04

  Copy full SHA for f695c04

• Clean up configuration

  joelpaulkoch

  committed
  11514bc

  Copy full SHA for 11514bc

• Make pipeline

  joelpaulkoch

  committed
  49f6133

  Copy full SHA for 49f6133

• Add mapping for DinoV2Backbone

  joelpaulkoch

  committed
  f1f36eb

  Copy full SHA for f1f36eb

Commits on Feb 11, 2024

• Add swiglu ffn layer

  joelpaulkoch

  committed
  ede347b

  Copy full SHA for ede347b

Commits on Feb 14, 2024

• Extracted scale layer from ffn

  joelpaulkoch

  committed
  657f950

  Copy full SHA for 657f950

• Refactor ffns

  joelpaulkoch

  committed
  8b332db

  Copy full SHA for 8b332db

• Rename block type

  joelpaulkoch

  committed
  5335d6b

  Copy full SHA for 5335d6b

• Refactor

  joelpaulkoch

  committed
  95004b8

  Copy full SHA for 95004b8

• Update docs

  joelpaulkoch

  committed
  18d8744

  Copy full SHA for 18d8744

• Refactor param naming

  joelpaulkoch

  committed
  3cc1622

  Copy full SHA for 3cc1622

• Floor instead of round in swiglu

  joelpaulkoch

  committed
  9b79e82

  Copy full SHA for 9b79e82

Commits on Feb 16, 2024

• Merge branch 'main' into DinoV2

  joelpaulkoch

  committed
  84f4d9c

  Copy full SHA for 84f4d9c

• Use new size representation

  joelpaulkoch

  committed
  43d7e12

  Copy full SHA for 43d7e12

• Support interpolation for rectangular input

  joelpaulkoch

  committed
  4502953

  Copy full SHA for 4502953

Commits on Feb 19, 2024

• Updates

  jonatanklosko

  committed
  1874e97

  Copy full SHA for 1874e97

• Updates

  jonatanklosko

  committed
  2da7db4

  Copy full SHA for 2da7db4

Commits on Feb 20, 2024

• Refactor transformer blocks

  jonatanklosko

  committed
  45e36c6

  Copy full SHA for 45e36c6

• Support custom block function

  jonatanklosko

  committed
  21c1df0

  Copy full SHA for 21c1df0

• Refactor ffn

  jonatanklosko

  committed
  2e56d04

  Copy full SHA for 2e56d04

• Rename test file

  jonatanklosko

  committed
  f148ed1

  Copy full SHA for f148ed1

• Updates

  jonatanklosko

  committed
  9e23241

  Copy full SHA for 9e23241

Commits on Feb 21, 2024

• Update feature maps

  jonatanklosko

  committed
  6cb23cc

  Copy full SHA for 6cb23cc

• Naming

  jonatanklosko

  committed
  041b8a7

  Copy full SHA for 041b8a7

• Up

  jonatanklosko

  committed
  a46083b

  Copy full SHA for a46083b