-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DINOv2 - Segmentation #393
Comments
Hi, You cannot use DINOv2 out-of-the-box for segmentation as in SAM. You need to explicitly train DINOv2 + some segmentation head (like a linear layer, or a more complex one like a Mask2Former decoder) to predict a segmentation map. The authors did release some DINOv2 + linear layer and DINOv2 + Mask2Former decoder checkpoints as shown here: https://github.com/facebookresearch/dinov2/blob/main/notebooks/semantic_segmentation.ipynb. |
If i have image embeddings extracted using dinov2 base - then how can use them for image segmentation.
I refered to your dinov2 notebooks - but it was more about finetuning linear head for segmentation.
How to use dinov2 out of the box for segmentation like we use SAM?
The text was updated successfully, but these errors were encountered: