Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set-of-Mark Prompting (via Segment-Anything-Model) + GPT4-V #527

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

abrichr
Copy link
Contributor

@abrichr abrichr commented Nov 21, 2023

Work-in-progress.

Related: https://github.com/OpenAdaptAI/SoM

sam_mixin.py:

image

image

Scratch:

Via https://huggingface.co/spaces/Roboflow/SoM :

image

gpt4v_coords.py:

image image

gpt4v_grid.py:

image image

Addresses #513

@abrichr abrichr mentioned this pull request Nov 21, 2023
Copy link

sweep-ai bot commented Nov 21, 2023

Apply Sweep Rules to your PR?

  • Apply: All new business logic should have corresponding unit tests.
  • Apply: Refactor large functions to be more modular.
  • Apply: Add docstrings to all functions and file headers.

@abrichr abrichr changed the title GPT4-V experiments State-of-Mark Prompting (via Segment-Anything-Model) + GPT4-V Dec 10, 2023
@abrichr abrichr changed the title State-of-Mark Prompting (via Segment-Anything-Model) + GPT4-V Set-of-Mark Prompting (via Segment-Anything-Model) + GPT4-V Dec 13, 2023
@abrichr abrichr mentioned this pull request Dec 13, 2023
7 tasks
@abrichr
Copy link
Contributor Author

abrichr commented Dec 25, 2023

Possibly relevant: https://github.com/ksugar/samapi

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant