Pali gemma modeling#1895

Merged

Narsil merged 29 commits intomainfrom

pali-gemma-modeling

May 16, 2024

Commits on May 14, 2024

feat: load and query model

drbh
authored and
Narsil
committed
feat: improve config and refactor

drbh
authored and
Narsil
committed
fix: debugging

drbh
authored and
Narsil
committed
fix: adjust siglip attention

drbh
authored and
Narsil
committed
fix: debug avoid scaling embed

drbh
authored and
Narsil
committed
fix: adjust image and text merge logic

drbh
authored and
Narsil
committed
fix: typo and lint

drbh
authored and
Narsil
committed
fix: adjust inputs_embeds passed to language model and debug

drbh
authored and
Narsil
committed
fix: prefer gemma rotary embed and split attention weight

drbh
authored and
Narsil
committed
fix: small test tweak

drbh
authored and
Narsil
committed
Don't break what's not broken.
Narsil
committed
Back functional gemma.
Narsil
committed
Fixed PaliGemma.
Narsil
committed
fix: apply paligemma template conditionally
drbh
committed
fix: improve pali test and add snapshot
drbh
committed

Commits on May 15, 2024