Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sparknlp 1060 implement phi 3.5 vision #14444

Open
wants to merge 28 commits into
base: master
Choose a base branch
from
Open

Sparknlp 1060 implement phi 3.5 vision #14444

wants to merge 28 commits into from

Conversation

prabod
Copy link
Contributor

@prabod prabod commented Oct 29, 2024 •
edited
Loading

This PR Integrates Phi3 Vision family models into SparkNLP

Screenshots (if appropriate):

Types of changes

  • Code improvements with no or little impact
  • New feature (non-breaking change which adds functionality)

Checklist:

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING page.
  • I have added tests to cover my changes.
  • All new and existing tests passed.

maziyarpanahi and others added 22 commits November 8, 2024 06:34
@maziyarpanahi @prabod
Add a new llama_cpp engine (#14436)
317abf9
@AbdullahMubeenAnwar @prabod
tasks-docs-integration (#14428)
4be100e 
* Update navigation.yml

Adding "- Tasks" page to SparkNLP Docs

* adding task files
@danilojsl @prabod
Introducing BertForMultipleChoice transformer (#14435)
11a7fd9 
* [SPARKNLP-1084] Introducing BertForMultipleChoice

* [SPARKNLP-1084] Introducing BertForMultipleChoice transformer
@maziyarpanahi @prabod
fixing the missing import
12c1014
@DevinTDHa @prabod
Fix pretrained models not being found on dbfs systems (#14438)
93f383e
@DevinTDHa @prabod
[SPARKNLP-1067] PromptAssembler (#14439)
cea9cf5 
* [SPARKNLP-1067] PromptAssembler Prototype

* [SPARKNLP-1067] PromptAssembler Scala Side

* [SPARKNLP-1067] PromptAssembler Python Side

* [SPARKNLP-1067] Add example for PromptAssembler

* [SPARKNLP-1067] Add documentation for PromptAssembler

* [SPARKNLP-1067] Update llamacpp dependency

* Switch to slowtest for promptasssembler
@danilojsl @prabod
[SPARKNLP-1084] Adding notebooks for BertForMultipleChoice
93e029d
@maziyarpanahi @prabod
name llama_cpp to llamacpp engine
fcfdcd6
@maziyarpanahi @prabod
add a default engine to the AutoGGUFModel
2f778ed
@maziyarpanahi @prabod
Bump to 5.5.1 and update CHANGELOG [run doc]
2e4e354
@actions-user @prabod
Update Scala and Python APIs
b2e429f
@maziyarpanahi @prabod
release conda 5.5.1 [skip test]
21647e5
@maziyarpanahi @prabod
Fix tasks path in navigation
0f3e657
@prabod
Phi3V preprocessing utils
3c5994e
@prabod
added phi3v
737b1b0
@prabod
add phi3v scala API
67bc194 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod
Added tests
f2e3480 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod
Phi3V python api and tests
25580a9 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod
added byte fallback
3a9cae6 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod
changed to pretrained
0bb77b9 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod
export notebook
bfaf0ec 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod
updated testes
f7e6d2d 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod prabod force-pushed the SPARKNLP-1060-Implement-Phi-3.5-Vision branch from 30364b2 to f7e6d2d Compare November 8, 2024 06:36
@prabod prabod marked this pull request as ready for review November 8, 2024 06:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@maziyarpanahi maziyarpanahi Awaiting requested review from maziyarpanahi

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@prabod @danilojsl @maziyarpanahi @AbdullahMubeenAnwar @DevinTDHa @actions-user