Skip to content

Issues: michaelfeil/infinity

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

42 Open 120 Closed
42 Open 120 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

How to disable posthog for send anonymous data to external domain
#428 opened Oct 17, 2024 by AlexBlack2202
1 of 4 tasks
1
Using infinity service with lite-llm help wanted Extra attention is needed
#427 opened Oct 15, 2024 by S1LV3RJ1NX
1
Abstraction for resolve_torch_dtype_device(dtype: Dtype, device: Device) -> tuple[quantization_type, torch.device, torch.dtype]
#424 opened Oct 14, 2024 by michaelfeil
Maintain: Improve the existing PR / issue templates
#416 opened Oct 11, 2024 by michaelfeil
@fadkeabhi
1
Maintainer: Breaking CI / Python installs help wanted Extra attention is needed
#415 opened Oct 11, 2024 by michaelfeil
cli to set max_seq_length = 2048
#411 opened Oct 10, 2024 by Liwan-Chen
1
[Doc] Documentation on how to run infinity on AWS Inf2
#408 opened Oct 8, 2024 by marcomarinodev
10
[Doc] Documentation on how to run infinity on AMD GPU
#400 opened Oct 7, 2024 by tjtanaa
3
Feature : Support SPLADE pooling
#399 opened Oct 7, 2024 by tsensei
2
Better Prometheus metrics: Idea collection thread
#398 opened Oct 5, 2024 by michaelfeil
Add a End-to-end unit test for image embeddings and audio embeddings help wanted Extra attention is needed
#378 opened Sep 24, 2024 by michaelfeil
2
when use engine optimum device tensorrt，startup fail
#372 opened Sep 23, 2024 by weibingo
2 of 4 tasks
5
prepend v1 to OpenAI compatible APIs
#371 opened Sep 22, 2024 by samos123
3
Reranker dynamic quantization help wanted Extra attention is needed
#363 opened Sep 16, 2024 by rawsh-rubrik
1
jinaai/jina-reranker-v1-*-en does not work with optimum
#362 opened Sep 13, 2024 by rawsh
2 of 4 tasks
Issue running cross-encoder onnx model exported with optimum-cli
#361 opened Sep 13, 2024 by rawsh
2 of 4 tasks
2
Write a custom flash-attention function for the deberta model.
#359 opened Sep 12, 2024 by wolfassi123
3 tasks done
1
Question: Support for colbertv2.0 ?
#355 opened Sep 10, 2024 by shatealaboxiaowang
3 tasks
1
Support Integration with KServe help wanted Extra attention is needed
#352 opened Sep 6, 2024 by indranilr
1
Reranker API “top_k” Support
#342 opened Aug 19, 2024 by etwk
5
Add Installation Option to Depend Only on ONNX, Excluding New Torch and CUDA Packages
#332 opened Aug 9, 2024 by bash99
3
Permit loading of models at different precision at load time for sentence_transformers
#331 opened Aug 2, 2024 by dawu415
2
Jina reranker(turbo/tiny) being classified as embedding models
#325 opened Jul 25, 2024 by John42506176Linux
2 of 4 tasks
9
release gpu memory wontfix This will not be worked on
#324 opened Jul 25, 2024 by Myson850
1
get asyncio.exceptions.CancelledError error
#317 opened Jul 22, 2024 by DFanny-5
2 of 4 tasks
4
ProTip! What’s not been updated in a month: updated:<2024-09-17.