-
Notifications
You must be signed in to change notification settings - Fork 477
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature Request: Distributed inference API where the "miners" are paid. #556
Comments
NewtonTrendy
changed the title
Feature Request: Paid distributed crypto inference API.
Feature Request: Paid distributed inference API.
Feb 20, 2024
NewtonTrendy
changed the title
Feature Request: Paid distributed inference API.
Feature Request: Distributed inference API where the "miners" are paid.
Feb 20, 2024
Hey @NewtonTrendy I was thinking on similar lines and am working on this. Wanna chat more on discord? |
Hi all, There is one already: https://github.com/hypertensor-blockchain/petals_tensor |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I'm imagining a situation where people can infer for others and make a small profit. In practicality it is similar to, but more useful than, cryptocurrency mining. You would get paid a small amount per percent of a request you inferred by users of the inference API.
If the system was built people could load their own models into the cluster and it would make sure demand is met at market rate. This would improve access for individuals to large compute in projects they want to develop, and would not be a worse use of compute than cryptocurrency mining.
The text was updated successfully, but these errors were encountered: