Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: rewrite in rust #20

Open
wants to merge 35 commits into
base: master
Choose a base branch
from
Open

feat: rewrite in rust #20

wants to merge 35 commits into from

Conversation

erhant
Copy link
Member

@erhant erhant commented Feb 7, 2025

  • Rewrite the launcher in Rust
  • Use inquire for interactive settings
  • Use clap for outermost CLI
  • The env file overwrite for a variable FOO_BAR shall be done such that the last line that start with FOO_BAR= should be replace with the new FOO_BAR=<new-value>.
  • Allow env selection & configuration w.r.t path.
    • Port configuration settings, set to 0 for "random port".
    • Ollama settings
    • Wallet settings
    • Model choice menu
  • Use self_update to update the node when there is a new release.
    • Launcher will update its own binary when it has a new version, but will not restart itself; the updated version will run
    • Compute will be updated by the launcher when it has a new version, and will be restarted
  • Added setup command, which does all settings for a first-time start
  • Add log level editor per module
  • Added measure command to measure & show TPS for Ollama models
  • Add Enum iterator to Ollama Workflow models and use that within the model lister (added with feat: enum iterators andthattoo/ollama-workflows#34)
  • Closes Couldn't get the latest dkn-compute version #11 with a retry mechanism on version checks

@erhant erhant added the enhancement New feature or request label Feb 7, 2025
@erhant erhant self-assigned this Feb 7, 2025
@erhant erhant marked this pull request as ready for review February 20, 2025 14:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Couldn't get the latest dkn-compute version
1 participant