Byte-Vision beta

What is Byte-Vision? Byte-Vision is a llama.cpp testing/workflow GUI application. It is written in Go and uses the Wails framework. The tool was developed to facilitate the tracking of test runs and the easy saving of llama.cpp settings. Existing Python packages did not meet these requirements. The project aims to help other developers understand how llama.cpp functions by providing a straightforward flat project. Llama.cpp offers numerous parameters, and this Go application enables quick model switches, setting changes, and version swaps. Completions and settings are saved in a database, allowing for result comparisons and workflow-specific testing tracking.

Table of Contents

1. Quick tour of GUI
2. Built with
3. Installing and running application in dev.
4. Roadmap
5. Contributing
6. License
7. Contact

Tour of interface features.

Main screen with menu and inference screen.

Settings screen, settings for llama-cli, llama-embedding and various logs.

Llama-cli parameters

Lama-embedding parameters

Llama-cli inference model log.

Embedding screen, settings for CSV embedding, text embedding and document parser.

Doc parser setup.

CSV embedding query.

Text embedding query.

Inference history and compare screen.

Inference history viewer.

Completion diff example.

(back to top)

Built with

• Wails
• Llamacpp
• Chromen-Go
• React
• Go SQL Lite
• Bootstrap 5
• Go-Diff

(back to top)

Installing and running application in dev

To-do

Roadmap

The feature list is the following Finish saving llama-cli settings. Finish saving llama-embedding settings. Finish how-to docs and examples.

See the open issues for a full list of proposed features (and known issues).

(back to top)

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

(back to top)

License

GNU General Public License v3.0

(back to top)

Contact

Kevin Brisson - LinkedIn - [email protected] Project Link: https://github.com/kbrisso/byte-vision

(back to top)