Skip to content

Commit

Permalink
Readme custom packages (#395)
Browse files Browse the repository at this point in the history
  • Loading branch information
psinger authored Sep 1, 2023
1 parent f1539cc commit 427a385
Showing 1 changed file with 13 additions and 0 deletions.
13 changes: 13 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,7 @@
- [Setup](#setup)
- [Recommended Install](#recommended-install)
- [Using requirements.txt](#using-requirementstxt)
- [Installing custom packages](#installing-custom-packages)
- [Run H2O LLM Studio GUI](#run-h2o-llm-studio-gui)
- [Run H2O LLM Studio GUI using Docker from a nightly build](#run-h2o-llm-studio-gui-using-docker-from-a-nightly-build)
- [Run H2O LLM Studio GUI by building your own Docker image](#run-h2o-llm-studio-gui-by-building-your-own-docker-image)
Expand Down Expand Up @@ -110,6 +111,18 @@ If you wish to use conda or another virtual environment, you can also install th
pip install -r requirements.txt
```

### Installing custom packages

If you need to install additional Python packages into your environment, you can do so using pip after activating your virtual environment via ```make shell```. For example, to install flash-attention, you would use the following commands:

```bash
make shell
pip install flash-attn --no-build-isolation
pip install git+https://github.com/HazyResearch/flash-attention.git#subdirectory=csrc/rotary
```

Alternatively, you can also directly install via ```pipenv install package_name```.

## Run H2O LLM Studio GUI

You can start H2O LLM Studio using the following command:
Expand Down

0 comments on commit 427a385

Please sign in to comment.