diff --git a/README.md b/README.md index f3ad8e6bdc..19b29624fa 100644 --- a/README.md +++ b/README.md @@ -17,6 +17,7 @@ - [Setup](#setup) - [Recommended Install](#recommended-install) - [Using requirements.txt](#using-requirementstxt) + - [Installing custom packages](#installing-custom-packages) - [Run H2O LLM Studio GUI](#run-h2o-llm-studio-gui) - [Run H2O LLM Studio GUI using Docker from a nightly build](#run-h2o-llm-studio-gui-using-docker-from-a-nightly-build) - [Run H2O LLM Studio GUI by building your own Docker image](#run-h2o-llm-studio-gui-by-building-your-own-docker-image) @@ -110,6 +111,18 @@ If you wish to use conda or another virtual environment, you can also install th pip install -r requirements.txt ``` +### Installing custom packages + +If you need to install additional Python packages into your environment, you can do so using pip after activating your virtual environment via ```make shell```. For example, to install flash-attention, you would use the following commands: + +```bash +make shell +pip install flash-attn --no-build-isolation +pip install git+https://github.com/HazyResearch/flash-attention.git#subdirectory=csrc/rotary +``` + +Alternatively, you can also directly install via ```pipenv install package_name```. + ## Run H2O LLM Studio GUI You can start H2O LLM Studio using the following command: