Add wandb (Weights & Biases) pip package to proxy Docker image
#3654
Conversation
I'd like to try the [Weights & Biases integration](https://docs.litellm.ai/docs/observability/wandb_integration). I'm using the standard Docker image (e.g.: `ghcr.io/berriai/litellm:main-v1.37.9-stable`). If I add this to the proxy config: ```yaml success_callback: ["wandb"] ``` then I get this error: ```pytb File "/usr/local/lib/python3.11/site-packages/litellm/proxy/proxy_server.py", line 3342, in startup_event proxy_logging_obj._init_litellm_callbacks() # INITIALIZE LITELLM CALLBACKS ON SERVER STARTUP <- do this to catch any logging errors on startup, not when calls are being made ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/litellm/proxy/utils.py", line 166, in _init_litellm_callbacks litellm.utils.set_callbacks(callback_list=callback_list) File "/usr/local/lib/python3.11/site-packages/litellm/utils.py", line 7365, in set_callbacks raise e File "/usr/local/lib/python3.11/site-packages/litellm/utils.py", line 7339, in set_callbacks weightsBiasesLogger = WeightsBiasesLogger() ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/litellm/integrations/weights_biases.py", line 190, in __init__ raise Exception( Exception: wandb not installed, try running 'pip install wandb' to fix this error ERROR: Application startup failed. Exiting. ``` So I propose to add `pip install wandb` to the `Dockerfile`. It's not excessively large: ```shell $ du -sh $VIRTUAL_ENV/lib/python3.12/site-packages/wandb 31M /Users/abramowi/Library/Caches/pypoetry/virtualenvs/litellm-Fe7WjZrx-py3.12/lib/python3.12/site-packages/wandb ```
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
|
@krrishdholakia: Did you see this one? |
|
Not yet - finishing up a PR - will review after (in an hour) cc: @ishaan-jaff |
|
@msabramo instead of adding a new dependency we've decided to move to using Is this an urgent need ? Happy to prioritize it accordingly |
Oh okay. Not an urgent need at all. You can take your time on that. |
|
It looks like the LangSmith integration doesn't require a separate package and just uses |
|
@msabramo we highly recommend Langfuse if you're trying to Log LLM I/O https://docs.litellm.ai/docs/proxy/logging#logging-proxy-inputoutput---langfuse It's our most used and best tested integration |
|
closing since we discussed other options |
I'd like to try the Weights & Biases integration. I'm using the standard Docker image (e.g.:
ghcr.io/berriai/litellm:main-v1.37.9-stable). If I add this to the proxy config:then I get this error:
So I propose to add
pip install wandbto theDockerfile.It's not excessively large:
$ du -sh $VIRTUAL_ENV/lib/python3.12/site-packages/wandb 31M /Users/abramowi/Library/Caches/pypoetry/virtualenvs/litellm-Fe7WjZrx-py3.12/lib/python3.12/site-packages/wandb