Improve robust for llm service

PaddlePaddle · jiangjiajun · Dec 14, 2023 · Nov 8, 2023 · Nov 8, 2023 · Nov 8, 2023
commit 7b657959cd93fd7a778917d6546eee00abdfbab3
diff --git a/llm_ic/README.md b/llm_ic/README.md
diff --git a/llm_ic/fastdeploy_ic/__init__.py b/llm_ic/fastdeploy_ic/__init__.py
diff --git a/llm_ic/fastdeploy_ic/config.py b/llm_ic/fastdeploy_ic/config.py
diff --git a/llm_ic/fastdeploy_ic/data/__init__.py b/llm_ic/fastdeploy_ic/data/__init__.py
diff --git a/llm_ic/fastdeploy_ic/data/manager.py b/llm_ic/fastdeploy_ic/data/manager.py
diff --git a/llm_ic/fastdeploy_ic/proto/__init__.py b/llm_ic/fastdeploy_ic/proto/__init__.py
diff --git a/llm_ic/fastdeploy_ic/proto/ic.proto b/llm_ic/fastdeploy_ic/proto/ic.proto
diff --git a/llm_ic/fastdeploy_ic/proto/ic_pb2.py b/llm_ic/fastdeploy_ic/proto/ic_pb2.py