sglang: [Bug] requires "python-multipart" to be installed with docker image
Checklist
- 1. I have searched related issues but cannot get the expected help.
- 2. The bug has not been fixed in the latest version.
- 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
Describe the bug
I tested sglang in Kubernetes with the minimum configuration below:
containers:
- args:
- --model-path
- /workspace/models/models--facebook--opt-125m
- --served-model-name
- opt-125m
- --host
- 0.0.0.0
- --port
- "8080"
command:
- python3
- -m
- sglang.launch_server
image: lmsysorg/sglang:v0.2.9-cu121
However, it emits error like:
Form data requires "python-multipart" to be installed.
You can install "python-multipart" with:
pip install python-multipart
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/sgl-workspace/sglang/python/sglang/launch_server.py", line 5, in <module>
from sglang.srt.server import launch_server
File "/sgl-workspace/sglang/python/sglang/srt/server.py", line 162, in <module>
async def openai_v1_files(file: UploadFile = File(...), purpose: str = Form("batch")):
File "/usr/local/lib/python3.10/dist-packages/fastapi/routing.py", line 944, in decorator
self.add_api_route(
File "/usr/local/lib/python3.10/dist-packages/fastapi/routing.py", line 883, in add_api_route
route = route_class(
File "/usr/local/lib/python3.10/dist-packages/fastapi/routing.py", line 519, in __init__
self.body_field = get_body_field(dependant=self.dependant, name=self.unique_id)
File "/usr/local/lib/python3.10/dist-packages/fastapi/dependencies/utils.py", line 817, in get_body_field
check_file_field(final_field)
File "/usr/local/lib/python3.10/dist-packages/fastapi/dependencies/utils.py", line 100, in check_file_field
raise RuntimeError(multipart_not_installed_error) from None
RuntimeError: Form data requires "python-multipart" to be installed.
You can install "python-multipart" with:
pip install python-multipart
Based on my understanding, this should be included in the docker image, anything I missed here? Thanks !
Reproduction
Part of the yaml file as described above.
Environment
Running with docker image `lmsysorg/sglang:v0.2.9-cu121`
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 18 (7 by maintainers)
Tested with A10, it works. I can test with T4 once fixed with that arch. Thanks for the feedbacks.