Update README.md
Browse files
README.md
CHANGED
|
@@ -153,7 +153,6 @@ You can serve the model as an API compatible with OpenAI clients:
|
|
| 153 |
|
| 154 |
vllm serve "Applied-Innovation-Center/Karnak" \
|
| 155 |
--trust-remote-code \
|
| 156 |
-
--max-model-len 20000 \
|
| 157 |
--dtype bfloat16 \
|
| 158 |
--port 8000
|
| 159 |
```
|
|
|
|
| 153 |
|
| 154 |
vllm serve "Applied-Innovation-Center/Karnak" \
|
| 155 |
--trust-remote-code \
|
|
|
|
| 156 |
--dtype bfloat16 \
|
| 157 |
--port 8000
|
| 158 |
```
|