Update README.md
Browse files
README.md
CHANGED
|
@@ -38,7 +38,7 @@ This example shows how to generate SWE-bench trajectories using [mini-swe-agent]
|
|
| 38 |
First, launch a vLLM server with your chosen model. For example:
|
| 39 |
|
| 40 |
```bash
|
| 41 |
-
vllm serve ricdomolm/mini-coder-
|
| 42 |
```
|
| 43 |
|
| 44 |
By default, the server will be available at `http://localhost:8000`.
|
|
@@ -47,7 +47,7 @@ Second, edit the mini-swe-agent SWE-bench config file located in `src/minisweage
|
|
| 47 |
|
| 48 |
```yaml
|
| 49 |
model:
|
| 50 |
-
model_name: "hosted_vllm/ricdomolm/mini-coder-
|
| 51 |
model_kwargs:
|
| 52 |
api_base: "http://localhost:8000/v1" # adjust if using a non-default port/address
|
| 53 |
```
|
|
@@ -57,8 +57,8 @@ Create a litellm `registry.json` file:
|
|
| 57 |
```bash
|
| 58 |
cat > registry.json <<'EOF'
|
| 59 |
{
|
| 60 |
-
"ricdomolm/mini-coder-
|
| 61 |
-
"max_tokens":
|
| 62 |
"input_cost_per_token": 0.0,
|
| 63 |
"output_cost_per_token": 0.0,
|
| 64 |
"litellm_provider": "hosted_vllm",
|
|
|
|
| 38 |
First, launch a vLLM server with your chosen model. For example:
|
| 39 |
|
| 40 |
```bash
|
| 41 |
+
vllm serve ricdomolm/mini-coder-4b &
|
| 42 |
```
|
| 43 |
|
| 44 |
By default, the server will be available at `http://localhost:8000`.
|
|
|
|
| 47 |
|
| 48 |
```yaml
|
| 49 |
model:
|
| 50 |
+
model_name: "hosted_vllm/ricdomolm/mini-coder-4b" # or hosted_vllm/path/to/local/model
|
| 51 |
model_kwargs:
|
| 52 |
api_base: "http://localhost:8000/v1" # adjust if using a non-default port/address
|
| 53 |
```
|
|
|
|
| 57 |
```bash
|
| 58 |
cat > registry.json <<'EOF'
|
| 59 |
{
|
| 60 |
+
"ricdomolm/mini-coder-4b": {
|
| 61 |
+
"max_tokens": 64000,
|
| 62 |
"input_cost_per_token": 0.0,
|
| 63 |
"output_cost_per_token": 0.0,
|
| 64 |
"litellm_provider": "hosted_vllm",
|