ricdomolm commited on
Commit
8daa80b
·
verified ·
1 Parent(s): 0e911e9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -38,7 +38,7 @@ This example shows how to generate SWE-bench trajectories using [mini-swe-agent]
38
  First, launch a vLLM server with your chosen model. For example:
39
 
40
  ```bash
41
- vllm serve ricdomolm/mini-coder-1.7b &
42
  ```
43
 
44
  By default, the server will be available at `http://localhost:8000`.
@@ -47,7 +47,7 @@ Second, edit the mini-swe-agent SWE-bench config file located in `src/minisweage
47
 
48
  ```yaml
49
  model:
50
- model_name: "hosted_vllm/ricdomolm/mini-coder-1.7b" # or hosted_vllm/path/to/local/model
51
  model_kwargs:
52
  api_base: "http://localhost:8000/v1" # adjust if using a non-default port/address
53
  ```
@@ -57,8 +57,8 @@ Create a litellm `registry.json` file:
57
  ```bash
58
  cat > registry.json <<'EOF'
59
  {
60
- "ricdomolm/mini-coder-1.7b": {
61
- "max_tokens": 40960,
62
  "input_cost_per_token": 0.0,
63
  "output_cost_per_token": 0.0,
64
  "litellm_provider": "hosted_vllm",
 
38
  First, launch a vLLM server with your chosen model. For example:
39
 
40
  ```bash
41
+ vllm serve ricdomolm/mini-coder-4b &
42
  ```
43
 
44
  By default, the server will be available at `http://localhost:8000`.
 
47
 
48
  ```yaml
49
  model:
50
+ model_name: "hosted_vllm/ricdomolm/mini-coder-4b" # or hosted_vllm/path/to/local/model
51
  model_kwargs:
52
  api_base: "http://localhost:8000/v1" # adjust if using a non-default port/address
53
  ```
 
57
  ```bash
58
  cat > registry.json <<'EOF'
59
  {
60
+ "ricdomolm/mini-coder-4b": {
61
+ "max_tokens": 64000,
62
  "input_cost_per_token": 0.0,
63
  "output_cost_per_token": 0.0,
64
  "litellm_provider": "hosted_vllm",