Skip to content
Open
Changes from 6 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 6 additions & 3 deletions demos/integration_with_OpenWebUI/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -363,7 +363,7 @@ mcpo --port 9000 -- python -m mcp_weather_server

## Using Web Search

### Step 1: Configure WebSearch
### Step 1: Configure Web Search

1. Go to **Admin Panel** → **Settings** → **Web Search**
2. Enable **Web Search**
Expand Down Expand Up @@ -474,19 +474,22 @@ Next, download and add to config model for transcription:
:::{tab-item} Windows
:sync: Windows
```bat
ovms.exe --pull --source_model OpenVINO/whisper-base-fp16-ov --model_repository_path models --task speech2text
ovms.exe --pull --source_model OpenVINO/whisper-base-fp16-ov --model_repository_path models --task speech2text --target_device GPU
ovms.exe --add_to_config --config_path models\config.json --model_path OpenVINO\whisper-base-fp16-ov --model_name OpenVINO/whisper-base-fp16-ov
```
:::
:::{tab-item} Linux (using Docker)
:sync: Linux
```bash
docker run --rm -u $(id -u):$(id -g) -v $PWD/models:/models openvino/model_server:2026.1-gpu --pull --source_model OpenVINO/whisper-base-fp16-ov --model_repository_path /models --task speech2text
docker run --rm -u $(id -u):$(id -g) --device /dev/dri --group-add=$(stat -c "%g" /dev/dri/render* | head -n 1) -v $PWD/models:/models openvino/model_server:2026.1-gpu --pull --source_model OpenVINO/whisper-base-fp16-ov --model_repository_path /models --task speech2text --target_device GPU
docker run --rm -u $(id -u):$(id -g) -v $PWD/models:/models openvino/model_server:2026.1-gpu --add_to_config --config_path /models/config.json --model_path OpenVINO/whisper-base-fp16-ov --model_name OpenVINO/whisper-base-fp16-ov
```
:::
::::

> **Note:** Family of Whisper models (except Whisper-large) can be also deployed on NPU or CPU devices by just changing the --target_device parameter.
Comment thread
przepeck marked this conversation as resolved.


### Step 2: Audio Settings

1. Go to **Admin Panel** → **Settings** → **Audio**
Expand Down