Error occurred while running Ollama on Windows Server 2022

[shangguan0755]

The error log is as follows：

C:\Users\Administrator>llm_benchmark run
Total memory size : 383.87 GB
cpu_info: AMD EPYC 7713 64-Core Processor
gpu_info: NVIDIA Tesla T4 Microsoft Remote Display Adapter Microsoft 基本显示适配器 NVIDIA Tesla T4
os_version: Microsoft Windows Server 2022 Standard Evaluation

ollama_version: 0.5.12

LLM models file path：C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\llm_benchmark\data\benchmark_models_32gb_ram.yml
Checking and pulling the following LLM models
phi4:14b
Traceback (most recent call last):

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_transports\default.py", line 72, in map_httpcore_exceptions
yield

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_transports\default.py", line 236, in handle_request
resp = self._pool.handle_request(req)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_sync\connection_pool.py", line 256, in handle_request
raise exc from None

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_sync\connection_pool.py", line 236, in handle_request
response = connection.handle_request(
pool_request.request
)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_sync\connection.py", line 101, in handle_request
raise exc

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_sync\connection.py", line 78, in handle_request
stream = self._connect(request)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_sync\connection.py", line 124, in _connect
stream = self._network_backend.connect_tcp(**kwargs)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_backends\sync.py", line 207, in connect_tcp
with map_exceptions(exc_map):
~~~~~~~~~~~~~~^^^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\contextlib.py", line 162, in exit
self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_exceptions.py", line 14, in map_exceptions
raise to_exc(exc) from exc

httpcore.ConnectError: [WinError 10049] 在其上下文中，该请求的地址无效。

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

File "", line 198, in _run_module_as_main

File "", line 88, in _run_code

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Scripts\llm_benchmark.exe_main_.py", line 7, in
sys.exit(app())
~~~^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\llm_benchmark\main.py", line 52, in run
check_models.pull_models(models_file_path)
~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\llm_benchmark\check_models.py", line 38, in pull_models
ollama.pull(model_name)
~~~~~~~~~~~^^^^^^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\ollama_client.py", line 223, in pull
return self._request_stream(
~~~~~~~~~~~~~~~~~~~~^
'POST',
^^^^^^^
...<6 lines>...
stream=stream,
^^^^^^^^^^^^^^
)
^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\ollama_client.py", line 98, in _request_stream
return self._stream(*args, **kwargs) if stream else self._request(*args, **kwargs).json()
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\ollama_client.py", line 69, in _request
response = self._client.request(method, url, **kwargs)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_client.py", line 837, in request
return self.send(request, auth=auth, follow_redirects=follow_redirects)
~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_client.py", line 926, in send
response = self._send_handling_auth(
request,
...<2 lines>...
history=[],
)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_client.py", line 954, in _send_handling_auth
response = self._send_handling_redirects(
request,
follow_redirects=follow_redirects,
history=history,
)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_client.py", line 991, in _send_handling_redirects
response = self._send_single_request(request)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_client.py", line 1027, in _send_single_request
response = transport.handle_request(request)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_transports\default.py", line 235, in handle_request
with map_httpcore_exceptions():
~~~~~~~~~~~~~~~~~~~~~~~^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\contextlib.py", line 162, in exit
self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_transports\default.py", line 89, in map_httpcore_exceptions
raise mapped_exc(message) from exc

httpx.ConnectError: [WinError 10049] 在其上下文中，该请求的地址无效。

[LeonDBL]

The error log is as follows：

C:\Users\Administrator>llm_benchmark run Total memory size : 383.87 GB cpu_info: AMD EPYC 7713 64-Core Processor gpu_info: NVIDIA Tesla T4 Microsoft Remote Display Adapter Microsoft 基本显示适配器 NVIDIA Tesla T4 os_version: Microsoft Windows Server 2022 Standard Evaluation

ollama_version: 0.5.12

LLM models file path：C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\llm_benchmark\data\benchmark_models_32gb_ram.yml Checking and pulling the following LLM models phi4:14b Traceback (most recent call last):

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_transports\default.py", line 72, in map_httpcore_exceptions yield

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_transports\default.py", line 236, in handle_request resp = self._pool.handle_request(req)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_sync\connection_pool.py", line 256, in handle_request raise exc from None

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_sync\connection_pool.py", line 236, in handle_request response = connection.handle_request( pool_request.request )

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_sync\connection.py", line 101, in handle_request raise exc

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_sync\connection.py", line 78, in handle_request stream = self._connect(request)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_sync\connection.py", line 124, in _connect stream = self._network_backend.connect_tcp(**kwargs)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_backends\sync.py", line 207, in connect_tcp with map_exceptions(exc_map): ~~~~~~~~~~~~~~^^^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\contextlib.py", line 162, in exit self.gen.throw(value) ~~~~~~~~~~~~~~^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpcore_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc

httpcore.ConnectError: [WinError 10049] 在其上下文中，该请求的地址无效。

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

File "", line 198, in _run_module_as_main

File "", line 88, in _run_code

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Scripts\llm_benchmark.exe__main__.py", line 7, in sys.exit(app()) ~~~^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\llm_benchmark\main.py", line 52, in run check_models.pull_models(models_file_path) ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\llm_benchmark\check_models.py", line 38, in pull_models ollama.pull(model_name) ~~~~~~~~~~~^^^^^^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\ollama_client.py", line 223, in pull return self._request_stream( ~~~~~~~~~~~~~~~~~~~~^ 'POST', ^^^^^^^ ...<6 lines>... stream=stream, ^^^^^^^^^^^^^^ ) ^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\ollama_client.py", line 98, in _request_stream return self._stream(*args, **kwargs) if stream else self._request(*args, **kwargs).json() ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\ollama_client.py", line 69, in _request response = self._client.request(method, url, **kwargs)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_client.py", line 837, in request return self.send(request, auth=auth, follow_redirects=follow_redirects) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_client.py", line 926, in send response = self._send_handling_auth( request, ...<2 lines>... history=[], )

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_client.py", line 954, in _send_handling_auth response = self._send_handling_redirects( request, follow_redirects=follow_redirects, history=history, )

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_client.py", line 991, in _send_handling_redirects response = self._send_single_request(request)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_client.py", line 1027, in _send_single_request response = transport.handle_request(request)

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_transports\default.py", line 235, in handle_request with map_httpcore_exceptions(): ~~~~~~~~~~~~~~~~~~~~~~~^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\contextlib.py", line 162, in exit self.gen.throw(value) ~~~~~~~~~~~~~~^^^^^^^

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python313\Lib\site-packages\httpx_transports\default.py", line 89, in map_httpcore_exceptions raise mapped_exc(message) from exc

httpx.ConnectError: [WinError 10049] 在其上下文中，该请求的地址无效。

I might be completely wrong, but I get the same error if ollama isn't running (i.e after I "systemctl stop ollama.service" and try llm_benchmark run).

[chuangtc]

@shangguan0755 Could you make sure ollama is running before you run benchmark tool. In your windows machine, check the bottom right to see if ollama is running. Or you can open a browser, put this url and see if ollama is running or not.
http://127.0.0.1:11434

[DesertCookie]

Running in to, as far as I can tell, the same error on Windows 11 (only on my tower, my laptop does work):

Total memory size : 95.91 GB
cpu_info: AMD Ryzen 9 5950X 16-Core Processor
gpu_info: AMD Radeon RX 7800 XT
os_version: Microsoft Windows 11 Pro

ollama_version: 0.6.5
----------
LLM models file path：C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\llm_benchmark\data\benchmark_models_32gb_ram.yml
Checking and pulling the following LLM models
phi4:14b
Traceback (most recent call last):

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpx\_transports\default.py", line 72, in map_httpcore_exceptions
    yield

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpx\_transports\default.py", line 236, in handle_request
    resp = self._pool.handle_request(req)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpcore\_sync\connection_pool.py", line 256, in handle_request
    raise exc from None

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpcore\_sync\connection_pool.py", line 236, in handle_request
    response = connection.handle_request(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpcore\_sync\connection.py", line 101, in handle_request
    raise exc

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpcore\_sync\connection.py", line 78, in handle_request
    stream = self._connect(request)
             ^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpcore\_sync\connection.py", line 124, in _connect
    stream = self._network_backend.connect_tcp(**kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpcore\_backends\sync.py", line 207, in connect_tcp
    with map_exceptions(exc_map):
         ^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\contextlib.py", line 158, in __exit__
    self.gen.throw(value)

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpcore\_exceptions.py", line 14, in map_exceptions
    raise to_exc(exc) from exc

httpcore.ConnectError: [WinError 10049] Die angeforderte Adresse ist in diesem Kontext ungültig


The above exception was the direct cause of the following exception:


Traceback (most recent call last):

  File "<frozen runpy>", line 198, in _run_module_as_main

  File "<frozen runpy>", line 88, in _run_code

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Scripts\llm_benchmark.exe\__main__.py", line 7, in <module>
    sys.exit(app())
             ^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\llm_benchmark\main.py", line 52, in run
    check_models.pull_models(models_file_path)

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\llm_benchmark\check_models.py", line 38, in pull_models
    ollama.pull(model_name)

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\ollama\_client.py", line 223, in pull
    return self._request_stream(
           ^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\ollama\_client.py", line 98, in _request_stream
    return self._stream(*args, **kwargs) if stream else self._request(*args, **kwargs).json()
                                                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\ollama\_client.py", line 69, in _request
    response = self._client.request(method, url, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpx\_client.py", line 837, in request
    return self.send(request, auth=auth, follow_redirects=follow_redirects)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpx\_client.py", line 926, in send
    response = self._send_handling_auth(
               ^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpx\_client.py", line 954, in _send_handling_auth
    response = self._send_handling_redirects(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpx\_client.py", line 991, in _send_handling_redirects
    response = self._send_single_request(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpx\_client.py", line 1027, in _send_single_request
    response = transport.handle_request(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpx\_transports\default.py", line 235, in handle_request
    with map_httpcore_exceptions():
         ^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\contextlib.py", line 158, in __exit__
    self.gen.throw(value)

  File "C:\Users\Ruben\AppData\Local\Programs\Python\Python312\Lib\site-packages\httpx\_transports\default.py", line 89, in map_httpcore_exceptions
    raise mapped_exc(message) from exc

httpx.ConnectError: [WinError 10049] Die angeforderte Adresse ist in diesem Kontext ungültig

Ollama is running and serving via Open WebUI just fine. The latter runs on my home server, connecting via LAN to Ollama on my Desktop. I enabled external connections on Ollama; everything else is the same to how it's set up on my laptop.