Connection error with urllib3

[landemou]

Good morning,
First of all thank you for this great project. I am using whisper v20230124 successfully on ubuntu 20.04 in an off-net venv.
Since then, I wanted to try v20230314 and I always get a connection error related to urllib3.
My question is: is it still possible to use the latest version in an off-grid venv?
I attach the full error message.
Thank you in advance for your help.

Traceback (most recent call last):
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._validate_conn(conn)
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/urllib3/connectionpool.py", line 1042, in _validate_conn
    conn.connect()
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/urllib3/connection.py", line 363, in connect
    self.sock = conn = self._new_conn()
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f18bbd92820>: Failed to establish a new connection: [Errno -2] Name or service not known

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt-2/encodings/main/vocab.bpe (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f18bbd92820>: Failed to establish a new connection: [Errno -2] Name or service not known'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/partage/www/html/whisper-v20230314/bin/whisper", line 8, in <module>
    sys.exit(cli())
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/whisper/transcribe.py", line 437, in cli
    result = transcribe(model, audio_path, temperature=temperature, **args)
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/whisper/transcribe.py", line 142, in transcribe
    tokenizer = get_tokenizer(model.is_multilingual, language=language, task=task)
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/whisper/tokenizer.py", line 385, in get_tokenizer
    encoding = get_encoding(name=encoding_name)
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/whisper/tokenizer.py", line 355, in get_encoding
    pat_str=gpt2()["pat_str"],
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/tiktoken_ext/openai_public.py", line 11, in gpt2
    mergeable_ranks = data_gym_to_mergeable_bpe_ranks(
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/tiktoken/load.py", line 73, in data_gym_to_mergeable_bpe_ranks
    vocab_bpe_contents = read_file_cached(vocab_bpe_file).decode()
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/tiktoken/load.py", line 46, in read_file_cached
    contents = read_file(blobpath)
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/tiktoken/load.py", line 24, in read_file
    return requests.get(blobpath).content
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/requests/api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/partage/www/html/whisper-v20230314/lib/python3.8/site-packages/requests/adapters.py", line 565, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt-2/encodings/main/vocab.bpe (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f18bbd92820>: Failed to establish a new connection: [Errno -2] Name or service not known'))

And the pip list :

certifi 2022.12.7
charset-normalizer 3.1.0
cmake 3.26.0
ffmpeg-python 0.2.0
filelock 3.10.0
future 0.18.3
idna 3.4
importlib-metadata 6.1.0
Jinja2 3.1.2
lit 15.0.7
llvmlite 0.39.1
MarkupSafe 2.1.2
more-itertools 9.1.0
mpmath 1.3.0
networkx 3.0
numba 0.56.4
numpy 1.23.5
nvidia-cublas-cu11 11.10.3.66
nvidia-cuda-cupti-cu11 11.7.101
nvidia-cuda-nvrtc-cu11 11.7.99
nvidia-cuda-runtime-cu11 11.7.99
nvidia-cudnn-cu11 8.5.0.96
nvidia-cufft-cu11 10.9.0.58
nvidia-curand-cu11 10.2.10.91
nvidia-cusolver-cu11 11.4.0.1
nvidia-cusparse-cu11 11.7.4.91
nvidia-nccl-cu11 2.14.3
nvidia-nvtx-cu11 11.7.91
openai-whisper 20230314
pip 20.0.2
regex 2022.10.31
requests 2.28.2
semantic-version 2.10.0
setuptools 67.6.0
setuptools-rust 1.5.2
sympy 1.11.1
tiktoken 0.3.1
torch 2.0.0+cu118
tqdm 4.65.0
triton 2.0.0
typing-extensions 4.5.0
urllib3 1.26.15
wheel 0.40.0
zipp 3.15.0

[LoneWanderer-GH]

same observation here

[Purfview]

It needs internet connection because of this patch: #1044
You can edit tiktoken_ext/openai_public.py file and link the online files to files on your HDD.

Btw, there is "offline" standalone compile if someone needs: https://github.com/Purfview/whisper-standalone-win

[jongwook]

I just made a commit b5851c6 to prevent it to try downloading https://openaipublic.blob.core.windows.net/gpt-2/encodings/main/vocab.bpe , so hopefully this wouldn't be an issue after this fix.

[Purfview]

...so hopefully this wouldn't be an issue after this fix.

No issue anymore. Thanks.

[landemou]

Many thanks for the fix 👌

[suborigin]

i'm still getting this exact error in an off-net environment, with latest version of code.

any ideas?

[Purfview]

i'm still getting this exact error in an off-net environment, with latest version of code.

any ideas?

Make sure you installed repo with latest commits.

[petermoo]

Tested today. Cannot get past 03-14.
pip install --upgrade --no-deps --force-reinstall git+https://github.com/openai/whisper.git
Defaulting to user installation because normal site-packages is not writeable
Collecting git+https://github.com/openai/whisper.git
Cloning https://github.com/openai/whisper.git to /tmp/pip-req-build-984eegv8
Running command git clone --filter=blob:none --quiet https://github.com/openai/whisper.git /tmp/pip-req-build-984eegv8
Resolved https://github.com/openai/whisper.git to commit e334ff1
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Building wheels for collected packages: openai-whisper
Building wheel for openai-whisper (pyproject.toml) ... done
Created wheel for openai-whisper: filename=openai_whisper-20230314-py3-none-any.whl size=798032 sha256=7665e8513c078bf18e2f87136d51dd066f3b126029ab947d630491d728a7ee38
Stored in directory: /tmp/pip-ephem-wheel-cache-xk27_a6o/wheels/8b/6c/d0/622666868c179f156cf595c8b6f06f88bc5d80c4b31dccaa03
Successfully built openai-whisper
Installing collected packages: openai-whisper
Attempting uninstall: openai-whisper
Found existing installation: openai-whisper 20230314
Uninstalling openai-whisper-20230314:
Successfully uninstalled openai-whisper-20230314
Successfully installed openai-whisper-20230314

[mora260]

same for me. This is the last version of whisper that I get when using pip

edit: https://pypi.org/project/openai-whisper/#history ... actually right now that is the latest published version. It seems that if you want the fixed version, you need to dowload the source code