Randomly frozen while downloading files

[scruel]

I found that httpx will be easily hang even I set the timeout parameter...

After debugging, I found that the program will be paused at return self._sslobj.read(len).

Stack trace:

read (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\ssl.py:1168)
recv (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\ssl.py:1295)
read (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpcore\_backends\sync.py:126)
_receive_event (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpcore\_sync\http11.py:224)
_receive_response_headers (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpcore\_sync\http11.py:186)
handle_request (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpcore\_sync\http11.py:113)
handle_request (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpcore\_sync\connection.py:101)
handle_request (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpcore\_sync\connection_pool.py:196)
handle_request (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpx\_transports\default.py:233)
_send_single_request (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpx\_client.py:1015)
_send_handling_redirects (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpx\_client.py:979)
_send_handling_auth (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpx\_client.py:942)
send (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpx\_client.py:914)
request (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpx\_client.py:827)
request (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpx\_api.py:106)
get (\home\scruel\mambaforge\envs\pytorch\lib\python3.11\site-packages\httpx\_api.py:198)

[tomchristie]

Could you provide a reproducible example?

[jokerpwn]

Why not answer discussion #941 ? I met the same problem, it's a bug of httpcore which should be fixed as soon as possilble.

[scruel]

while True:
  httpx.get('https://export.arxiv.org/pdf/2407.18219', timeout=120)
  httpx.get('https://export.arxiv.org/src/2407.18219', timeout=120)

[tomchristie]

@jokerpwn blocked. Off topic & spammy.
If you've got any genuinely useful feedback then be constructive in how you offer it. Otherwise please don't waste our time.

[tomchristie]

@scruel I'm not seeing that reproduce. Perhaps you were being throttled by the server and ending up with a slow download.
Note that timeout=120 will set the connect and socket timeouts - it's not an overall response timeout.

httpcore/httpcore/_backends/sync.py

Lines 125 to 126 in ba3f942

	self._sock.settimeout(timeout)
	return self._sock.recv(max_bytes)

An overall response timeout would be a great feature, and we're looking into it... encode/httpx#1450