Jupyterhub: idle_culler errors out with tornado-ioloop error

[yashali]

Bug description

[E 250114 23:32:18 ioloop:941] Exception in callback functools.partial(<function cull_idle at 0x7feaec7f3ca0>, url='http://localhost:8081/hub/api', api_token='2f57c9af4794465d92285fcbe4d31b9e', inactive_limit=72000, cull_users=False, remove_named_servers=True, max_age=0, concurrency=10, ssl_enabled=False, internal_certs_location='internal-ssl', cull_admin_users=False, api_page_size=0, cull_default_servers=True, cull_named_servers=True)
Traceback (most recent call last):
File "/usr/local/lib/python3.9/dist-packages/tornado/ioloop.py", line 939, in _run
await val
File "/usr/local/lib/python3.9/dist-packages/jupyterhub_idle_culler/init.py", line 171, in cull_idle
resp = await fetch(HTTPRequest(url=f"{url}/", headers=auth_header))
File "/usr/local/lib/python3.9/dist-packages/jupyterhub_idle_culler/init.py", line 124, in fetch
return await client.fetch(req)
tornado.simple_httpclient.HTTPTimeoutError: Timeout during request

These logs show up on the hub pod and it stops responding to any requests

How to reproduce

Unable to reproduce.
Hub just stops working after we see the error. We didnt see the error when we were on :
jupyterhub-idle-culler==1.3.1
jupyterhub-kubespawner==5.0.0
jupyterhub==4.0.0
tornado==6.4

Actual behaviour

Hub just stops working after we see the error in the logs.

Your personal set up

We have these on our jupyterhub K8s pod:
jupyterhub==4.1.6
jupyterhub-idle-culler==1.4.0
jupyterhub-kubespawner==5.0.0
tornado==6.4
python=3.9

values.yaml ->
cull:
adminUsers: false # --cull-admin-users
removeNamedServers: true # --remove-named-servers
timeout: 72000 # 20hrs
every: 600
concurrency: 10 # --concurrency
maxAge: 0 # --max-age

Please let me know if you need more info. Thanks!

[manics]

This is a duplicate of jupyterhub/jupyterhub-idle-culler#87