Having trouble running Application within another running loop...

[tumma72]

Hi there,
first compliments for the amazing work everyone did with PTB, it is really well thought through, and very well coded! I have recently started my attempt to integrate the PTB into another application which is already managing the event loop. My intention was to synchronize sending messages on events (which is quite easy using Bot.send_message()) with updating the message queue at the end of every loop. Now without being able to start with Application.run_poll() unless considering going multiple Threads or processes, I was wondering how can I manually get the Application.update_queue to fill and then running the Application.start() to process the queue and get the benefit of the Handlers, without having to write custom code to process the updates.

So far I have managed to use Bot.get_updates() then update the Application.update_queue but when I try to run Application.start() I get a RuntimeError:
RuntimeError: The connection pool was closed while 1 HTTP requests/responses were still in-flight.

In order to initialize the Application outside of the run_poll() context, I have manually used:

try:
  self.application._check_initialized()

except RuntimeError as e:
  print(f"Initializing... {e}")
  await self.application.initialize()

Which seems to execute.

I hope this makes sense, I'll be happy for any advice you can provide.

Best
ANdreaT

[Bibo-Joshi]

Hi, glad that you like the library :)

Application.run_polling is purely optional. It's bascially a thin wrapper that runs

• Application.initalize
• Application.start
• Application.updater.start_polling
• Application.updater.stop
• Application.stop
• Application.shutdown

and blocks the event loop until the user sends a stop signal. The last part is what makes run_polling unsuitable when combining PTB with other asyncio frameworks. In that case, you can just manually call the methods. See also this example, which showcases this in the context of setting up a custom webhook.

[jnxyatmjx]

moreover,

async def downloader(queuq: queue.Queue,app: Application) -> None:
    while True:
        url_ = queuq.get()
        filename_ = dlp_down(url_)
        await app.update_queue.put(VideosUpdate(user_id=9900, filename=filename_))

def downloader_callback(queuq: queue.Queue,app: Application) -> None:
    loop_ = asyncio.new_event_loop()
    asyncio.set_event_loop(loop_)
    loop_.run_until_complete(downloader(queuq ,app))
    loop_.close() 

downloader_callback run in the downloader thread.

[Bibo-Joshi]

I highly recommend not to max asyncio with threading

[jnxyatmjx]

OK,
but how combine long time tasks into PTB and not block PTB event loop?

[jnxyatmjx]

Thank you very much if there are examples for me

[Bibo-Joshi]

Please have a look at https://github.com/python-telegram-bot/python-telegram-bot/wiki/Frequently-requested-design-patterns#running-ptb-alongside-other-asyncio-frameworks and kindly actually read the messages in the thread above. If you have follow-up questions, please open a new thread.