New multiprocess manager

[abersheeran]

https://github.com/abersheeran/zibai/blob/main/src/zibai/multiprocess.py

I have been using the multi-process manager in runweb for a while now, and it works really well. If there are plans to optimize uvicorn's current multi-process setup, I would be happy to submit a pull request and contribute my experience to uvicorn.

[abersheeran]

cc @encode/maintainers

[Kludex]

Please do. If you can explain everything on the PR, it would be great. 🙏

[ahopkins]

Chiming in to also hear what is planned and offer advice. I went down this route fairly recently as well.

[perinm]

is this a replacement for gunicorn + uvicorn? (meaning we could achieve multiple workers better with just uvicorn now?)
How does this compare over using gunicorn + uvicorn?

[Kludex]

Yes.

[adriangb]

Where are you deploying that you have multiple CPUs available?

[perinm]

Thanks, will test this to compare performance some moment

…

On Wed, May 29, 2024, 10:23 Marcelo Trylesinski ***@***.***> wrote: Yes. — Reply to this email directly, view it on GitHub <#2164 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AGNN2SIKBGKBUVSN2TG7SALZEXJFBAVCNFSM6AAAAAA77I2LM2VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TKOJTHAYTI> . You are receiving this because you commented.Message ID: ***@***.***>

[perinm]

I only have multiple cpu cores, not cpus itself

…

On Wed, May 29, 2024, 19:24 Adrian Garcia Badaracco < ***@***.***> wrote: Where are you deploying that you have multiple CPUs available? — Reply to this email directly, view it on GitHub <#2164 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AGNN2SLH3CD36AI5TZCDOTTZEZIRNAVCNFSM6AAAAAA77I2LM2VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TKOJYHA3TK> . You are receiving this because you commented.Message ID: ***@***.***>

[adriangb]

But is this a bare metal server, an EC2 instance, etc?

[perinm]

EC2, t4g.medium, basically, 2 shared cores of an ARM CPU

[adriangb]

Ok makes sense that you'd want to use multiprocessing then! I just want to make sure you've considered the option of scaling horizontally via your infrastructure provider.

[perinm]

That's very kind of you! Thank you! Yeah, I am in a very early startup, but hopefully in the future I will need to start considering horizontal scaling too :)

[philipbjorge]

How does this compare over using gunicorn + uvicorn?

@Kludex --
Are you able to comment on this question?
We're trying to figure out whether we want to swap to the uvicorn process manager or continue using the gunicorn + uvicorn workers which has been working well for us.