Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some info for later #1

Open
N-Demir opened this issue Jan 2, 2024 · 0 comments
Open

Some info for later #1

N-Demir opened this issue Jan 2, 2024 · 0 comments

Comments

@N-Demir
Copy link

N-Demir commented Jan 2, 2024

I read a bit about prefect work pools and workers. Here is some off the cuff information to save for later if I return to it:

.serve is a simple way to both update the prefect API with the latest deployments / flow definitions but also to start a process that waits for flow runs to be launched and runs them locally.
limitations in what it can do, and mostly seems to be a way to get started quickly

The level up is to separate the workers that actually run the jobs from where they are configed. You do this by creating a work pool which either your own workers listen to or more automatic workers that can run code on things like google cloud run listen to.
The work pool is managed as part of prefect cloud I think

It seems like the better long term way to define and work with prefect is through the cli prefect deploy and a yaml config file prefect.yaml.

Still overwhelming how many different ways there are to work with prefect, you really need your blinders on and ignore the "deployment blocks" "agents" etc etc stuff that doesn't matter and is just other ways to use prefect

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant