You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Implement Process (currently it's called Spider, but i think it makes more sense if we call it process since it's a process), for each crawling process.
Implement Crawler class
Implement the functionality of appending all those process, like a router configuration in fastapi.
Initiate all process to rocketry task to write print("Hello fastcrawler") on console, present it to a team member confirming your work in progress.
Implement the functionality of making request, in minimal version, no feature for now. let's KISS :)
Parse the result and print it on console. Catch all errors in memory for now if there's any.
Be friendly to uvicorn (async serve) to run the crawler with uvicorn.
This issue shall be started to work when schedule is merged
The text was updated successfully, but these errors were encountered:
Core functionality should be:
This issue shall be started to work when schedule is merged
The text was updated successfully, but these errors were encountered: