Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add base code for scraping articles #16

Open
kggold4 opened this issue Mar 29, 2023 · 0 comments
Open

add base code for scraping articles #16

kggold4 opened this issue Mar 29, 2023 · 0 comments
Assignees
@kggold4 @TalSomech
Labels
enhancement New feature or request

Comments

@kggold4
Copy link
Member

kggold4 commented Mar 29, 2023

No description provided.

@kggold4 kggold4 added the enhancement New feature or request label Mar 29, 2023
kggold4 added a commit that referenced this issue Apr 16, 2023
@kggold4
(#16)
fc0d47e 
* Change name of scraper_component to scraper_driver
* Start implement scraper logic
kggold4 added a commit that referenced this issue Apr 16, 2023
@kggold4
(#16)
e9e8d4e 
* Change name of scraper_component to scraper_driver
* Start implement scraper logic
kggold4 added a commit that referenced this issue Apr 16, 2023
@kggold4
(#16)
7556566 
* Update `websites_scrapers_factory` doc
kggold4 added a commit that referenced this issue Apr 27, 2023
@kggold4
(#16)
3162818 
* Start implement `bbc` scraper and logic_scraper
* Update scrapers README.md
* Add `Task` object
kggold4 added a commit that referenced this issue Apr 29, 2023
@kggold4
(#16)
bc24011 
* Create `db_utils` in `server_utils`
* Create `validation_utils` in `server_utils`
* Continue implement logic scraper
kggold4 added a commit that referenced this issue Apr 30, 2023
@kggold4
(#16)
ccf3b23 
* Add statuses to db consts
kggold4 added a commit that referenced this issue May 10, 2023
@kggold4
(#16)
6153f4a 
* Update `Article` data class
* Start implement bbc article data scraper
* Fix consts
* Move general server functions to server utils
* Create base methods for `WebsiteScraperBase`
kggold4 added a commit that referenced this issue May 10, 2023
@kggold4
(#16)
48703fb 
* Done implement bbc scraper
* Add `article_utils` class into `db_utils`
* Fix `Article` data class object
* Improve scrapers logic run file
* Update `website_scraper_base.py` methods
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kggold4 kggold4

@TalSomech TalSomech

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kggold4 @TalSomech