This is a python program which scrapes using beautifulsoup4
,selenim
and requests
the deviantart website for popular steam artworks.
Then using the steam links, it fetches the steam price of the game and saves it to a file.
The program also generates a html file using streamlit
with the data.
Check out the documentation here Documentation
NOTE
- Have an account on deviantart and be logged in.
- Make sure you have the latest version of firefox installed as selenium uses it for logging in.
- Visit the changelog to know what's new in the latest version.
- Visit the Modules page to know more about the modules used in this program.
- Install the requirements using
pip install -r requirements.txt
- Run the program using
python main.py
- Enter your deviantart username and password
- Wait for the program to finish
- The script will automatically open the html file in your default browser
- Visit the external links to view the artworks on steamcardexchange and steam and make your bet.
- 📈📈📈Enjoy!📈📈📈
- You can add new links to the
links.txt
file to scrape more artworks. - You can change the number of links to check by changing the
links_to_scrape
variable in themain.py
file. For example, if you want to scrape 10 links from thelinks.txt
, change thelinks_to_scrape
variable to 10.(Note: The links are scraped in the order they are in thelinks.txt
file. Also make sure that the links are valid and are within the length of the file.) - You can adjust the number of pages to visit by changing the
pages_to_check
variable in themain.py
file. For example, if you want to visit 5 pages per link, change thepages_to_check
variable to 5.
NOTE
- Please note that this program is not affiliated with deviantart in any way.
- This program is made for the sole purpose of learning and is not meant to be used for any other purpose.
NOTE
- Please read the To-do list to know what features are planned for the future.
- This is a work in progress. If you have any suggestions, please let me know. Mail
python -m http.server -b 127.0.0.1 -d docs