List of libraries, tools and APIs for web scraping and data processing.

🕷️ An undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy again!

Scalable Python web scraping scripts for +40 popular domains

Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu.

🕷 Automatically detect changes made to the official Telegram sites, clients and servers.

The script for selenium in python. Make automated testing easier! 使用json脚本驱动selenium

A universal solution for web crawling lists. 抓取网页列表的通用解决方案

Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.

Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!

此项目分享安卓逆向的实战案例以及学习笔记，适合新手学习，随着作者逐渐变成大神，这个仓库也会适合大神学习~

Web scraping API for building AI applications.

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

API to parse tibia.com content into python objects.

微博数据采集，微博爬虫，微博网页解析，完整代码（主体内容+评论内容）

项目已经移动至：https://github.com/BaiduSpider/BaiduSpider ！！ 一个爬取百度搜索结果的爬虫，目前支持百度网页搜索，百度图片搜索，百度知道搜索，百度视频搜索，百度资讯搜索，百度文库搜索，百度经验搜索和百度百科搜索。

File Crawler index files and search hard-coded credentials

Free Facebook pages MetaData Scraping Library - Unlimited Calls

Tutorial de raspagem de dados realizado em parceria com a JusBrasil

This package is used to get a profile picture of the LinkedIn user using Google Custom Search API

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖