PROXYROLL is a proxy testing and scraping tool. It helps users in their quest for finding and validating proxies from various sources (you can add your own sources) in scraper.py.

The app provides an efficient way to collect and verify the validity of proxies, making it a valuable asset for anyone in need of reliable proxy lists. Here's a breakdown of its key features and usage:

1. Proxy Scraping:

• PROXYROLL can scrape proxies from various websites that offer proxy lists.
• It has a list of predefined URLs to source these proxies, including both HTTP and SOCKS proxies.
• Users can easily update the URL sources for more flexibility.

2. Proxy Testing:

• The main functionality of PROXYROLL is to test the validity of proxies.
• It sends requests through each proxy to a test URL, checking their reachability and responsiveness.
• The tool handles common issues like timeouts and connection errors gracefully.

3. Concurrent Testing:

• To increase efficiency, the app utilizes multithreading.
• Configurable thread counts:
  • Up to 30 threads for proxy scraping
  • Up to 100 threads for proxy testing
• Significantly improved performance with parallel processing

4. Organized Valid Proxy Storage:

• PROXYROLL categorizes valid proxies based on their types (HTTP, SOCKS4, SOCKS5)
• Timestamps added to filenames for better organization
• Automated directory creation and management
• Files are saved in a dedicated 'proxies' folder

5. User-Friendly Logging:

• Comprehensive logging system with both file and console output
• Color-coded progress bars showing real-time scraping and testing progress
• Detailed statistics for each proxy type including:
  • Total proxies scraped
  • Number of valid proxies
  • Success rate percentage
• Beautiful ASCII art interface with welcome message

6. Enhanced Features:

• Improved proxy validation with multiple retry attempts
• Automatic proxy type detection
• Thread-safe file operations
• Better error handling and reporting
• Support for various proxy formats and automatic normalization

7. Technical Specifications:

• Configurable timeout settings
• Support for HTTP, SOCKS4, and SOCKS5 proxies
• Parallel processing for both scraping and testing
• Real-time progress tracking with tqdm
• Automatic proxy format detection and cleaning

Usage:

# To start the proxy scraper:
python main.py

# The script will:
1. Display welcome message
2. Start scraping proxies from all sources
3. Test all scraped proxies
4. Save valid proxies in the 'proxies' folder
5. Show detailed statistics

Output Structure:

PROXYROLL/
├── proxies/
│   ├── http_proxies_YYYYMMDD_HHMMSS.txt
│   ├── socks4_proxies_YYYYMMDD_HHMMSS.txt
│   └── socks5_proxies_YYYYMMDD_HHMMSS.txt
└── scraper.log

Donations

If you feel like showing your love and/or appreciation for this Sipmle project, then how about shouting me a coffee or Milk :)