regexHunter

regex Hunter- Fast website endpoint sensitive data scraper

The tool in question was created in javascript (node js), python and shell scripting and its main objective is to search for sensitive data and API keys in JavaScript files and HTML pages.

Showcases

File Tracture

One Directory after there must be a list of website file need.

  ├── gospider_domain_list
└── regexHunter(tols)
    ├── package.json
    ├── package-lock.json
    ├── run.sh
    └── tools.js

Features

• Super Faster

Requirement

• node js
• python
• GoSpider Tools

Usage

 (                       )                          
 )\ )                 ( /(               )          
(()/((  (    (    )   )\())  (        ( /(  (  (    
 /(_))\))(  ))\( /(  ((_)\  ))\  (    )\())))\ )(   
(_))((_))\ /((_)\())  _((_)/((_) )\ )(_))//((_|()\  
| _ \(()(_|_))((_)\  | || (_))( _(_/(| |_(_))  ((_) 
|   / _` |/ -_) \ /  | __ | || | ' \))  _/ -_)| '_| 
|_|_\__, |\___/_\_\  |_||_|\_,_|_||_| \__\___||_|   
    |___/                                           


Author: @SecurityTalent
join_us: https://t.me/Securi3yTalent
 
Usage: ./run.sh <inputFilePath> <input_file1> [<input_file2> ...] ** Fast need to sorting url's
Usage: ./run.sh [-h] [-t] [-s] [-i]      example:  run.sh -t | run.sh -s | run.sh -i

Options:
  -h, --help       Display this help message
  -t               Identify the technology used by websites
  -s               Find the endpoint sensitive data
  -i               Convert domains to IP addresses and save to file

Fast need clone the repo

git clone https://github.com/securi3ytalent/regexHunter.git

cd regexHunter

Dependency install

npm i

pip install builtwith

sorting the url's

./run.sh <inputFilePath/gospiderOutputfile.txt>

Find the endpoint sensitive data and API

./run.sh -s

Identify the technology

./run.sh -t

Convert domains to IP addresses

./run.sh -i

License

regexHunter is released under MIT license. See LICENSE.

Buy me a coffee?