about

this app helps you to collect PUBLIC DATA from sheypoor posts with json format

requirements

• npm
• nodejs

npm dependencies

• axios
• cheerio
• express

install

git clone "https://github.com/DevsHashtag/sheypoor-post-collector.git"

cd sheypoor-post-collector

npm install

npm run server

goto: http://localhost:8080/

how to use

1. select a city
   

2. set start page, end page that you want to download posts ( min: 1, max: 10000)
   

3. click on جستجو(search) and wait for app to download data
   

4. after a while you can see data loaded for each page
   

5. you can click on download button at any moment or you can wait for app to finish downloading
   

6. you can go back if you want and start over but all downloaded posts will be lost unless you downloaded it as json
   
   

Errors

due to api limit after a while you'll get a error message ( every 10 page ) and you have to change your ip to continue:

• if you are with wifi you have to restart you'r wifi to get new ip
• if you are with mobile networks you have to simply turn off and turn on your mobile data

click on continue to download other pages

if you dont have internet turn on, you'll get this error and app is waiting for you to turn it on

screenshots

more screenshots