Using lcurl, you need to install first lcurl
Crowling domain: -cuts all style -cuts all script -cuts all HTML tags -gets all words -gets all links -formats all links -calls all links -saves all words found in the html into a file
Compile in linux with: gcc -o crowler crowler.c -lcurl