Crawler & Scraper

Adafruit.com web_crawling and scraping

Working application to crawl and scrap a website http://www.adafruit.com/categories written in the flask framework with sqlite3 as a database.

Front-end has been enhanced with materialize CSS and js library with a few other routes of Top Seller, Out Of Stock, Common items

with a custom SQL query box.

The backend logic @('/') default option invoked when download button is clicked. The python 3 code crawl 35 various categories

and scrap all links with beautifulsoup4 and requests packages.

The data of each product is feed into the following table schema defined in sqlite3.

______________________________________________________

| Category | ID | Name | Price | Quantity | Stock |

-------------------------------------------------------