0. Data are collected through web scraping, scanning and various other sources. VPNs are used for data collection to avoid exposing our identity. Since 1000s of vpns from various vpn providers are being used, VPN manager a REST web service being developed and used to provide vpns on the request and managing them properly.

   The client is also provided which runs on Linux machine, interacts with vpn manager and make sure all traffic goes only via VPN

0. FlashPoint-Intel

   FlashPoint-Intel data source that provides deep and dark web data through api. These sensitive data are obtained for thousands of domains. Elastic search is used to get information from the raw data and finally aggregated data are stored in postgres. These data are used for building models

   Recorded Futures

   Recorded futures data source also provide dark and deep web data through api. We collect data for all the websites and store raw dump in mongo.

SecurityFocus

The SecurityFocus Vulnerability Database provides security professionals with the most up-to-date information on vulnerabilities for all platforms and services.

These information are being scrapped from the website and used the data for building model.
 

Youtube

Stats of each channels like videos count, view count, comments count, subscriber counts, likes and dislike counts are being collected using youtube api and web scraping.

Vulnerability assessments is one of the crucial factors for scoring the cyber risk. OpenVAS is used to do this Analysis. Scanning is done using Master – Slave architecture where slave does all the scanning and returns results to Master and finally uploaded it to s3.

• ●  Automating the complete OpenVAS setup

• ●  Writing API to manage all operation of Scanning

• ●  Monitoring OpenVAS cluster using Nagios

• ●  Analysing the new vulnerabilities and classifying in

  various categories