Stock Data Scraper

Developed a script that can scrape important metrics for various stocks based on their market capitalization.

Demo video

Source code

Features

  • Developed a utility that gets information about various stocks like their past 3 days’ price, sector, valuation ratios, profit ratios, and debt ratios, and saves them into a csv.
  • It can also gather the top 500 stocks based on their market capitalization
  • Made the data crawler multi-threaded which improved the performance by 100%

Technologies used

  • Languages: Python
  • Libraries: BeautifulSoup, Selenium, Requests
  • Tools: Insomnia, Google Web Developer Tools