EXPANSION SCRAPER

Expansion is the large database of companies and people working history. Our customers wanted to obtain information about all companies in Spain and scrape people working in them. For companies we scraped legal information, address, phone, sales rank, number of employers, share capital and public financial data. For persons we scraped their positions and working history.

The scraper was implemented with multiple threads to scrape data with the highest possible performance. The scraper used proxies in order to hide scraping activity and imitate humans. Total we collected about 1 million records for companies.

HIGHLIGHTS

PHP

MongoDB

Proxies