Github: lorien

Web Scraping Services

Hello. I am an experienced web developer and my main area of expertise is web scraping. I have completed more than 300 web scraping projects.

My experience:

  • Scraping large websites with millions of pages
  • Using proxy lists to bypass website scraping protection
  • Scraping captcha-protected websites
  • Scraping javascript-driven (AJAX) websites
  • Extracting data from API endpoints
  • Processing XML, JSON, and CSV documents
  • Storing and processing data in Redis, MongoDB, MySQL and Postgresql databases
  • Building a web interface to control crawlers
  • Building complex systems to process data from multiple sources

I am author of the open source web scraping framework Grab. I use that framework in most of my web scraping projects.

I would be happy to work on any interesting project related to web scraping and data processing. Feel free to contact me to discuss your project for a quote and estimated time to complete the project.

If you need the software/script/bot to be installed on your server then I am not the right person for this task. I do not provide source codes of my programs. I collect data with my own software, servers and proxies. Clients get only data, no software.

Databases for Sell

Google Play Applications Database (US region)

$1000  —  416K devs , 2.3M apps

Database of IDs and titles of books on

$100  —  12.2M books

Database of linkedin companies

$2000  —  47K schools , 14.5M orgs

Database of companies from directory

$500  —  725K orgs

Database of crypto coins from

$100  —  866 coins

Database of sites from stats

Free  —  416K hosts

Whois emails of companies listed on

$100  —  452K domains , 115K mails companies database

$500  —  2.7M orgs

Database of products and reviews from

$250  —  29K products , 171K reviews

Crunchbase Companies and Persons Database

$1000  —  468K persons , 506K orgs

Crunchbase Companies Database

$500  —  506K orgs