Our Journey

The World’s Leading Web Scraping Experts

icon-research-data
2007

The Unmet Need - Founders Meet

Founders Shane Evans and Pablo Hoffman met at a time when more and more companies needed web data to help power their business. With no external solutions available they built their own data extraction software.

icon-scrapy training
2008

Open Source from the Beginning

The first release candidate of Scrapy went public, and Scrapy became the first dedicated open source Python web crawling and scraping framework.

2010

Launch of Scrapinghub

Scrapinghub was founded, a company to provide services that go beyond spider development and provide a holistic and scalable data extraction solution with a community of web scraping experts.

logo-scrapy-cloud
2011

Scrapy Cloud - Web Crawler Hosting

Customers wanted to run and manage their own spiders. So Scrapy Cloud was released, a dedicated hosting service specifically designed for running and managing web scraping spiders in the cloud.

logo-crawlera
2012

Crawlera - Smart Proxy Management

Traditional proxy services weren’t giving our customers the reliability they needed to extract data at scale. It was at this point Crawlera was born, an endpoint proxy solution that automated proxy management.

logo-portia
2013

Portia - Visual Scraping Tool

To continue to support the need for data, a non-developer tool was created to allow our customers to easily get data from a limited number of websites with no coding needed.

2014

Data on Demand - Data Subscription

Some customers wanted access to only the data - they didn’t want to worry about spiders, proxies, QA, etc. so we launched our managed data services, customers get the data when they need it.

2017

Enterprise Account Management

Launched our dedicated enterprise account management service, where we engage in deep partnerships with our enterprise customers to deliver full service solutions with access to data quality assurance, enterprise service-level agreements and maintenance plans. Full access to project’s code with training.

dod-best-in-business
2018

Explosive Growth

Every day over 2,000 companies (many Fortune 500’s) and 1 million developers rely on our tools and services to get the data they need to grow their businesses.

Scraped 50 websites daily within a month

Our time-sensitive study involved compiling data on the 2015 Canadian federal election. Scrapinghub scraped about 50 websites daily over the period of a month. We weren’t familiar with many of the technical aspects of scraping but the Scrapinghub team patiently and promptly answered our questions. The data we needed were delivered on time and in a format that helped make our research project a success.

April Lindgren

Associate Professor - Ryerson University School of Journalism

Enabled us to enter the market quickly

Scrapinghub's senior engineers built a secure and reliable solution for online multi-platform ticket bookings that enabled us to enter the market quickly. Their technology gave us a scalable platform that helped us achieve our business goals. It has been a great experience and I truly recommended working with them.

Fabio Zecchini

VP Technology & Digital - Marketing Musement

One of the best decisions we’ve made

Hiring Scrapinghub and building our next-generation scraping system on open source Scrapy and Scrapyd are some of the best decisions we've made. Scrapy has been accurate, reliable, easy to maintain and ScrapingHub people have been a joy to work with.

Mike Seidle

Director of Development DirectEmployers Foundation

High integrity and superior service

Gilberto's (Engineer at Scrapinghub) expertise and resourcefulness has been fantastic as he has supported our service. He knows how to talk to those of us who aren't technical and he consistently produces high quality results. We trust his recommendations completely due to his high integrity and superior service.

Terese Herbig

Director of Member Development - The Path to Purchase Institute

My questions were promptly answered

I was very pleased with both the finished project and with the way my questions were promptly answered. This is definitely the way to run a successful company. Thanks!

Carolyn Goodnight

IT Director - Geist Holdings Inc

Our Values

People first
Grow fast, grow together
Open by default
Own it
Results Matter

Some of Our Open Positions

For full listing click here

The Leadership Team

Shane Evans
Co-Founder & CEO
Pablo Hoffman
Co-Founder & Director
Angela Piper
Head of HR
Daniel Graña
Head of Engineering
Marie Moynihan
Head of Marketing
Mark Henderson
Head of Sales
Oonagh Killeen
Head of Finance
Sanaea Daruwalla
Head of Legal
Scott Garcia
Head of Product
Suzanne Hassett
Head of Professional Services