We provide a fully managed solution where we take care of all the entire scraping process so that you can receive freshly-harvested data, without the fuss & hassle.
TYPICAL WORKFLOW FOR A DATA SCRAPING PROJECT
- Please Contact us with an overview of your project requirements.
- We call (or skype) you back to discuss your project and better understand your requirements.
- We will review the sites with your intentions in mind and then provide a written quote. This takes approx. 2 days.
- Sign a mutual non-disclosure agreement, if required.
- Once we receive your signed Letter of Engagement, we commence the development of the spider(s).
- Once completed, spiders are tested and reviewed. We also provide you with a sample data extract for your review and approval.
- Once approved, we run the spider, providing feedback at pre-agreed intervals.
- Complete any post-production data processing including parsing, standardization, normalization and de-duplication.
- Submit data to you in agreed format.
- Once deliverables approved, submit invoice .
Bear in mind that this workflow is just an example, and not all projects follow the same workflow. For instance, many customers are only interested in getting scraped data and don’t care about the scraping process.