Different industries publish different kinds of information, and each structures it in its own way. A product catalog, a job listing, a stock quote and a news article are different kinds of records, with their own fields, sources and boundaries.
This page introduces the 15 industry areas covered. Each has its own page describing its data model, the data types it covers, its sources, its use cases and what is outside its scope. Start with the one closest to your data.
Request a Data Collection Project
Industry Data Collection
Industry data collection starts from what a record represents. In some industries it is a product, in others a property, a job listing, an instrument, an article or an institution. The related information, such as prices, locations, employers, issuers or publishers, attaches to that record, and the sources that publish it differ from one industry to the next.
The industry areas below are grouped by the kind of record they center on. All of them work from publicly displayed information collected from the sources specified for a project, and the industry pages describe what each one covers.
Product, Retail & Brand Data
These industries center on products and what is displayed about them: catalog details, prices, promotions and availability, from online stores, multi-vendor marketplaces and brand-operated storefronts.
Ecommerce & Retail Data
Focuses on product and catalog data from online stores: product details, displayed prices, discounts and promotions, and availability. The data reflects what each store displays. Read more in Ecommerce & Retail Data.
Marketplaces & Online Retail
Centers on marketplace listings, the seller offers attached to them and search and category placement, which differ from a single retailer’s own site. Ratings are limited to aggregate figures rather than individual reviewers. Read more in Marketplaces & Online Retail.
Consumer Brands & D2C
Covers brand-operated storefronts: collections, product pages and variants, regional storefronts, and displayed prices and promotions. Inventory quantities are not assumed unless a storefront publicly displays them. Read more in Consumer Brands & D2C.
Listing-Based Data
These industries center on individual listings and the attributes each one displays, such as price, location, status and dates.
Real Estate & Property Data
Distinguishes a property from the listings that advertise it, with asking prices or rents, location and listing status. Agency information stays at business level, and private owners and private sellers are outside the scope. Read more in Real Estate & Property Data.
Travel & Hospitality Data
Centers on properties, their room types and rate plans, and displayed rates that depend on stay dates and occupancy, along with destinations. Traveler and booking information is outside the scope. Read more in Travel & Hospitality Data.
Automotive Data
Separates model-level data, such as make, model year, variant and specifications, from individual vehicle listings with mileage, displayed price and status. Dealers are recorded at business level, and private sellers are outside the scope. Read more in Automotive Data.
Recruitment & Jobs Data
Centers on the job listing, with the employer at business level, the role, skills and requirements, location and work arrangement, and salary where publicly displayed. Candidate data, resumes and personal contact information are outside the scope. Read more in Recruitment & Jobs Data.
Company, Business & Market Data
These industries center on businesses, markets and financial instruments: which companies and instruments are listed, how sources classify them, and what each source displays about them.
B2B & Market Research
Centers on companies, the products and services they offer, and the industry and market structure around them, including supplier relationships. Contact information is limited to publicly displayed business details, and private or personal contact information is outside the scope. Read more in B2B & Market Research.
Business & Local Directory Data
Centers on business listings organized by category and location, and treats the listing, the business and the location as distinct records. Contact information is limited to business-level details, and private or personal contact information is outside the scope. Read more in Business & Local Directory Data.
Financial & Market Data
Centers on instruments and securities, the issuers behind them, displayed prices and quotes, historical series, financial metrics and corporate events. It is research data from publicly displayed sources, not investment advice. Read more in Financial & Market Data.
Market Intelligence Data
Builds datasets around a defined market scope, such as an industry, category or segment, linking companies, products and services, displayed prices, aggregate ratings and announcements. Collections are timestamped snapshots of what sources displayed, not forecasts. Read more in Market Intelligence Data.
Media, Knowledge & Sector Data
These industries center on published content, institutions and specialist sectors, where the record is an article, a course, a medicine or a research publication.
News & Media Data
Centers on the article or content item, recorded through metadata: headline, publisher, dates, sections and topics, and the displayed summary. Article text is not collected, and authors are limited to the byline as displayed. Read more in News & Media Data.
Education Data
Centers on institutions, their campuses and locations, and the courses and programs they offer, with fees, admissions information and ratings or rankings as displayed. Student records, applicant records and private student information are outside the scope. Read more in Education Data.
Healthcare & Pharmaceutical Data
Centers on pharmaceutical and healthcare product data, including brand, manufacturer, form, strength, pack and displayed price, with provider and facility information kept at business level. Patient data, medical records and other private health information are outside the scope. Read more in Healthcare & Pharmaceutical Data.
AI & Machine Learning Data
Covers publicly displayed information about AI: organizations, products and tools, models and versions, research publication metadata and announcements. It does not describe collecting datasets for training AI or machine learning models. Read more in AI & Machine Learning Data.
How Each Industry Page Is Organized
The industry pages describe the same things in each industry’s own terms:
- What a record represents and how the data is organized
- The types of data the industry commonly displays
- The source types the data can come from
- The main use cases
- The requirements to define for a project
- One-time and recurring collection
The pages describe publicly displayed information, and they state where certain data is outside the scope, such as candidate data, patient data, private-seller information and student records.
One-Time and Recurring Industry Data
A one-time collection captures selected sources at a single point and suits a defined research or dataset need. Recurring collection repeats the same sources and fields as timestamped snapshots of publicly displayed information, so that changes can be compared over time.
Which fits depends on how the data will be used, and how often data is collected depends on the project requirements.
Define Your Industry Data Requirement
A clear requirement makes it easier to choose the right industry page and the right record structure. It helps to outline:
- The industry or business area
- The sources
- What each record should represent
- The fields needed
- The geographic or source scope
- One-time or recurring collection
Once these are defined, we can review the project scope and confirm an approach.
Request a Data Collection Project