Glossary
web capture record
web capture record is one row in a web-archive index describing a single crawl of a URL at a timestamp, carrying the urlkey, capture timestamp, mimetype, statuscode, digest and length, aggregatable by host, domain, path prefix or mimetype. Datadory's catalog of 1,744 datasets documents it directly in Wayback Machine CDX Server API.
What is web capture record?
One row in a web-archive index describing a single crawl of a URL at a timestamp, carrying the urlkey, capture timestamp, mimetype, statuscode, digest and length, aggregatable by host, domain, path prefix or mimetype.
In this catalog it appears concretely: - Wayback Machine CDX Server API — "One record per capture of a specific URL at a specific timestamp; aggregatable by host, domain, path prefix or mimetype".
Why does web capture record matter when choosing a dataset?
A label on a listing is not a deliverable. Teams that license on the strength of a product-name match routinely find the shipped files cover a narrower slice than they assumed, and backfilling history afterwards costs more than the license ever did.
The failure mode is concrete: a source can carry the web capture record label while differing from what you need on exactly the dimension that matters — One record per capture of a specific URL at a specific timestamp; aggregatable by host, domain, path prefix or mimetype. Comparing two sources on that line usually settles the choice faster than any feature matrix.
You rarely have to take a vendor's word for it. 82.4% of the 1,744 datasets Datadory catalogs are free to access, and Wayback Machine CDX Server API lets you inspect the real artifact before any budget is committed.
How do you evaluate web capture record in a data source?
Treat every claim of this attribute as testable:
- Open Wayback Machine CDX Server API and confirm its record — "One record per capture of a specific URL at a specific timestamp; aggregatable by host, domain, path prefix or mimetype" — against the files you actually receive.
- Pin down update cadence in writing. Across this catalog, 22.6% of 1,744 datasets refresh daily and 64 still arrive only through a manual request form, so ask exactly how fresh each release is.
- Check whether definitions are verified at all. Field definitions are verified for 1495 of 1,744 datasets (85.7%), and any source you license should meet that bar.
- Price the delivery route before the license. In this catalog bulk download is the most common access method (725 datasets) ahead of official APIs (574), and 379 sources still require scraping — a maintenance cost that lands on you, not the vendor.
See the term applied to real records: interactive-media-services data.
Related terms
Adjacent concepts worth reading next: - domain popularity ranking - hourly pageview files
Frequently asked questions
What is an example of web capture record?
Wayback Machine CDX Server API is the clearest example in this catalog. Its record states: "One record per capture of a specific URL at a specific timestamp; aggregatable by host, domain, path prefix or mimetype". Across all 1,744 datasets Datadory averages a quality score of 7.81 out of 10, so a named example can be weighed rather than trusted blindly.
Is data described as "web capture record" free to use?
Treat access and permission separately. 82.4% of the 1,744 datasets in this catalog are free to access, but 235 are freemium and 61 are paid outright, so confirm both the price and the license on the exact distribution before building on it.
Datasets containing this field
Datasets containing web capture record
6 datasets carry web capture record in the catalog. Open one, count the fields, judge for yourself.
APNIC Labs Measurements & Dashboards
Domain Name Industry Brief & DNIB Data
quarter / reporting period · total_domain_name_registrations · com_net_domain_name_base …+3 more
Hurricane Electric BGP Toolkit
IANA Root Zone Database
OONI Explorer – Global Internet Censorship Measurements
Every listing shows the field dictionary, sample rows, and coverage before you commit. API, files, or your warehouse. Daily, weekly, or hourly.
Get sample rows