CKAN metadata catalog

A CKAN metadata catalog is a data portal built on CKAN, the open-source platform behind data.gov.uk — formally recorded as the "UK National Data Library / Find Open Data". It is searchable through a JSON action API that returns dataset records together with their resource files, so enumeration happens programmatically rather than by browsing.

Metadata catalogs tell you what exists before you commit to any one file. Because CKAN normalizes records across publishers, a single query pattern surfaces everything from broadcast statistics to retail price series, with each dataset's own licence and formats attached — which is exactly the due-diligence layer buyers otherwise assemble by hand.

The alternative is per-agency scraping, where every site has its own structure and breaks independently. Portal-level harvesting via the JSON action API concentrates that fragility into one interface.

Cost is rarely the barrier: 82.4% of the 1,744 datasets Datadory catalogs are free to access, so the differentiator between sources is metadata quality and licence clarity, not price.

1. Run one narrow query and count results. A broadcasting query on the UK National Data Library returns 23 datasets; if your counts differ wildly, your filter logic is off.
2. Check format coverage. CSV, PDF, XLSX, JSON (CKAN API) and HTML are listed — a catalogue weak on tabular exports will cost you scraping time later.
3. Confirm resources carry licences. UK records publish under Open Government Licence v3.0 or per-dataset terms; verify per resource, not per portal.
4. Prefer statistical APIs where present. Some portals add SDMX interfaces for series-level retrieval beyond package metadata.
5. Watch freshness. Only 22.6% of the 1,744 datasets Datadory catalogs update daily, so ask how often harvested records refresh.

Where to see it in context: broadcasting data and food-retail data.

Portal concepts adjacent to CKAN catalogs: - open-government-licence-v3 — The UK public-sector license under which ONS publishes its content, allowing use and redistribution with attribution to the source and requiring no registration or integration key. - per-dataset-license — Community dataset platforms attach whatever license each uploader chose, so identical-looking pharmacy CSVs can range from commercial delivery terms to non-commercial-only. On Kaggle every download requires accepting that specific dataset's license at download time, with no accuracy or maintenance guarantees. - sdmx-statistical-api — The SDMX statistical API is the machine interface behind Eurostat's data browser, exposing each dataset as a dataflow queryable without registration or key. Roughly 8,150 dataflows were listed in the structure at retrieval, returning JSON or SDMX payloads.