Datadory notebook
How Competitive Intel Product Teams Use Diversified Metals Mining Data
Competitive intel product teams use diversified metals mining data to track rival miners through public records instead of rumor: SEC EDGAR XBRL filing diffs for BHP, Rio Tinto, Vale and Freeport, MSHA's ~92,000-mine registry with violations from 2000, 168-country production tables and the World Bank Pink Sheet's price series from January 1960. Twelve of these 16 primary datasets are free.
1,744 datasets. Pick your catch.
How do competitive intel product teams actually use this data?
CI teams covering diversified miners start from an uncomfortable fact: BHP, Rio Tinto and Vale publish reserve statements once a year, say nothing about idled capacity until a press release lands, and give no forward signal at all about permitting trouble or safety incidents. The official record fills that gap because regulators timestamp exactly the events strategy depends on - a filing amended, a violation issued, a mine registered, a production rank lost.
The workflow teams converge on runs in five steps:
- Diff each rival's XBRL filings on SEC EDGAR for capex, guidance and SK-1300 reserve changes.
- Watch MSHA inspection and violation feeds by MINE_ID for operational deterioration at US sites.
- Benchmark country-level output shifts with World Mining Data's market-share and HHI rankings.
- Frame every move against the Pink Sheet's price cycle in nominal and real 2010 dollars.
- Add study-group supply-demand balances last, where the free press releases justify the effort.
Which datasets reveal a rival miner's next move first?
SEC EDGAR is the fastest free telescope on listed diversified miners, and it is machine-readable rather than a PDF chore. The data.sec.gov REST APIs return XBRL facts per company, period and concept - a single large miner's companyfacts payload runs about 4.5 MB - while company_tickers.json maps 10,387 ticker-CIK pairs so you can resolve the whole listed universe programmatically. Filings reach back to 1994/1995 with XBRL from roughly 2009, and indexes rebuild nightly from about 10:00 PM ET as filings are accepted, so an overnight diff catches morning disclosures.
Can regulatory records flag a rival's operating trouble before the press release?
Yes, for anything touching United States operations. MSHA's Mine Data Retrieval System publishes the full public-domain record: roughly 92,000 mine registry entries back to 1970, event-level inspections, violation records from January 1, 2000 and Part 50 accident, injury and employment files from 1983. Everything arrives as bulk pipe-delimited ZIP files with documented field layouts - no registration, no integration key - so a weekly pull keyed on MINE_ID gives you a compliance trajectory per operator: rising significant-and-substantial counts, repeated accident entries, shrinking reported hours.
That feed reads as a leading indicator because enforcement precedes narrative: a miner whose US sites show climbing violation density tends to explain it on a later earnings call, while the MSHA file shows the trend quarters earlier. Pair it with OSMRE for the liability angle - e-AMLIS documents abandoned-mine problems across 63 published fields per record, and the NMMR archive holds more than 275,000 mine maps.
How do you benchmark a rival's production footprint by country?
World Mining Data, Austria's annual statistical report, answers the share question directly. Each edition tabulates 65 mineral commodities across 168 producer countries from 1984 onward, shipping as a 264-page PDF plus nine Excel workbooks totalling roughly 200 worksheets. Its built-in market-share rankings and HHI concentration scores are the quotable part: when a rival's home jurisdiction loses rank in a commodity, the source table shows it without any modeling on your side. Country-commodity detail covers the five most recent years (2020-2024 in WMD 2026), with continent totals reaching back to 1984.
National agencies sharpen the picture where rivals operate: Cochilco reports company-level Chilean copper production alongside daily LME/COMEX/SHFE inventory series from 1960, commercial delivery terms on datos.gob.cl; Natural Resources Canada publishes commodity x province x year production CSVs at 1,951 rows per edition; the Mining Association of Canada lists about 90 producing Canadian mines with annex tables back to 1978; and the Minerals Council South Africa's nine-sheet XLSX spans 2013-2024 across eight commodity groups.
Do study-group balances and EU statistics catch supply-side surprises?
European exposure has its own instrument: Eurostat covers NACE section B through structural business statistics - sbs_na_ind_r2 alone tops 6.4 million observations - plus PRODCOM output and COMEXT trade from 1988, served through a JSON-stat and SDMX API with bulk TSV, free for commercial reuse with attribution.
Where does asset-level mapping fit a competitor-tracking workflow?
Filing diffs tell you what a rival says; deposit layers show where the optionality sits. Geoscience Australia publishes deposit-location GIS layers for about 20 commodities - the copper layer alone holds 406 features - plus operating-mine layers, critical-minerals chemistry and AIMR 2025 reserves and resources as at December 31, 2024, with editions archived back to 1983, all commercial delivery terms 4.0 via ArcGIS REST, WFS/WMS, XLSX and CSV. Watching how a rival's reported Australian reserves reconcile against the national assessment is a check few decks perform.
Ranked shortlist for competitor tracking, ordered by CI fit first and Datadory quality score second:
Pick up where this leaves off
Every one of these ships with sample rows before you commit to anything.
SEC EDGAR Mining Company Filings Data
MSHA Mine Data Retrieval System & Reports
OSMRE Mining Regulation & Reclamation Data
World Mining Data
Cochilco Chilean Copper Statistics Data
Natural Resources Canada - Mineral Statistics Data
Want rows instead of a pitch? Name the datasets.
API, files, or your warehouse. Daily, weekly, or hourly.
Get a sampleQuestions worth asking
How can I monitor a mining competitor's filings for free?
SEC EDGAR's REST APIs return XBRL facts per company, period and concept for BHP, Rio Tinto, Vale and Freeport, free with no integration key beyond a declared User-Agent under a 10-requests-per-second fair-access policy. Indexes rebuild nightly from about 10:00 PM ET, so an overnight diff of SK-1300 reserve concepts in 10-K and 20-F reports surfaces new disclosures each morning.
Where can I see a rival miner's safety and violation record over time?
MSHA's Mine Data Retrieval System holds about 92,000 mine registry records back to 1970, violations from January 1, 2000 and Part 50 accident files from 1983, all commercial delivery terms as bulk pipe-delimited ZIPs keyed on MINE_ID. A quarterly pull yields a per-operator compliance trajectory - violation density, accident counts and reported hours - before any press release mentions it.