hmm The Record · ex-17 / 38

03 · The data Methodology

03 · Methodology

The Necessity Index. Methodology

How the classified universe was built, how the T1 / T2 screen is applied, and how to reproduce the headline figures.

The figures01 / 05
  • 19,416 Four-market companies
  • 725 Regulations mapped (global)
  • 174 Four-market regulations

The Necessity Index is a public data product that summarises the hmm Ventures classified universe of APAC technology companies and the regulatory architecture they operate against. This page documents how each figure on the index is produced, the source datasets, and the steps required to reproduce the result.

The sources02 / 05

Source datasets

The Index draws from three primary datasets, all maintained as part of the fund's continuous research operation.

  • Classified company universe. 19,416 technology companies headquartered in the four target markets (Australia, Japan, New Zealand, Singapore), enriched from licensed commercial data feeds (domain, registry, funding, headcount, location) and classified against the T1 / T2 framework using a two-stage pipeline.
  • Comprehensive regulations dataset. 725 regulations across 64 countries and 13 sectors, drawn from public legislation portals, regulator publications, and parliamentary records. 174 regulations operate in the four target markets. Status is tracked across three states: enacted, in_parliament, expected.
  • Four-market sector-tier breakdown. A reconciled table of the 174 four-market regulations grouped by sector and by tier (T1 / T2), used for the per-market and per-Necessity views in the Index.
The classifier03 / 05

Classification rules

A company passes the screen and enters the Necessities-aligned universe only if it is classified as Tier 1 or Tier 2 against the Five Necessities or the cross-cutting AI and Data band.

  • Tier 1. Licence-as-barrier. The company cannot legally operate without regulatory approval. The classifier flags a company as T1 when its registry, product description, or hiring signals indicate dependence on a named licence, clearance, or certification regime in one of the four markets.
  • Tier 2. Compulsion-as-barrier. The company's buyers are statutorily required to purchase compliant solutions. The classifier flags a company as T2 when its sector and customer profile map to a compliance mandate that creates demand for the company's product.

The conservative classifier (the figure reported on the public Index) requires both stages of the pipeline to agree. Where the two stages disagree, the company is held out of the conservative count. The conservative classifier returns 33.5 percent (6,505 of 19,416) for the four-market universe.

The limitations04 / 05

Known limitations

  1. English-language bias. Japanese and multilingual portals (e-Gov, METI, MLIT) are scanned in both English and Japanese, but where only the Japanese text is authoritative the English rendering is translated and labelled accordingly.
  2. Four-market bound. Coverage outside Australia, Japan, New Zealand, and Singapore is reference-only in the wider 725-regulation dataset. The 174 four-market entries are the authoritative scope for fund investment decisions and for the Index.
  3. Per-Necessity counts may not reconcile against four-market totals. Some regulations span multiple Necessities. The per-market totals (174) count each regulation once; the per-Necessity totals do not de-duplicate cross-Necessity entries.
The reproducibility05 / 05

Reproducibility

Every figure on the Index resolves to a row in one of the three source datasets above. The classifier rules and worked examples are published openly across the research surface.