<?xml version="1.0"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "JATS-journalpublishing1.dtd"[]>
<article xml:lang="en" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" dtd-version="1.2" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">IJPDS</journal-id>
<journal-title-group>
<journal-title>International Journal of Population Data Science</journal-title>
<abbrev-journal-title>IJPDS</abbrev-journal-title>
</journal-title-group>
<issn pub-type="epub">2399-4908</issn>
<publisher>
<publisher-name>Swansea University</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.23889/ijpds.v11i5.3595</article-id>
<article-id pub-id-type="publisher-id">11:5:3595</article-id>
<article-id pub-id-type="pii">S2399490821035953</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Population Data Science</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Designing An Ambiguity-Aware Clerical Review Strategy</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Lam</surname><given-names initials="J">Joseph</given-names></name><xref ref-type="aff" rid="affil-1"><sup>1</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Imaz Blanco</surname><given-names initials="A">Amaia</given-names></name><xref ref-type="aff" rid="affil-2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Setakis</surname><given-names initials="E">Efrosini</given-names></name><xref ref-type="aff" rid="affil-2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Laidler</surname><given-names initials="J">Jonathan</given-names></name><xref ref-type="aff" rid="affil-2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Pearson</surname><given-names initials="J">Jonathan</given-names></name><xref ref-type="aff" rid="affil-2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Harron</surname><given-names initials="K">Katie</given-names></name><xref ref-type="aff" rid="affil-3"><sup>3</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Cortina-Borja</surname><given-names initials="M">Mario</given-names></name><xref ref-type="aff" rid="affil-3"><sup>3</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Christen</surname><given-names initials="P">Peter</given-names></name><xref ref-type="aff" rid="affil-4"><sup>4</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Mantovani</surname><given-names initials="G">Giulia</given-names></name><xref ref-type="aff" rid="affil-2"><sup>2</sup></xref></contrib>
<aff id="affil-1"><label>1</label><institution>NHS England, London, United Kingdom; UCL Great Ormond Street Institute of Child Health, London, United Kingdom</institution></aff>
<aff id="affil-2"><label>2</label><institution>NHS England, London, United Kingdom</institution></aff>
<aff id="affil-3"><label>3</label><institution>UCL Great Ormond Street Institute of Child Health, London, United Kingdom</institution></aff>
<aff id="affil-4"><label>4</label><institution>School of Computing, The Australian National University, Canberra, Australia; Scottish Centre for Administrative Data Research, University of Edinburgh, Edinburgh, United Kingdom</institution></aff>
</contrib-group>
<pub-date date-type="pub" publication-format="electronic"><day></day><month></month><year></year></pub-date>
<pub-date date-type="collection" publication-format="electronic"><year></year></pub-date>
<volume>11</volume>
<issue>5</issue>
<elocation-id>3595</elocation-id>
<permissions>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by-nc-nd/4.0/">
<license-p>This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.</license-p>
</license>
</permissions>
<self-uri xlink:href="https://ijpds.org/article/view/3595">This article is available from the IJPDS website at: https://ijpds.org/article/view/3595</self-uri>
<abstract>
<p>Clerical review of candidate record pairs remains the de-facto gold standard for evaluating record linkage, but is resource-intensive and often designed informally. We propose a design-based framework that treats clerical review as finite-population sampling over strata defined by match weight, identifier agreement pattern, record-level ambiguity and demographic group. Bands are constructed from deciles of model-based match probability; within bands, strata are formed by agreement patterns and record ambiguity. A band-wise margin-of-error profile encodes substantive priorities (e.g. tighter targets in high-score bands), while a single global scaling parameter enforces an overall clerical budget. From deduplicating a labelled training dataset using Splink (50,000 records; ∼478,000 candidate pairs), we compared performance of baseline design reviewing ∼23% pairs with “budget” design reviewing ∼7% pairs. Under the baseline design, estimates of global (4.2%) and band-specific match rates are accurate and the sampled distributions of agreement patterns, demographics (such as gender) and ambiguity track the population reasonably well. Under the “budget design”, global linkage error estimation roughly doubles (9.3%), band-level errors increase most in mid-score bands where matches, non-matches and ambiguous cases are intermixed, but accuracy in the highest bands and the band-wise record ambiguity are largely preserved. We focused clerical effort on records with most ambiguous candidate pairs, at the cost of reduced representativeness in agreement patterns and gender. The framework generalises to other clerical review goals and can incorporate gold standards as priors for calibration. It makes the trade-offs between clerical workload, precision, representativeness and ambiguity coverage explicit and therefore negotiable.</p>
</abstract>
</article-meta>
</front>
</article>