<?xml version="1.0"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "JATS-journalpublishing1.dtd"[]>
<article xml:lang="en" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" dtd-version="1.2" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">IJPDS</journal-id>
<journal-title-group>
<journal-title>International Journal of Population Data Science</journal-title>
<abbrev-journal-title>IJPDS</abbrev-journal-title>
</journal-title-group>
<issn pub-type="epub">2399-4908</issn>
<publisher>
<publisher-name>Swansea University</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.23889/ijpds.v6i1.2383</article-id>
<article-id pub-id-type="publisher-id">10:1:07</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Population Data Science</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Improving opportunities for data linkage within Children Looked After administrative records in Wales</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Bailey</surname><given-names initials="GA">Grace A.</given-names></name><xref ref-type="aff" rid="affil-1">1</xref><xref ref-type="corresp" rid="correspondingAurthor">*</xref></contrib>
<contrib contrib-type="author"><name><surname>Lee</surname><given-names initials="A">Alex</given-names></name><xref ref-type="aff" rid="affil-1">1</xref></contrib>
<contrib contrib-type="author"><name><surname>Ahmed</surname><given-names initials="S">Saira</given-names></name><xref ref-type="aff" rid="affil-1">1</xref></contrib>
<contrib contrib-type="author"><name><surname>Scanlon</surname><given-names initials="I">Ieuan</given-names></name><xref ref-type="aff" rid="affil-1">1</xref></contrib>
<contrib contrib-type="author"><name><surname>Cowley</surname><given-names initials="LE">Laura E.</given-names></name><xref ref-type="aff" rid="affil-1">1</xref></contrib>
<contrib contrib-type="author"><name><surname>Stuart</surname><given-names initials="A">Amy</given-names></name><xref ref-type="aff" rid="affil-1">1</xref></contrib>
<contrib contrib-type="author"><name><surname>Farr</surname><given-names initials="I">Ian</given-names></name><xref ref-type="aff" rid="affil-1">1</xref></contrib>
<contrib contrib-type="author"><name><surname>Brooks</surname><given-names initials="C">Caroline</given-names></name><xref ref-type="aff" rid="affil-1">1</xref></contrib>
<contrib contrib-type="author"><name><surname>North</surname><given-names initials="L">Laura</given-names></name><xref ref-type="aff" rid="affil-1">1</xref></contrib>
<contrib contrib-type="author"><name><surname>Griffiths</surname><given-names initials="LJ">Lucy J.</given-names></name><xref ref-type="aff" rid="affil-1">1</xref></contrib>
<aff id="affil-1"><label>1</label><institution>Population Data Science, Swansea University Medical School, Swansea, SA2 8PP, UK</institution></aff>
</contrib-group>
<author-notes>
<corresp id="correspondingAurthor"><label>*</label>Corresponding author: Bailey GA <email>g.a.bailey@swansea.ac.uk</email>
</corresp>
<fn fn-type="conflict">
<label>Statements of conflicts of interest</label>
<p>The authors report no conflicts of interest.</p>
</fn>
</author-notes>
<pub-date date-type="pub" publication-format="electronic"><day>19</day><month>02</month><year>2025</year></pub-date>
<pub-date date-type="collection" publication-format="electronic"><year>2025</year></pub-date>
<volume>10</volume>
<issue>1</issue>
<elocation-id>2383</elocation-id>
<permissions>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by-nc-nd/4.0/">
<license-p>This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.</license-p>
</license>
</permissions>
<self-uri xlink:href="https://ijpds.org/article/view/2383">This article is available from the IJPDS website at: https://ijpds.org/article/view/2383</self-uri>
<abstract>
<title>Abstract</title>
<sec>
<title>Introduction</title>
<p>Linkage of population-based administrative data is a powerful tool for studying important public issues. To overcome confidentiality and disclosure issues, records are de-identified and allocated a unique identifier. Within the Secure Anonymised Information Linkage (SAIL) Databank, these are known as Anonymised Linking Fields (ALFs). Assignment of an ALF enables linkage of individuals across multiple routinely collected datasets. Within the Children Looked After (CLA) Wales dataset, only 37% of the children have an ALF, limiting linkage to other datasets and, as a result, potential research. There are also other known data issues, including discrepancies with the week of births, duplicate identifiers and year-on-year changes in identifiers. Objectives To improve accuracy and availability of the ALFs in the CLA dataset, and overall research quality.</p>
</sec>
<sec>
<title>Methods</title>
<p>Using several datasets within the SAIL Databank, we developed a six-step CLA matching algorithm to improve the ALF matching rate and correct for data errors. To assess the performance of our algorithm, we benchmarked against routine ALFs already identified via the algorithm currently used by SAIL.</p>
</sec>
<sec>
<title>Results</title>
<p>Our algorithm increased ALF matching by 25%, assigning 61% of individuals an ALF. Inconsistent weeks of birth, and incorrect and duplicate identifiers were resolved. When benchmarking against the current ALF-assigning algorithm used by SAIL, our algorithm had an overall sensitivity of 90%.</p>
</sec>
<sec>
<title>Conclusion</title>
<p>We have developed an algorithm which demonstrates comparable ALF matching performance to the current algorithm used within SAIL, and which greatly improves the ALF matching in the CLA dataset. This algorithm may help to overcome potential bias due to missing data, and increases the potential for linkage to other datasets. Further development and refinement could result in the algorithm being applied to other datasets in SAIL.</p>
</sec>
</abstract>
<kwd-group>
<kwd>administrative data linkage</kwd>
<kwd>children looked after</kwd>
<kwd>SAIL Databank</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec>
<title>Introduction</title>
<p>In the United Kingdom, children looked after are defined as children under the age of 18 years who are looked after by the local authority and are in its care or provided with accommodation for a continuous period of more than 24 hours [<xref ref-type="bibr" rid="ref-1">1</xref>]. Children can become looked after under voluntary arrangements or under a compulsory care order granted by the courts. Throughout the last decade, there has been an upward trend in the number of children looked after in the UK, with the exception of Scotland where rates of children in care have been falling [<xref ref-type="bibr" rid="ref-2">2</xref>, <xref ref-type="bibr" rid="ref-3">3</xref>]. These children are considered one of the most vulnerable groups in society, with previous work showing increased risk of poor outcomes across social, education and health domains [<xref ref-type="bibr" rid="ref-4">4</xref>&#x2013;<xref ref-type="bibr" rid="ref-6">6</xref>].</p>
<p>In recent years, there has been growing interest in the use of administrative data to advance our understanding and insights into children in receipt of care and support, and children looked after by the state, as well as the implementation and effectiveness of social policies [<xref ref-type="bibr" rid="ref-7">7</xref>&#x2013;<xref ref-type="bibr" rid="ref-9">9</xref>]. Current Government policy strongly supports the need to reduce the number of children in need of care and improve their outcomes, including the recent policy paper <italic>Data Saves Lives</italic> which promotes how it can improve children&#x2019;s social care services [<xref ref-type="bibr" rid="ref-10">10</xref>, <xref ref-type="bibr" rid="ref-11">11</xref>]. Administrative data relates to individual or organisational level information, which has been derived from data routinely collected by public sector agencies for organisational purposes including, but not limited to, education, healthcare and social care agencies [<xref ref-type="bibr" rid="ref-12">12</xref>]. It contains abundant, detailed information that has significant potential for research.</p>
<p>As part of the UK&#x2019;s statutory guidance, local authorities are required to submit information about families and children who interact with children&#x2019;s statutory social services to the Government on an annual basis; this enables service provisions and outcomes to be monitored [<xref ref-type="bibr" rid="ref-13">13</xref>]. These returns, known as the Children Looked After (CLA) Census, contain individual-level data for all children and young people placed under the care of a local authority and are available for research purposes within Trusted Research Environments (a centralised, secure data platform) across all four UK nations.<xref ref-type="fn" rid="fn1"><sup>1</sup></xref> Information about the variables within the datasets have been described elsewhere [<xref ref-type="bibr" rid="ref-14">14</xref>&#x2013;<xref ref-type="bibr" rid="ref-18">18</xref>].</p>
<p>Within these TREs, person-level data can be linked between datasets using a unique identifier, allowing for a more comprehensive understanding about the needs of a population [<xref ref-type="bibr" rid="ref-19">19</xref>]. Within health datasets, the linkage variable is often based on unique identifiers such as the National Health Service (NHS) number (England and Wales), the Community Health Index (CHI) (Scotland) or the Health and Care number (HCN) (Northern Ireland). However, for the children&#x2019;s social care datasets (England, Scotland and Wales<xref ref-type="fn" rid="fn2"><sup>2</sup></xref>), including the CLA dataset, the NHS/CHI number is not available. Instead, quasi-identifiers are used &#x2013; these are attributes that are not themselves unique identifiers but in combination can be used to identify an individual (e.g. name, gender, date of birth, address and postcode) [<xref ref-type="bibr" rid="ref-20">20</xref>].</p>
<p>Demographic data collected within the CLA Census is limited; alongside the Unique Pupil Number (UPN) (England and Wales) or Scottish Candidate Number (SCN) (Scotland), only the date of birth, gender and ethnicity are collected. Other identifiable information such as the child&#x2019;s name, address and postcode are stored separately in the education dataset<xref ref-type="fn" rid="fn3"><sup>3</sup></xref>. The UPN/SCN is used to link the two datasets to access the child&#x2019;s name and address. Children are automatically allocated a UPN/SCN on their entry to a maintained school. The majority of children in the UK will not attend school until after they turn four years old, although the compulsory school age in England and Wales is five years old. In the absence of the UPN/SCN, very few children under the age of four have sufficient quasi-identifiable information for probabilistic matching, meaning they do not have a unique identifier which allows linkage to other datasets. In some cases, children aged two or three may have an identifier if they attend a maintained nursery [<xref ref-type="bibr" rid="ref-21">21</xref>]. This is particularly problematic for researchers who wish to link the CLA dataset because it is well established that most children looked after are less than one years old [<xref ref-type="bibr" rid="ref-22">22</xref>].</p>
<p>Within the CLA dataset held in the Secure Anonymised Information Linkage (SAIL) Databank, only 37% of the CLA population have a unique identifier, the Anonymised Linkage Field (ALF), assigned via the routine algorithm (see Methods and <xref ref-type="supplementary-material" rid="sup-a">Supplementary Appendix 1</xref>), drastically reducing the cohort sample that can be linked to other datasets [<xref ref-type="bibr" rid="ref-19">19</xref>, <xref ref-type="bibr" rid="ref-23">23</xref>]. Previous researchers using the CLA dataset have also reported inconsistencies in the data, including discrepancies with the week of births, duplicate ALFs and year-on-year changes in quasi-identifiers amongst individuals in North Wales<xref ref-type="fn" rid="fn4"><sup>4</sup></xref>. Lastly, the use of direct and indirect identifiers is particularly problematic for children looked after. These children are subject to recurring changes in quasi-identifiers e.g. frequent address changes which will contribute to the lack of a postcode.</p>
<p>To overcome the issue of limited routine ALF availability, we have developed a six-step CLA matching algorithm for the SAIL CLA dataset, with the main aim being to improve research quality by producing a standardised data table with additional matched ALFs. This tool utilises de-identified quasi-identifiers from several datasets already available to obtain the routine pre-assigned ALF held in SAIL. The improved ALF table has been made available as an additional resource to all researchers working with the CLA data to ensure projects can benefit from a benchmarked and reliable solution. Whilst this algorithm was developed specifically for the data held within SAIL Databank, it can be adapted to be applied to other anonymised population databases that use similar techniques to those in SAIL.</p>
</sec>
<sec>
<title>Methods</title>
<sec>
<title>Data linkage</title>
<p>Within the SAIL Databank, the use of a unique Anonymised Linking Field (ALF) has been developed and implemented to enable an accurate matching process. The pseudonymisation and linkage processes have been described in detail elsewhere [<xref ref-type="bibr" rid="ref-19">19</xref>]. It is important to note that SAIL does not handle or contain any identifiable information, only pseudonymised data (e.g. week of birth instead of date of birth). Datasets are readily linkable via the ALF which is included within the datasets required for each research project. Data is pseudonymised through a split-file process by a trusted third party, as described in <xref ref-type="supplementary-material" rid="sup-a">Supplementary Appendix 1</xref>.</p>
<p>In addition to the unique identifier (ALF), the social care datasets contain the system ID for each child, this is a unique child identifier assigned by the local authority and it is retained from year to year. However, in Wales, the child&#x2019;s identifiers do not continue with the child if the responsibility for their care is transferred to another local authority [<xref ref-type="bibr" rid="ref-24">24</xref>].</p>
</sec>
<sec>
<title>Data sources</title>
<p>The CLA census has previously been described elsewhere [<xref ref-type="bibr" rid="ref-14">14</xref>, <xref ref-type="bibr" rid="ref-21">21</xref>]. Within SAIL, this table is referred to by the LACW (Looked After Children Wales) acronym however, in-keeping with the census, we will refer to it as the CLA. It is an annual census (1 April to 31 March) which collects information relating to children and young people who are &#x2018;looked after&#x2019; by the local authority. In Wales, this refers to a child who is in care or provided with accommodation for a continuous period of more than 24 hours, as defined by Section 74 of the Social Services and Well-being (Wales) Act 2014 [<xref ref-type="bibr" rid="ref-24">24</xref>]. Within SAIL, CLA data is currently available between 1 April 2002 and 31 March 2021.</p>
<p>The following datasets are all available and pre-linked (i.e. where possible, records have an ALF assigned) within SAIL, and were used to identify additional ALFs. They include: Children and Family Court Advisory and Support Service (Cafcass Cymru/CAFW); Children in Need (CIN, referred to as CINW in SAIL); Children Looked After (CLA, referred to as LACW in SAIL); Children Receiving Care and Support (CRCS); Education Wales (EDUW), National Community Child Health Database (NCCHD); Welsh Demographic Service Dataset (WDSD); Welsh Longitudinal General Practice (WLGP) and Welsh Index of Multiple Deprivation (WIMD) 2014 (<xref ref-type="table" rid="table-1">Table 1</xref>). Additional information about each of these datasets can also be found on the Health Data Research Innovation Gateway (<uri>https://www.healthdatagateway.org/</uri>).</p>
<table-wrap id="table-1">
<label>Table 1</label><caption><title>Datasets and variables used in the algorithm</title></caption>
<table frame="hsides" rules="groups">
<col width="30%"/>
<col width="20%"/>
<col width="25%"/>
<col width="25%"/>
<tbody>
<tr>
<td align="left" style="border-top: solid 1pt; border-bottom: solid 1pt;" valign="middle"><bold>Dataset</bold></td>
<td align="left" style="border-top: solid 1pt; border-bottom: solid 1pt;" valign="middle"><bold>Data provider</bold></td>
<td align="left" style="border-top: solid 1pt; border-bottom: solid 1pt;" valign="middle"><bold>Description</bold></td>
<td align="left" style="border-top: solid 1pt; border-bottom: solid 1pt;" valign="middle"><bold>Variables</bold></td>
</tr>
<tr>
<td align="left" valign="top">Children and Family Court Advisory and Support Service (Cafcass Cymru/CAFW) (<uri>https://web.www.healthdatagateway.org/dataset/29a714e1-5289-4362-be24-2848c954344e</uri>)</td>
<td align="left" valign="top">Welsh Government</td>
<td align="left" valign="top">Cafcass is an organisation that is independent of the courts and social services but works under the rules of the Family Court and legislation to work with children and their families. They advise the courts on what is considered to be in the best interest of the child</td>
<td align="left" valign="top">Week of birth, gender, hearing date, hearing outcome type, maternal ALF</td>
</tr>
<tr>
<td align="left" valign="top">Children in Need (CIN) (referred to as CINW in SAIL) <uri>https://web.www.healthdatagateway.org/dataset/e4f6d9a8-88d0-4781-b192-cd165451b272</uri>)</td>
<td align="left" valign="top">Welsh Government</td>
<td align="left" valign="top">This discontinued census collected data on children and their families who were in need or provided with social services by the local authority (2009&#x2013;2016)</td>
<td align="left" valign="top">Individual Record Number (IRN); is based on, and replaces the Unique Pupil Numbers (UPN) as a system ID across the education tables (EDUW) because UPNs would allow individuals to be identified as they are known in the real world</td>
</tr>
<tr>
<td align="left" valign="top">Children Looked After (CLA) (referred to as LACW in SAIL) (<uri>https://web.www.healthdatagateway.org/dataset/cfdafacb-48f0-4ad8-9f20-193a5eec2da4</uri>)</td>
<td align="left" valign="top">Welsh Government</td>
<td align="left" valign="top">An annual census that contains information relating to the child and their care episodes</td>
<td align="left" valign="top">Week of birth, gender, episode start date, legal status code, child&#x2019;s home Lower Layer Super Output Area (LSOA)</td>
</tr>
<tr>
<td align="left" valign="top">Children Receiving Care and Support (CRCS) (<uri>https://web.www.healthdatagateway.org/dataset/fb3fac03-a428-4b3f-8058-5622e1fd57d8</uri>)</td>
<td align="left" valign="top">Welsh Government</td>
<td align="left" valign="top">This superseded the Children in Need census, and is an annual census that includes information relating to children who have an eligible care and support plan</td>
<td align="left" valign="top">Individual Record Number (IRN)</td>
</tr>
<tr>
<td align="left" valign="top">Education Wales (EDUW) (<uri>https://web.www.healthdatagateway.org/dataset/204fa806-071d-4410-9c2c-143017d32d24</uri>)</td>
<td align="left" valign="top">Welsh Government</td>
<td align="left" valign="top">School and Pupil data covering all state-funded Welsh learning centres</td>
<td align="left" valign="top">Week of birth</td>
</tr>
<tr>
<td align="left" valign="top">National Community Child Health Database (NCCHD) (referred to as NCCH in SAIL) (<uri>https://web.www.healthdatagateway.org/dataset/20fe153c-a5e5-4991-900e-8fa9988e771a</uri>)</td>
<td align="left" valign="top">Digital Health and Care Wales</td>
<td align="left" valign="top">Includes information relating to birth registration, child health examinations and monitoring, and immunisations</td>
<td align="left" valign="top">Week of birth, gender, child&#x2019;s LSOA at birth, birth weights, birth times and maternal ALF to check whether children are twins</td>
</tr>
<tr>
<td align="left" valign="top">Welsh Demographic Service Dataset (WDS) (referred to as WDSD in SAIL) (<uri>https://web.www.healthdatagateway.org/dataset/8a8a5e90-b0c6-4839-bcd2-c69e6e8dca6d</uri>)</td>
<td align="left" valign="top">Digital Health and Care Wales</td>
<td align="left" valign="top">Contains information about individuals in Wales that use NHS services. Includes address and practice registration history</td>
<td align="left" valign="top">Week of birth, gender, child&#x2019;s home LSOA address, address start and end date</td>
</tr>
<tr>
<td align="left" valign="top">Welsh Longitudinal General Practice (WLGP) (<uri>https://web.www.healthdatagateway.org/dataset/33fc3ffd-aa4c-4a16-a32f-0c900aaea3d2</uri>)</td>
<td align="left" valign="top">Direct to SAIL</td>
<td align="left" valign="top">Covers 86% of General Practices in Wales, includes information relating to diagnoses, prescriptions and process of care codes</td>
<td align="left" valign="top">Week of birth, gender, event date, event LSOA</td>
</tr>
<tr>
<td align="left" valign="top">Welsh Index of Multiple Deprivation (WIMD) 2014</td>
<td align="left" valign="top"></td>
<td align="left" valign="top">Welsh Government&#x2019;s measure of deprivation for small areas in Wales</td>
<td align="left" valign="top">WIMD is derived based on the LSOA. It ranks each LSOA from 1 (most deprived) to 1909 (least deprived), roughly grouping rankings into equal quintiles. It captures deprivation based on 8 domains</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Abbreviations: ALF: Anonymised Linkage Field, LSOA: Lower Layer Super Output Area, WIMD: Welsh Index of Multiple Deprivation.</p>
</table-wrap-foot>
</table-wrap>
<p>The WDSD is a register containing demographic information about all individuals registered at a Welsh General Practice (GP). The demographic details included in this dataset are often considered as the gold standard compared with other datasets in SAIL, as they are confirmed as part of the GP registration process and used for patient contact and communication by NHS Wales. Within this dataset, residential postcodes are replaced by the Lower Layer Super Output Area (LSOA) code. Similarly, both home and placement residences are recorded and replaced by LSOAs in the social care datasets. LSOAs are geographic units designed for the reporting of small area statistics. They must have a minimum population size of 1,000, and a mean population size close to 1,600. There are 1,909 LSOAs in Wales [<xref ref-type="bibr" rid="ref-25">25</xref>]. LSOA codes can be used to ascertain an area-based measure of deprivation, known as the Welsh Index of Multiple Deprivation (WIMD) 2019. The WIMD ranks these LSOAs from most deprived to least deprived on a measure that considers a range of factors including income and employment, health, education, access to services, housing, community safety and the physical environment [<xref ref-type="bibr" rid="ref-25">25</xref>].</p>
<p>In addition, within SAIL, the Welsh Longitudinal General Practice (WLGP) dataset contains Read codes, a coded thesaurus of clinical terms used by general practitioners to report findings and procedures [<xref ref-type="bibr" rid="ref-26">26</xref>]. Children looked after can be identified using codes relating to &#x2018;adoption&#x2019;, &#x2018;care&#x2019; and &#x2018;parent of looked-after-child&#x2019; for the parent and child. A list of the codes is available in the concept library: <uri>https://conceptlibrary.saildatabank.com/phenotypes/PH1593/version/2945/detail/</uri>.</p>
</sec>
<sec>
<title>Matching algorithm pre-processing</title>
<p>Before proceeding with the primary linkage, we performed pre-linkage processing to improve match rates in the CLA using other datasets which will also be used in the primary process. Broadly, this includes:</p>
<list list-type="bullet">
<list-item><p>Linking CIN and CRCS to EDUW via the IRN to retrieve the ALF from EDUW to improve the CIN and CRCS match rates.</p></list-item>
<list-item><p>Correcting cases in CLA where some local authorities changed all child system IDs between 2010 &#x2013; 2012. Changes in system IDs disallowed the continuous link between a child&#x2019;s care records. Restoring this link allows for both improvements in the matching process and opportunities for further research. Individuals who do not have a recorded end date for their most recent episode in the CLA table and those who do not have a recorded start date for their earliest episode were identified and matched to find their pre- and post-change system IDs. These individuals were then given a new "unified" system ID, which was applied to all their pre- and post-change entries.</p></list-item>
<list-item><p>Linking Cafcass Wales to NCCHD Births using the female parent ALF, child week of birth, and child gender code to improve the match rate for children in the Cafcass Wales dataset.</p></list-item>
</list>
<p>The matching algorithm is available here: <uri>https://github.com/SwanseaUniversityDataScience/LACW-ALF-Matching</uri>.</p>
</sec>
<sec>
<title>Matching algorithm procedure</title>
<p>Here, we provide an overview of the six-step CLA matching algorithm (summarised in <xref ref-type="fig" rid="fig-1">Figure 1</xref>). Our linkage algorithm is an iterative process where each child proceeds through every step, providing in some cases that they meet the criteria to be matched in a given step, only stopping when they have been successfully assigned an ALF or have reached the end of the process.</p>
<list list-type="order">
<list-item><p>The first step depended on the dates a child was recorded in CLA. If the child was in CLA pre-2016, we linked to CINW using the system ID and local authority code. If the child had an ALF in CINW, this was their ALF in CLA. If the child was in CLA post-2016, we linked to CRCS using the system ID and local authority code. If the child had an ALF in CRCS, this was their ALF in CLA.</p></list-item>
<list-item><p>Next, we required that a child had an IRN recorded in CLA. If they did, we used the IRN, week of birth, and gender code to link to EDUW. If the child had an ALF in EDUW, this became their ALF in CLA.</p></list-item>
<list-item><p>For the children unmatched by the first two steps, we continued the process by linking CLA to Cafcass Wales (CAFW) on the week of birth, gender, episode start date (CLA) and hearing date (CAFW), and a legal status code (CLA) and hearing outcome type (CAFW). If there was a fully matching CAFW record with an ALF, we considered it their ALF. This stage uses the "improved" CAFW match as described in one of the pre-processing tasks.</p></list-item>
<list-item><p>Next, we required that a child&#x2019;s first entry into CLA occurs under six months of age and that their first entry in CLA had a home LSOA recorded. We link CLA to NCCHD births using the week of birth, gender, child home LSOA (CLA) and LSOA of birth (NCCHD). If a single record in NCCHD matched all of these fields, then that ALF was taken to be the child ALF in CLA. This stage operates on the assumption that it is unlikely that the mother moved between giving birth and the child being taken into care if the child was under six months of age.</p></list-item>
<list-item><p>For the children who remain unmatched, we used the WLGP events table to filter for events with care event-related read codes and then linked to CLA, looking for a complete match on the week of birth, gender, child home or placement LSOA (CLA) and event LSOA (WLGP), and episode start/end date (CLA) and event date (WLGP). This step was carried out for every placement recorded for a child in CLA. If a single ALF matched the above fields for two or more placements of a child in CLA, this was taken to be their ALF.</p></list-item>
<list-item><p>Finally, using WDSD to examine GP registration dates, we looked for a match on the week of birth, gender, child home and placement LSOA (LACW) and address LSOA (WDSD), placement start/end date and address start/end date (WDSD). As in step 5, this was done for every placement recorded for a child in CLA. If a single ALF matched all of these fields for three or more placements of a child in LACW, this was taken to be their ALF.</p></list-item>
<list-item><p>Any remaining children were considered not to have an ALF.</p></list-item>
</list>
</sec>
<sec>
<title>Implementation and testing</title>
<p>The algorithm was implemented in Python 3.9.15 [<xref ref-type="bibr" rid="ref-27">27</xref>]. Where it was possible to link records between datasets, Python&#x2019;s Record Linkage package was used [<xref ref-type="bibr" rid="ref-28">28</xref>]. Following implementation, ibm-db and ibm-db-sa [<xref ref-type="bibr" rid="ref-29">29</xref>, <xref ref-type="bibr" rid="ref-30">30</xref>] commands were then used to provide Python an interface to connect to IBM D2B database [<xref ref-type="bibr" rid="ref-31">31</xref>] and adapt data including preparing and issuing SQL statements.</p>
</sec>
<sec>
<title>Benchmarking</title>
<p>We conducted a benchmarking exercise to have a point of comparison for the performance of our algorithm (sensitivity). Since the algorithm utilised by SAIL had access to identifiable data, it is likely that our algorithm is indicative of correct identifiers. To benchmark our algorithm, we ran individuals with an ALF assigned via the routine SAIL processes (37% of children in CLA) through our algorithm to examine whether our algorithm was able to replicate ALFs. The routine algorithm used to assign ALFs within SAIL has produced specificity and sensitivity values of 99.8% and 94.6%, respectively in health datasets, and a sensitivity of 95.2% in social care datasets [<xref ref-type="bibr" rid="ref-19">19</xref>].</p>
</sec>
</sec>
<sec>
<title>Results</title>
<p>CLA data is currently available from 2002/03 to 2020/21 and can be accessed by researchers through the SAIL Databank. During this period, we identified 38,260 individuals with a record in the CLA dataset, with 14,024 (37%) having been allocated an ALF via the standard SAIL algorithm (<xref ref-type="supplementary-material" rid="sup-a">Supplementary Appendix 2</xref>).</p>
<p>Following the implementation of our algorithm, the overall match rate increased by 25%, with a total of 23,409 (61%) individuals having an ALF (via our algorithm and the routine SAIL algorithm). <xref ref-type="fig" rid="fig-1">Figure 1</xref> shows the number of &#x2018;new&#x2019; ALFs assigned at each step of our developed algorithm. A total of 9,842 individuals were assigned an ALF via the algorithm. Note, an inidividual could be assigned an ALF for one or more care episodes where their system ID had changed if they had moved local authorities. This is why the unique number of ALFs assigned via the alogorithm, as per <xref ref-type="supplementary-material" rid="sup-a">Supplementary Appendix 2</xref> (n = 9,385), is lower.</p>
<fig id="fig-1"><label>Figure 1: Data linkage of education, social and healthcare data sources used to identify ALFs</label>
<graphic xlink:href="ijpds-06-2383-g001.tif"/>
<attrib>Abbreviations: ALF: Anonymised Linkage Field; CAFW: Children and Family Court Advisory and Support Service (Cafcass) Wales; CINW: Children in Need Wales; CLA: Children looked after; CRCS: Children Receving Care and Support; EDUW: Education Wales; IRN: Individual Record Number; LA: Local authority; LSOA: Lower Layer Super Output Area; NCCHD: National Community Child Health Database; WLGP: Welsh Longitudinal General Practice; WOB: Week of birth</attrib>
</fig>
<p>The algorithm was also able to correct data quality issues. We also report the cohort demographics for the entire CLA cohort at the time of first entry into CLA before (routine ALF) and after (boosted ALF) applying the algorithm (<xref ref-type="supplementary-material" rid="sup-a">Supplementary Appendix 2</xref>).</p>
<p>We were able to benchmark our algorithm by comparing routine ALFs assigned via the SAIL process to those assigned by our algorithm. Our algorithm demonstrated a high sensitivity rate of 90% when compared to the ALFs already assigned in SAIL (13,253/14,725)<xref ref-type="fn" rid="fn5"><sup>5</sup></xref>. Only a small proportion were &#x2018;incorrect&#x2019; or mis-matched (1.2%, 170/14,725). The algorithm was unable to assign the remaining 8.8% of children an ALF (1302/14,725). We were unable to calculate specificity because we do not have access to the de-anonymised data, and therefore we do not have a set of children that we can confidently say who should not be linked/recorded within the CLA dataset.</p>
<p>Individuals who were born before 1994 had the fewest pre- and post-match ALFs allocated, likely due to fewer datasets being available (e.g. CINW in 2009/10, EDUW in 2002/2003 (academic year)) and poorer data coverage. For example, although the WLGP data pre-dates 2000, the transition to electronic records was not widespread across practices until the late 1990s [<xref ref-type="bibr" rid="ref-32">32</xref>], and records are known to be less complete before 1 January 2000 [<xref ref-type="bibr" rid="ref-33">33</xref>].</p>
<p>As expected, there were also more children under the age of four who did not have an ALF when they entered care for the first time, having the most &#x2018;unlinked&#x2019; ALFs (<xref ref-type="fig" rid="fig-2">Figure 2</xref>). As previously alluded to, this is likely due to the UPN being assigned at entry into school but could also be explained by the lack of placement stability (poor recording of postcode) and continuity in the healthcare system that children looked after experience. The recognition of children looked after as a highly mobile population, together with limited experience of continued general practice care may contribute to the reduction in attributable ALFs [<xref ref-type="bibr" rid="ref-34">34</xref>]. However, the former explanation appears to be most probable, supported by comparable improvements in ALF percentages amongst those less than and greater than four years of age. There was also a high proportion of children aged 15+ years who remained &#x2018;unlinked&#x2019;. One plausible explanation could be because these children have &#x2018;aged out&#x2019; of care and/or left education, and therefore, they have no further contact with these sectors.</p>
<fig id="fig-2"><label>Figure 2: Percentage of individuals with an Anonymised Linkage Field for children looked after pre- (routine) and post-matching (boosted) algorithm, by age at first entry into care</label>
<graphic xlink:href="ijpds-06-2383-g002.tif"/>
</fig>
<p>There appeared to be no difference in ALF improvement by sex; males and females both had around a 25% increase. Again, deprivation did not appear to impact ALF assignment, although there were fewer ALFs matched for individuals who were missing a WIMD score (<xref ref-type="fig" rid="fig-3">Figure 3</xref>). This is to be expected and reflects the lack of a recorded postcode, an identifier used in the ALF linkage process. In line with previous studies, variation in data completeness was more prominent for ethnicity [<xref ref-type="bibr" rid="ref-35">35</xref>, <xref ref-type="bibr" rid="ref-36">36</xref>]. Specifically, ethnic minority groups, with the exception of &#x2018;Mixed&#x2019; ethnic group, were less likely to be successfully matched (<xref ref-type="fig" rid="fig-4">Figure 4</xref>) [<xref ref-type="bibr" rid="ref-37">37</xref>, <xref ref-type="bibr" rid="ref-38">38</xref>]. It has been speculated that this reflects inconsistencies in the quality and distinctiveness of registered names [<xref ref-type="bibr" rid="ref-39">39</xref>, <xref ref-type="bibr" rid="ref-40">40</xref>]. Since those with asylum seeker status (a person who has left their own country and is seeking protection in another country) are likely to be born outside of the UK, this may also impact linkage success (e.g. lack of NHS number, postcode history).</p>
<fig id="fig-3"><label>Figure 3: Percentage of individuals with an Anonymised Linkage Field for children looked after pre- (routine) and post-matching (boosted) algorithm, by Welsh Index of Multiple Deprivation (WIMD) based on the home postcode at time of first entry into care</label>
<graphic xlink:href="ijpds-06-2383-g003.tif"/>
</fig>
<fig id="fig-4"><label>Figure 4: Percentage of individuals with an Anonymised Linkage Field for children looked after pre- (routine) and post-matching (boosted) algorithm, by ethnic group at first entry into care</label>
<graphic xlink:href="ijpds-06-2383-g004.tif"/>
</fig>
</sec>
<sec>
<title>Discussion</title>
<p>Our CLA ALF improvement algorithm increased ALF matching from 37% to 61%, allowing an additional 9,385 (25%) individuals to be assigned an ALF. The algorithm also amended incorrect weeks of birth and gender, and incorrect/duplicate identifiers. Benchmarking against the SAIL ALF assignment algorithm demonstrated high levels of sensitivity (90%) for our CLA ALF algorithm.</p>
<sec>
<title>Strengths</title>
<p>Our algorithm led to a large improvement in the number of individuals assigned an ALF within the CLA dataset. An additional 25% of identifiers were matched, and other known data errors such as incorrect weeks of birth, duplicate and inconsistent ALFs were corrected. Through improvement of ALF matching, we hope to reduce some bias that occurs with missing data, particularly ethnic and deprivation bias, demographics that may be associated with children in care. Our algorithm also demonstrated high levels of sensitivity (90%) when benchmarked against the routine algorithm used by SAIL to assign ALFs. This algorithm provides an underlying foundation for further development, particularly as SAIL continues to obtain new data sources. Other datasets may also benefit from our algorithm, and future work should explore its application.</p>
</sec>
<sec>
<title>Limitations</title>
<sec>
<title>Potential biases in ALF availability</title>
<p>Whilst the algorithm improves the number of ALFs allocated, it is important to note that although a secondary outcome of the algorithm was to reduce bias in the CLA population by improving ALF matching, it was not possible to completely alleviate. A successful ALF match is dependent on an individual being present in the dataset through interactions with services. For example, for an individual to be recorded in the WDSD, NCCHD or WLGP, an interaction with a Welsh NHS service must take place. This may not be the case, for example, for infants who are born in England and move into Wales, thus it would not be possible to match an ALF via this method. In addition, children looked after lack stability, which may contribute to limited continuity in primary care and residential addresses. Further, by capturing ALFs using the CAFW dataset we are less likely to identify children who enter care via voluntary arrangements because Cafcass is not involved in these cases [<xref ref-type="bibr" rid="ref-41">41</xref>]. This is potentially problematic as approximately two-thirds of children in Wales initially enter care by voluntary arrangements [<xref ref-type="bibr" rid="ref-42">42</xref>]. Researchers should take these issues into consideration and aim to address any potential biases these may introduce.</p>
</sec>
<sec>
<title>Impact of adoption on an ALF</title>
<p>One known limitation of the CLA data is that it does not contain a child&#x2019;s information post-adoption. When an adoption order is granted, an individual&#x2019;s identifier changes because they are assigned a new NHS number and unique identifier within the local authority. It is therefore not possible to link pre- and post-adoption records [<xref ref-type="bibr" rid="ref-14">14</xref>]. This may explain the lower rates of ALF matches in younger children less than four years of age, especially as the average age for adoption is three years old in Wales [<xref ref-type="bibr" rid="ref-43">43</xref>].</p>
</sec>
<sec>
<title>Assessing the sensitivity and benchmarking</title>
<p>We were only able to examine the sensitivity (90%) of our ALF matching algorithm in comparison against previously published record linkage methods (routine (pre-assigned) ALFs by SAIL) [<xref ref-type="bibr" rid="ref-19">19</xref>]. As the algorithm used de-identified quasi-identifiers and not the original data, it was not possible to calculate specificity or check for sources of error. Whilst the algorithm was highly sensitive, researchers should be aware that a small proportion of ALFs assigned are potentially erroneous (1.2%). Also, it is important to note that comparing our algorithm to the routine algorithm has its own limitations. First, any incorrect matches are constrained to both algorithms. Second, because we were only able to benchmark against routine (pre-assigned) ALFs this may introduce bias issues, whereby different populations are not equally assigned an ALF. As a result, this may accentuate disparities in social care. Lastly, we cannot directly compare the algorithms because of the influence of data quality; the algorithms use different variables and data sources to assign an ALF, which is likely to affect the matching process.</p>
<p>Future work should aim to validate the algorithm against identifiable data to determine the accuracy of the linkage, or alternatively, to benchmark using synthetic data. Researchers need to consider whether to adjust for missing data amongst vulnerable groups such as those with asylum seeker status, or ethnic minority groups because of missed linkage. This is particularly relevant in this field of research, as those with asylum seeker status represent around 7% of all children looked after in England and figures continue to rise across the UK [<xref ref-type="bibr" rid="ref-44">44</xref>]. Future work should involve collaborations with each of the UK home nations Governments and local authorities to explore how match rates could be improved.</p>
<p>In this work, we have limited our improved ALF matching algorithm to the CLA dataset because of the known poor ALF match rate. It may be possible that with further refinement, improved match benefits can also be made to other datasets that contain cohorts of school-aged children without NHS numbers e.g. the Student Health and Wellbeing Survey Dataset.</p>
</sec>
</sec>
<sec>
<title>Conclusion</title>
<p>Our work highlights the benefits of our CLA ALF improvement algorithm, resulting in the potential to explore a wide range of research questions through its linkage to other datasets. We characterise our algorithms&#x2019; performance by benchmarking against the standard ALF matching algorithm utilised by SAIL, which shows promising results. Our benchmarked algorithm produced high rates of sensitivity (90%) and importantly, greatly improved the ALF match rate from 37% to 61%. Additionally, this algorithm has the potential to overcome some of the bias that researchers may experience due to missing data. However, researchers should be aware of some biases and missing data that may remain. We demonstrate a standardised and reliable matching tool to facilitate the improved allocation of an ALF in the CLA dataset, which has been implemented as part of the CLA dataset. Development and future benchmarking efforts may further refine our algorithm, allowing application to other linkable datasets.</p>
</sec>
</sec>
<sec sec-type="supplementary-material">
<title>Supplementary Files</title>
<supplementary-material id="sup-a">
<label>Supplementary Appendices</label> 
<media mimetype="application" mime-subtype="pdf" xlink:href="ijpds-06-2383-s001.pdf"/>
</supplementary-material>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<p>This study makes use of anonymised data held in the SAIL system, which is part of the national e-health records research infrastructure for Wales. We would like to acknowledge all the data providers who make anonymised data available for research. We would like to thank our colleagues at Welsh Government for the guidance they have provided.</p>
</ack>
<sec>
<title>Funding</title>
<p>This work was supported by Health and Care Research Wales and Administrative Data Research (ADR) Wales. LJG is a member of the Children&#x2019;s Social Care Research and Development Centre (CASCADE) partnership, which receives infrastructure funding from Health and Care Research Wales (HCRW) (517199). LEC is a research fellow, funded by Health and Care Research Wales (SCF-22-07).</p>
</sec>
<sec>
<title>Ethics statement</title>
<p>In accordance with Health Research Authority guidance, ethical approval is not mandatory for studies using only anonymized data. The project proposal was reviewed by the SAIL independent Information Governance Review Panel, experts in information governance, and members of the public approved this study (reference: 1533).</p>
</sec>
<sec>
<title>Data availability statement</title>
<p>Data may be obtained from a third party and are not publicly available. The data used in this study is available from the Secure Anonymised Information Linkage (SAIL) Databank at the Health Information Research Unit (HIRU) Swansea University, Swansea, UK. All proposals to use SAIL datasets must comply with HIRU&#x2019;s information governance policy and are subject to review by an independent Information Governance Review Panel (IGRP). Before data can be accessed, approval must be given by the IGRP. Requests to access these datasets should be directed to: <uri>www.saildatabank.com/application-process</uri>.</p>
</sec>
<fn-group>
<fn id="fn1"><label>1</label><p>Wales: the Secure Anonymised Information Linkage (SAIL) Databank (Swansea University, Wales) (<uri>https://saildatabank.com/</uri>) England: the Office for National Statistics Secure Research Service. Note, several ADR UK flagship datasets, including Education and Child Health Insights from Linked Data (ECHILD), Longitudinal Education Outcomes (LEO) and Growing up in England (GUIE) datasets contain variables from the CLA Census via the National Pupil Database (NPD) (<uri>https://www.ons.gov.uk/aboutus/whatwedo/statistics/requestingstatistics/secureresearchservice</uri>) Scotland: The National Safe Haven is controlled by the Electronic Data Research and Innovation Service (eDRIS) who are part of Public Health Scotland (<uri>https://www.researchdata.scot/accessing-data/information-for-researchers/tresand-data-access/</uri>) Northern Ireland: Children&#x2019;s social care data is available in the Social Services Client Administration and Retrieval Environment (SOSCARE) dataset (<uri>https://bso.hscni.net/directorates/digital/honest-broker-service/</uri>).</p></fn>
<fn id="fn2"><label>2</label><p>SOSCARE (Northern Ireland) has an integrated health and social care system, whereby children&#x2019;s social care datasets contain the Health and Care Number (HCN), the equivalent of the NHS number. This allows linkage across health and social care datasets by matching of the HCN [<xref ref-type="bibr" rid="ref-45">45</xref>].</p></fn>
<fn id="fn3"><label>3</label><p>Wales: Pupil Level Annual School Census (PLASC); England: National Pupil Database (NPD); Scotland: Scottish Exchange of Data (ScotXed).</p></fn>
<fn id="fn4"><label>4</label><p>In the CLA collections, the four NorthWales local authorities changed their child identifiers from one year to the next. This means that it is not possible to follow the same child longitudinally in these local authorities.</p></fn>
<fn id="fn5"><label>5</label><p>Note, this is higher than the unique number of ALFs (n=14,024) described in <xref ref-type="supplementary-material" rid="sup-a">Supplementary Appendix 2</xref> because a child may have several system IDs from where they have moved local authority</p></fn>
</fn-group>
<ref-list>
<title>References</title>
<ref id="ref-1"><label>1</label><mixed-citation publication-type="website"><collab>NSPCC Learning</collab>. <article-title>Looked after children [Internet]</article-title>. <year>2024</year>. Available from: <uri>https://learning.nspcc.org.uk/children-and-families-at-risk/looked-after-children#skip-to-content</uri></mixed-citation></ref>
<ref id="ref-2"><label>2</label><mixed-citation publication-type="journal"><string-name><surname>McGhee</surname> <given-names>J</given-names></string-name>, <string-name><surname>Bunting</surname> <given-names>L</given-names></string-name>, <string-name><surname>McCartan</surname> <given-names>C</given-names></string-name>, <string-name><surname>Elliott</surname> <given-names>M</given-names></string-name>, <string-name><surname>Bywaters</surname> <given-names>P</given-names></string-name>, <string-name><surname>Featherstone</surname> <given-names>B</given-names></string-name>. <article-title>Looking after children in the UK&#x2014;convergence or divergence?</article-title> <source>Br J Soc Work</source>. <year>2018</year>;<volume>48</volume>(<issue>5</issue>):<fpage>1176</fpage>&#x2013;<lpage>98</lpage>. <pub-id pub-id-type="doi">10.1093/bjsw/bcx103</pub-id></mixed-citation></ref>
<ref id="ref-3"><label>3</label><mixed-citation publication-type="journal"><collab>NSPCC</collab>. <article-title>Statistics Briefing: Children in Care</article-title>. <source>NSPCC Learn</source>. <year>2024</year>;<fpage>1</fpage>&#x2013;<lpage>26</lpage>.</mixed-citation></ref>
<ref id="ref-4"><label>4</label><mixed-citation publication-type="journal"><string-name><surname>Simkiss</surname> <given-names>D</given-names></string-name>. <article-title>Outcomes for looked after children and young people</article-title>. <source>Paediatr Child Heal (United Kingdom) [Internet]</source>. <year>2012</year>;<volume>22</volume>(<issue>9</issue>):<fpage>388</fpage>&#x2013;<lpage>92</lpage>. <pub-id pub-id-type="doi">10.1016/j.paed.2012.05.004</pub-id></mixed-citation></ref>
<ref id="ref-5"><label>5</label><mixed-citation publication-type="journal"><string-name><surname>McAuley</surname> <given-names>C</given-names></string-name>, <string-name><surname>Davis</surname> <given-names>T</given-names></string-name>. <article-title>Emotional well-being and mental health of looked after children in England</article-title>. <source>Child Fam Soc Work</source>. <year>2009</year>;<volume>14</volume>(<issue>2</issue>):<fpage>147</fpage>&#x2013;<lpage>55</lpage>. <pub-id pub-id-type="doi">10.1111/j.1365-2206.2009.00619.x</pub-id></mixed-citation></ref>
<ref id="ref-6"><label>6</label><mixed-citation publication-type="journal"><string-name><surname>Luke</surname> <given-names>N</given-names></string-name>, <string-name><surname>O&#x2019;Higgins</surname> <given-names>A</given-names></string-name>. <article-title>Is the Care System to Blame for the Poor Educational Outcomes of Children Looked After? Evidence from a Systematic Review and National Database Analysis</article-title>. <source>Child Aust [Internet]</source>. <year>2018</year> <month>Jun</month> <day>1</day>;<volume>43</volume>(<issue>2</issue>):<fpage>135</fpage>&#x2013;<lpage>51</lpage>. <pub-id pub-id-type="doi">10.1017/cha.2018.22</pub-id></mixed-citation></ref>
<ref id="ref-7"><label>7</label><mixed-citation publication-type="journal"><string-name><surname>Connelly</surname> <given-names>R</given-names></string-name>, <string-name><surname>Playford</surname> <given-names>CJ</given-names></string-name>, <string-name><surname>Gayle</surname> <given-names>V</given-names></string-name>, <string-name><surname>Dibben</surname> <given-names>C</given-names></string-name>. <article-title>The role of administrative data in the big data revolution in social science research</article-title>. <source>Soc Sci Res [Internet]</source>. <year>2016</year>;<volume>59</volume>:<fpage>1</fpage>&#x2013;<lpage>12</lpage>. Available from: <pub-id pub-id-type="doi">10.1016/j.ssresearch.2016.04.015</pub-id>.</mixed-citation></ref>
<ref id="ref-8"><label>8</label><mixed-citation publication-type="journal"><string-name><surname>Bailey</surname> <given-names>GA</given-names></string-name>, <string-name><surname>Lee</surname> <given-names>A</given-names></string-name>, <string-name><surname>Bedford</surname> <given-names>H</given-names></string-name>, <string-name><surname>Perry</surname> <given-names>M</given-names></string-name>, <string-name><surname>Holland</surname> <given-names>S</given-names></string-name>, <string-name><surname>Walton</surname> <given-names>S</given-names></string-name>, <etal>et al</etal>. <article-title>Immunisation status of children receiving care and support in Wales: a national data linkage study</article-title>. <source>Front Public Heal [Internet]</source>. <year>2023</year> [cited 2023 Oct 5];<volume>11</volume>. Available from: /pmc/articles/PMC10423803/<pub-id pub-id-type="doi">10.3389/FPUBH.2023.1231264/FULL</pub-id>.</mixed-citation></ref>
<ref id="ref-9"><label>9</label><mixed-citation publication-type="journal"><string-name><surname>Doebler</surname> <given-names>S</given-names></string-name>, <string-name><surname>Broadhurst</surname> <given-names>K</given-names></string-name>, <string-name><surname>Alrouh</surname> <given-names>B</given-names></string-name>, <string-name><surname>Cusworth</surname> <given-names>L</given-names></string-name>, <string-name><surname>Griffiths</surname> <given-names>L</given-names></string-name>. <article-title>Born into care: Associations between area-level deprivation and the rates of children entering care proceedings in Wales</article-title>. <source>Child Youth Serv Rev</source>. <year>2022</year> <month>Oct</month> <day>1</day>;<volume>141</volume>:<fpage>106595</fpage>. <pub-id pub-id-type="doi">10.1016/j.childyouth.2022.106595</pub-id></mixed-citation></ref>
<ref id="ref-10"><label>10</label><mixed-citation publication-type="website"><collab>Department of Health &amp; Social Care</collab>. <article-title>Data saves lives: reshaping health and social care with data - GOV.UK [Internet].</article-title> <source>UK Government</source>. <year>2022</year>. Available from: <uri>https://www.gov.uk/government/publications/data-saves-lives-reshaping-health-and-social-care-with-data/data-saves-lives-reshaping-health-and-social-care-with-data#improving-data-for-adult-social-care</uri></mixed-citation></ref>
<ref id="ref-11"><label>11</label><mixed-citation publication-type="website"><collab>Welsh Government</collab>. <article-title>Programme for government 2021 to 2026: update. 2021;(June)</article-title>. Available from: <uri>https://gov.wales/programme-for-government-2021-to-2026-html</uri>.</mixed-citation></ref>
<ref id="ref-12"><label>12</label><mixed-citation publication-type="journal"><string-name><surname>Mc Grath-Lone</surname> <given-names>L</given-names></string-name>, <string-name><surname>Jay</surname> <given-names>MA</given-names></string-name>, <string-name><surname>Blackburn</surname> <given-names>R</given-names></string-name>, <string-name><surname>Gordon</surname> <given-names>E</given-names></string-name>, <string-name><surname>Zylbersztejn</surname> <given-names>A</given-names></string-name>, <string-name><surname>Wiljaars</surname> <given-names>L</given-names></string-name>, <etal>et al</etal>. <article-title>What makes administrative data research-ready?</article-title> <source>Int J Popul Data Sci [Internet]</source>. <year>2022</year> <month>Apr</month> <day>27</day>;<volume>7</volume>(<issue>1</issue>):<fpage>12</fpage>&#x2013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.23889/ijpds.v7i1.1718</pub-id></mixed-citation></ref>
<ref id="ref-13"><label>13</label><mixed-citation publication-type="website"><string-name><surname>Holmes</surname> <given-names>L</given-names></string-name>. <article-title>Use of children&#x2019;s social care data at the local and regional area level.</article-title> <source>Nuff Fam Justice Obs [Internet]</source>. <year>2019</year>; Available from: <uri>https://www.nuffieldfjo.org.uk/wp-content/uploads/2021/05/Use-of-childrens-social-care-data_final.pdf</uri>.</mixed-citation></ref>
<ref id="ref-14"><label>14</label><mixed-citation publication-type="website"><string-name><surname>Allnatt</surname> <given-names>G</given-names></string-name>, <string-name><surname>Elliott</surname> <given-names>M</given-names></string-name>, <string-name><surname>Cowley</surname> <given-names>L</given-names></string-name>, <string-name><surname>Lee</surname> <given-names>A</given-names></string-name>, <string-name><surname>North</surname> <given-names>L</given-names></string-name>, <string-name><surname>Griffiths</surname> <given-names>L</given-names></string-name>. <article-title>Data Explained: Children Looked After datasets.</article-title> <source>ADR Wales [Internet]</source>. <year>2023</year>; Available from: <uri>https://adrwales.org/wp-content/uploads/2023/06/Data-Explained-CLA-datasets_final.pdf</uri>.</mixed-citation></ref>
<ref id="ref-15"><label>15</label><mixed-citation publication-type="website"><string-name><surname>Soraghan</surname> <given-names>J</given-names></string-name>, <string-name><surname>Raab</surname> <given-names>G</given-names></string-name>. <article-title>Data Explained: Scottish Government&#x2019;s Looked After Children Longitudinal Dataset</article-title>. <source>ADR Scotl [Internet]</source>. <year>2023</year>;(April). Available from: <uri>https://www.adruk.org/fileadmin/uploads/adruk/Documents/Data_Explained/Data_Explained_Scottish_Government_Looked_After_Children_Longitudinal_Dataset_April_2023.pdf</uri>.</mixed-citation></ref>
<ref id="ref-16"><label>16</label><mixed-citation publication-type="journal"><string-name><surname>Jay</surname> <given-names>MA</given-names></string-name>, <string-name><surname>McGrath-Lone</surname> <given-names>L</given-names></string-name>, <string-name><surname>Gilbert</surname> <given-names>R</given-names></string-name>. <article-title>Data Resource: the National Pupil Database (NPD)</article-title>. <source>Int J Popul data Sci [Internet]</source>. <year>2019</year>;<volume>4</volume>(<issue>1</issue>):<fpage>1101</fpage>. <pub-id pub-id-type="doi">10.23889/ijpds.v4i1.1101</pub-id></mixed-citation></ref>
<ref id="ref-17"><label>17</label><mixed-citation publication-type="website"><string-name><surname>Mckenna</surname> <given-names>AS</given-names></string-name>, <string-name><surname>Maguire</surname> <given-names>A</given-names></string-name>, <string-name><surname>Bunting</surname> <given-names>L</given-names></string-name>, <string-name><surname>Gleghorne</surname> <given-names>N</given-names></string-name>, <string-name><surname>Reilly</surname> <given-names>DO</given-names></string-name>. <article-title>Data Explained: Social Services Client Administration and Retrieval Environment (SOSCARE).</article-title> <source>ADR Nothern Irel [Internet]</source>. <year>2024</year>; Available from: <uri>https://www.adruk.org/fileadmin/uploads/adruk/Documents/Data_Explained/ADR_UK_Data_Explained_SOSCARE.pdf</uri>.</mixed-citation></ref>
<ref id="ref-18"><label>18</label><mixed-citation publication-type="journal"><string-name><surname>Mc Grath-Lone</surname> <given-names>L</given-names></string-name>, <string-name><surname>Harron</surname> <given-names>K</given-names></string-name>, <string-name><surname>Dearden</surname> <given-names>L</given-names></string-name>, <string-name><surname>Nasim</surname> <given-names>B</given-names></string-name>, <string-name><surname>Gilbert</surname> <given-names>R</given-names></string-name>. <article-title>Data Resource Profile: Children Looked After Return (CLA)</article-title>. <source>Int J Epidemiol</source>. <year>2016</year>;<volume>45</volume>(<issue>3</issue>):<fpage>716</fpage>-<lpage>717F</lpage>. <pub-id pub-id-type="doi">10.1093/ije/dyw117</pub-id></mixed-citation></ref>
<ref id="ref-19"><label>19</label><mixed-citation publication-type="journal"><string-name><surname>Lyons</surname> <given-names>RA</given-names></string-name>, <string-name><surname>Jones</surname> <given-names>KH</given-names></string-name>, <string-name><surname>John</surname> <given-names>G</given-names></string-name>, <string-name><surname>Brooks</surname> <given-names>CJ</given-names></string-name>, <string-name><surname>Verplancke</surname> <given-names>JP</given-names></string-name>, <string-name><surname>Ford</surname> <given-names>D V.</given-names></string-name>, <etal>et al</etal>. <article-title>The SAIL databank: Linking multiple health and social care datasets</article-title>. <source>BMC Med Inform Decis Mak [Internet]</source>. <year>2009</year> [cited 2021 Jan 20];<volume>9</volume>(<issue>1</issue>). <pub-id pub-id-type="doi">10.1186/1472-6947-9-3</pub-id></mixed-citation></ref>
<ref id="ref-20"><label>20</label><mixed-citation publication-type="journal"><string-name><surname>Christen</surname> <given-names>P</given-names></string-name>, <string-name><surname>Ranbaduge</surname> <given-names>T</given-names></string-name>, <string-name><surname>Schnell</surname> <given-names>R</given-names></string-name>. <article-title>Linking Sensitive Data: Methods and Techniques for Practical Privacy-Preserving Information Sharing</article-title>. <source>Link Sensitive Data Methods Tech Pract Privacy-Preserving Inf Shar</source>. <year>2020</year>;<fpage>1</fpage>&#x2013;<lpage>468</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-030-59706-1</pub-id></mixed-citation></ref>
<ref id="ref-21"><label>21</label><mixed-citation publication-type="journal"><string-name><surname>Allnatt</surname> <given-names>G</given-names></string-name>, <string-name><surname>Lee</surname> <given-names>A</given-names></string-name>, <string-name><surname>Scourfield</surname> <given-names>J</given-names></string-name>, <string-name><surname>Elliott</surname> <given-names>M</given-names></string-name>, <string-name><surname>Broadhurst</surname> <given-names>K</given-names></string-name>, <string-name><surname>Griffiths</surname> <given-names>L</given-names></string-name>. <article-title>Data resource profile: children looked after administrative records in Wales</article-title>. <source>Int J Popul data Sci</source>. <year>2022</year>;<volume>7</volume>(<issue>1</issue>):<fpage>1752</fpage>. <pub-id pub-id-type="doi">10.23889/ijpds.v7i1.1752</pub-id></mixed-citation></ref>
<ref id="ref-22"><label>22</label><mixed-citation publication-type="website"><string-name><surname>Alrouh</surname> <given-names>B</given-names></string-name>, <string-name><surname>Broadhurst</surname> <given-names>K</given-names></string-name>, <string-name><surname>Cusworth</surname> <given-names>L</given-names></string-name>, <string-name><surname>Griffiths</surname> <given-names>L</given-names></string-name>, <string-name><surname>Johnson</surname> <given-names>RD</given-names></string-name>, <string-name><surname>Akbari</surname> <given-names>A</given-names></string-name>, <etal>et al</etal>. <article-title>Born into care: newborns and infants in care proceedings in Wales [Internet].</article-title> <source>Nuffield Family Justice Observatory</source>. <year>2019</year>. Available from: <uri>https://www.nuffieldfjo.org.uk/wp-content/uploads/2021/05/Born-into-care-Wales-main-report_English_final_web.pdf</uri>.</mixed-citation></ref>
<ref id="ref-23"><label>23</label><mixed-citation publication-type="journal"><string-name><surname>Ford</surname> <given-names>D V.</given-names></string-name>, <string-name><surname>Jones</surname> <given-names>KH</given-names></string-name>, <string-name><surname>Verplancke</surname> <given-names>J-P</given-names></string-name>, <string-name><surname>Lyons</surname> <given-names>RA</given-names></string-name>, <string-name><surname>John</surname> <given-names>G</given-names></string-name>, <string-name><surname>Brown</surname> <given-names>G</given-names></string-name>, <etal>et al</etal>. <article-title>The SAIL Databank: building a national architecture for e-health research and evaluation</article-title>. <source>BMC Health Serv Res</source>. <year>2009</year> <month>Dec</month> <day>4</day>;<volume>9</volume>(<issue>1</issue>):<fpage>157</fpage>. <pub-id pub-id-type="doi">10.1186/1472-6963-9-157</pub-id></mixed-citation></ref>
<ref id="ref-24"><label>24</label><mixed-citation publication-type="website"><collab>Welsh Government</collab>. <article-title>Children looked after census 2021-2022 [Internet]</article-title>. <year>2022</year>. Available from: <uri>https://www.gov.wales/sites/default/files/statistics-and-research/2022-05/looked-after-children-census-2021-22-guidance.pdf</uri>.</mixed-citation></ref>
<ref id="ref-25"><label>25</label><mixed-citation publication-type="website"><string-name><surname>Wales</surname> <given-names>S</given-names></string-name> for. <article-title>Welsh Index of Multiple Deprivation 2019 (WIMD 2019): guidance on use [Internet]</article-title>. <year>2019</year> [cited 2021 Jan 21]. Available from: <uri>https://gov.wales/sites/default/files/statistics-and-research/2019-11/welsh-index-of-multiple-deprivation-wimd-2019-guidance-on-use.pdf</uri>.</mixed-citation></ref>
<ref id="ref-26"><label>26</label><mixed-citation publication-type="website"><collab>UK Gov</collab>. <article-title>UK Read Code - data.gov.uk [Internet]</article-title>. <source>NHS Digital</source>. <year>2015</year> [cited 2023 Oct 5]. Available from: <uri>https://data.gov.uk/dataset/f262aa32-9c4e-44f1-99eb-4900deada7a4/uk-read-code</uri>.</mixed-citation></ref>
<ref id="ref-27"><label>27</label><mixed-citation publication-type="website"><collab>Python Foundation</collab>. <article-title>About PythonTM &#x2013; Python.org [Internet]</article-title>. <source>About Python</source>. <year>2016</year> [cited 2023 Oct 5]. p. <fpage>1</fpage>. Available from: <uri>https://www.python.org/about/</uri>.</mixed-citation></ref>
<ref id="ref-28"><label>28</label><mixed-citation publication-type="website"><string-name><surname>de Bruin</surname> <given-names>J</given-names></string-name>. <article-title>About &#x2014; Python Record Linkage Toolkit 0.15 documentation [Internet]</article-title>. [cited 2023 Oct 5]. Available from: <uri>https://recordlinkage.readthedocs.io/en/latest/about.html</uri>.</mixed-citation></ref>
<ref id="ref-29"><label>29</label><mixed-citation publication-type="website"><article-title>Application development in Python with ibm_db &#x2013; IBM Documentation [Internet]</article-title>. <year>2022</year> [cited 2023 Oct 5]. Available from: <uri>https://www.ibm.com/docs/en/db2/11.5?topic=framework-application-development-db</uri>.</mixed-citation></ref>
<ref id="ref-30"><label>30</label><mixed-citation publication-type="website"><article-title>ibm-db-sa &#x2013; PyPI [Internet]</article-title>. <year>2023</year> [cited 2023 Oct 5]. Available from: <uri>https://pypi.org/project/ibm-db-sa/</uri>.</mixed-citation></ref>
<ref id="ref-31"><label>31</label><mixed-citation publication-type="website"><collab>IBM</collab>. <article-title>IBM DB2 Database [Internet].</article-title> <uri>Https://Www.Ibm.Com/Br-Pt/Products/Db2-Database</uri>. <year>2024</year>. Available from: <uri>https://www.ibm.com/products/db2-database</uri>.</mixed-citation></ref>
<ref id="ref-32"><label>32</label><mixed-citation publication-type="journal"><string-name><surname>McMillan</surname> <given-names>B</given-names></string-name>, <string-name><surname>Eastham</surname> <given-names>R</given-names></string-name>, <string-name><surname>Brown</surname> <given-names>B</given-names></string-name>, <string-name><surname>Fitton</surname> <given-names>R</given-names></string-name>, <string-name><surname>Dickinson</surname> <given-names>D</given-names></string-name>. <article-title>Primary care patient records in the United Kingdom: Past, present, and future research priorities</article-title>. <source>J Med Internet Res</source>. <year>2018</year>;<volume>20</volume>(<issue>12</issue>):<fpage>1</fpage>&#x2013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.2196/11293</pub-id>.</mixed-citation></ref>
<ref id="ref-33"><label>33</label><mixed-citation publication-type="journal"><string-name><surname>Torabi</surname> <given-names>F</given-names></string-name>, <string-name><surname>Harris</surname> <given-names>DE</given-names></string-name>, <string-name><surname>Bodger</surname> <given-names>O</given-names></string-name>, <string-name><surname>Akbari</surname> <given-names>A</given-names></string-name>, <string-name><surname>Lyons</surname> <given-names>RA</given-names></string-name>, <string-name><surname>Gravenor</surname> <given-names>M</given-names></string-name>, <etal>et al</etal>. <article-title>Identifying unmet antithrombotic therapeutic need, and implications for stroke and systemic embolism in atrial fibrillation patients: a population-scale longitudinal study</article-title>. <source>Eur Hear J Open</source>. <year>2022</year>;<volume>2</volume>(<issue>6</issue>):<fpage>1</fpage>&#x2013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1093/ehjopen/oeac066</pub-id></mixed-citation></ref>
<ref id="ref-34"><label>34</label><mixed-citation publication-type="journal"><string-name><surname>Ridley</surname> <given-names>J</given-names></string-name>, <string-name><surname>Larkins</surname> <given-names>C</given-names></string-name>, <string-name><surname>Farrelly</surname> <given-names>N</given-names></string-name>, <string-name><surname>Hussein</surname> <given-names>S</given-names></string-name>, <string-name><surname>Austerberry</surname> <given-names>H</given-names></string-name>, <string-name><surname>Manthorpe</surname> <given-names>J</given-names></string-name>, <etal>et al</etal>. <article-title>Investing in the relationship: Practitioners&#x2019; relationships with looked-after children and care leavers in Social Work Practices</article-title>. <source>Child Fam Soc Work</source>. <year>2016</year>;<volume>21</volume>(<issue>1</issue>):<fpage>55</fpage>&#x2013;<lpage>64</lpage>. <pub-id pub-id-type="doi">10.1111/cfs.12109</pub-id></mixed-citation></ref>
<ref id="ref-35"><label>35</label><mixed-citation publication-type="journal"><string-name><surname>Teece</surname> <given-names>L</given-names></string-name>, <string-name><surname>Gray</surname> <given-names>LJ</given-names></string-name>, <string-name><surname>Melbourne</surname> <given-names>C</given-names></string-name>, <string-name><surname>Orton</surname> <given-names>C</given-names></string-name>, <string-name><surname>Ford</surname> <given-names>D V.</given-names></string-name>, <string-name><surname>Martin</surname> <given-names>CA</given-names></string-name>, <etal>et al</etal>. <article-title>United Kingdom Research study into Ethnicity and COVID-19 outcomes in Healthcare workers (UK-REACH): A retrospective cohort study using linked routinely collected data, study protocol</article-title>. <source>BMJ Open</source>. <year>2021</year>;<volume>11</volume>(<issue>6</issue>). <pub-id pub-id-type="doi">10.1136/bmjopen-2020-046392</pub-id></mixed-citation></ref>
<ref id="ref-36"><label>36</label><mixed-citation publication-type="journal"><string-name><surname>M&#x00F8;ller</surname> <given-names>H</given-names></string-name>, <string-name><surname>Henson</surname> <given-names>K</given-names></string-name>, <string-name><surname>L&#x00FC;chtenborg</surname> <given-names>M</given-names></string-name>, <string-name><surname>Broggio</surname> <given-names>J</given-names></string-name>, <string-name><surname>Charman</surname> <given-names>J</given-names></string-name>, <string-name><surname>Coupland</surname> <given-names>VH</given-names></string-name>, <etal>et al</etal>. <article-title>Short-term breast cancer survival in relation to ethnicity, stage, grade and receptor status: National cohort study in England</article-title>. <source>Br J Cancer</source>. <year>2016</year>;<volume>115</volume>(<issue>11</issue>):<fpage>1408</fpage>&#x2013;<lpage>15</lpage>. <pub-id pub-id-type="doi">10.1038/bjc.2016.335</pub-id></mixed-citation></ref>
<ref id="ref-37"><label>37</label><mixed-citation publication-type="journal"><string-name><surname>Libuy</surname> <given-names>N</given-names></string-name>, <string-name><surname>Harron</surname> <given-names>K</given-names></string-name>, <string-name><surname>Gilbert</surname> <given-names>R</given-names></string-name>, <string-name><surname>Caulton</surname> <given-names>R</given-names></string-name>, <string-name><surname>Cameron</surname> <given-names>E</given-names></string-name>, <string-name><surname>Blackburn</surname> <given-names>R</given-names></string-name>. <article-title>Linking education and hospital data in England: Linkage process and quality</article-title>. <source>Int J Popul Data Sci</source>. <year>2021</year>;<volume>6</volume>(<issue>1</issue>). <pub-id pub-id-type="doi">10.23889/ijpds.v6i1.1671</pub-id></mixed-citation></ref>
<ref id="ref-38"><label>38</label><mixed-citation publication-type="journal"><string-name><surname>Hagger-johnson</surname> <given-names>G</given-names></string-name>. <article-title>Probabilistic linking to enhance deterministic algorithms and reduce linkage errors in hospital administrative data</article-title>. <year>2018</year>;<volume>24</volume>(<issue>2</issue>). <pub-id pub-id-type="doi">10.14236/jhi.v24i2.891</pub-id></mixed-citation></ref>
<ref id="ref-39"><label>39</label><mixed-citation publication-type="journal"><string-name><surname>Harron</surname> <given-names>KL</given-names></string-name>, <string-name><surname>Doidge</surname> <given-names>JC</given-names></string-name>, <string-name><surname>Knight</surname> <given-names>HE</given-names></string-name>, <string-name><surname>Gilbert</surname> <given-names>RE</given-names></string-name>, <string-name><surname>Goldstein</surname> <given-names>H</given-names></string-name>, <string-name><surname>Cromwell</surname> <given-names>DA</given-names></string-name>, <etal>et al</etal>. <article-title>A guide to evaluating linkage quality for the analysis of linked data</article-title>. <source>Int J Epidemiol</source>. <year>2017</year>;<volume>46</volume>(<issue>5</issue>):<fpage>1699</fpage>&#x2013;<lpage>710</lpage>. <pub-id pub-id-type="doi">10.1093/IJE/DYX177</pub-id></mixed-citation></ref>
<ref id="ref-40"><label>40</label><mixed-citation publication-type="journal"><string-name><surname>Aspinall</surname> <given-names>PJ</given-names></string-name>, <string-name><surname>Jacobson</surname> <given-names>B</given-names></string-name>. <article-title>Why poor quality of ethnicity data should not preclude its use for identifying disparities in health and healthcare</article-title>. <source>Qual Saf Heal Care</source>. <year>2007</year>;<volume>16</volume>(<issue>3</issue>):<fpage>176</fpage>&#x2013;<lpage>80</lpage>. <pub-id pub-id-type="doi">10.1136/qshc.2006.019059</pub-id></mixed-citation></ref>
<ref id="ref-41"><label>41</label><mixed-citation publication-type="journal"><string-name><surname>Johnson</surname> <given-names>RD</given-names></string-name>, <string-name><surname>Ford</surname> <given-names>D V.</given-names></string-name>, <string-name><surname>Broadhurst</surname> <given-names>K</given-names></string-name>, <string-name><surname>Cusworth</surname> <given-names>L</given-names></string-name>, <string-name><surname>Jones</surname> <given-names>KH</given-names></string-name>, <string-name><surname>Akbari</surname> <given-names>A</given-names></string-name>, <etal>et al</etal>. <article-title>Data Resource: Population level family justice administrative data with opportunities for data linkage</article-title>. <source>Int J Popul Data Sci</source>. <year>2020</year> <month>Jan</month>;<volume>5</volume>(<issue>1</issue>):<fpage>1339</fpage>. <pub-id pub-id-type="doi">10.23889/ijpds.v5i1.1339</pub-id></mixed-citation></ref>
<ref id="ref-42"><label>42</label><mixed-citation publication-type="website"><string-name><surname>Elliott</surname> <given-names>M</given-names></string-name>. <article-title>The backgrounds of children entering public care in Wales [Internet]</article-title>. <year>2017</year>. Available from: <uri>https://orca.cardiff.ac.uk/id/eprint/125393/1/PhD_Summary_Martin Elliott.pdf</uri></mixed-citation></ref>
<ref id="ref-43"><label>43</label><mixed-citation publication-type="website"><collab>StatsWales</collab>. <article-title>Average age, in months, at adoption of looked after children during year ending 31 March by local authority and year [Internet]</article-title>. <source>Welsh Government</source>. <year>2022</year> [cited 2023 Aug 25]. Available from: <uri>https://statswales.gov.wales/Catalogue/Health-and-Social-Care/Social-Services/Childrens-Services/Children-Looked-After/Adoptions/averageageatadoptionoflookedafterchildrenduringyearending31march-by-localauthority-year</uri></mixed-citation></ref>
<ref id="ref-44"><label>44</label><mixed-citation publication-type="website"><collab>Department for Education</collab>. <article-title>Children looked after in England including adoptions [Internet]</article-title>. <year>2022</year> [cited 2023 Aug 25]. Available from: <uri>https://explore-education-statistics.service.gov.uk/find-statistics/children-looked-after-in-england-including-adoptions/2021#releaseHeadlines-charts</uri></mixed-citation></ref>
<ref id="ref-45"><label>45</label><mixed-citation publication-type="journal"><string-name><surname>McKenna</surname> <given-names>S</given-names></string-name>, <string-name><surname>O&#x2019;Reilly</surname> <given-names>D</given-names></string-name>, <string-name><surname>Maguire</surname> <given-names>A</given-names></string-name>. <article-title>The mental health of all children in contact with social services: a population-wide record-linkage study in Northern Ireland</article-title>. <source>Epidemiol Psychiatr Sci</source>. <year>2023</year>;<volume>32</volume>. <pub-id pub-id-type="doi">10.1017/S2045796023000276</pub-id></mixed-citation></ref>
</ref-list>
</back>
</article>