<?xml version="1.0"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "JATS-journalpublishing1.dtd"[]>
<article xml:lang="en" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" dtd-version="1.2" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">IJPDS</journal-id>
<journal-title-group>
<journal-title>International Journal of Population Data Science</journal-title>
<abbrev-journal-title>IJPDS</abbrev-journal-title>
</journal-title-group>
<issn pub-type="epub">2399-4908</issn>
<publisher>
<publisher-name>Swansea University</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.23889/ijpds.v10i1.2938</article-id>
<article-id pub-id-type="publisher-id">10:1:2938</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Population Data Science</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>A novel protocol for a &#x201C;Citizen Panel&#x201D; for diverse Public and Participant Involvement in the review and development of the process to access data in the UK Longitudinal Linkage Collaboration Trusted Research Environment</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Garbovan</surname><given-names initials="L">Lidis</given-names></name><xref ref-type="aff" rid="affil-1">1</xref><xref ref-type="aff" rid="affil-5">5</xref><xref ref-type="corresp" rid="correspondingAurthor">*</xref></contrib>
<contrib contrib-type="author"><name><surname>Idemudia</surname><given-names initials="BO">Betty O.</given-names></name><xref ref-type="aff" rid="affil-1">1</xref><xref ref-type="aff" rid="affil-5">5</xref></contrib>
<contrib contrib-type="author"><name><surname>Flaig</surname><given-names initials="R">Robin</given-names></name><xref ref-type="aff" rid="affil-1">1</xref><xref ref-type="aff" rid="affil-5">5</xref></contrib>
<contrib contrib-type="author"><name><surname>Campbell</surname><given-names initials="K">Kirsteen</given-names></name><xref ref-type="aff" rid="affil-1">1</xref><xref ref-type="aff" rid="affil-5">5</xref></contrib>
<contrib contrib-type="author"><name><surname>Evans</surname><given-names initials="K">Katharine</given-names></name><xref ref-type="aff" rid="affil-2">2</xref><xref ref-type="aff" rid="affil-3">3</xref></contrib>
<contrib contrib-type="author"><name><surname>Boyd</surname><given-names initials="A">Andy</given-names></name><xref ref-type="aff" rid="affil-2">2</xref><xref ref-type="aff" rid="affil-3">3</xref><xref ref-type="aff" rid="affil-4">4</xref></contrib>
<contrib contrib-type="author"><name><surname>Cunningham-Burley</surname><given-names initials="S">Sarah</given-names></name><xref ref-type="aff" rid="affil-1">1</xref><xref ref-type="aff" rid="affil-5">5</xref></contrib>
<contrib contrib-type="author"><name><surname>Turner</surname><given-names initials="EL">Emma L.</given-names></name><xref ref-type="aff" rid="affil-2">2</xref><xref ref-type="aff" rid="affil-3">3</xref></contrib>
<aff id="affil-1"><label>1</label><institution>UK Longitudinal Linkage Collaboration, The University of Edinburgh, Edinburgh, UK</institution></aff>
<aff id="affil-2"><label>2</label><institution>UK Longitudinal Linkage Collaboration, University of Bristol, Bristol, UK</institution></aff>
<aff id="affil-3"><label>3</label><institution>Population Health Sciences, Bristol Medical School, University of Bristol, UK</institution></aff>
<aff id="affil-4"><label>4</label><institution>Health Data Research UK, London, UK</institution></aff>
<aff id="affil-5"><label>5</label><institution>Usher Institute, The University of Edinburgh, Edinburgh, UK</institution></aff>
</contrib-group>
<author-notes>
<corresp id="correspondingAurthor"><label>*</label>Corresponding author: Lidis Garbovan <email>Lgarbova@ed.ac.uk</email></corresp>
<fn fn-type="conflict">
<label>Conflict of interests statement</label>
<p>The authors have no conflicts of interest to declare. All co-authors agree with the contents of the manuscript, certify that the submission is original work and is not under review at any other publication.</p>
</fn>
</author-notes>
<pub-date date-type="pub" publication-format="electronic"><day>08</day><month>07</month><year>2025</year></pub-date>
<pub-date date-type="collection" publication-format="electronic"><year>2025</year></pub-date>
<volume>10</volume>
<issue>1</issue>
<elocation-id>2938</elocation-id>
<permissions>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by-nc-nd/4.0/">
<license-p>This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.</license-p>
</license>
</permissions>
<self-uri xlink:href="https://ijpds.org/article/view/2938">This article is available from the IJPDS website at: https://ijpds.org/article/view/2938</self-uri>
<abstract>
<title>Abstract</title>
<sec>
<title>Background</title>
<p>Researchers can apply to UK Longitudinal Linkage Collaboration (UK LLC) to access Longitudinal Population Study (LPS) data linked to health, non-health administrative and geo-environmental data. This paper describes the protocol for the &#x201C;UK LLC Citizen Panel&#x201D;: a new method of incorporating a diverse public in decisions about the acceptability and suitability of the UK LLC data access process. The UK LLC Citizen Panel aims to embed public feedback and perceptions into UK LLC&#x2019;s data access process design and decision-making.</p>
</sec>
<sec>
<title>Methods</title>
<p>The UK LLC Citizen Panel will be created through a two-stage co-design process. Stage 1: UK LLC will identify and invite a public Steering Group to co-design the work of the Citizen Panel. The Steering Group will include public contributors from UK LLC&#x2019;s Public Involvement Programme and participant representatives from partner LPS. Stage 2: the UK LLC Citizen Panel will comprise participants of partner LPS and seldom-heard groups, primarily recruited via third sector organisations. The Panel will review the data access process during several online and in-person meetings. Findings will be analysed using thematic analysis and disseminated to UK LLC partner organisations, third sector organisations working with minority communities and young people under-represented in longitudinal studies, and networks of the Universities of Edinburgh and Bristol.</p>
</sec>
<sec>
<title>Discussion</title>
<p>The UK LLC Citizen Panel is a novel methodological approach that aims to consider a diverse public view of the use of a Trusted Research Environment to provide access to LPS data linked to health, non-health administrative and geo-environmental data. This diversity complements the existing public involvement in decision-making in all UK LLC data access and enables populations that are rarely heard in such decision-making to participate in and review the UK LLC data access process.</p>
</sec>
</abstract>
<kwd-group>
<kwd>longitudinal population studies</kwd>
<kwd>UK Longitudinal Linkage Collaboration</kwd>
<kwd>citizen panel</kwd>
<kwd>linked data</kwd>
<kwd>seldom-heard communities</kwd>
<kwd>trusted research environment</kwd>
<kwd>patient and public involvement</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec>
<title>Introduction</title>
<p>A major driver of the transition of population data science [<xref ref-type="bibr" rid="ref-1">1</xref>] to occurring within Trusted Research Environments (TRE) is the concern regarding &#x2018;Social Licence&#x2019; which suggests that factors such as demonstrable public good are essential for socially acceptable data use [<xref ref-type="bibr" rid="ref-2">2</xref>]. Yet, whilst public dialogue has helped identify the criteria to define what is &#x2018;in the public good&#x2019; [<xref ref-type="bibr" rid="ref-3">3</xref>], we currently lack the methodologies necessary to bring a diverse perspective as to whether we are achieving this. The &#x2018;Citizen Panel&#x2019; concept may be a mechanism to integrate a diverse public voice into decision-making as a form of public audit of such data access decision-making.</p>
<p>The concept of a &#x2018;Citizen Panel&#x2019; is developed by the organisation Understanding Patient Data as a learning data governance model for data access in Longitudinal Population Studies (LPS) that shift the involvement of the public in data access from a one-way direction to a feedback cycle [<xref ref-type="bibr" rid="ref-4">4</xref>]. To date, this model has not been deployed in the context of data access to public data as recommended by Understanding Patient Data and therefore it is not known whether the model will work as intended or how a panel would be constituted and operate in practice.</p>
<p>LPS employ continuous or repeated measures to follow particular individuals over prolonged periods of time&#x2014;often decades or lifetimes. They are usually observational in nature and include collections of quantitative and/or qualitative data on any combination of exposures and outcomes [<xref ref-type="bibr" rid="ref-5">5</xref>].</p>
<p>UK Longitudinal Linkage Collaboration (UK LLC) - the national TRE for data linkage in longitudinal research - has been funded by UK Research and Innovation (UKRI), the Economic and Social Research Council (ESRC) and Medical Research Council (MRC) to pilot the first operational Citizen Panel.</p>
<sec>
<title>The social licence for population data science</title>
<p>The concept of social licence suggests that publics expect that organisations that are holding and using the public&#x2019;s data will go beyond the requirements of formal regulation, and adhere to voluntary codes of trustworthy behaviour and transparency. According to social licence theory, only when the public are satisfied that the motivations of the organisation are trustworthy, will they confer a &#x201C;social license&#x201D; to operate [<xref ref-type="bibr" rid="ref-6">6</xref>]. This is particularly pertinent within longitudinal research, given the requirement for building a trust relationship between participants and their study which needs to extend over very long time periods &#x2013; often lifetimes &#x2013; and which can survive dramatic changes in technologies, scientific opportunities and changes in social expectations [<xref ref-type="bibr" rid="ref-7">7</xref>].</p>
<p>One element in creating and maintaining the reciprocity that underpins social licence is transparency about, for example, the policies and procedures for handling personal information as well as the outcomes of research projects [<xref ref-type="bibr" rid="ref-8">8</xref>]. Within longitudinal research, factors such as these have been seen to influence participants&#x2019; views regarding linkage of study data to routine records [<xref ref-type="bibr" rid="ref-9">9</xref>], the committees which make decisions regarding data use [<xref ref-type="bibr" rid="ref-9">9</xref>] and has led to some studies &#x2013; such as the Avon Longitudinal Study of Parents and Children [<xref ref-type="bibr" rid="ref-10">10</xref>] to develop participant facing frameworks consisting of study &#x201C;commitments to you&#x201D;. These commitments and principles include safeguards relating to data use processes and reassure participants that all data use is in the public good [<xref ref-type="bibr" rid="ref-11">11</xref>].</p>
<p>Recent research [<xref ref-type="bibr" rid="ref-12">12</xref>] suggests that data teams and researchers should move towards a shared or reflexive data governance model, which focuses on mutual learning, communication and deliberation, in which all stakeholders share power and are consulted. While public views on data sharing, including public concerns, are now well established, there is limited research on how to transform public expectations into a testable social licence to operate. Furthermore, achieving a social licence is not a one-off event &#x2013; it requires continuous reflection and maintenance [<xref ref-type="bibr" rid="ref-6">6</xref>]. For instance, recent research measured and modelled the critical elements of social licence by conducting a longitudinal study in an Australian mining region. The results showed that building trust with local communities was crucial for mining companies to obtain and maintain a social licence to operate [<xref ref-type="bibr" rid="ref-13">13</xref>].</p>
</sec>
<sec>
<title>Public involvement and social licence</title>
<p>Public Involvement and Engagement (PIE) is a crucial method for creating and maintaining the required social acceptance for data-intensive health research [<xref ref-type="bibr" rid="ref-14">14</xref>]. The public, with their varied viewpoints and valuable insights, should have a significant influence on the development of research infrastructures, procedures and applications. Additionally, the public may offer a broader social viewpoint [<xref ref-type="bibr" rid="ref-15">15</xref>]. The best results from public participation are probably obtained when dialogic and deliberative communication styles are used. As a result, continuous attempts to increase transparency should concentrate on &#x201C;informational transparency,&#x201D; &#x201C;participatory transparency&#x201D; and &#x201C;accountability transparency&#x201D; [<xref ref-type="bibr" rid="ref-27">27</xref>].</p>
<p>This paper will provide a background about UK LLC and the Citizen Panel concept and will then, within the methodology, describe our iterative co-development protocol. This represents the protocol as conceived by the UK LLC team and approved by the EMREC - Edinburgh Medical School Research Ethics Committee at the University of Edinburgh (REC Reference: 24-EMREC-034). We provide initial conclusions drawn primarily from the motivations for instigating the Citizen Panel within UK LLC and reflect on potential impact for the longitudinal research community and wider TRE and population data science communities.</p>
</sec>
</sec>
<sec>
<title>Background information &#x2013; about UK LLC and Citizen Panels</title>
<sec>
<title>UK Longitudinal Linkage Collaboration (UK LLC)</title>
<p>UK LLC is the national TRE for data linkage in longitudinal research, supporting its unparalleled collection of Longitudinal Population Studies (LPS). Initially set up as a COVID-19 research resource, UK LLC is now a generic database for any research in the public good [<xref ref-type="bibr" rid="ref-16">16</xref>]. The UK LLC TRE is a regulated, highly secure computing environment that allows authorised researchers remote access to de-identified data about LPS participants. This includes self-reported data collected by the LPS, and where permissions allow, these data are linked to participants&#x2019; health and non-health administrative routine records, and environment and neighbourhood data.</p>
<p>UK LLC provides a secure analytics environment, a trusted third-party linkage processor and a comprehensive governance framework to minimise risks to participant confidentiality. UK LLC is ISO 27001 certified and accredited by the UK Statistics Authority as a processor under the Digital Economy Act (2017). UK LLC&#x2019;s Public Involvement Programme integrates LPS participants and the wider public views into the operation of UK LLC.</p>
<p>The ultimate objective of UK LLC is to support research in the public good [<xref ref-type="bibr" rid="ref-3">3</xref>]. Suggests that public good means minimising harm, providing clear and accessible public-facing communications about the use of data and practicing safeguarding principles to ensure secure access to data. Therefore, involving the public in the review of the data access process through the UK LLC Citizen Panel initiative appears to be a step in the right direction towards accomplishing this objective.</p>
<p>The UK LLC Citizen Panel is funded by UKRI, ESRC and MRC. It is building on an existing UK LLC Public Involvement Programme spanning public contributor involvement in (i) strategic advisory board; (ii) a network tackling emerging issues and shaping future developments of UK LLC; (iii) advising on the clarity and content of information materials and (iv) an advisory committee forming part of the data application review process (Supplementary Appendix 5 &#x2013; UK LLC Public Involvement - Overview). As distinct from these, the UK LLC Citizen Panel will be designed to improve and supplement existing public involvement methods with the goal of enhancing trust in data science and the TRE ecosystem</p>
<p>To present, while it is common to incorporate the public/participants in data access and governance processes for LPS, such as the TwinsUK Voluntary Advisory Panel (VAP) [<xref ref-type="bibr" rid="ref-17">17</xref>] or ALSPAC Law and Ethics Committee (ALEC) [<xref ref-type="bibr" rid="ref-18">18</xref>, <xref ref-type="bibr" rid="ref-28">28</xref>], the UK LLC Citizen Panel recruited across both LPS and minoritised groups, and explicitly set up as an external review of existing processes is novel, innovative and uncommon.</p>
</sec>
<sec>
<title>Citizen Panels</title>
<p>When it comes to gathering public opinions, a Citizen Panel is typically understood to be a stable and representative sample of a specific demographic [<xref ref-type="bibr" rid="ref-19">19</xref>]. Although PIE has been extensively promoted and implemented over the past decade, there are concerns that its involvement is restricted to a specific group of individuals, and does not reflect the diversity of the community [<xref ref-type="bibr" rid="ref-20">20</xref>].</p>
<p>In the wider literature, Citizen Panels are groups of purposively selected members of the public, usually mixed in terms of age, gender and socio-economic group, who meet several times and consider presentations by experts about particular issues, and who then question and challenge those experts. They debate and deliberate within the group and then formulate their own priorities and recommendations for policy-making. They are not required to reach a specific decision (unlike Citizens&#x2019; Juries) but rather are seen as a method for identifying broader issues of public concern, especially in areas of uncertainty about science or policy [<xref ref-type="bibr" rid="ref-21">21</xref>].</p>
<p>By articulating the perspectives of diverse social groups, Citizen Panels may foster a symbolic sense of being represented among people who identify with those groups. Although participation on Citizen Panels is limited by the constraints of the selection process, those who do participate can shape the representations of the public interest produced by the panel [<xref ref-type="bibr" rid="ref-22">22</xref>]. Additionally, Citizen Panels may improve the capacities of participants to represent both their own experiential perspectives and their conceptions of the public interest during the meetings of the panel [<xref ref-type="bibr" rid="ref-22">22</xref>].</p>
</sec>
</sec>
<sec>
<title>Methods and co-design</title>
<sec>
<title>The Citizen Panel at UK LLC</title>
<p>The concept of a &#x2018;Citizen Panel&#x2019; is developed by the organisation Understanding Patient Data as a learning data governance model for data access in LPS. The aim is to shift the involvement of the public in data access from a one-way direction to a feedback cycle, as exemplified in <xref ref-type="fig" rid="fig-1">Figures 1</xref> and <xref ref-type="fig" rid="fig-2">2</xref> below.</p>
<fig id="fig-1"><label>Figure 1</label>
<caption><p>Visual outline of how data access decisions are currently made (adapted from Understanding Patient Data)</p></caption>
<graphic xlink:href="ijpds-06-2938-g001.tif"/>
<attrib>Source: <uri>https://understandingpatientdata.org.uk/learning-data-governance-new-approach-decisions-about-data</uri>.</attrib>
</fig>
<fig id="fig-2"><label>Figure 2</label>
<caption><p>Visual of a new learning data governance model (adapted from Understanding Patient Data)</p></caption>
<graphic xlink:href="ijpds-06-2938-g002.tif"/>
<attrib>Source: <uri>https://understandingpatientdata.org.uk/learning-data-governance-new-approach-decisions-about-data</uri>.</attrib>
</fig>
<p>The new learning model involves two key ideas: (1) the outcomes from access to data are reported back to the decision-making group; and (2) a Citizen Panel reviews previous data access decisions and their outcomes. The Citizen Panel provides feedback to the decision-making group, to inform their future decisions (<xref ref-type="fig" rid="fig-2">Figure 2</xref>).</p>
<p>The UK LLC Citizen Panel is an open evaluation of the UK LLC data access process that attempts, first, to establish a new method of incorporating the public in decisions regarding the acceptability and usefulness of longitudinal population data usage and linkage. Secondly, the Panel will seek to incorporate diverse public opinions and feedback into data access decision-making processes. In addition to contributing to UK LLC, the Citizen Panel project will provide insights to other TREs, data producers and academic institutions, thus increasing trust in data science and the TRE ecosystem. Publicly available results will contribute to important projects, novel UKRI cohort studies, clinical trials and whole population datasets that incorporate information from a diverse range of the public, including individuals who are more difficult to reach or who hold uncertain views. This novel methodological approach confers credibility on public views of the TRE, involves a more diverse public and gives ethical standing to decision-making in populations that are seldom-heard. There is a risk that any PIE process or finding can introduce barriers to research (e.g., introducing new steps to application processes or restrictive policy requirements); after all most governance is effectively balancing the different, and potentially incompatible, expectations of different stakeholders. There is therefore a risk that findings from the Citizen Panel could add complexity or barriers to the UK LLC access process. UK LLC will manage this risk by factoring in panel recommendations and balancing them against wider stakeholder needs: whilst all recommendations will be treated seriously, it is likely that not all will be adopted. The UK LLC Citizen Panel, as a Public Governance Group, has the ability to influence decisions on the applications to access data and the process by which this is assessed. The Citizen Panel has an advisory role and this is made clear to all participants. The UK LLC commit to the transparent reporting of recommendations and considerations relating to whether these are, or are not, adopted. UK LLC will be guided in deliberations by its wider PIE structures.</p>
</sec>
<sec>
<title>Citizen Panel objectives</title>
<p>The UK LLC Citizen Panel has the following objectives:</p>
<list list-type="order">
<list-item><p>to involve diverse publics in decisions around the acceptance and suitability of data use.</p></list-item>
<list-item><p>to assess the scope and benefit of research questions used in applications for data held in the UK LLC TRE.</p></list-item>
<list-item><p>to create a learning feedback loop which enables decision-making about data access to linked data resources to remain informed, responsive to change and inclusive of diverse views.</p></list-item>
</list>
<p>The UK LLC Citizen Panel aims to answer questions such as: &#x2018;Did UK LLC ask the appropriate questions of the applicants?&#x2019;; &#x2018;Are the questions inclusive of seldom-heard communities?&#x2019;; &#x2018;What (or who) is missing from the decision-making process?&#x2019;; &#x2018;How should the outcomes of previous projects inform future thinking on potential risks and benefits from proposals to use data?&#x2019;; &#x2018;What questions are not being asked by the research community that should be?&#x2019;</p>
</sec>
<sec>
<title>Consent, data management and data protection for UK LLC Citizen Panel members</title>
<p>Individuals will be provided with a Participant Information Sheet (Appendix 1) and a Participant Consent form (Appendix 2), i.e. they will have an informed choice to take part in the research project. The Panel members will be provided with information about how their personal data will be anonymised as part of this research and they will choose if their unattributed and de-identified quotes can be used in research outputs. Any reference to participants in public-facing documents will be anonymised. The Panel members will have the choice to be co-authors of publications and research outputs if they wish to do so. In this case their names would be used in publications as co-authors, but not linked to specific quotes or contributions.</p>
<p>Collaboration and co-production of research with communities have been deemed important for research equity and impact [<xref ref-type="bibr" rid="ref-23">23</xref>]. Moreover, co-produced research with the public or communities allows collaborators/co-authors to contribute to the research agenda and decision-making processes [<xref ref-type="bibr" rid="ref-24">24</xref>]. Contribution of non-academic partners, and how this should be recognised, is often missing from authorship guidelines and there are suggested ways of how to do co-authorship with community or public members involved in the research process, depending on the context. In this paper, we acknowledge the importance of co-produced authorship with the Citizen Panel members as one way in which we can improve how we do community participation and help mitigate institutional and socio-economic hierarchies and we aim to follow a set of proposed guidelines for academic authorship in collaborative health research [<xref ref-type="bibr" rid="ref-24">24</xref>].</p>
<p>The Panel members will have their personal data collected to administer the study and to help ensure that we recruit a diverse group of public contributors. Personal information includes names and contact details and demographic data (age group, gender, ethnicity, education level, occupation status). These data will be protected and kept confidential and separately from any research data. Qualitative data on the views and feedback of the Panel members about the UK LLC data access process will be de-identified and stored separately from the contact and demographic data.</p>
<p>The personal information will be stored on a password protected Excel spreadsheet only accessible to a small number of University of Edinburgh-based UK LLC staff. All qualitative data collected during the project will be stored on a University of Edinburgh secure research server with access to the folder limited to University of Edinburgh UK LLC staff and IT services staff. The data will not be shared with any third parties. Personal data will be retained according to the University retention policy and backed up regularly through standard Datastore policies.</p>
<p><bold>Potential risks:</bold> There are no anticipated or potential risks for the Panel members involved in this project. They will be volunteers, providing informed consent and can withdraw at any time. The Panel will be facilitated by the Panel lead, supported by experienced academic Co-Investigators. The subject matter of the discussions is unlikely to be sensitive. The facilitator will ensure all discussion is respectful and ensure there are multiple ways for participants to engage. The risk of pre-existing bias of participants from LPS, as members who are already involved in data collection and might have an inherently optimistic view of the research and could thus limit critical or diverse perspectives, is very low. When deciding to include 50% LPS members in the UK LLC Citizen Panel membership, the Panel co-leads anticipated the benefits of their membership in terms of (1) knowledge and experience of taking part in LPS research, (2) equal membership on the Panel, with no privileged status and no anticipated influencing power over the other Panel Members and (3) as representatives of direct stakeholders whose data are being used. However, this is a risk that is monitored as part of UK LLC business risk management.</p>
<p><bold>Potential benefits:</bold> The Panel members will potentially benefit from being part of this project by being involved in decisions around the acceptance and suitability of data use, including their own data where they are LPS participants. They will also provide unique views and perspectives as members of seldom-heard groups and communities and will therefore help increase confidence in public perceptions of UK LLC and the wider research community&#x2019;s approach to inclusive research. The UK LLC Citizen Panel provides a new model for the review of the data access process and revision that could be adopted by other data providers in future, including national, regional and specialist areas.</p>
</sec>
<sec>
<title>Citizen Panel co-design</title>
<p>The UK LLC Citizen Panel will have a two-stage co-design process (<xref ref-type="fig" rid="fig-3">Figure 3</xref>). This process will contribute to developing methodological innovations in the way the UK LLC Citizen Panel is planned, formed, piloted, executed, evaluated and how it will inform the next round, by co-producing new knowledge with various publics.</p>
<fig id="fig-3"><label>Figure 3</label>
<caption><p>Citizen Panel co-development process diagram</p></caption>
<graphic xlink:href="ijpds-06-2938-g003.tif"/>
</fig>
</sec>
<sec>
<title>Steering Group</title>
<p>The small amount of current literature on Patient and Public Involvement and Engagement (PPIE) research includes the role a Steering Committee or Group, usually made of 3-6 members from the public, usually including people with lived-experience on a specific topic required in the project. The Steering Group&#x2019;s role is to advise the research team on the planned project PPIE activities and collaboration, to provide direction, advice and guidance for the project, to consult over the objectives, timelines, risks and deliverables [<xref ref-type="bibr" rid="ref-25">25</xref>].</p>
<p>The six Steering Group members will be recruited from three UK LLC partner LPS (three members) and from the current UK LLC Public Involvement Programme (three members). The UK LLC Citizen Panel team will develop materials to recruit Steering Group members and circulate them to the three partner LPS. Interested applicants will submit an expression of interest by email and will have a short interview with the UK LLC Citizen Panel team. They will then be selected based on agreed selection criteria and invited to join the Steering Group.</p>
<p>The UK LLC Citizen Panel Steering Group will set the parameters of the full Panel review. The Steering Group will co-design the recruitment, induction and operation of the Panel, and provide guidance and advice on the activities and tasks for the Citizen Panel. They will attend regular meetings, on average once a month.</p>
</sec>
<sec>
<title>Recruitment of the Citizen Panel</title>
<p>For recruiting the Citizen Panel, target population groups are: (1) UK LLC partner LPS participants and; (2) people from seldom-heard communities that are known to be under-represented or prone to attrition in LPS. This small number of people (max 14 people) is not intended to represent all LPS participants and/or all underserved groups. However, their participation in the Citizen Panel is aimed at responding to identified patterns in LPS attrition and lack of representation in LPS of participants from certain groups, such as ethnic minorities, those with particular health or social conditions and those from a migrant and asylum seeker background who may not have stable accommodation [<xref ref-type="bibr" rid="ref-7">7</xref>]. Our objective for this strategy is to build confidence that the UK LLC access process is reviewed by a broad range of public stakeholders with diverse backgrounds, to inform its development and to build broad trust in the safeguards used within the longitudinal research community.</p>
<p>The role of a Citizen Panel member will be advertised via materials such as e-leaflets on social media, posters to be distributed to community meeting places, and via emails sent out to UK LLC partner LPS and third sector community organisations. Interested candidates will be invited to submit a short expression of interest form via email, in which they explain why they are applying and mention if they have any previous experience as public contributors. The project team will receive the forms and pre-select candidates who are suitable, based on selection criteria. These will be invited to an informal interview with two members from the project team and a maximum of 14 will be selected to join the six members of the Steering Group and become members of the Citizen Panel. As mentioned earlier, this will be an iterative process and the membership of the Citizen Panel will be reviewed and updated regularly.</p>
<p><bold>Payments</bold>: The Panel Members will receive payments for their time guided by the NIHR standards of payment. When they meet monthly for two hours, they will be paid a minimum of &#x00A3;25 per hour, and &#x00A3;15 per pre-meeting activity e.g. feedback on webpages or completion of survey [<xref ref-type="bibr" rid="ref-26">26</xref>].</p>
</sec>
<sec>
<title>The Citizen Panel operation</title>
<p>The UK LLC Citizen Panel will meet on average once per month or more often if required, for a duration of approximately two hours, during online meetings sessions and at least one in-person session.</p>
<p>The UK LLC Citizen Panel will co-design the sessions and seek answers about whether the questions asked by UK LLC applicants wishing to access data held in UK LLC&#x2019;s TRE are appropriate, including for example, whether they address underserved communities, engaging effectively with them as part of the research process.</p>
<p>The findings, such as notes on the meetings and surveys will be synthesized and analysed using thematic analysis. Findings will be reported in different co-produced outputs, such as blogposts, academic articles, reports and visual and artistic outputs.</p>
<p>As the process is designed to be cyclical and iterative, the UK LLC Citizen Panel team will be learning and not retaining a static view of public perceptions and engagements. The Terms of Reference for the Steering Group (Appendix 3), the Participant Consent Form and Participant Information Sheet will make clear the co-produced nature of the operation and that the data will be used for research purposes, including academic and other publications.</p>
</sec>
<sec>
<title>Evaluating the UK LLC Citizen Panel</title>
<p>The evaluation of the UK LLC Citizen Panel will include capturing the publics&#x2019; perspectives in design decisions, knowledge exchange emerging from interactions with stakeholders, key objectives (i.e. diversity of membership) and the outcomes and iterative development of the model. The methods for evaluation will potentially include short surveys and individual interviews with Citizen Panel members to gather their insights and reflections of the process.</p>
<p>Final evaluation methods will be agreed with the Panel itself as a part of the co-production work. The evaluation will focus both on process and outcomes.</p>
<p>The intended aim and impact of the evaluation activity is to assess how the UK LLC Citizen Panel would have enhanced and complemented the existing ways in which public involvement is conducted. This &#x2018;learning model&#x2019; will embed a diverse public voice in UK LLC&#x2019;s planning and decision-making, enabling UK LLC to remain responsive to new opportunities and changes in context.</p>
</sec>
<sec>
<title>Publications and dissemination of outputs</title>
<p>Findings will be published in relevant academic journals and key learning distributed to stakeholders across the TRE ecosystem, including the UK&#x2019;s national data science institutions (Health Data Research (HDR) UK and ADR UK), data owner organisations such as NHS England, the Office for National Statistics, Public Health Scotland, regulators (e.g. Health Research Authority and UK Statistics Authority) and organisations representing the public voice (National Data Guardian (NSG), UPD) and across the TRE community. The evaluation outputs will make a strong contribution to the evolution of programmes to understand public views and to build engagement and trust.</p>
<p>The findings will be disseminated to UK LLC partner organisations including our partner LPS, CLOSER (<uri>www.closer.ac.uk</uri>), Population Research UK (<uri>www.pruk.ac.uk</uri>), Administrative Data Research UK (<uri>www.adruk.org</uri>), UK government data owners (e.g., NHS and Office for National Statistics), Health Data Research UK (<uri>www.hdruk.ac.uk</uri>), Public Engagement in Data Research Initiative (<uri>https://www.pedri.org.uk/</uri>), and UK Research and Innovation, third sector organisations working with minority communities and young people under-represented in longitudinal studies, networks of the Universities of Edinburgh and Bristol, young people and public engagement communities and Research Data Scotland.</p>
<p>The project will be made publicly visible by publishing and updating a lay summary on the UK LLC website and social channels. The UK LLC Citizen Panel project team will report and disseminate the results of the research in peer-reviewed academic articles, internal reports, at conferences and external events and on the UK LLC website.</p>
</sec>
</sec>
<sec>
<title>Discussion</title>
<p>The Citizen Panel at UK LLC is a novel methodological approach that aims to confer credibility on public views of UK LLC, involve a diverse section of the public, and give ethical standing to decision-making in populations that are rarely accessible.</p>
<p>The Panel members will be co-designing the project, as well as sharing final results summaries. The Panel members will be invited to contribute to writing and co-producing outputs, such as blog posts, academic articles and reports and their co-authorship will be acknowledged in these publications.</p>
<p>This work is important for UK LLC because (1) it will inform mechanisms to develop a dynamic social licence for UK LLC&#x2019;s data use through regular and ongoing consultations; (2) it will provide insight into the UK LLC data use decision-making process, to help evolve this; (3) it will provide confidence in the &#x2018;delegated decision-making&#x2019; for stakeholders such as the NHS; and (4) it will provide insights for UK LLC governance on shifting public perceptions around data use, acceptability of different types of data being used for research and by whom e.g. sensitive data, allowing the learning to steer future strategy.</p>
<p>More broadly, the UK LLC Citizen Panel will provide insight for global TREs as to whether the Citizen Panel model is an effective framework for including a wide public voice in the critical evaluation of TRE operations. The findings it generates will contribute to thinking regarding social licence and the acceptable use of data for public good research.</p>
</sec>
<sec>
<title>Conclusion</title>
<p>The UK LLC Citizen Panel aims to create a dialogue between the data community and the wider public that is embedded in governance and enhances mutual learning. In future the UK LLC team will consider applications for further funding to continue the Citizen Panel at UK LLC or in collaboration with other organisations that may be interested in applying this concept. From a sustainability perspective, a future project might consider scaling up the Citizen Panel concept in size, for instance designing a panel with &lt;100 members, and geography, e.g. Citizen Panel groups running in each of the four UK nations, or elsewhere globally, to engage closely with the wider TRE ecosystem, data community and those shaping governance frameworks.</p>
</sec>
</body>
<back>
<sec>
<title>Ethics statement</title>
<p>The Citizen Panel project received ethical approval from the Edinburgh Medical School Research Ethics Committee at the University of Edinburgh (REC Reference: 24-EMREC-034) on 28<sup>th</sup> May 2024 and the overarching UK LLC infrastructure has ethical approval from the Health Research Authority (HRA) Research Ethics Committee (Haydock Committee; ref: 20/NW/0446).</p>
</sec>
<sec>
<title>Funding statement</title>
<p>UK Longitudinal Linkage Collaboration (UK LLC) received funding from ESRC and MRC (ES/X000567/1) to fund the piloting of a novel &#x2018;Citizen Panel&#x2019; project. More broadly, UK LLC is funded by UK Research and Innovation to form the national Trusted Research Environment for data linkage in longitudinal research (MR/X021556/1, ES/X000567/1). This includes support for UK LLC&#x2019;s wider Public Involvement Programme.</p>
</sec>
<sec>
<title>Data availability statement</title>
<p>Data are available within the submitted article and supplementary files.</p>
</sec>
<sec>
<title>Authors&#x2019; contribution</title>
<p>LG led the manuscript writing and review process, wrote the Ethical application submitted to the Ethics Committee at the University of Edinburgh which includes the Protocol (Appendix 4).</p>
<p>BI contributed to the literature review and drafting the manuscript.</p>
<p>RF co-designed the UK LLC Citizen Panel pilot concept, contributed to the funding application, and reviewed the manuscript.</p>
<p>KC is the operational lead for the UK LLC Public Involvement Programme, co-designed the UK LLC Citizen Panel pilot concept, contributed to the funding application, and reviewed the manuscript.</p>
<p>AB co-designed the UK LLC Citizen Panel pilot concept, led the funding application, and reviewed the manuscript.</p>
<p>KE contributed to co-writing the Data Protection Impact Assessment (DPIA), which formed part of the Ethical application submitted to the Ethics Committee and reviewed the manuscript.</p>
<p>S C-B co-designed the UK LLC Citizen Panel pilot concept, contributed to the funding application, and reviewed the manuscript.</p>
<p>ET contributed to the funding application, and reviewed the manuscript.</p>
</sec>
<sec>
<title>Supplementary appendices</title>
<p>Supplementary Appendix 1 &#x2013; Participant Information Sheet UK LLC Citizen Panel</p>
<p>Supplementary Appendix 2 &#x2013; Participant Consent Form UK LLC Citizen Panel</p>
<p>Supplementary Appendix 3 &#x2013; Terms of Reference for the Steering Group UK LLC Citizen Panel</p>
<p>Supplementary Appendix 4 &#x2013; Protocol document UK LLC Citizen Panel</p>
<p>Supplementary Appendix 5 &#x2013; UK LLC Public Involvement - Overview</p>
</sec>
<ref-list>
<title>References</title>
<ref id="ref-1"><label>1</label><mixed-citation publication-type="journal"><string-name><surname>McGrail</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Moran</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>O&#x2019;Keefe</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Preen</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Quan</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Sanmartin</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Schull</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Smith</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Williams</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Williamson</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Wyper</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Moorin</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Kum</surname>, <given-names>H.-C.</given-names></string-name>, <string-name><surname>Jones</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Akbari</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Bennett</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Boyd</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Carinci</surname>, <given-names>F.</given-names></string-name>, <string-name><surname>Cui</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Denaxas</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Dougall</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Ford</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Kirby</surname>, <given-names>R. S</given-names></string-name>. and <string-name><surname>Kotelchuck</surname>, <given-names>M</given-names></string-name>. <year>2018</year>. <article-title>&#x201C;A Position Statement on Population Data Science: The science of data about people&#x201D;</article-title>, <source><italic>International Journal of Population Data Science</italic></source>, <volume>3</volume>(<issue>1</issue>). <pub-id pub-id-type="doi">10.23889/ijpds.v3i1.415</pub-id></mixed-citation></ref>
<ref id="ref-2"><label>2</label><mixed-citation publication-type="journal"><string-name><surname>Carter</surname> <given-names>P</given-names></string-name>, <string-name><surname>Laurie</surname> <given-names>GT</given-names></string-name>, <string-name><surname>Dixon-Woods</surname> <given-names>M</given-names></string-name>. <article-title>The social licence for research: <italic>why care.data ran into trouble.</italic></article-title> <source>Journal of Medical Ethics</source> <year>2015</year>;<volume>41</volume>:<fpage>404</fpage>-<lpage>409</lpage>. <pub-id pub-id-type="doi">10.23889/ijpds.v3i1.415</pub-id></mixed-citation></ref>
<ref id="ref-3"><label>3</label><mixed-citation publication-type="website"><collab>ADR UK</collab>. <year>2022</year>. <source><italic>A UK-wide public dialogue exploring what the public perceive as &#x2018;public good&#x2019; use of data for research and statistics</italic></source>. Available from: <uri>Public_ perceptions_of_public_good.pdf</uri> (<email>statisticsauthority.gov.uk</email>) [Accessed 19 Aug. 2024].</mixed-citation></ref>
<ref id="ref-4"><label>4</label><mixed-citation publication-type="website"><article-title>Understanding Patient Data</article-title>. <source><italic>Learning data governance: a new approach to decisions about data &#x2013; Understanding patient data.</italic></source> [online] Understanding Patient Data. Available from: <uri>https://understandingpatientdata.org.uk/learning-data-governance-new-approach-decisions-about-data</uri> [Accessed 19 Aug. 2024].</mixed-citation></ref>
<ref id="ref-5"><label>5</label><mixed-citation publication-type="journal"><string-name><surname>Caruana</surname> <given-names>EJ</given-names></string-name>, <string-name><surname>Roman</surname> <given-names>M</given-names></string-name>, <string-name><surname>Hern&#x00E1;ndez-S&#x00E1;nchez</surname> <given-names>J</given-names></string-name>, <string-name><surname>Solli</surname> <given-names>P</given-names></string-name>. <article-title>Longitudinal studies</article-title>. <source>J Thorac Dis</source>. <year>2015</year> Nov;<volume>7</volume>(<issue>11</issue>):<fpage>E537</fpage>-<lpage>40</lpage>. <pub-id pub-id-type="doi">10.3978/j.issn.2072-1439.2015.10.63</pub-id>. 26716051; PMCID: PMC4669300. <uri>https://pmc.ncbi.nlm.nih.gov/articles/PMC4669300/</uri></mixed-citation></ref>
<ref id="ref-6"><label>6</label><mixed-citation publication-type="journal"><collab>Ford</collab> et al. <article-title>Understanding how to build a social licence for using novel linked datasets for planning and research in Kent, Surrey and Sussex: results of deliberative focus groups</article-title>, <source><italic>Int J Popul Data Sci</italic></source>. <year>2020</year>; <volume>5</volume>(<issue>3</issue>): <fpage>2114</fpage>. <pub-id pub-id-type="doi">10.23889/ijpds.v5i3.2114</pub-id></mixed-citation></ref>
<ref id="ref-7"><label>7</label><mixed-citation publication-type="website"><string-name><surname>Boyd</surname> <given-names>A</given-names></string-name>. <year>2021</year>. <source><italic>Understanding Population Data for Inclusive Longitudinal Research</italic></source>. <publisher-loc>Bristol, UK</publisher-loc>: <publisher-name>University of Bristol. Available from</publisher-name>: <uri>https://www.ukri.org/wp-content/uploads/2021/12/ESRC-240322-Understanding-Population-Data-for-Inclusive-longitudinal-research-V2.pdf</uri> [Accessed 19 Aug. 2024].</mixed-citation></ref>
<ref id="ref-8"><label>8</label><mixed-citation publication-type="journal"><string-name><surname>Allen</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Adams</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Flack</surname>, <given-names>F</given-names></string-name>. <year>2019</year>. <source><italic>The role of data custodians in establishing and maintaining social licence for health research, Bioethics</italic></source>, <pub-id pub-id-type="doi">10.1111/bioe.12549</pub-id></mixed-citation></ref>
<ref id="ref-9"><label>9</label><mixed-citation publication-type="journal"><string-name><surname>Audrey</surname> <given-names>S</given-names></string-name>, <string-name><surname>Brown</surname> <given-names>L</given-names></string-name>, <string-name><surname>Campbell</surname> <given-names>R</given-names></string-name>, <string-name><surname>Boyd</surname> <given-names>A</given-names></string-name>, <string-name><surname>Macleod</surname> <given-names>J</given-names></string-name>. <article-title>Young people&#x2019;s views about the purpose and composition of research ethics committees: findings from the PEARL qualitative study</article-title>. <source><italic>BMC medical ethics</italic></source>. <year>2016</year> Dec;<volume>17</volume>:<fpage>1</fpage>-<lpage>0</lpage>.</mixed-citation></ref>
<ref id="ref-10"><label>10</label><mixed-citation publication-type="website"><source><italic>Avon Longitudinal Study of Parents and Children</italic></source>. Available from <uri>https://www.bristol.ac.uk/alspac/participants/our-commitment-to-you/</uri> [Accessed 19 Aug. 2024].</mixed-citation></ref>
<ref id="ref-11"><label>11</label><mixed-citation publication-type="website"><article-title>UK LLC promises to LPS participants</article-title>. Available from <uri>https://ukllc.ac.uk/our-promises</uri> [Accessed 19 Aug. 2024].</mixed-citation></ref>
<ref id="ref-12"><label>12</label><mixed-citation publication-type="journal"><string-name><surname>Muller</surname> <given-names>SHA</given-names></string-name>, <string-name><surname>Kalkman</surname> <given-names>S</given-names></string-name>, <string-name><surname>van Thiel</surname> <given-names>GJMW</given-names></string-name>, <string-name><surname>Mostert</surname> <given-names>M</given-names></string-name>, <string-name><surname>van Delden</surname> <given-names>JJM</given-names></string-name>. <article-title>The social licence for data-intensive health research: towards co-creation, public value and trust</article-title>. <source><italic>BMC Medical Ethics.</italic></source> <year>2021</year>;<volume>22</volume>(<issue>1</issue>):<fpage>110</fpage>. <uri>https://link.springer.com/article/10.1186/s12910-021-00677-5</uri></mixed-citation></ref>
<ref id="ref-13"><label>13</label><mixed-citation publication-type="journal"><string-name><surname>Moffat</surname>, <given-names>K</given-names></string-name>. and <string-name><surname>Zhang</surname>, <given-names>A</given-names></string-name>. <article-title>The paths to social licence to operate: An integrative model explaining community acceptance of mining</article-title>. <source><italic>Elsevier</italic></source>, Volume <volume>39</volume>, March <year>2014</year>, Pages <fpage>61</fpage>-<lpage>70</lpage>. <uri>https://www.sciencedirect.com/science/article/pii/S0301420713001141</uri></mixed-citation></ref>
<ref id="ref-14"><label>14</label><mixed-citation publication-type="journal"><string-name><surname>Aitken</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Cunningham-Burley</surname>, <given-names>S</given-names></string-name>. and <string-name><surname>Pagliari</surname>, <given-names>C</given-names></string-name>. <article-title>Moving from trust to trustworthiness: Experiences of public engagement in the Scottish Health Informatics Programme</article-title>. <source><italic>Science and Public Policy</italic></source>, <year>2016</year>. <volume>43</volume>(<issue>5</issue>), pp.<fpage>713</fpage>&#x2013;<lpage>723</lpage>. <pub-id pub-id-type="doi">10.1093/scipol/scv075</pub-id>.</mixed-citation></ref>
<ref id="ref-15"><label>15</label><mixed-citation publication-type="website"><article-title>National Institute for Health and Care Research</article-title>. <year>2021</year>. <source><italic>Briefing notes for researchers - public involvement in NHS, health and social care research.</italic></source> [online] <uri>www.nihr.ac.uk</uri>. <uri>https://www.nihr.ac.uk/documents/briefing-notes-for-researchers-public-involvement-in-nhs-health-and-social-care-research/27371</uri>. [Accessed 19 Aug. 2024].</mixed-citation></ref>
<ref id="ref-16"><label>16</label><mixed-citation publication-type="book"><string-name><surname>Evans</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Richard</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Crane</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Turner</surname>, <given-names>E.</given-names></string-name>, <year>2023</year>, <source><italic>UK Longitudinal Linkage Collaboration: The National Trusted Research Environment for Longitudinal Research (Research Protocol V2.0</italic></source>. Available from <publisher-name>UK Longitudinal Linkage Collaboration: The National Trusted Research Environment for Longitudinal Research (Research Protocol V2.0)</publisher-name></mixed-citation></ref>
<ref id="ref-17"><label>17</label><mixed-citation publication-type="website"><collab>Twins UK Voluntary Advisory Panel (VAP)</collab>. Available from <uri>https://twinsuk.ac.uk/media-and-engagement/twins-engagement/</uri>. [Accessed 19 Aug. 2024]</mixed-citation></ref>
<ref id="ref-18"><label>18</label><mixed-citation publication-type="website"><collab>ALSPAC Law and Ethics Committee (ALEC)</collab>. Available from: <uri>https://research-information.bris.ac.uk/en/activities/alspac-law-and-ethics-committee-alec</uri>. [Accessed 19 Aug. 2024].</mixed-citation></ref>
<ref id="ref-19"><label>19</label><mixed-citation publication-type="journal"><string-name><surname>Rowe</surname>, <given-names>G</given-names></string-name>. and <string-name><surname>Frewer</surname>, <given-names>L.J</given-names></string-name>. <article-title>A Typology of Public Engagement Mechanisms</article-title>. <source><italic>Science, Technology, &amp; Human Values</italic></source>, <year>2005</year>. <volume>30</volume>(<issue>2</issue>), pp.<fpage>251</fpage>&#x2013;<lpage>290</lpage>. <pub-id pub-id-type="doi">10.1177/0162243904271724</pub-id></mixed-citation></ref>
<ref id="ref-20"><label>20</label><mixed-citation publication-type="journal"><string-name><surname>Dawson</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Campbell</surname>, <given-names>S.M.</given-names></string-name>, <string-name><surname>Giles</surname>, <given-names>S.J.</given-names></string-name>, <string-name><surname>Morris</surname>, <given-names>R.L</given-names></string-name>. and <string-name><surname>Cheraghi-Sohi</surname>, <given-names>S</given-names></string-name>. <article-title>Black and minority ethnic group involvement in health and social care research: A systematic review</article-title>. <source><italic>Health Expectations</italic></source>, <year>2017</year>. <volume>21</volume>(<issue>1</issue>), pp.<fpage>3</fpage>&#x2013;<lpage>22</lpage>. <pub-id pub-id-type="doi">10.1111/hex.12597</pub-id></mixed-citation></ref>
<ref id="ref-21"><label>21</label><mixed-citation publication-type="journal"><string-name><surname>Flynn</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Ricci</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Bellaby</surname>, <given-names>P</given-names></string-name>. <article-title>Deliberation over new hydrogen energy technologies: evidence from two Citizens&#x2019; Panels in the UK</article-title>. <source><italic>Journal of Risk Research</italic></source>, <year>2013</year>. <volume>16</volume>(<issue>3&#x2013;4</issue>), <fpage>379</fpage>&#x2013;<lpage>391</lpage>. <pub-id pub-id-type="doi">10.1080/13669877.2012.743160</pub-id></mixed-citation></ref>
<ref id="ref-22"><label>22</label><mixed-citation publication-type="journal"><string-name><surname>Brown</surname>. <given-names>M</given-names></string-name>. <article-title>Survey Article: Citizen Panels and the Concept of Representation</article-title>, <source><italic>The Journal of Political Philosophy</italic></source>: Volume <volume>14</volume>, Number 2, <year>2006</year>, pp. <fpage>203</fpage>&#x2013;<lpage>225</lpage>, jopp_245.qxd (cspo.org)</mixed-citation></ref>
<ref id="ref-23"><label>23</label><mixed-citation publication-type="website"><article-title>National Institute for Health Research</article-title>. <year>2018</year>. <source>Guidance on co-producing a research project</source>. Available from: <uri>https://www.invo.org.uk/wp-content/uploads/2019/04/Copro_Guidance_Feb19.pdf</uri> [Accessed 19 Aug. 2024].</mixed-citation></ref>
<ref id="ref-24"><label>24</label><mixed-citation publication-type="journal"><string-name><surname>Miles</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Renedo</surname>, <given-names>A.</given-names></string-name>, &amp; <string-name><surname>Marston</surname>, <given-names>C</given-names></string-name>. <year>2021</year>. <article-title>Reimagining authorship guidelines to promote equity in co-produced academic collaborations</article-title>. <source><italic>Global Public Health</italic></source>, <volume>17</volume>(<issue>10</issue>), <fpage>2547</fpage>&#x2013;<lpage>2559</lpage>. <pub-id pub-id-type="doi">10.1080/17441692.2021.1971277</pub-id></mixed-citation></ref>
<ref id="ref-25"><label>25</label><mixed-citation publication-type="journal"><string-name><surname>Kaisler</surname>, <given-names>R.E.</given-names></string-name>, <string-name><surname>Missbach</surname>, <given-names>B</given-names></string-name>. <article-title>Co-creating a patient and public involvement and engagement &#x2018;how to&#x2019; guide for researchers</article-title>. <source><italic>Res Involv Engagem</italic></source> <volume>6</volume>, <fpage>32</fpage> (<issue>2020</issue>). <pub-id pub-id-type="doi">10.1186/s40900-020-00208-3</pub-id></mixed-citation></ref>
<ref id="ref-26"><label>26</label><mixed-citation publication-type="other"><collab>NIHR</collab>. <year>2023</year>. <article-title>Payment guidance for researchers and professionals</article-title>. Available from: <publisher-name>Payment guidance for researchers and professionals &#x2013; NIHR</publisher-name> [Accessed 19 Aug. 2024].</mixed-citation></ref>
<ref id="ref-27"><label>27</label><mixed-citation publication-type="journal"><string-name><surname>Aitken</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Tully</surname>, <given-names>M.P.</given-names></string-name>, <string-name><surname>Porteous</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Denegri</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Cunningham-Burley</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Banner</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Black</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Burgess</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Cross</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Van Delden</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Ford</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Fox</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Fitzpatrick</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Gallacher</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Goddard</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Hassan</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Jamieson</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Jones</surname>, <given-names>K.H.</given-names></string-name>, <string-name><surname>Kaarakainen</surname>, <given-names>M</given-names></string-name>. and <string-name><surname>Lugg-Widger</surname>, <given-names>F</given-names></string-name>. <article-title>Consensus Statement on Public Involvement and Engagement with Data-Intensive Health Research</article-title>. <source><italic>International Journal of Population Data Science</italic></source>, <year>2019</year>. <volume>4</volume>(<issue>1</issue>). <pub-id pub-id-type="doi">10.23889/ijpds.v4i1.586</pub-id></mixed-citation></ref>
<ref id="ref-28"><label>28</label><mixed-citation publication-type="website"><article-title>Our commitments to you</article-title>. Available from: <uri>https://www.bristol.ac.uk/alspac/participants/our-commitment-to-you/</uri> [Accessed 19 Aug. 2024].</mixed-citation></ref>
</ref-list>
</back>
</article>
