<?xml version="1.0"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "JATS-journalpublishing1.dtd" [
]>
<article xml:lang="en" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML"
  dtd-version="1.2" article-type="abstract">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">IJPDS</journal-id>
      <journal-title-group>
        <journal-title>International Journal of Population Data Science</journal-title>
        <abbrev-journal-title>IJPDS</abbrev-journal-title>
      </journal-title-group>
      <issn pub-type="epub">2399-4908</issn>
      <publisher>
        <publisher-name>Swansea University</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.23889/ijpds.v10i3.3328</article-id>
      <article-id pub-id-type="publisher-id">10:3:06</article-id>
      <title-group>
        <article-title>Simulating Policy Discussions with Digital Footprints and Large Language Models</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <name>
            <surname>Meng</surname>
            <given-names initials="W">Weiyao</given-names>
          </name>
          <xref ref-type="aff" rid="affil-1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Harvey</surname>
            <given-names initials="J">John</given-names>
          </name>
          <xref ref-type="aff" rid="affil-1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Carter</surname>
            <given-names initials="C">Christopher</given-names>
          </name>
          <xref ref-type="aff" rid="affil-1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Nica-Avram</surname>
            <given-names initials="G">Georgiana</given-names>
          </name>
          <xref ref-type="aff" rid="affil-1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Goulding</surname>
            <given-names initials="J">James</given-names>
          </name>
          <xref ref-type="aff" rid="affil-1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Frobisher</surname>
            <given-names initials="P">Paul</given-names>
          </name>
          <xref ref-type="aff" rid="affil-2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Forrest</surname>
            <given-names initials="M">Mina</given-names>
          </name>
          <xref ref-type="aff" rid="affil-2">2</xref>
        </contrib>
      </contrib-group>
      <aff id="affil-1"><label>1</label><institution>University of Nottingham, United Kingdom</institution></aff>
      <aff id="affil-2"><label>2</label><institution>Strategic Innovation Ltd, United Kingdom</institution></aff>
      <author-notes>
        <p>This research was supported by the Innovate UK Knowledge Transfer Partnership grant (project number KTP13737).</p>
      </author-notes>
      <pub-date date-type="pub" publication-format="electronic">
        <day>01</day>
        <month>09</month>
        <year>2025</year>
      </pub-date>
      <pub-date date-type="collection" publication-format="electronic">
        <year>2025</year>
      </pub-date>
      <volume>8</volume>
      <issue>4</issue>
      <elocation-id>3328</elocation-id>
      <permissions>
        <license license-type="open-access" xlink:href="https://creativecommons.org/licences/by/4.0/">
          <license-p>This work is licenced under a Creative Commons Attribution 4.0 International License.</license-p>
        </license>
      </permissions>
      <self-uri xlink:href="https://ijpds.org/article/view/3328">This article is available from the IJPDS website at: https://ijpds.org/article/view/3328</self-uri>
      <kwd-group>
        <kwd>Large Language Models</kwd>
        <kwd>Parliamentary Debates</kwd>
        <kwd>Social Simulation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec>
      <title>Introduction &amp; Background</title>
      <p>Parliaments play a significant role in democratic decision-making, drawing on evidence from a wide range of stakeholders. This evidence data, published on official government websites, is a valuable archive of digital traces reflecting the policymaking process. Among the key data sources is Hansard, the UK Parliament’s official verbatim record which captures the full transcripts of parliamentary debates and discussions, revealing diverse perspectives, stances and interactions shaped by participants’ political and social contexts. While datasets like Hansard offer rich insights into the policymaking process, their scale and varied dialogic structure present challenges for traditional analysis methods.</p>
      <p>Recent studies indicate large language models (LLMs) can exhibit intelligent and collaborative decision-making behaviours in social simulations. This makes them a useful tool for simulating complex discussions and analysing group dynamics.</p>
    </sec>
    <sec>
      <title>Objectives &amp; Approach</title>
      <p>This study explores the potential of LLMs to simulate UK parliamentary debates, with a focus on speaker roles and stance-taking. The immediate objective is to assess whether LLMs can mimic the structure and dynamics of real debates. Longer-term, this work aims to lay the foundation for a more comprehensive deliberation sandbox which provides an experimental environment that supports multi-stakeholder negotiation and collaborative problem-solving in a low-risk setting. Such a tool could enhance transparency and support more inclusive, evidence-informed policymaking.</p>
      <p>We evaluate model performance by comparing LLM-generated debates with real parliamentary discussions. The study tests general-purpose LLMs (including Gemini 2.5 and ChatGPT-o3) and GovernmentGPT (an open-source LLM fine-tuned on Hansard). All models were prompted on the same topic (i.e., ultra-processed foods) to enable comparison. Each generated output includes a speaker’s party affiliation and speech content.</p>
    </sec>
    <sec>
      <title>Relevance to Digital Footprints</title>
      <p>The Hansard data in this study qualify as digital footprints, capturing the digital traces of stakeholder engagement in shaping public policy. By analysing and simulating these footprints, this study shows how such data can be used to model complex social interactions and support public understanding of policy discussion.</p>
    </sec>
    <sec>
      <title>Results</title>
      <p>Two key patterns emerge from analysis. First, the simulated debates approximate the party composition of real parliamentary debates, i.e., the proportion of utterances by party broadly aligns with actual distribution. Second, many statements exhibit neutral or unclear stances, highlighting challenges in generating clear argumentative positions.</p>
    </sec>
    <sec>
      <title>Conclusions &amp; Implications</title>
      <p>These initial results suggest that LLMs can reproduce key elements of real parliamentary debates, offering a promising step toward simulating more complex, multi-actor policy dialogues. Future work will seek to connect these outputs to public understanding more directly by introducing new stakeholder voices, simulating responses to citizen concerns, and identifying opportunities for consensus or clarification in contested policy areas such as sustainable food systems, public health, and wellbeing.</p>
    </sec>
  </body>
</article>