Laying the Foundation for Real-World Evidence Studies of Psoriatic Disease in Newfoundland and Labrador

Abstract

The Janssen and Newfoundland and Labrador Health Innovation Partnership (JANL-HIP) was established to carry out Real-World Evidence (RWE) projects to generate evidence about disease pathways, healthcare delivery, the effects of clinical interventions. Doing so will support and influence clinical decision-making in Newfoundland and Labrador (NL). This case study describes the foundational elements necessary for a~real-world evidence~generation project in NL and may provide learning for the effective execution of real-world studies in other jurisdictions. It uses an ongoing project in psoriatic disease in NL to illustrate the partnership and the benefits of RWE studies. Ultimately, the JANL-HIP RWE project aims to inform decisions that will drive improvements in health outcomes, system delivery, and policy mutually beneficial to health ecosystem stakeholders.

Introduction

Real-World Evidence (RWE) refers to the analysis of data collected outside of a clinical trial setting [1]. Such data collected outside of conventional randomized controlled trials is aptly referred to as Real-World Data (RWD), an umbrella term that includes healthcare data collected from patients, clinicians, hospitals, and payers [2]. Using varied data sources to generate RWE enables assessments of the effectiveness, safety and cost-benefit of drug therapies and other clinical interventions. Real world evidence is also used to inform decisions that aim to drive improvements in policy, system delivery, and ultimately health outcomes, with mutual benefit to health ecosystem stakeholders (clinicians, partners, patients, and citizens).

RWD-based research can be invaluable in interrogating common complex diseases. This approach is more efficient, less expensive, and has better generalizability than traditional clinical trials [3]. In addition, populations that are typically excluded from traditional research studies—such as children, pregnant women, and the elderly—have the opportunity to be included in RWE studies. Also, richer information on patients and their health can be captured using RWE studies, ultimately helping to determine factors that affect the disease course and outcomes in these populations.

This case study provides an in-depth look at the foundational elements used for a RWE generation in NL, including a strong public-private partnership, robust data and data infrastructure, and prioritization of privacy and ethics.

JANL-HIP: a partnership among key health system stakeholders

The rich data landscape in Canada stands in stark contrast to its low levels of data access and use relative to the rest of the world. Canada has thirteen provinces and territories, and each health ministry governs each system of publicly-funded healthcare. This individual governing system structure creates barriers between data sources and limits the ability of both public and private sector researchers to connect with RWD. While these challenges exist, there has been increasing interest from Canadian healthcare stakeholders, health ministries, and public and private payers to leverage RWE to inform decision-making.

Recognizing their role as an industry leader in driving discussions of RWE generation, Janssen Canada developed partnerships across different regions of the country to identify key shared areas of interest to improve population health. These long-term, public-private RWE partnerships are grounded in strong governance and reciprocal trust – two ingredients necessary for effective collaboration towards meaningful evidence generation. This model can provide deeper insights into burden of illness, quality and efficiency of healthcare delivery, drug effectiveness, and long-term safety. In terms of provincial research capabilities, RWE partnerships can apply scientific best practices and advance methodologies, generate evidence about disease pathways, healthcare delivery and the effects of clinical interventions, and ultimately support decision making and scientific exchange.

In October 2017, Janssen Canada announced the Janssen and Newfoundland and Labrador Health Innovation Partnership (JANL-HIP). This partnership involves the Government of Newfoundland and Labrador, Eastern Health, the Newfoundland and Labrador Centre for Health Information (NLCHI), Janssen Inc., and Memorial University of Newfoundland (MUN). JANL-HIP’s work focuses on RWE projects that will bring mutually beneficial solutions to Janssen, the health system, and to patients of Newfoundland and Labrador.

NLCHI’s provincial data lab: a rich reservoir of data

Newfoundland and Labrador (NL) has a population of 520 998 living in 11 census divisions in 281 municipalities. Nearly two-thirds (59.6%) of the population is reported to live in a large urban population centre, 9.0% in medium population centre, 12.7% in small population centres and 18.7% in rural communities [4]. There are four regional health authorities in NL, namely Eastern Health, Central Health, Western Health and Labrador-Grenfell Health. These health authorities are responsible for the healthcare needs and services of residents within their catchment area.

The NL Centre for Health Information (NLCHI) is responsible for developing, operating, and managing a comprehensive and aligned information system that fully integrates and uses data and health information from all health and community services system components [5]. Through collaboration with the healthcare system, the NLCHI supports the development of data and technical standards, maintains provincial health data and information assets, carries out analytics, evaluation, and decision support services, and supports health research. The NLCHI is also responsible for implementing digital health systems in the province to enable improved patient access and healthcare delivery and create improved accountability, stability, and efficiency in the provincial healthcare system. Digital health systems include virtual care, the electronic health record (HEALTHeNL), the electronic medical record (eDOCS NL), telehealth, and telepathology [6].

The NLCHI is a custodian of many key health databases in the province that capture healthcare interactions for all individuals accessing healthcare services in NL. Data captured include vital statistics, fee-for-service physician billings, hospitalizations, prescriptions filled at community pharmacies, laboratory data, and emergency department visits [7]. In addition, the NLCHI has an internal de-identification process that allows the consolidation of individuals with multiple healthcare numbers into one unique ID, enabling data linkage across multiple datasets.

NLCHI has been leading efforts to advance the availability, quality, and use of health system data for decision making, research, and innovation purposes through its Provincial Data Lab and Data Governance Framework [8]. The Provincial Data Lab includes a data repository and secure, virtual environments that allow users to interact with data and information in a privacy protective manner.

The Provincial Data Lab is where internal NLCHI users currently work with data; however, there is also a Research and Evaluation Environment where users external to NLCHI can access and analyze data regardless of geography. Once all required approvals and data sharing agreements are in place, authorized users can remotely access the Provincial Data Lab from any computer via a virtual private network and two-factor authentication. Individuals who access record-level data are provided with access to various analytical tools and software and the ability for project teams to access data, code, and output in common project spaces. In addition to providing access to data and information, the Provincial Data Lab also provides data management, audit, storage, retention, and secure disposal services to users.

Partnership purpose and governance

The success of a unique RWE partnership model is rooted in a common purpose, strong governance, and effective operations. The JANL-HIP is a collaboration to fund and lead the generation of RWE, the scope of which is limited to projects focused on topics of interest to the members. These topics are agreed upon and documented by all parties. Project criteria include: (i) a focus on improved health outcomes; (ii) identification of analytic findings that can inform provincial health policy; (iii) timely conduct of the project (for example, data output within twelve months and completed analysis within two years); and (iv) pan-provincial considerations.

The JANL-HIP governance model is comprised primarily of a Steering Committee and a RWE Working Group (Figure 1).

Figure 1: JANL-HIP Governance Model.

A Steering Committee was established with representation from all funding partners. These partners may also include mutually agreed upon third-party collaborators on the Steering Committee. In general, decisions of the Steering Committee are expected to be made by consensus, with each party having one vote. The Steering Committee members established terms of reference and nominated a chairperson from MUN. In addition, MUN was responsible for the management, administration, and distribution of the Partnership Fund, including managing the budget.

As the main governing body for JANL-HIP, the role of the Steering Committee involved

1. Establishing objectives and priorities of the partnership, and identifying RWE project ideas based on areas of common interest or unmet needs of the partners. Regarding financial and operational activities, the Steering Committee recommends and approves funding concerning the partnership and confirms the scope, schedule, and budget for RWE projects.
2. Review results of collaborative efforts and activities undertaken; and
3. Promote the sharing of knowledge among the parties.

The RWE Working Group was established to undertake the RWE projects, ideally with equal representation from the partners. There can also be representation from other collaborators, as agreed upon by the Steering Committee. In general, decisions of the Working Group are expected to be by consensus.

The role of the Working Group includes the following:

1. Be responsible for operationalizing research questions.
2. Establish a review process to assess the quality and relevance of proposed RWE projects in relation to the areas of interest identified by the Steering Committee.
3. Review RWE project opportunities based on project criteria and make funding recommendations to the Steering Committee; and
4. Develop a research protocol plan template that the selected researcher(s) will be required to complete to ensure transparency. The studies will use methods appropriate for non-interventional studies utilizing secondary data, e.g., registries, claims databases.

In essence, the JANL-HIP governance and operations model guides the utilization of RWD to undertake relevant and important RWE projects to support patient care and health outcomes.

Ethics, privacy, and security of real-world database studies in NL

In addition to strong partnership governance, privacy and security are also essential considerations given the sensitive nature of the data needed for such projects. Real-world studies constitute one example of secondary use of data in that data are collected and gathered for other purposes, such as in the context of healthcare provision. [9]. Secondary use of data in RWE studies is often considered an economical approach to answering research questions as it relies on the reanalysis of previously gathered data. Such types of studies have become increasingly common in an era of big data and as researchers discover the value of re-interrogating information [10].

The primary issue faced by users of secondary data are privacy and confidentiality [11]. The risk level depends on the type of information gathered and whether there are any identifying features included in the dataset. Because current access and secondary use of data pertain to studies for which consent may not have initially been sought, oversight must safeguard the secondary use of RWD.

Studies using personal health information in the province of NL are governed by complementary legislation and ethical guidance. In NL, personal health information and its safeguarding fall under the purview of the Personal Health Information Act (PHIA), which was proclaimed in 2011 [12]. PHIA governs the use of personal health information in NL, designates custodians of personal health information, and establishes the rules that they must follow for the collection, use, and disclosure of this information. Because studies utilizing these data do not necessarily obtain direct consent from patients, the role of the custodian is to ensure that identifying features are removed and to consider potential harm to patients. Unlike clinical trials or other more traditional research studies, the use of secondary data does not typically pose physical risks to patients. Instead, potential risks pertain largely to privacy stemming from the use of personal data [13].

The ethics requirements of studies undertaken in NL are regulated first and foremost by provincial legislation. Health research taking place in NL is governed by the Health Research Ethics Board (HREB), a mechanism of the Health Research Ethics Authority (HREA), which the provincial government established under the Health Research Ethics Authority Act in 2011 [14]. The HREB reviews and renders an approval decision on all health-related research in NL. While some countries have laws in place that govern Research Ethics Board (REB) operations, Canada lacks a uniform research oversight regulation at the federal level, relying instead on guidelines established by the Panel on Research Ethics for research involving humans as outlined in the Tri-Council Policy Statement version 2 (TCPS2) [15].

Ethics approval is of particular importance in NL, given the local geographic context. Data that may not otherwise lead to identifiable participants (such as postal code) can be identifying in communities with only a few dozen inhabitants and a handful of sufferers of specific diseases. Complementary legislation, ethical guidance, and NLCHI’s governance framework for the Provincial Data Lab all helped guide the team and ensure the security and proper usage of real-world health data. This combined oversight is a crucial component to any research study carried in NL, including real-world studies.

Other relevant RWE initiatives across Canada

There are several other real-world evidence initiatives in Canada, providing access to large-scale RWD for analysis to generate evidence beneficial to the healthcare system. RWE can range from broad population-based academic initiatives to disease-specific collaborations to commercial-led partnerships, as illustrated in these examples.

Population data BC (PopData)

Population Data BC (PopData), located at the University of British Columbia in the School of Population and Public Health, is a resource that supports data linkage and access to de-identified data for research on health and wellbeing and training related to the use of those data [16].

PopData focuses on university-based researchers and does not work with the private sector, but in other ways it is similar to the JANL-HIP data lab in that PopData operates with a governance and management framework consisting of an advisory board and a working group. Also, both partnerships function with a privacy mandate and promote access to population-based secondary data provided in a secure research environment. Using the PopData resource, studies have been carried out to examine the symptoms exhibited by multiple sclerosis patients five years before their first recognized symptoms [17] and investigate the safety of home births compared to hospital deliveries [18].

These investigations conducted via the PopData resource facilitate evidence and result generation to aid policy decisions and improve population health.

The Canadian Real-world evidence for value of cancer drugs (CanREValue) collaboration

The Canadian Real-world Evidence for Value of Cancer Drugs (CanREValue) collaboration was established to create a framework for Canadian provinces regarding the generation and usage of RWE to make funding decisions concerning cancer medications [19]. To generate RWE, the collaboration intends to focus on the generation of RWE using RWD collected from existing population-level healthcare databases, including cancer registries, hospital records, and insurance claims.

To achieve this goal, the CanREValue collaboration established five working groups: Planning and Drug Selection; Methods; Data; Reassessment and Uptake and Engagement. These working groups will develop a framework, undertake multiple RWE projects across provinces, and assimilate that framework into the Canadian healthcare system. The CanREValue collaboration intends for their framework to facilitate the reassessment of cancer medications and improve recommendations regarding funding by stakeholders across Canada to ensure that the healthcare system provides clinical benefits and value for its funding.

The goals of the CanREValue collaboration are similar to those of the JANL-HIP collaboration. In addition to examining and assessing the incidence, prevalence and comorbidities of various diseases, the JANL-HIP partnership plans to examine the financial burden of various illnesses, including but not limited to hospitalization and medications, and to provide recommendations to stakeholders to ensure maximum benefit and value.

Commercial organizations partnerships

Other commercial organizations have also developed partnerships with public and private establishments with external data sources such as national and provincial databases, disease registries, patient support programs, and EMR networks [20, 21]. This is to carry out real-world studies to generate insights into medication usage, disease progression, and clinical outcomes [20, 21]. The commercial entitiy IQVIA, for example, collaborates with various data stewards to create a process for real-world studies that include securing data, integrating multiple data sources and employing a methodological approach for data analysis [20]. Using RWD, they have partnered with different study groups to answer questions and generate evidence regarding migraine and metastatic gastric cancer, among others [22, 23].

The JANL-HIP builds on the guidance of various real-world initiatives to answer relevant healthcare questions and provide insights for NL’s people and the healthcare system. The close partnership between industry, academia, and the NL government that captures the entire provincial dataset, sets this initiative apart.

Illustration of the value of JANL-HIP in NL through ongoing study in Psoriatic disease

Newfoundland and Labrador have a high prevalence of psoriatic disease than anywhere else in Canada; therefore, its study is critical to the provincial healthcare system and the patients it serves. However, results derived from traditional research methods might not wholly represent most people living with the disease. This is because only a subgroup of the psoriatic population can meet the requirement to enroll in clinical trials or other psoriasis registries. For example, despite high-quality Phase III randomized trials in psoriasis and psoriatic disease, the efficacy of advanced targeted immune therapies in biologically experienced patients is not as robust. This is because the response rate for biologically experienced patients is lower than biologically naïve psoriatic patients, and their drug persistence is much shorter [24]. Also, the generalizability of these cost-effectiveness studies is a challenge as only a subset of the entire biologically eligible PsA spectrum patients is entered into a clinical trial. Additionally, psoriatic patients with concomitant medical illness are not included in clinical trials, likely resulting in greater tolerability and increased drug safety profile because medically complicated patients cannot tolerate prolonged immunosuppression [25].

The opposite scenario also occurs, as noted in a Canadian biologic registry, where patients with such milder disease PsA are over-represented in clinic patients receiving biologic agents compared to the clinical trials [26]. This has economic implications as patients with milder disease may be managed with palliative care, and the therapeutic effect size between DMARDs and biologics appears to be smaller [26]. So, including real-life data from registries will be important in determining the actual value of biologic agents and, overall, the prevalence and effect of psoriatic disease in the province.

Recognizing that RWE studies have the potential to provide further insights into disease associations, the partnership intends to use RWD available through the NLCHI to explore the association between psoriasis and mental illness and other metabolic diseases such as obesity, diabetes, and hypertension associated with active psoriatic disease [27, 28].

Our first study investigates the association between psoriasis and mental health [29]. Data on 15,100 patients with psoriasis and 75,500 controls (1:5) was collected from the NLCHI Electronic Health Records, and the cases and controls were matched for age, sex, and geography. Patients with psoriasis were identified through ICD-9 code 696 from dermatologists in the province. Diagnosis of mental illnesses was obtained from physician’s visits and hospitalization records using ICD-9 and ICD-10 codes.

Following the study analysis, the percentage of people coded for anxiety in the psoriatic cohort was 36.5% compared to 28.9%, p < 0.0001 in the comparison group; and depression was 37.0% compared to 30.1%, p < 0.0001. The most significant increased risk for anxiety [OR 1.4 (1.20–1.67)] and depression [OR 1.65 (1.36–2.00)] among psoriasis was found for patients in the 0 to 20 age group.

Through this research, the JANL-HIP database provides relevant information regarding the burden of mental health disease in NL. Upcoming analyses will focus on attempted and completed suicides and the impact of health care resources of psoriasis patients compared to the control cohort. The partnership also plans to interrogate the association between psoriatic disease and cardiovascular diseases as psoriatic patients are at increased risk for cardiovascular disease compared to the general population, and cardiovascular disease is among the leading causes of death for psoriasis and PsA patients [30, 31]. We have also completed linkage of the JANL-HIP data with the NL- APPROACH database, an ongoing prospective data collection that captures the population of patients undergoing cardiac catheterization in Newfoundland.

RWE studies, like this example for psoriatic studies in NL, can generate evidence about disease pathways, healthcare delivery, clinical pathways, and support and influence clinical decision-making. RWE studies can also provide necessary data on the comparative effectiveness of traditional disease-modifying drugs and biologic agents and information on drug persistence and safety.

Conducting RWE studies does have limitations. These limitations include lack of randomization and internal validity [32]; risk of using compromised data which can be due to high drop rates or incomplete reporting by study participants [32–34]; likelihood of performing a biased study as a result of using data from a very homogenous population and therefore deriving results that cannot be extrapolated easily to other populations; possibility of determining association but not causation [34] and lack of a study design and standardization for reporting [35]. These potential shortcomings have led to calls for caution and transparency when working with RWD [3, 34]. Despite these limitations, the insights gained from RWE studies are invaluable and will augment existing study results and address limitations found in randomized clinical trial studies [35].

Conclusion

There are multiple determinants to positive patient health outcomes. Traditional research identifies only a portion of these determinants, leaving a gap. RWE is complementary to traditional research, providing both an efficient and holistic examination of the patient population. JANL-HIP has brought together diverse system stakeholders with the common aim of closing this gap by interrogating RWD in NL, and will provide good value for the healthcare system as it can impart further data on long-term effectiveness, adverse events, and drug persistence of psoriatic disease.

With NL’s harmonized medical care system infrastructure, NLCHI’s Data Governance Framework and Provincial Data Lab containing multiple sources of high-quality data, and provincial review processes for ethics, privacy, and security and unique complimentary legislative framework, JANL-HIP has a winning formula to realize its vision. This public-private partnership demonstrates a successful model of RWE generation to improve the healthcare system and provide a better quality of care for patients.

Acknowledgement

Funding for the JANL-HIP partnership is through Janssen Inc. and in-kind support from Memorial University. It should be noted that no Janssen products are discussed within this manuscript.

Conflicts of Interest

Proton Rahman has received grants from Janssen, Novartis and Speaker’s Bureau/Consultancy fromAbbVie, Amgen, Bristol Myers Squibb, Celgene, Eli Lilly, Janssen, Merck, Novartis, Pfizer, UCB.

Wayne Gulliver has received Grants/research support from AbbVie, Amgen, Eli Lilly, Novartis, Pfizer and Honoraria for Ad Boards/Invited Talks/Consultation from AbbVie, Actelion, Amgen, Arylide, Bausch Health, Boehringer, Celgene, Cipher, Eli Lilly, Galderma, Janssen, LEO Pharma, Merck, Novartis, PeerVoice, Pfizer, Sanofi-Genzyme, Tribute, UCB, Valeant. Other: Clinical trials (study fees): AbbVie, Asana Biosciences, Astellas, Boerhinger-lngleheim, Celgene, Corrona/National Psoriasis Foundation, Devonian, Eli Lilly, Galapagos, Galderma, Janssen, LEO Pharma, Novartis, Pfizer, Regeneron, UCB.

Evelyn Pyper, Janey Shin, Houng Hew and Brenda Fisher are employees of Janssen Inc. The other authors have no conflict of interest to declare.

Abbreviations

HREA	Health Research Ethics Authority
HREB	Health Research Ethics Board
ICD-9	International Classification of Diseases 9th revision
JANL-HIP	Janssen and Newfoundland and Labrador Health Innovation Partnership
MUN	Memorial University of Newfoundland
NL	Newfoundland and Labrador
NLCHI	Newfoundland and Labrador Centre for Health Information
PHIA	Personal Health Information Act
RWD	Real World Data
RWE	Real World Evidence

References

1. Makady A, de Boer A, Hillege H, Klungel O, Goettsch W. What is real-world data? A review of definitions based on literature and stakeholder interviews. Value in health. 2017 Jul 1;20(7):858–65 10.1016/j.jval.2017.03.008

   https://doi.org/10.1016/j.jval.2017.03.008

2. Miani C, Robin E, Horvath V, Manville C, Cave J, Chataway J. Health and healthcare: assessing the real-world data policy landscape in Europe. Rand health quarterly 2014;4(2)

3. Sherman RE, Anderson SA, Dal Pan GJ, Gray GW, Gross T, Hunter NL, LaVange L, Marinac-Dabic D, Marks PW, Robb MA, Shuren J. Real-world evidence—what is it and what can it tell us. N Engl J Med 2016 Dec 8;375(23):2293–7. https://www.nejm.org/doi/full/10.1056/nejmsb1609216.

4. Statistics Canada. 2018. Census indicator profile, based on the 2016 Census short-form questionnaire, Canada, provinces and territories, and health regions (2017 boundaries). Retrieved May 01, 2021 from https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=1710012201.

5. 2022.
6. DIGITAL HEALTH SYSTEMS; 2022.
7. Live Birth System 2020 User Guide May 2022 v.1.1; 2022.
8. Welcome to the Provincial Data Lab; 2022.

9. Camm AJ, Fox KA. Strengths and weaknesses of ’real-world studies involving non-vitamin K antagonist oral anticoagulants. Open Heart 2018 Apr 1;5(1):e000788. 10.1136/openhrt-2018-000788

   https://doi.org/10.1136/openhrt-2018-000788

10. Schlegel DR, Ficheur G. Secondary use of patient data: review of the literature published in 2016. Yearbook of medical informatics 2017 Aug;26(01):68–71. 10.15265%2FIY-2017-032

    https://doi.org/10.15265%2FIY-2017-032

11. Tripathy JP. Secondary data analysis: Ethical issues and challenges. Iranian journal of public health. 2013 Dec;42(12):1478

12. Government of NL. 2019. Personal Health Information Act. Queen’s Printer. Retrieved May 4, 2021 from https://assembly.nl.ca/Legislation/sr/statutes/p07-01.htm.

13. Martani A, Geneviève LD, Pauli-Magnus C, McLennan S, Elger BS. Regulating the secondary use of data for research: arguments against genetic exceptionalism. Frontiers in genetics. 2019 Dec 20;10:1254. 10.3389/fgene.2019.01254

    https://doi.org/10.3389/fgene.2019.01254
14. The HREA Corporate Statement; 2020.

15. Alas JK, Godlovitch G, Mohan CM, Jelinski SA, Khan AA. Regulatory framework for conducting clinical research in Canada. Canadian Journal of Neurological Sciences. 2017 Sep;44(5):469–74. 10.1017/cjn.2016.458

    https://doi.org/10.1017/cjn.2016.458

16. Ark TK, Kesselring S, Hills B, McGrail KM. Population Data BC: supporting population data science in British Columbia. International Journal of Population Data Science. 2020 Mar 26;4(2). 10.23889%2Fijpds.v5i1.1133

    https://doi.org/10.23889%2Fijpds.v5i1.1133

17. Wijnands JM, Zhu F, Kingwell E, Fisk JD, Evans C, Marrie RA, Zhao Y, Tremlett H. Disease-modifying drugs for multiple sclerosis and infection risk: a cohort study. Journal of Neurology, Neurosurgery & Psychiatry. 2018 Oct 1;89(10):1050–6. 10.1136/jnnp-2017-317493

    https://doi.org/10.1136/jnnp-2017-317493

18. Janssen PA, Saxell L, Page LA, Klein MC, Liston RM, Lee SK. Outcomes of planned home birth with registered midwife versus planned hospital birth with midwife or physician. Cmaj. 2009 Sep 15;181(6–7):377–83. 10.1503/cmaj.081869

    https://doi.org/10.1503/cmaj.081869

19. Chan K, Nam S, Evans B, de Oliveira C, Chambers A, Gavura S, Hoch J, Mercer RE, Dai WF, Beca J, Tadrous M. Developing a framework to incorporate real-world evidence in cancer drug funding decisions: the Canadian Real-world Evidence for Value of Cancer Drugs (CanREValue) collaboration. BMJ Open. 2020 Jan 1;10(1):e032884. 10.1136/bmjopen-2019-032884

    https://doi.org/10.1136/bmjopen-2019-032884

20. Neish C. 2020. Generating Real-World Evidence from Patient Support Programs to Enhance Patient Care. Retrieved March 14 2022 from https://www.iqvia.com/locations/canada/blogs/2020/11/generating-real-world-evidence-from-patient-support-programs-to-enhance-patient-care

21. IQVIA. Outcomes Research. Retrieved March 15 2022 from https://www.iqvia.com/locations/canada/solutions/pharmaceutical-manufacturers/real-world-solutions/outcomes-research

22. Gladstone J, Chhibber S, Minhas J, Neish CS, Power GS, Lan Z, Rochdi D, Lanthier-Martel J, Bastien N. Real-world persistence of erenumab for preventive treatment of chronic and episodic migraine: Retrospective real-world study. Headache: The Journal of Head and Face Pain. 2022 Jan;62(1):78–88. 10.1111/head.14218

    https://doi.org/10.1111/head.14218

23. Gómez-Ulloa D, Amonkar M, Kothari S, Cheung WY, Chau I, Zalcberg JR, Lara Suriñach N, Falcone A. Real-world treatment patterns, healthcare resource use and clinical outcomes of patients receiving second-line therapy for advanced or metastatic gastric cancer. BMC gastroenterology. 2020 Dec;20(1):1–4.

24. Ritchlin CT, Colbert RA, Gladman DD. Psoriatic arthritis. New England Journal of Medicine. 2017 Mar 9;376(10):957–70. 10.1056/nejmra1505557

    https://doi.org/10.1056/nejmra1505557

25. Mease PJ, Gladman DD, Gomez-Reino JJ, Hall S, Kavanaugh A, Lespessailles E, Schett G, Paris M, Delev N, Teng L, Wollenhaupt J. Long-Term Safety and Tolerability of Apremilast Versus Placebo in Psoriatic Arthritis: A Pooled Safety Analysis of Three-Phase III, Randomized, Controlled Trials. ACR open rheumatology. 2020 Aug;2(8):459–70. 10.1002%2Facr2.11156

    https://doi.org/10.1002%2Facr2.11156

26. Rahman P, Baer P, Keystone E, Choquette D, Thorne C, Haraoui B, Chow A, Faraawi R, Olszynski W, Kelsall J, Rampakakis E. Long-term effectiveness and safety of infliximab, golimumab and golimumab-IV in rheumatoid arthritis patients from a Canadian prospective observational registry. BMC rheumatology. 2020 Dec;4(1):1–4. 10.1186%2Fs41927-020-00145-4

    https://doi.org/10.1186%2Fs41927-020-00145-4

27. Neimann AL, Shin DB, Wang X, Margolis DJ, Troxel AB, Gelfand JM. Prevalence of cardiovascular risk factors in patients with psoriasis. Journal of the American Academy of Dermatology. 2006 Nov 1;55(5):829–35. 10.1016/j.jaad.2006.08.040

    https://doi.org/10.1016/j.jaad.2006.08.040

28. Guenther L, Gulliver W. Psoriasis comorbidities. Journal of cutaneous medicine and surgery. 2009 Sep;13(5_suppl):S77–87. 10.1016/j.jaad.2006.08.040

    https://doi.org/10.1016/j.jaad.2006.08.040

29. Badaiki W, Penney M, Pyper E, Lester K, Skeard J, Shin J, Fisher B, Gulliver S, Gulliver W, Rahman P. Real World Studies of Psoriasis and Mental Illness in Newfoundland and Labrador. Journal of Cutaneous Medicine and Surgery. 2022 Aug 7:12034754221117736. 10.1177%2F12034754221117736

    https://doi.org/10.1177%2F12034754221117736
30. In Seminars in arthritis and rheumatism. WB Saunders; 2004.
    https://doi.org/10.1016/j.semarthrit.2004.07.010

31. Han C, Robinson DW, Hackett MV, Paramore LC, Fraeman KH, Bala MV. Cardiovascular disease and risk factors in patients with rheumatoid arthritis, psoriatic arthritis, and ankylosing spondylitis. The Journal of rheumatology. 2006 Nov 1;33(11):2167–72. 10.1016/j.semarthrit.2004.07.010

    https://doi.org/10.1016/j.semarthrit.2004.07.010

32. Blonde L, Khunti K, Harris SB, Meizinger C, Skolnik NS. Interpretation and impact of real-world clinical data for the practicing clinician. Advances in therapy. 2018 Nov;35(11):1763–74. 10.1007%2Fs12325-018-0805-y

    https://doi.org/10.1007%2Fs12325-018-0805-y

33. CIOs KJ, Moore GW. Uniqueness of medical data mining. Artificial intelligence in medicine. 2002 Sep 1;26(1–2):1–24. 10.1016/s0933-3657(02)00049-0

    https://doi.org/10.1016/s0933-3657(02)00049-0

34. Kim HS, Kim JH. Proceed with caution when using real world data and real world evidence. Journal of Korean medical science. 2019 Jan 28;34(4). 10.3346/jkms.2019.34.e28

    https://doi.org/10.3346/jkms.2019.34.e28

35. Nazha B, Yang JC, Owonikoko TK. Benefits and limitations of real-world evidence: lessons from EGFR mutation-positive non-small-cell lung cancer. Future Oncology. 2021 Feb;17(8):965–77. 10.2217/fon-2020-0951

    https://doi.org/10.2217/fon-2020-0951