Article Text

Download PDFPDF

Real-world evidence: what is it and can it be trusted?
Free
  1. Philip Wiffen
  1. Pain Research Unit, Churchill Hospital, Oxford, UK
  1. Correspondence to Professor Philip Wiffen, Pain Research Unit, Churchill Hospital, Thame OX9 3GG, UK; pwiffen{at}oxfordsrs.org.uk

Statistics from Altmetric.com

There is a new term slipping into submissions—‘real world’ sometimes expressed as ‘real-world data’ (RWD) or ‘real-world evidence’ (RWE). Since the start of 2020, we have published some 10 articles that use this term in some form, six of them from Spain. But what does the term mean?

In that famous children’s book ‘Alice’s Adventures in Wonderland’,1 there is a now famous quotation from Humpty Dumpty: “When I use a word,” Humpty Dumpty said in rather a scornful tone, “it means just what I choose it to mean—neither more nor less.” “The question is,” said Alice, “whether you can make words mean so many different things.”

In the early days of evidence-based medicine (EBM), there were those who thought that using the term evidence was sufficient without paying attention to the philosophy that lay behind the concept. We need to be sure that the same thing does not happen with the term ‘real world’ and so we need to carefully define what we mean.

The early EBM developments led to advances in critical appraisal as a means to assess evidence and a number of tools are now available for different study designs2; however, I am not aware of such a tool to appraise RWD studies.

There is an emerging literature on the topic of RWD. Lipworth3 from Sydney Australia defines RWD as ‘data collected outside of the laboratory or conventional randomised controlled trials’. She goes on to list what this might look like including:

  • Public health data such as disease surveillance and population health.

  • Clinical research including data sources for trials that aim to capture the effects of interventions in populations receiving routine healthcare or to generate observational data about the safety and effectiveness of healthcare interventions.

Furthermore, the use of RWD is used to generate RWE which is used to guide regulation, financing or clinical use as well as for broader health service design.2

Gokhale and colleagues4 suggest that RWE is ‘a concept that offers an understanding of the effects of healthcare interventions using routine clinical data’. They helpfully point out that while such an approach is attractive, it also opens the doors to biases in both the design and analytical phases of non-experimental studies. The paper written from the point of view of RWE based on diabetes studies is recommended to any who wish to use RWD. It works through a series of issues that are similar to a critical appraisal tool. This paper could provide a useful background as it covers such issues as the types of data sources and study design, and lists the potential biases.

Lipworth3 further points out that those using RWD can be driven by commercial, political, professional or personal self-interest.

I am pleased to publish a commissioned paper in this issue from an experienced team based in Chengdu, West China, titled: ‘Toward the better understanding about real-world evidence: a short overview of methodologies’.5 I have had the privilege of working with one of the authors, Xin Sun, over a good number of years. The paper covers key issues such as sources of data, formulating the research question, developing the dataset as well as appropriate analysis and reporting.

The topic of RWE will be on the agenda for the EJHP editors meeting in March 2021 and I am hoping to stimulate discussion among authors and readers to ensure that RWE papers that are published in EJHP meet agreed standards as well as provide answers to clinical questions.

Ethics statements

Patient consent for publication

References

Footnotes

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Provenance and peer review Commissioned; internally peer reviewed.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Linked Articles