NEW YORK, NY–COVID vaccine surveillance efforts are a global priority, but safety monitoring for vaccines should not reflect a single population. The largest, most extensive international study of the background rates of adverse events of special interest (AESI) that are being tracked in vaccine surveillance efforts show that adverse event rates vary substantially by age, sex, and method of data capture.
Led by researchers at Oxford University, Columbia University, Erasmus MC, UCLA, and Janssen, an international team of collaborators from the Observational Health Data Sciences and Informatics (OHDSI) network provided a timely reference of the background rates of AESIs in a new study published June 14 in The BMJ.
The researchers found significant differences in the observed rates of AESIs based on the age groups and sex of more than 126 million people across four continents and 13 databases. Differences were also observed among people within databases.
“We knew regulators would be monitoring a long list of events for the surveillance of COVID vaccines safety,” said co-senior author Dani Prieto-Alhambra MD MSc PhD, Professor of Pharmacoepidemiology at the University of Oxford. “To do this, they need robust estimates of the background rates of these events in historical data. These results can be used as benchmark for the monitoring of these potential safety events and for any upcoming COVID-19 vaccines.”
There were 15 prespecified adverse events studied, matching those being monitored by the U.S. Food and Drug Administration and similar to those used by other regulatory agencies, including heart attack, stroke, and blood clotting. Incidence rates were classified by age groups and gender across the databases, though the outcomes of those groups vary by database.
“We found significant heterogeneity in background rates between age and sex,” said co-lead author Xintong Li, DPhil candidate and Clarendon scholar at the University of Oxford. “If we compare these rates regardless of age or sex group, we may either find a false signal or neglect a real safety signal while monitoring vaccine surveillance.
“The observed and expected rates comparison should also be conducted within the same health database whenever possible,” Li added. “While we understand that is not possible for all surveillance systems or vaccine safety studies, choosing a similar population and stratifying or standardizing by age and sex is highly recommended.”
Heart attack, for example, was observed as a very rare (1/10,000) outcome for a 24-year-old female, but it was a common (1/10 to ?1/100) one for an 88-year-old male. The research team believes that the populations that are more likely to suffer these AESIs (like the older man in this example) should be analyzed separately from populations in much lower-risk groups.
“If a vaccinated population is older than an unvaccinated population, and we do not adjust for it, we may see a false increased risk of events following vaccination,” said co-lead author Anna Ostropolets, MD, a PhD candidate in the Columbia University Department of Biomedical Informatics.
The variability between different databases could reflect numerous factors, ranging from the process of data capture to population differences such as socioeconomic status and comorbidities.
“The observed heterogeneity between databases was more than I expected,” Prieto-Alhambra said. “As a consequence, vaccine safety surveillance should be conducted using the same database for both post-vaccine and background rates.”
This multinational network cohort study used deidentified electronic health records and health claims data, all of which were mapped to the OMOP common data model, which allows for the systematic analysis of different observational databases. All rates of adverse events, as well as the protocol and study codes, are available in the publication.
###
The study was developed and executed by the OHDSI community, a global, multi-stakeholder network that has more than 2,100 interdisciplinary researchers from six continents, as well as standardized health records for nearly 600 million unique patients around the world. The community strives to promote better health decisions and care through globally standardized health data, continuously developing large-scale analytics and a spirit of collaboration though open science.
Columbia University serves as the central coordinating center for the OHDSI community.
OHDSI research on COVID-19 has resulted in published studies on the safety profile of hydroxychloroquine, the characteristics and outcomes of more than 34,000 COVID-19 patients, the varied therapies used around the world for COVID treatment, the impact on children and adolescents, as well as several others in both peer-reviewed journals or on preprint servers.
The study, “Characterising the background incidence rates of adverse events of special interest for covid-19 vaccines in eight countries: multinational network cohort study,” was published as a Special Paper June 14 by The BMJ.
Columbia authors are Anna Ostropolets, Patrick Ryan, Adjunct Assistant Professor of Biomedical Informatics, and George Hripcsak, Chair and Vivian Beaumont Allen Professor of Biomedical Informatics.
This work was partially funded by the UK National Institute for Health Research (NIHR), European Medicines Agency, European Health Data and Evidence Network (EHDEN), US Food and Drug Administration CBER BEST initiative (75F40120D00039), and US National Library of Medicine (R01 LM006910). EHDEN has received funding from the Innovative Medicines Initiative 2 Joint Undertaking under grant agreement No 806968. The Innovative Medicines Initiative 2 Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation programme and EFPIA. The study funders had no role in the conceptualization, design, data collection, analysis, decision to publish, or preparation of the manuscript. This document expresses the opinion of the authors of the paper, and may not be understood or quoted as being made on behalf of or reflecting the position of the European Medicines Agency or one of its committees or working parties.
