PMCID: 10810962 (link)
Year: 2024
Reviewer Paper ID: 23
Project Paper ID: 95
Q1 - Title(show question description)
Explanation: The title of the manuscript explicitly identifies the study as a cost-effectiveness analysis, which is a type of economic evaluation, and specifies that it is analyzing vaccines for COVID-19, which indicates the intervention being compared.
Quotes:
-
Cost-Effectiveness Analysis of Vaccines for COVID-19 According to Sex, Comorbidity and Socioeconomic Status: A Population Study
Q2 - Abstract(show question description)
Explanation: The abstract is not structured into distinct sections that cover context, key methods, results, and alternative analyses as typical structured abstracts would have. It provides a general overview of the study's background, objective, methods, results, and conclusions, mostly in narrative form without explicit section headings for each element.
Quotes:
-
Background and Objective: Coronavirus disease 2019 (COVID-19) vaccines are extremely effective in preventing severe disease, but their real-world cost effectiveness is still an open question.
-
Methods: To calculate costs and quality-adjusted life years for the entire population of the Basque Country, dynamic modelling and a real-world data analysis were combined.
-
Results: By averting severe disease-related outcomes, COVID-19 vaccination resulted in monetary savings of $26.44 million for the first semester of 2021.
-
Conclusions: The incremental cost-effectiveness ratio of the vaccination programme justified the policy of prioritising high-comorbidity patients.
Q3 - Background and objectives(show question description)
Explanation: The introduction of the manuscript provides context by discussing the importance of COVID-19 vaccines in controlling the pandemic and highlights the gap in understanding their real-world cost-effectiveness. It addresses the study question of calculating the economic impact of vaccine rollout in the Basque Country and emphasizes the practical relevance of this analysis in guiding public health policy, especially regarding SES and comorbidities.
Quotes:
-
The fast rollout of coronavirus disease 2019 (COVID-19) vaccination programmes was of paramount importance in containing the pandemic.
-
Although the licenced COVID-19 vaccines are extremely effective in preventing severe disease symptoms, their real-world cost utility is still an open question.
-
Given this gap in the literature, we have used individual-level data from the Basque Health Service, disaggregated by SES and level of comorbidity, to calculate the real-world cost-utility and economic impact of COVID-19 vaccines administered to the population in the Basque Country, Spain.
Q4 - Health economic analysis plan(show question description)
Explanation: The manuscript does not explicitly mention the development of a specific health economic analysis plan or its availability. Instead, it describes the methods and models used to perform the cost-effectiveness analysis, but there is no reference to a formal document or plan detailing the economic analysis being made available.
Quotes:
-
The incremental cost-effectiveness ratio of the vaccination programme justified the policy of prioritising high-comorbidity patients.
-
Given this gap in the literature, we have used individual-level data from the Basque Health Service, disaggregated by SES and level of comorbidity, to calculate the real-world cost-utility and economic impact of COVID-19 vaccines administered to the population in the Basque Country, Spain.
Q5 - Study population(show question description)
Explanation: The manuscript thoroughly describes the characteristics of the study population by detailing factors such as age, sex, socioeconomic status (SES), and comorbidities. It uses data from a nationwide cohort study covering 2.3 million individuals in the Basque Country, which captures these demographic and clinical aspects.
Quotes:
-
Data on COVID-19 infection outcomes (cases, hospitalisations, intensive care unit admissions and deaths) and population characteristics (age, sex, socioeconomic status and comorbidity) during the initial phase of the vaccination rollout, from January to June of 2021, were retrieved from the Basque Health Service database.
-
The clinical and socioeconomic characteristics of individuals in the population by COVID-19 outcome... to ascertain the determinants of the COVID-19 infection outcomes for each individual in the population (age, sex and Charlson Comorbidity Index [CCI]) in 2021 for the epidemiological scenario with vaccination.
-
To categorise individuals by SES, we used pharmacy co-payment codes, which classify individuals based on their household income.
Q6 - Setting and location(show question description)
Explanation: The manuscript provides relevant contextual information about the setting and location, which is the Basque Country in Spain. This regional context, including the centralised vaccine rollout by the Basque Health Service and demographic details specific to that region, can influence the findings, particularly as they relate to vaccine cost-effectiveness and health outcomes.
Quotes:
-
We present an analysis of the cost-effectiveness and economic impact of the initial phase of the COVID-19 vaccination rollout in the Basque Country, Spain.
-
The study combined dynamic modelling and real-world data to calculate the cost effectiveness of the initial phase of the COVID-19 vaccination rollout in the Basque Country from the perspective of the healthcare payer.
-
All the COVID-19 vaccines administered to the entire population in the Basque Country were delivered in a centralised manner by the Basque Health Service in phases by priority group.
-
By the end of June 2021, the percentages of fully vaccinated individuals by age group were 5% in 0- to 29-year-olds, 19% in 30- to-49-year-olds, 66% in 50- to 69-year-olds and 95% in \u003e= 70-year-olds.
Q7 - Comparators(show question description)
Explanation: The manuscript describes the COVID-19 vaccination programme in the Basque Country, including the vaccines used, the priority groups targeted for vaccination, and the rationale for these choices. It emphasizes the centralised delivery approach, prioritization of elderly and individuals with comorbidities, and the types of vaccines administered.
Quotes:
-
"All the COVID-19 vaccines administered to the entire population in the Basque Country were delivered in a centralised manner by the Basque Health Service in phases by priority group, these groups including elderly people and individuals with comorbidities."
-
"Between January and June 2021, a total of 2,071,204 vaccine doses were administered in the Basque Country; of these, 70% were of the Pfizer-BioNTech vaccine, while 17% were Oxford-AstraZeneca, 10% were Moderna and 4% were Johnson & Johnson's Janssen vaccines."
-
"Given this gap in the literature, we have used individual-level data from the Basque Health Service, disaggregated by SES and level of comorbidity, to calculate the real-world cost-utility and economic impact of COVID-19 vaccines administered to the population in the Basque Country, Spain."
Q8 - Perspective(show question description)
Explanation: The manuscript clearly states that the study was conducted from the perspective of the healthcare payer, specifically the Basque Health Service. This perspective was chosen to calculate the cost-effectiveness of the COVID-19 vaccination programme during its initial rollout phase in the Basque Country.
Quotes:
-
This study combined dynamic modelling and real-world data to calculate the cost effectiveness of the initial phase of the COVID-19 vaccination rollout in the Basque Country from the perspective of the healthcare payer, i.e. the Basque Health Service.
-
The label of dominance in an economic evaluation means that the treatment under evaluation provides more QALYs and saves healthcare costs and, therefore, it should be adopted. In the Basque Country, COVID-19 vaccination was dominant from the perspective of the healthcare payer when real prices were used.
Q9 - Time horizon(show question description)
Explanation: The time horizon for the study is appropriate as it spans the initial phase of the COVID-19 vaccination rollout, which allows for the assessment of immediate impacts and cost-effectiveness of the vaccines during a critical period of vaccine distribution.
Quotes:
-
We present results obtained for the initial vaccination rollout phase, from January to June 2021.
-
...the outcomes in the alternative scenario (without vaccination) were estimated with the dynamic model used to guide public health authority policies, from February to December 2020.
Q10 - Discount rate(show question description)
Explanation: The manuscript briefly mentions a discount rate of 3% applied to the remaining life expectancy, without providing a rationale for the selection of this rate. No further explanation or detailed rationale for the choice of this specific discount rate is provided in the text.
Quotes:
-
We applied an annual discount of 3% to the remaining life expectancy.
Q11 - Selection of outcomes(show question description)
Explanation: The manuscript states that the benefits of the COVID-19 vaccination were measured in terms of quality-adjusted life years (QALYs) gained, and harms were assessed through healthcare costs and negative health outcomes like infections, hospitalizations, ICU admissions, and deaths.
Quotes:
-
Dynamic models have been recognised as a powerful tool for understanding the impact of vaccines on COVID-19-related outcomes worldwide: infections, hospitalizations, intensive care unit (ICU) admissions and deaths.
-
We estimated the lost QALYs attributable to COVID-19 as the difference between the total remaining comorbidity-adjusted QALYs in the two scenarios.
-
Hospitalization costs were estimated based on summing the average costs of a ward stay and follow-up by outpatient services
Q12 - Measurement of outcomes(show question description)
Explanation: The manuscript explains that COVID-19 outcomes were measured using quality-adjusted life years (QALYs) to assess both the benefits, such as life expectancy and reduced severe disease outcomes, and harms like prolonged symptoms. These metrics were derived from the observed and modeled scenarios with and without vaccination.
Quotes:
-
We estimated the outcomes for the scenario with no vaccination using the dynamic SHARUCD model... and assessed population-level benefits from the vaccination programme by comparing the observed OAS data for 2021 (scenario with vaccination) with the disease outcomes predicted by the dynamic model (scenario with no vaccination).
-
We estimated the lost QALYs attributable to COVID-19 as the difference between the total remaining comorbidity-adjusted QALYs in the two scenarios.
Q13 - Valuation of outcomes(show question description)
Explanation: The manuscript details how the outcomes of the COVID-19 vaccination program were measured and valued using a dynamic model combined with real-world data from the Basque Health Service. Outcomes such as quality-adjusted life years were measured for the entire population of the Basque Country, utilizing a combination of the SHARUCD model and Oracle Analytics System data.
Quotes:
-
Dynamic models have been recognised as a powerful tool for understanding the impact of vaccines on COVID-19-related outcomes worldwide: infections, hospitalisations, intensive care unit (ICU) admissions and deaths.
-
To calculate costs and quality-adjusted life years for the entire population of the Basque Country, dynamic modelling and a real-world data analysis were combined.
-
We estimated the outcomes for the scenario with no vaccination using the dynamic SHARUCD model... We then assessed population-level benefits from the vaccination programme by comparing the observed OAS data for 2021 (scenario with vaccination) with the disease outcomes predicted by the dynamic model (scenario with no vaccination).
Q14 - Measurement and valuation of resources and costs(show question description)
Explanation: The manuscript specifies how costs were valued using data from the Basque Health Service Accounting System for healthcare outcomes and includes both official and actual vaccine prices paid by the European Commission for the COVID-19 vaccines.
Quotes:
-
Average unit costs for healthcare outcomes in 2021 were obtained from the Basque Health Service Accounting System (Table SM4 of the ESM).
-
The European Commission bought the vaccines at below the official market price. Specifically, the prices paid for vaccines (Moderna, $18; Pfizer-BioNTech, $12; Oxford-AstraZeneca, $1.78; and Johnson & Johnson's Janssen, $8.50)...
-
Vaccines costed $32.44 million based on the official prices and $22.17 million considering the prices paid.
Q15 - Currency, price, date, and conversion(show question description)
Explanation: The manuscript does not specifically provide the dates or the currency used for the estimated resource quantities and unit costs. Although it mentions some official and actual vaccine prices and gives cost estimates, it does not clarify the currency or the cost base year.
Quotes:
-
Average unit costs for healthcare outcomes in 2021 were obtained from the Basque Health Service Accounting System (Table SM4 of the ESM).
-
Vaccines costed $32.44 million based on the official prices and $22.17 million considering the prices paid.
-
Specifically, the prices paid for vaccines (Moderna, $18; Pfizer-BioNTech, $12; Oxford-AstraZeneca, $1.78; and Johnson & Johnson's Janssen, $8.50) as posted on Twitter by Belgium's Secretary of State for the Budget...
Q16 - Rationale and description of model(show question description)
Explanation: The manuscript describes the dynamic SHARUCD model in detail, explaining its components and rationale for its use in estimating COVID-19 outcomes and the cost-effectiveness of vaccination. However, it does not explicitly mention the model's public availability or where it can be accessed.
Quotes:
-
The equations for the model describing the COVID-19 transmission dynamics in the Basque Country, as well as the model parameters and initial conditions used for the modelling simulations, are provided in the Electronic Supplementary Material (ESM).
-
The model used is an extension of the Susceptible-Hospitalized-Asymptomatic-Recovered (SHAR) model.
-
The SHARUCD model developed to guide decision making by public health managers during the first year of the pandemic was used to estimate the number of cases expected in a scenario in which vaccination had not been implemented.
Q17 - Analytics and assumptions(show question description)
Explanation: The manuscript details multiple methods for analyzing data, including the use of dynamic modeling for scenario estimation, use of the SHARUCD model for predictions, and validation against empirical data from 2020. The framework's calibration with empirical data and statistical methods applied to life expectancy and utility calculations are also described.
Quotes:
-
We estimated the outcomes for the scenario with no vaccination using the dynamic SHARUCD model (described in more detail below), developed to guide the decision making of the public health authorities in the Basque Country.
-
The SHARUCD model provided accurate 15-day-ahead estimates of infections, hospitalisations, ICU admissions and deaths during the whole of 2020.
-
The remaining comorbidity-adjusted life expectancy was calculated for each individual in the population...using a continuous approach was extended to parameterise survival (Weibull, Gompertz, log-normal, log-logistic).
Q18 - Characterizing heterogeneity(show question description)
Explanation: The manuscript does not detail any specific methods used to estimate how results vary for different sub-groups. Instead, it describes a general approach of using a dynamic model and real-world data to analyze cost-effectiveness related to clinical and sociodemographic characteristics but does not detail methods for sub-group variation explicitly.
Quotes:
-
Given the limitation of dynamic models based on differential equations to incorporate the clinical and sociodemographic characteristics of the population and enable a subgroup analysis, we analysed the health service data lake ... to provide effectiveness and costs for such subgroup analysis.
-
The SHARUCD model provided the total number of cases of infection, hospitalisations, ICU admissions and deaths in the scenario without vaccination but did not allow subgroup analyses by sex, age, comorbidity or SES.
Q19 - Characterizing distributional effects(show question description)
Explanation: While the manuscript discusses the distribution of impacts by sex, comorbidity, and socioeconomic status, and recognizes the importance of prioritizing high-comorbidity patients, it does not indicate any adjustments made specifically to reflect priority populations in the analysis of impacts.
Quotes:
-
"Even though some models have used age-stratified populations, the clinical characteristics of the individuals vaccinated are not considered in many dynamic models, possibly to avoid an exponential increase in model complexity."
-
"The benefits of vaccine administration depend, however, on individual characteristics such as sex, age, socioeconomic status (SES) and pre-existing health conditions (comorbidities)."
Q20 - Characterizing uncertainty(show question description)
Explanation: The manuscript mentions specific methods used to characterize sources of uncertainty, such as the use of dynamic modeling alongside real-world data and the validation of the model with empirical data, ensuring predictions align with observed outcomes. Moreover, the incorporation of individual characteristics into the analysis using real-world datasets helps in reducing uncertainty in subgroup analyses.
Quotes:
-
The SHARUCD model was validated with empirical data and provided accurate 15-day-ahead estimates of infections, hospitalisations, ICU admissions and deaths during the whole of 2020.
-
Our innovative approach combined the results of a dynamic model to estimate the scenario with no vaccination, with the analysis of the whole population to identify CCI and SES, and techniques from parametric survival to achieve individual-level results for health and costs associated with COVID-19 infection.
Q21 - Approach to engagement with patients and others affected by the study(show question description)
Explanation: The manuscript does not mention any engagement or involvement of patients, the general public, or any stakeholders in the study design. The study primarily used data from the Basque Health Service and employed dynamic modelling and database analysis for its methods, without additional input or engagement from these groups.
Quotes:
-
Data on COVID-19 infection outcomes (cases, hospitalisations, intensive care unit admissions and deaths) and population characteristics (age, sex, socioeconomic status and comorbidity) during the initial phase of the vaccination rollout... were retrieved from the Basque Health Service database.
-
This study combined dynamic modelling and real-world data to calculate the cost effectiveness of the initial phase of the COVID-19 vaccination rollout in the Basque Country from the perspective of the healthcare payer, i.e. the Basque Health Service.
Q22 - Study parameters(show question description)
Explanation: The manuscript does not comprehensively report all analytic inputs or study parameters, such as the explicit values, ranges, and references, nor does it discuss uncertainty or distributional assumptions in detail. While some methods and data sources are mentioned, specifics on all parameters and their associated uncertainties are missing.
Quotes:
-
The equations for the model describing the COVID-19 transmission dynamics in the Basque Country, as well as the model parameters and initial conditions used for the modelling simulations, are provided in the Electronic Supplementary Material (ESM).
-
As in cardiovascular risk models, life expectancy was adjusted for each individual's CCI by including a hazard ratio in the equation according to the individual's CCI (Table SM3 of the ESM).
-
A nationwide cohort study (2.3 million individuals) was performed using the Basque Health Service database (observed data) from January to June of 2021 to ascertain the determinants of the COVID-19 infection outcomes for each individual in the population (age, sex and Charlson Comorbidity Index [CCI]) in 2021 for the epidemiological scenario with vaccination.
Q23 - Summary of main results(show question description)
Explanation: The manuscript presents mean values for costs and outcomes through measures such as the incremental cost-effectiveness ratio (ICER) and savings in costs resulting from COVID-19 vaccination. These values effectively summarize the economic and health impact of vaccination using appropriate measures such as QALYs and monetary savings.
Quotes:
-
The incremental cost-effectiveness ratio was $707/quality-adjusted life year considering official vaccine prices and dominant real prices.
-
Vaccines costed $32.44 million based on the official prices and $22.17 million considering the prices paid. The total costs saved were estimated at $26.44 million resulting from the multiplication of unit costs by avoided outcomes (Table 1).
Q24 - Effect of uncertainty(show question description)
Explanation: The manuscript does not provide any specific discussion or analysis about the effect of uncertainty related to analytic judgments, inputs, or choices of discount rates and time horizon on the findings. The focus instead is on the cost-effectiveness analysis without highlighting how varying these parameters could impact the results.
Quotes:
-
The study focused on calculating incremental cost-effectiveness ratios based on available data rather than discussing uncertainty related to analytical inputs.
-
"Our findings on the ICER did not render clear differences between low-SES, medium-SES, and high-SES groups."
Q25 - Effect of engagement with patients and others affected by the study(show question description)
Explanation: The manuscript does not mention involving patients, service recipients, general public, community, or stakeholders in shaping the study approach or affecting its findings. It heavily focuses on dynamic modeling and real-world data analysis from the Basque Health Service database without mention of stakeholder involvement.
Quotes:
-
To calculate costs and quality-adjusted life years for the entire population of the Basque Country, dynamic modelling and a real-world data analysis were combined.
-
We have used individual-level data from the Basque Health Service, disaggregated by SES and level of comorbidity, to calculate the real-world cost-utility and economic impact of COVID-19 vaccines administered to the population in the Basque Country, Spain.
Q26 - Study findings, limitations, generalizability, and current knowledge(show questiondescription)
Explanation: The manuscript does not report on ethical or equity considerations. While it discusses the cost-effectiveness and impacts on different socio-economic groups, it does not address ethical implications, equity issues, or the broader potential impact on patients or policy beyond economic evaluation.
Quotes:
-
"The incremental cost-effectiveness ratio of the vaccination programme justified the policy of prioritising high-comorbidity patients."
-
"Our findings on the ICER did not render clear differences between low-SES, medium-SES, and high-SES groups."
-
"The ICER of COVID-19 vaccines was $707/QALY with official vaccine prices and was dominant with real prices."
SECTION: TITLE
Cost-Effectiveness Analysis of Vaccines for COVID-19 According to Sex, Comorbidity and Socioeconomic Status: A Population Study
SECTION: ABSTRACT
Background and Objective
Coronavirus disease 2019 (COVID-19) vaccines are extremely effective in preventing severe disease, but their real-world cost effectiveness is still an open question. We present an analysis of the cost-effectiveness and economic impact of the initial phase of the COVID-19 vaccination rollout in the Basque Country, Spain.
Methods
To calculate costs and quality-adjusted life years for the entire population of the Basque Country, dynamic modelling and a real-world data analysis were combined.To calculate costs and quality-adjusted life years for the entire population of the Basque Country, dynamic modelling and a real-world data analysis were combined. Data on COVID-19 infection outcomes (cases, hospitalisations, intensive care unit admissions and deaths) and population characteristics (age, sex, socioeconomic status and comorbidity) during the initial phase of the vaccination rollout, from January to June of 2021, were retrieved from the Basque Health Service database. The outcomes in the alternative scenario (without vaccination) were estimated with the dynamic model used to guide public health authority policies, from February to December 2020. Individual comorbidity-adjusted life expectancy and costs were estimated.
Results
By averting severe disease-related outcomes, COVID-19 vaccination resulted in monetary savings of $26.44 million for the first semester of 2021. The incremental cost-effectiveness ratio was $707/quality-adjusted life year considering official vaccine prices and dominant real prices. While the analysis by comorbidity showed that vaccines were considerably more cost effective in individuals with pre-existing health conditions, this benefit was lower in the low socioeconomic status group.
Conclusions
The incremental cost-effectiveness ratio of the vaccination programme justified the policy of prioritising high-comorbidity patients.The incremental cost-effectiveness ratio of the vaccination programme justified the policy of prioritising high-comorbidity patients. The initial phase of COVID-19 vaccination was dominant from the perspective of the healthcare payer.
Supplementary Information
The online version contains supplementary material available at 10.1007/s40273-023-01326-y.
SECTION: INTRO
Key Points
SECTION: TABLE
Measurement of costs and benefits of coronavirus disease 2019 vaccines disaggregated by socioeconomic status and level of comorbidity has yet to be estimated. The initial phase of coronavirus disease 2019 vaccination rendered more health gains and saved costs. Though no clear differences were observed by socioeconomic status, vaccines were more cost effective in individuals with pre-existing health conditions.
SECTION: INTRO
Introduction
The fast rollout of coronavirus disease 2019 (COVID-19) vaccination programmes was of paramount importance in containing the pandemic. Although the licenced COVID-19 vaccines are extremely effective in preventing severe disease symptoms, their real-world cost utility is still an open question. From the macroeconomic perspective, externalities associated with the COVID-19 pandemic have produced substantial drops in gross domestic product and the economic benefit of vaccination programmes is overwhelmingly positive. However, a microeconomic analysis in terms of the cost and effectiveness of these programmes is still ongoing.
Dynamic models have been recognised as a powerful tool for understanding the impact of vaccines on COVID-19-related outcomes worldwide: infections, hospitalisations, intensive care unit (ICU) admissions and deaths.. The benefits of vaccine administration depend, however, on individual characteristics such as sex, age, socioeconomic status (SES) and pre-existing health conditions (comorbidities). Even though some models have used age-stratified populations, the clinical characteristics of the individuals vaccinated are not considered in many dynamic models, possibly to avoid an exponential increase in model complexity. This makes it difficult to fully understand the economic impact of COVID-19 vaccination programmes. Presently, it is well known that elderly and vulnerable individuals with comorbidities are at a higher risk of developing severe disease and therefore would be likely to benefit the most from vaccination. In addition, social deprivation, on a continuous scale, is known to be a risk factor for death from COVID-19.
Real-world data from national registries contain individual information on diagnoses and treatments, and have been used to assess changes in social and clinical determinants of COVID-19 outcomes. However, to our knowledge, while economic evaluations have been conducted to analyse hypothetical scenarios with various assumptions concerning the supply, cost and effectiveness of vaccines, real costs per quality-adjusted life-years of COVID-19 vaccination programmes have yet to be estimated.
Given this gap in the literature, we have used individual-level data from the Basque Health Service, disaggregated by SES and level of comorbidity, to calculate the real-world cost-utility and economic impact of COVID-19 vaccines administered to the population in the Basque Country, Spain.Given this gap in the literature, we have used individual-level data from the Basque Health Service, disaggregated by SES and level of comorbidity, to calculate the real-world cost-utility and economic impact of COVID-19 vaccines administered to the population in the Basque Country, Spain. We present results obtained for the initial vaccination rollout phase, from January to June 2021.
SECTION: METHODS
Methods
Design
This study combined dynamic modelling and real-world data to calculate the cost effectiveness of the initial phase of the COVID-19 vaccination rollout in the Basque Country from the perspective of the healthcare payerThis study combined dynamic modelling and real-world data to calculate the cost effectiveness of the initial phase of the COVID-19 vaccination rollout in the Basque Country from the perspective of the healthcare payer, i.e. the Basque Health Service. Given the limitation of dynamic models based on differential equations to incorporate the clinical and sociodemographic characteristics of the population and enable a subgroup analysis, we analysed the health service data lake constructed on an Oracle Analytics System (OAS) to provide effectiveness and costs for such subgroup analysis. In this way, the dynamic model reproduced the behaviour of the COVID-19 epidemic in the scenario without vaccines jointly for the entire Basque population, but the results associated with COVID-19 could be disaggregated by combining them with the individual characteristics contained in the OAS. The OAS is a platform containing complete healthcare information (clinical and administrative datasets) about the entire population of the Basque Country (2.3 million people) in an anonymised format. It provided information on COVID-19 infections related to disease outcomes and the use of healthcare resources during the first semester of 2021. We estimated the outcomes for the scenario with no vaccination using the dynamic SHARUCD model (described in more detail below), developed to guide the decision making of the public health authorities in the Basque Country. We then assessed population-level benefits from the vaccination programme by comparing the observed OAS data for 2021 (scenario with vaccination) with the disease outcomes predicted by the dynamic model (scenario with no vaccination).eveloped to guide the decision making of the public health authorities in the Basque Country. We then assessed population-level benefits from the vaccination programme by comparing the observed OAS data for 2021 (scenario with vaccination) with the disease outcomes predicted by the dynamic model (scenario with no vaccination). Specifically, we calculated the incremental cost-effectiveness ratio (ICER), by dividing the incremental cost (cost with vaccination minus cost without vaccination) by the incremental utility (utility with vaccination minus utility without vaccination). Note that we did not analyse several hypothetical sub-group delivery options. Instead, we evaluated the consequences for each subgroup of the actual rollout strategy compared with a no-vaccination strategy.
Vaccination Programme in the Basque Country
All the COVID-19 vaccines administered to the entire population in the Basque Country were delivered in a centralised manner by the Basque Health Service in phases by priority group, these groups including elderly people and individuals with comorbidities. By the end of June 2021, the percentages of fully vaccinated individuals by age group were 5% in 0- to 29-year-olds, 19% in 30- to-49-year-olds, 66% in 50- to 69-year-olds and 95% in = 70-year-olds. Between January and June 2021, a total of 2,071,204 vaccine doses were administered in the Basque Country; of these, 70% were of the Pfizer-BioNTech vaccine, while 17% were Oxford-AstraZeneca, 10% were Moderna and 4% were Johnson & Johnson's Janssen vaccines.
COVID-19 Infection Outcomes
The observed COVID-19 infection outcomes considered in the population, from January to June 2021, were the total number of detected cases of infection, hospitalisations, ICU admissions and deaths in the scenario with vaccination and these were obtained from the OAS. The challenge was to estimate, by modelling, the outcomes in the alternative scenario with no vaccination in the same population. For this, we used the working dynamic SHARUCD model to estimate the number of cases of each one of the aforementioned outcomes. This model was validated with empirical data and provided accurate 15-day-ahead estimates of infections, hospitalisations, ICU admissions and deaths during the whole of 2020. The predictions for 2021 were obtained by assuming the same epidemiological conditions as in the last quarter of 2020.
Underlying Mathematical Model and Predictions
The equations for the model describing the COVID-19 transmission dynamics in the Basque Country, as well as the model parameters and initial conditions used for the modelling simulations, are provided in the Electronic Supplementary Material (ESM). The model used is an extension of the Susceptible-Hospitalized-Asymptomatic-Recovered (SHAR) model. To describe the COVID-19 dynamics in the Basque Country, the basic SHAR model was extended to a form called SHARUCD, introducing the classes of ICU admissions, U and deaths, D, and for comparison with the available cumulative empirical data, the cumulative classes of individuals who were infected but asymptomatic/mild cases, were hospitalised, were admitted to an ICU and recovered, CA, CH, CU and CR, respectively, counting all incoming cases in the dynamic compartments and neglecting outflows. A detection ratio xi for mild/asymptomatic cases was also considered, as a proportion of mild/asymptomatic cases are detected by contact tracing/screening tests, and hence, the number of infections (i.e. cases that have tested positive) is larger than the number of hospitalisations. Disease severity is decided upon infection, a proportion eta of cases developing severe infection leading to hospitalisation, and 1 - eta experiencing mild/asymptomatic infection. It is assumed that undetected asymptomatic cases transmit the disease more efficiently (phi 1) than severe cases. Hospitalised individuals can recover, with a recovery rate gamma, die, with a mortality rate mu, or be transferred to an ICU, with an admission rate nu. Here, ICU admission is assumed to be a progression of disease severity after hospitalisation. For more information, see the ESM.
Once the framework had been calibrated with empirical data and validated with 15-day-ahead predictions for the last quarter of 2020, modelling simulations were obtained for the following months (January to June 2021), assuming similar epidemiological conditions. We note that the SHARUCD model provided the total number of cases of infection, hospitalisations, ICU admissions and deaths in the scenario without vaccination but did not allow subgroup analyses by sex, age, comorbidity or SES.
Clinical and Socioeconomic Characteristics of Individuals in the Population by COVID-19 Outcome
A nationwide cohort study (2.3 million individuals) was performed using the Basque Health Service database (observed data) from January to June of 2021 to ascertain the determinants of the COVID-19 infection outcomes for each individual in the population (age, sex and Charlson Comorbidity Index [CCI]) in 2021 for the epidemiological scenario with vaccination. Data were gathered on the following variables: sex, SES, diagnosis of COVID-19 infection and infection-related outcomes (uninfected, infected, hospitalised, admitted to an ICU and died). The CCI quantifies the mortality risk associated with 19 weighted comorbidities including congestive heart failure, cerebrovascular disease, chronic lung disease, and diabetes mellitus, and is a significant prognostic factor for infected patients.
To categorise individuals by SES, we used pharmacy co-payment codes, which classify individuals based on their household income. The low-income category ("low SES") included cases in which the heads of the household were pensioners with a non-contributory pension, disabled individuals or unemployed workers who had exhausted their unemployment benefits. Individuals whose head of household had an income (workers or pensioners with a contributory pension) were classified in the medium-income or high-income category depending on whether the income was $18,000 ("medium SES") or = $18,000 ("high SES"). Table SM2 of the ESM provides the characteristics of the Basque population (sex, age group and CCI) in January 2020 according to these SES categories.
For the alternative epidemiological scenario with no vaccination, the individual characteristics of COVID-19-associated outcomes in the first semester of 2021 were assumed to be the same as in the last quarter of 2020. The same variables considered above were analysed, from 1 September to 31 December, 2020. Instead of building a standard new simulation model by assigning the characteristics separately to infected cases, hospitalised, ICU admissions and deaths, individuals with these outcomes were randomly selected from the entire population in 2021, in a staggered and matched manner to achieve the same distribution as for 2020. First, from the total number of cases predicted by the dynamic model, we disaggregated the number of individuals infected, hospitalised, admitted to an ICU and who died in groups according to the combination of certain variables, namely, sex, age group, CCI and SES, in 2020. To do this, we built a decision tree for each global outcome associated with COVID-19 in which this distribution was taken into account step by step to disaggregate each total outcome into homogeneous subgroups for all variable combinations (sex, age group, CCI, SES). Second, from the population in 2021, we proceeded to randomly select individuals for groups meeting the specified values for each variable. For example, in the first stage, we were able to estimate with the decision tree that the distributions of characteristics of infections in 2020 indicated that 60- to 69-year-old men, with a medium SES and a moderate level of comorbidity represented 2.3% of the 121,743 cases predicted by the SHARUCD model. Therefore, in the second stage, we randomly picked 2800 cases with these characteristics from the 2021 population. In this way, correlations between these variables were ensured, thereby satisfying the assumption that the distribution of characteristics was similar to that of individuals with COVID-19-associated outcomes in 2020.
Estimating Remaining Life Expectancy Based on Age, Sex and Comorbidity
The remaining comorbidity-adjusted life expectancy was calculated for each individual in the population with one parametric survival function for men and another for women based on year-by-year mortality rates obtained, from the Basque Institute of Statistics (EUSTAT), for 2019-2020 (Table SM1 of the ESM). The procedure described by Roman et al. that determines the lifetime density function using a continuous approach was extended to parameterise survival (Weibull, Gompertz, log-normal, log-logistic) and select the best fit based on R2 values. The life expectancies were validated with the expected survival values estimated by the Spanish Institute of Statistics (INE) in 2019 (see Table SM2 of the ESM). As in cardiovascular risk models, life expectancy was adjusted for each individual's CCI by including a hazard ratio in the equation according to the individual's CCI (Table SM3 of the ESM). Individuals who died had zero life expectancy. To avoid stochastic uncertainty, the same random parameter included in the function was assigned to each individual in both scenarios, with and without vaccination. We applied an annual discount of 3% to the remaining life expectancy.
Utilities and Disutilities Associated with COVID-19 Infection
We estimated the lost QALYs attributable to COVID-19 as the difference between the total remaining comorbidity-adjusted QALYs in the two scenarios. The utility of the remaining life expectancy was obtained using EuroQol EQ-5D-5L scores from the 2012 Spanish Health Survey. Utility was assigned to each individual, according to his/her sex and age (1-29, 30-49, 50-59, 60-69, 70-79 and = 80 years).
As symptoms persist for several months in some infected individuals, we added a disutility to 10% of infected cases and 75% of hospitalised cases to take into account the harmful effect of "long COVID" on the quality of life of patients with symptoms lasting far longer than the initial illness. Specifically, we assumed disutilities of 0.19, 0.30 and 0.50 associated with symptoms lasting for 6 months, 1 year and 2 years for patients infected, hospitalised and admitted to an ICU, respectively. The corresponding number of lost QALYs was calculated by multiplying the duration by the disutility as follows:
Costs
Average unit costs for healthcare outcomes in 2021 were obtained from the Basque Health Service Accounting System (Table SM4 of the ESM). Infected cases were assumed to result in two visits to a general practitioner ($118). Hospitalisation costs were estimated based on summing the average costs of a ward stay and follow-up by outpatient services ($7919). Admission to an ICU had a higher average cost, including both more outpatient consultations and rehabilitation ($36,345). We did not take into account the costs of contact tracing or polymerase chain reaction tests for cases and contacts.
Both the official prices and actual prices paid were used to estimate the cost of the vaccination programme. The European Commission bought the vaccines at below the official market price. Specifically, the prices paid for vaccines (Moderna, $18; Pfizer-BioNTech, $12; Oxford-AstraZeneca, $1.78; and Johnson & Johnson's Janssen, $8.50) as posted on Twitter by Belgium's Secretary of State for the Budget (https://www.theguardian.com/world/2020/dec/18/belgian-minister-accidentally-tweets-eus-covid-vaccine-price-list) were substantially lower than the official prices (Moderna, $31; Pfizer-BioNTech, $17; Oxford-AstraZeneca, $3; and Johnson & Johnson's Janssen, $8).
SECTION: RESULTS
Results
SECTION: TABLE
Coronavirus disease 2019-associated outcomes and costs in the alternative scenarios considered: with vaccination (observed) and without vaccination (simulated)
Outcome No vaccinationa Vaccinationb Difference Difference in costs ($) Infections 121,744 90,663 31,081 3,667,558 Hospitalisations 9127 7674 1453 11,506,307 ICU admissions 1579 1274 305 11,085,225 Deaths 2617 2136 481 Total 26,259,090
ICU intensive care unit
aEstimated by the SHARUCD dynamic model
bOfficial data reported by the Public Health Department in the Basque Country
Characteristics of infected and uninfected individuals in the Basque Country during the last quarter of 2020 and the first half of 2021
September 2020 to December 2020 January 2021 to June 2021 Infected Not infected Infected Not infected Men 34,210 (2.98%) 1,112,476 (97.02%) 41,959 (3.67%) 1,100,499 (96.33%) Women 38,244 (3.19%) 1,158,928 (96.81%) 43,155 (3.62%) 1,149,882 (96.38%) Age 18 years 7932 (4.14%) 183,797 (95.86%) 10,546 (5.73%) 173,353 (94.27%) Age 18-50 years 33,916 (3.29%) 998,477 (96.71%) 42,056 (4.10%) 984,330 (95.90%) Age 50-65 years 16,912 (3.01%) 544,245 (96.99%) 19,330 (3.43%) 545,017 (96.57%) Age =65 years 13,694 (2.45%) 544,885 (97.55%) 13,182 (2.35%) 547,681 (97.65%) Low income 6679 (2.77%) 234,797 (97.23%) 7501 (3.11%) 233,506 (96.89%) Medium income 32,128 (2.99%) 1,043,585 (97.01%) 37,325 (3.49%) 1,033,278 (96.51%) High income 33,647 (3.28%) 993,022 (96.72%) 40,288 (3.93%) 983,597 (96.07%) Charlson 0 49,275 (3.04%) 1,572,181 (96.96%) 59,542 (3.81%) 1,503,142 (96.19%) Charlson 1-2 17,834 (3.17%) 543,993 (96.83%) 20,627 (3.78%) 525,009 (96.22%) Charlson 3-4 3187 (3.18%) 96,929 (96.82%) 3049 (3.13%) 94,462 (96.87%) Charlson 4 2158 (3.57%) 58,301 (96.43%) 1895 (3.20%) 57,266 (96.80%) Total 72,454 (3.09%) 2,271,404 (96.91%) 85,114 (3.64%) 2,250,381 (96.36%)
SECTION: RESULTS
Table 1 presents the differences in total outcomes and costs for the two scenarios considered, namely, with and without vaccination. The savings due to vaccines reached an estimated $26 million. The good fit between the characteristics of the populations infected in 2020 and simulated for 2021 can be seen in Fig. SM1 of the ESM. Table 2 describes the characteristics of the infected and uninfected individuals during the last quarter of 2020 and the first half of 2021.
SECTION: TABLE
Characteristics of the infected cases in the population in the Basque Country in the first semester of 2021 in the scenarios with vaccination (observed) and without vaccination (simulated)
Variable Categories No vaccination Vaccination Difference % Total 121,744 90,663 31,081 25.5 Sex Men 59,047 44,431 14,616 24.8 Women 62,697 46,232 16,465 26.3 Age group, years 0-29 33,529 25,274 8255 24.6 30-49 39,992 30,024 9968 24.9 50-69 32,996 24,195 8801 26.7 =70 15,227 11,170 4057 26.6 Charlson Comorbidity Index 0 84,138 62,664 21,474 25.5 1-2 29,666 22,179 7487 25.2 3-4 4,68 3451 1317 27.6 4 3172 2369 803 25.3 Socioeconomic status Low 10,778 8041 2737 25.4 Medium 53,739 39,782 13,957 26 High 57,227 42,840 14,387 25.1
Characteristics of the hospitalised cases in the population in the first semester of 2021 in the scenarios with vaccination (observed) and without vaccination (simulated)
Variable Categories No vaccination Vaccination Difference % Total 9127 7674 1453 15.9 Sex Men 5259 4384 875 16.6 Women 3868 3290 578 14.9 Age group, years 0-29 201 162 39 19.4 30-49 1711 1575 136 7.9 50-69 3685 3276 409 11.1 =70 3530 2661 869 24.6 Charlson Comorbidity Index 0 4139 3705 434 10.5 1-2 3010 2501 509 16.9 3-4 1164 878 286 24.6 4 814 590 224 27.5 Socioeconomic status Low 1329 1144 185 13.9 Medium 3958 3311 647 16.3 High 3840 3219 621 16.2
SECTION: RESULTS
The characteristics of the individuals with the four COVID-19-related outcomes in the two scenarios are compared in Tables 3 and 4 and Tables SM6 and SM7 of the ESM. The largest difference was observed in the distribution of hospitalisations by CCI, which evidenced that vaccination avoided a considerable percentage of severe cases in individuals with comorbidities. On the contrary, the percentages of avoided infections were similar in all categories.
After the assignment of characteristics for each avoided outcome, we calculated the life expectancy (Table SM8 of the ESM) and quality-adjusted life expectancy of the population in each scenario, which shows that the gain in years of life was greater in the younger groups. The average life expectancy for the population was 34.812 years with vaccination and 34.791 years without vaccination. Adjusting for quality of life and the discount yielded QALY values of 15.855 and 15.849, respectively. The average individual gains for the total population were 0.021 years and 0.006 discounted QALYs.
SECTION: TABLE
Cost-utility analysis with discount using the official and real prices of vaccines
Incremental cost$ Official prices Incremental cost$ Real prices Incremental utilityQALY ICER $/QALYOfficial prices ICER $/QALYReal prices Total 3.75 - 0.64 0.0052 717 - 123 Men - 1.64 - 5.45 0.0029 - 559 - 1856 Women 8.92 3.96 0.0074 1199 533 Low SES 7.59 1.82 0.0055 1393 334 Medium SES 3.47 - 0.35 0.0051 682 - 69 High SES 3.14 - 1.53 0.0053 589 - 287 CCI 0 3.70 0.36 0.0047 781 77 CCI 1-2 5.51 - 0.47 0.0060 923 - 78 CCI 3-4 0.89 - 9.08 0.0088 101 - 1033 CCI 4 -6.36 - 16.19 0.0062 - 1019 - 2593
CCI Charlson Comorbidity Index, ICER incremental cost-effectiveness ratio, QALY quality-adjusted life-year, SES socioeconomic status
SECTION: FIG
Cost-effectiveness plane (incremental cost on the vertical axis and incremental effectiveness on the horizontal axis) with confidence intervals for the analysis disaggregated by sex (a), socioeconomic status [SES] (b) and level of comorbidity (c). CCI Charlson Comorbidity Index, QALY quality-adjusted life-year
SECTION: RESULTS
Vaccines costed $32.44 million based on the official prices and $22.17 million considering the prices paid.Vaccines costed $32.44 million based on the official prices and $22.17 million considering the prices paid. The total costs saved were estimated at $26.44 million resulting from the multiplication of unit costs by avoided outcomes (Table 1). The ICER of COVID-19 vaccines was $707/QALY with official vaccine prices and was dominant with real prices (Table 5). When disaggregating the cost-effectiveness analysis by SES to estimate the distributional ICER, the result did not render clear differences between income categories. By contrast, considering comorbidities, there were marked differences between groups with low (CCI 0, CCI 1-2) and high levels of comorbidity (CCI 3-4, CCI 4), as shown in Table 5 and Table SM9 of the ESM with confidence intervals for incremental cost and utility. The ICER was always dominant for the latter, with both official and real prices, but it was never dominant for the healthiest individuals (CCI 0). Last, there were differences by sex, the ICER being dominant for men and positive for women. The distributional cost-effectiveness plane (incremental cost on the vertical axis and incremental effectiveness on the horizontal axis) with confidence intervals for the ICER, presented in Fig. 1, indicates the same results.
SECTION: DISCUSS
Discussion
This study presents a cost-utility analysis of COVID-19 vaccination based on the actual infection outcomes in a nationwide cohort of 2.3 million individuals disaggregated by comorbidity and SES. Although recently published studies have explored the health and economic impacts of COVID-19 vaccination by considering different vaccination strategies and future scenarios, we are unaware of any studies that have measured the actual health and economic value of vaccination programmes in a real-world population. Our innovative approach combined the results of a dynamic model to estimate the scenario with no vaccination, with the analysis of the whole population to identify CCI and SES, and techniques from parametric survival to achieve individual-level results for health and costs associated with COVID-19 infection. It is noteworthy that the synergies between modelling and real-world data to achieve full economic evaluations are reinforced by the use of common data sources. Our results answer an important question about the efficiency of the vaccination programme for different groups as a function of clinical and social determinants, confirming that the priority given to people with comorbidities was well justified. More importantly, our findings have shown some indicators of inequity during the vaccination rollout in the Basque Country, probably owing to a lower adherence to vaccination. The higher percentage of avoided deaths in the low SES could be understood as evidence of equity. However, we found that the low SES group achieved less gain than the other groups when we calculated the benefit of vaccines as the mean remaining comorbidity-adjusted life expectancy of the population according to age, SES and CCI in the scenarios with and without vaccination. Our interpretation is that the differences in the percentage of avoided deaths are biased by the higher comorbidity of the low SES group and the reality is that people with comorbidity in the higher SES groups benefited more from the vaccination.
The label of dominance in an economic evaluation means that the treatment under evaluation provides more QALYs and saves healthcare costs and, therefore, it should be adopted. In the Basque Country, COVID-19 vaccination was dominant from the perspective of the healthcare payer when real prices were used, consistent with the efficiency of vaccines shown by studies analysing potential scenarios. To avoid misunderstandings, we underline that our modelling results are not based on the analysis of hypothetical scenarios of selective delivery of vaccines to each subgroup but on a single incremental cost-effectiveness analysis of a "real" vaccination strategy compared to a counterfactual strategy of non-vaccination. We have only carried out one application of the SHARUCD model and its results have been projected in the complete OAS database. The procedure for randomly assigning the results associated with COVID that took into account the probability of the different categories of sociodemographic and comorbidity variables made it possible to obtain individual data on the cost and effectiveness of each subgroup in the scenario without vaccines based on the combination of the dynamic model and the OAS database. The same information about the vaccination alternative was already available in the OAS database.
Our findings on the ICER did not render clear differences between low-SES, medium-SES, and high-SES groups. However, using the CCI to classify population comorbidity prior to COVID-19 infection showed that the programme was more efficient in the highest comorbidity groups (CCI 4). These results justify the vaccine administration priority criteria applied by the Basque Public Health System, in agreement with its Beveridge model, implementing a centralised rollout of vaccines and giving priority to elderly and high-risk individuals. By the end of June 2021, the vaccination programme in the Basque Country had administered vaccines to 95% of = 70-year-olds, the age group with the highest rates of comorbidity. By contrast, younger people had fewer comorbidities and their full vaccination percentages were much lower at this stage. Despite 20% of the population in the Basque Country having double healthcare coverage (public and private), access to the vaccination programme was only possible through the public system, ensuring equity in terms of SES in vaccine distribution. The lack of a clear social gradient in our results may be surprising as the literature is abundant on an increased risk of infection and an increased risk of death in deprived areas. However, in 2021, the greatest risk of contagion in the Basque population occurred in the groups between 15 and 50 years of age because of their greater socialisation, to a large extent in leisure venues, which correlates with a greater availability of income. In addition, the prioritisation of groups with higher comorbidity in the implementation of vaccination boosted vaccination in lower-income groups as they had higher comorbidity. The possible barriers to accessibility of lower income groups were solved by a vaccination rollout carried out in a centralised and proactive manner, reinforcing the primarycCare network that covers 100% of the population.
The SHARUCD model developed to guide decision making by public health managers during the first year of the pandemic was used to estimate the number of cases expected in a scenario in which vaccination had not been implemented. Giving predictions validated with the official data from February to December 2020, the simulations were obtained without adding any control function for January to June 2021. For interpreting the model, we assumed that, in the absence of a vaccination rollout, the behaviour of the pandemic in the first semester of 2021 would have followed the same trend as observed in the last months of 2020, i.e. a situation before COVID-19 antibodies started to decline, reflecting waning immunity, and before the Delta variant became dominant. This assumption was justified by empirical data showing similar patterns in the epidemic waves reported from the last months of 2020 until the end of June of 2021, with incidence rates and reproduction numbers in similar ranges to those associated with the same COVID-19 Alpha variant. A comparison of model simulations with official data for the first half of 2021 indicated that the initial phase of the vaccination rollout was responsible for reducing infections, hospitalisations, ICU admissions and deaths associated with COVID-19 by 25.5%, 16.0%, 19.6% and 18.4%, respectively.
The SES, CCI, sex and age of the population had only a small influence on the risk of infection, the percentage of avoided infections not varying substantially as a function of these variables. On the contrary, differences did appear among patients with more severe disease; specifically, we found: (1) proportionally fewer hospitalisations in =70-year-olds, patients with CCI scores of 3-4, and those with high SES, and (2) proportionally fewer ICU admissions in men, patients with high SES, and 50- to 69-year-olds. Further, proportionally more deaths were avoided, indicating a greater benefit from the vaccination programme, in some groups, namely, patients with high levels of comorbidity (CCI score 2) and = 70-year-olds. As men had more comorbidities than women, they benefited more from vaccination, their ICER being dominant while that of women was positive.
Last, but not least, we underline the importance of knowing the real costs of drugs to carry out realistic economic evaluations, as highlighted by the results described here. In the case of the real costs of the COVID-19 vaccines used in the European Union, this information was released by an "accidental data leak" revealing the savings in the prices obtained by centralised purchasing. Notably, the analysis with the real vaccine prices rendered, from the perspective of the healthcare payer, a dominant ICER.
Our work is not exempt from limitations. The main limitations relate to the lack of a comprehensive approach for estimating the cost of each scenario by incorporating indirect costs and the macroeconomic perspective considering the impact of the pandemic in terms of drops in gross domestic product. Moreover, while the vaccination rollout was still ongoing at the 6-month time horizon, our approach was not able to include all the real benefits from vaccines remaining effective for a longer period. Another limitation to mention is the lack of adjustment of comorbidity or SES on quality of life. This means that the QALY gains and cost effectiveness of vaccinating comorbid or low SES individuals may have been overestimated. We can justify this omission on the grounds of seeking to avoid the potential risk of indirect disability or social discrimination. Additionally, we have to mention that the best calibration would have been carried out by introducing vaccines to the model, but this adaptation was not available and we proceeded by running the model according to the calibration to the last quarter of 2020.
SECTION: CONCL
Conclusions
Finally, we conclude that the analysis by comorbidity showed that vaccines were considerably more cost effective in individuals with pre-existing health conditions. However, this benefit was lower in the low SES group. The economic evaluation of the vaccination programme justified the policy of prioritising high-risk patients. The initial phase of COVID-19 vaccination was dominant from the perspective of the healthcare payer.
Supplementary Information
Below is the link to the electronic supplementary material.
Declarations
SECTION: METHODS
Availability of data and material
Data were provided by the Basque Health Service. Our data sharing agreement clearly stipulates that they cannot be shared with any third party.
SECTION: SUPPL
Code availability
Not applicable.