This paper presents an approach named sensitivity-driven simulation development (SDSD), where the use of sensitivity analysis (SA) guides the focus of further simulation development and refinement efforts, avoiding direct calibration to validation data. SA identifies assumptions that are particularly pivotal to the validation result, and in response model ruleset refinement resolves those assumptions in greater detail, balancing the sensitivity more evenly across the different assumptions and parameters. We implement and demonstrate our approach to refine agent-based models of forcibly displaced people in neighbouring countries. Over 70.8 million people are forcibly displaced worldwide, of which 26 million are refugees fleeing from armed conflicts, violence, natural disaster or famine. Predicting forced migration movements is important today, as it can help governments and NGOs to effectively assist vulnerable migrants and efficiently allocate humanitarian resources. We use an initial SA iteration to steer the simulation development process and identify several pivotal parameters. We then show that we are able to reduce the relative sensitivity of these parameters in a secondary SA iteration by approximately 54% on average. This article is part of the theme issue 'Reliability and reproducibility in computational science: implementing verification, validation and uncertainty quantification in silico'.
BACKGROUND: Summary measures of health are essential in making estimates of health status that are comparable across time and place. They can be used for assessing the performance of health systems, informing effective policy making, and monitoring the progress of nations toward achievement of sustainable development goals. The Global Burden of Diseases, Injuries, and Risk Factors Study 2015 (GBD 2015) provides disability-adjusted life-years (DALYs) and healthy life expectancy (HALE) as main summary measures of health. We assessed the trends of health status in Iran and 15 neighboring countries using these summary measures. METHODS: We used the results of GBD 2015 to present the levels and trends of DALYs, life expectancy (LE), and HALE in Iran and its 15 neighboring countries from 1990 to 2015. For each country, we assessed the ratio of observed levels of DALYs and HALE to those expected based on socio-demographic index (SDI), an indicator composed of measures of total fertility rate, income per capita, and average years of schooling. RESULTS: All-age numbers of DALYs reached over 19 million years in Iran in 2015. The all-age number of DALYs has remained stable during the past two decades in Iran, despite the decreasing trends in all-age and age-standardized rates. The all-cause DALY rates decreased from 47,200 in 1990 to 28,400 per 100,000 in 2015. The share of non-communicable diseases in DALYs increased in Iran (from 42% to 74%) and all of its neighbors between 1990 and 2015; the pattern of change is similar in almost all 16 countries. The DALY rates for NCDs and injuries in Iran were higher than global rates and the average rate in High Middle SDI countries, while those for communicable, maternal, neonatal, and nutritional disorders were much lower in Iran. Among men, cardiovascular diseases ranked first in all countries of the region except for Bahrain. Among women, they ranked first in 13 countries. Life expectancy and HALE show a consistent increase in all countries. Still, there are dissimilarities indicating a generally low LE and HALE in Afghanistan and Pakistan and high expectancy in Qatar, Kuwait, and Saudi Arabia. Iran ranked 11th in terms of LE at birth and 12th in terms of HALE at birth in 1990 which improved to 9th for both metrics in 2015. Turkey and Iran had the highest increase in LE and HALE from 1990 to 2015 while the lowest increase was observed in Armenia, Pakistan, Kuwait, Kazakhstan, Russia, and Iraq. CONCLUSIONS: The levels and trends in causes of DALYs, life expectancy, and HALE generally show similarities between the 16 countries, although differences exist. The differences observed between countries can be attributed to a myriad of determinants, including social, cultural, ethnic, religious, political, economic, and environmental factors as well as the performance of the health system. Investigating the differences between countries can inform more effective health policy and resource allocation. Concerted efforts at national and regional levels are required to tackle the emerging burden of non-communicable diseases and injuries in Iran and its neighbors.
Background: Surgery is the main modality of cure for solid cancers and was prioritised to continue during COVID-19 outbreaks. This study aimed to identify immediate areas for system strengthening by comparing the delivery of elective cancer surgery during the COVID-19 pandemic in periods of lockdown versus light restriction. Methods: This international, prospective, cohort study enrolled 20 006 adult (≥18 years) patients from 466 hospitals in 61 countries with 15 cancer types, who had a decision for curative surgery during the COVID-19 pandemic and were followed up until the point of surgery or cessation of follow-up (Aug 31, 2020). Average national Oxford COVID-19 Stringency Index scores were calculated to define the government response to COVID-19 for each patient for the period they awaited surgery, and classified into light restrictions (index 60). The primary outcome was the non-operation rate (defined as the proportion of patients who did not undergo planned surgery). Cox proportional-hazards regression models were used to explore the associations between lockdowns and non-operation. Intervals from diagnosis to surgery were compared across COVID-19 government response index groups. This study was registered at ClinicalTrials.gov, NCT04384926. Findings: Of eligible patients awaiting surgery, 2003 (10·0%) of 20 006 did not receive surgery after a median follow-up of 23 weeks (IQR 16-30), all of whom had a COVID-19-related reason given for non-operation. Light restrictions were associated with a 0·6% non-operation rate (26 of 4521), moderate lockdowns with a 5·5% rate (201 of 3646; adjusted hazard ratio [HR] 0·81, 95% CI 0·77-0·84; p<0·0001), and full lockdowns with a 15·0% rate (1775 of 11 827; HR 0·51, 0·50-0·53; p<0·0001). In sensitivity analyses, including adjustment for SARS-CoV-2 case notification rates, moderate lockdowns (HR 0·84, 95% CI 0·80-0·88; p<0·001), and full lockdowns (0·57, 0·54-0·60; p<0·001), remained independently associated with non-operation. Surgery beyond 12 weeks from diagnosis in patients without neoadjuvant therapy increased during lockdowns (374 [9·1%] of 4521 in light restrictions, 317 [10·4%] of 3646 in moderate lockdowns, 2001 [23·8%] of 11 827 in full lockdowns), although there were no differences in resectability rates observed with longer delays. Interpretation: Cancer surgery systems worldwide were fragile to lockdowns, with one in seven patients who were in regions with full lockdowns not undergoing planned surgery and experiencing longer preoperative delays. Although short-term oncological outcomes were not compromised in those selected for surgery, delays and non-operations might lead to long-term reductions in survival. During current and future periods of societal restriction, the resilience of elective surgery systems requires strengthening, which might include protected elective surgical pathways and long-term investment in surge capacity for acute care during public health emergencies to protect elective staff and services.
