Background: Non-pharmaceutical interventions (NPIs) have been widely utilised to control the COVID-19 pandemic. However, it is unclear what the optimal strategies are for implementing NPIs in the context of coronavirus vaccines. This study aims to systematically identify, describe, and evaluate existing ecological studies on the real-world impact of NPIs in containing COVID-19 pandemic following the roll-out of coronavirus vaccines.

Methods: We conducted a comprehensive search of relevant studies from January 1, 2021, to June 4, 2023 in PubMed, Embase, Web of science and MedRxiv. Two authors independently assessed the eligibility of the studies and extracted the data. A risk of bias assessment tool, derived from a bibliometric review of ecological studies, was applied to evaluate the study design, statistical methodology, and the quality of reporting. Data were collected, synthesised and analysed using qualitative and quantitative methods. The results were presented using summary tables and figures, including information on the target countries and regions of the studies, types of NPIs, and the quality of evidence.

Results: The review included a total of 17 studies that examined the real-world impact of NPIs in containing the COVID-19 pandemic after the vaccine roll-out. These studies used five composite indicators that combined multiple NPIs, and examined 14 individual NPIs. The studies had an average quality assessment score of 13 (range: 10-16), indicating moderately high quality. NPIs had a larger impact than vaccination in mitigating the spread of COVID-19 during the early stage of the vaccination implementation and in the context of the Omicron variant. Testing policies, workplace closures, and restrictions on gatherings were the most effective NPIs in containing the COVID-19 pandemic, following the roll-out of vaccines. The impact of NPIs varied across different time frames, countries and regions.

Conclusion: NPIs had a larger contribution to the control of the pandemic as compared to vaccination during the early stage of vaccine implementation and in the context of the omicron variant. The impact of NPIs in containing the COVID-19 pandemic exhibited variability in diverse contexts. Policy- and decision-makers need to focus on the impact of different NPIs in diverse contexts. Further research is needed to understand the policy mechanisms and address potential future challenges.