Abstract
Background: Canada lags behind other countries with respect to wait times for specialist physician and allied health professional consultations. We conducted a systematic review to assess the effects of a single-entry model on waiting time, referral volume and the satisfaction of patients and health care providers.
Methods: We searched MEDLINE, Embase, Cochrane CENTRAL and CINAHL databases from inception to December 2019. We included studies from countries in the Organisation for Economic Co-operation and Development that reported on the effects of a single-entry model on the time between referral to first assessment by a specialist physician or allied health professional, termed wait time 1 (WT1). Patient volume and the satisfaction of providers and patients were secondary outcomes. We conducted a narrative synthesis using descriptive statistics.
Results: Of the 4637 citations identified, 17 met the eligibility criteria, and we included 10 of these in the final analysis. All of the included studies reported an absolute reduction in WT1 after implementation of the single-entry model. The average percent reduction in WT1 across specialties was greatest for surgical referrals (57%) and urgent internal medicine referrals (40%). Higher initial WT1 was associated with a greater absolute reduction in WT1 after implementation of the single-entry model (p = 0.002). Patient and provider satisfaction with the single-entry model was high in all studies. The effect estimates from all included studies were at high risk of bias.
Interpretation: Single-entry models were associated with an absolute reduction in time from referral from primary care to consultation. These models represent a promising option to improve access to a range of health services, but there is a need for rigorous prospective evaluations to inform policy.
PROSPERO Registration: CRD42018100395
Poor access to specialist physicians and allied health professionals (hereafter referred to as “specialists”) and long wait times are pervasive problems facing many health care systems.1 Relative to its international peers, Canada struggles to provide timely access to care.2 Canadian wait times between referral and appointment are twice as long as they were 25 years ago, increasing from an average of 9.3 weeks in 1993 to 19.8 weeks in 2018.3 Currently, most outpatient clinicians use a “multiple-queue, multiple-server” model to manage their referrals and wait lists, whereby each clinician has a separate queue.4 As such, clinicians of the same specialty, working in the same region, may have different approaches to managing referral and wait lists, potentially leading to inequitable and suboptimal patient outcomes. In contrast, single-entry models assemble patients referred to specific specialists in a given jurisdiction into a single queue, thereby allowing each patient to see the first available specialist. The single-entry model consists of a centralized intake (i.e., referrals are received through a single point of entry) or a pooled referral system (i.e., merging of multiple waiting lists), along with a centralized, coordinated approach to triage (i.e., appointments arranged according to urgency).5
The single-entry model is based on queuing theory6 and has been proven successful in operational fields such as the airline industry.5 In health care, the benefits of this model are thought to relate to rebalancing of supply (i.e., clinician availability) and demand (i.e., the number of referrals).4 In addition, sicker patients may be seen faster with a central intake system, whereby the patient is referred to an available provider according to urgency. Although single-entry models may prevent duplicate and cancelled appointments, they may also limit choice and reduce satisfaction.4 A prior review suggested that this model may reduce wait times for surgeries. 5 However, that review included only referrals to surgical specialties and measured waiting time from consultation to surgery (also known as “wait time 2”), as well as overall wait time from referral to surgery.5
Here, we evaluated the effect of implementation of a single-entry model on the wait time from initial referral (typically from primary care) to consultation with any specialist physician or allied health professional (also known as “wait time 1” [WT1]), as well as measuring overall referral volume and the satisfaction of both patients and providers, because these outcomes were deemed to have the highest priority for policy-makers.
Methods
We followed the PRISMA guidelines for reporting,7 and this review was registered on PROSPERO (CRD42018100395). The only protocol amendment for this study was that we considered for our systematic review single-entry models related to allied health professionals, as well as those involving specialist physicians. The complete PICO (population, intervention, comparison, outcome) research questionnaire can be found in Appendix 1 (available at www.cmajopen.ca/content/9/2/E413/suppl/DC1).
Literature search
Three of the authors (M.M., M.E.N., S.V.) independently conducted a systematic literature search of the following databases, from inception to December 2019: Medical Literature Analysis and Retrieval System Online (MEDLINE, Ovid, from 1946), Excerpta Medica database (Embase, Ovid, from 1947), Cochrane Central Register of Controlled Trials (CENTRAL, from 1999) and Cumulative Index to Nursing and Allied Health Literature (CINAHL, EBSCO, from 1937). The reviewers searched all keywords and mapped them onto subject headings where appropriate. To ensure completeness, we also screened the reference lists of all included articles for additional articles and cross-referenced against the references included in a 2017 review on the same subject by Damani and colleagues.5 We extended the search from that conducted by Damani and colleagues5 (which focused on referral to elective surgery) to include appointments with specialist physicians and allied health providers. The full search strategy for MEDLINE is provided in Appendix 2 (available at www.cmajopen.ca/content/9/2/E413/suppl/DC1). We did not restrict the search to any particular language, and we modified the search strategy appropriately for each database. We did not extend the search to include grey literature.
Study selection
We excluded duplicates from the search results before screening. Three reviewers (M.M., M.E.N., S.V.) conducted the title and abstract screening, followed by full-text review. The reviewers independently screened all search results and then compared their individual results. They resolved discrepancies through consensus or by consulting the senior author (N.M.I.).
We included original studies that met all of the following inclusion criteria: inclusion of outpatients who were referred to specialists for medical, surgical or allied health services; implementation of a single-entry model; and measurement of the wait time from referral to the specialist appointment (WT1), both before and after implementation of the single-entry model.5 We included only studies that reported the absolute (not relative) reduction in WT1 after implementation of the single-entry model. Given the paucity of evidence in this field of study, we included conference abstracts as reviewed articles, although we did not combine their findings with the results of other studies for the purpose of statistical analysis.
We excluded studies that did not report original data. To facilitate generalizability within the Canadian health care system, we excluded studies conducted in countries other than those of the Organisation for Economic Co-operation and Development (OECD).8 The choice of OECD countries was based on the following rationale. Single-entry models are most likely to be effective in situations where there are multiple specialists with different waiting lists in the same catchment area. Although single-entry models could be helpful in low- and middle-income countries, the mechanism may be slightly different in those settings, which often lack adequate health care human resources.
Data collection
Two reviewers (M.M., A.M.C.) independently collected the data and then compared their individual results. We considered the following study variables: first author, year of publication, country of implementation, specialty setting, health care setting (i.e., private v. public), insurance mandate (i.e., single payer v. multiple payers), study design, type of single-entry model (central intake, centralized approach to triage, pooled referral system), sample size, implementation process, implementation fidelity (i.e., how research teams ensured uptake and ongoing use of the new approach, the “degree of adherence to the described implementation strategy”9) and whether the study was reporting on optional or mandatory implementation. Collected outcome data included WT1 before and after implementation of the single-entry model, as well as changes in patient volume and changes in patient and provider satisfaction. We contacted the corresponding authors of individual studies by e-mail to request any data that were missing from the published report; however, despite these efforts, the sample size was not available for 3 of the included studies.10–12 Any discrepancies were resolved though consensus.
Risk of bias
We used the Risk of Bias in Nonrandomized Studies of Interventions tool to assess quality and risk of bias of the included studies. This tool was specifically designed to assess risk of bias in nonrandomized studies comparing the effects of 2 or more interventions.13 We assessed the risk of bias using all 7 domains of the tool. For each domain, 2 reviewers (M.M., A.M.C) conducted the risk-of-bias assessment according to the following scale: low, moderate, serious, critical or no information. They also assessed the risk of bias related to study funding and conflicts of interest. The reviewers resolved any discrepancies through consensus or by consulting the senior author (N.M.I.).
Statistical analysis
For all study characteristics and outcomes (such as wait times and satisfaction of patients and physicians), we report the data as arithmetic means, frequencies or proportions, as appropriate, using medians as measures of central tendency when means were not available. We report all numeric values with the same number of significant figures as reported in the original studies. For data obtained from figures, we extracted the preimplementation values at last follow-up for comparison with post-implementation data at last follow-up. We recorded standard deviations at the level of the study cohort and converted interquartile ranges into standard deviations if appropriate.
We defined the exposure as implementation of a single-entry model and the outcome of interest as the absolute reduction in wait time after implementation of the single-entry model. We investigated the relation between baseline WT1 and absolute reduction in WT1 using the coefficient of determination based on a linear relation, as well as a univariable linear regression. If there were multiple possible values for pre- and post-implementation WT1, we chose the earliest pre-implementation and latest post-implementation values, to avoid the collection of artificial data that could be attributable to the immediate peri-implementation period. We included p values if they were reported, with p values less than 0.05 considered statistically significant.
We used Excel (Microsoft Corporation) to compile the data and SPSS Statistics, version 23 (IBM), to analyze the data. Meta-analysis was not possible, given the lack of available information and the difference in reporting of results across the included studies.
Ethics approval
Given the nature of the study design, ethics approval was not required.
Results
Of the 4637 citations identified, 17 met the eligibility criteria, and 10 were included in the final analysis6,10–12,14–19 (Figure 1). Seven articles20–26 were excluded from full-text screening.
Study characteristics
Table 1 summarizes the characteristics of the included studies. Eight studies were from Canada,6,10,11,14–18 1 study was from Australia, 19 and 1 study was from England.12 The studies were published between 2004 and 2017, with most published after 2010.6,11,16–19 Overall, 9 articles used a simple comparative study design (pre-implementation v. post-implementation),6,10–12,14,15,17–19 and 1 was cross-sectional.16
The setting for evaluation of a single-entry model was surgery (orthopedics and general surgery) in 3 studies,10,12,16 internal medicine (gastroenterology, rheumatology, cardiology, general internal medicine and nephrology) in 5 studies, 6,14,15,17,19 chronic pain in 1 study11 and physiotherapy in 1 study.18 All but one of the studies were conducted in a single-payer health care system,6,10–12,14–18 the exception involving a 2-tier system.19 Three studies required mandatory implementation of a single-entry model,14,18,19 whereas 7 reported on optional implementation.6,10–12,15–17
The implementation process for the single-entry model was described in all studies; however, implementation fidelity was described in only 3 articles.6,10,16 Nine of the studies used quantitative analysis,6,10–12,14–17,19 and 1 study used a mixed-methods approach.18
Risk of bias
The effect estimates from all included studies were at high risk of bias (Table 2). Eight of the included studies had an overall serious risk of bias,6,11,12,14,15,17–19 and 2 studies had a critical risk of bias.10,16 There was serious or critical risk of bias in the following categories: confounding (n = 10), selection of participants for the study (n = 1) and missing data (n = 1). Three categories generally had low risk of bias: classification of intervention (n = 10), measurement of outcome (n = 8) and selection of the reported results (n = 8). One study reported high risk of bias for conflicts of interest,16 and no studies reported high risk of bias for funding.
Effects of single-entry model on wait time and volume
Table 3 summarizes the main outcomes of the included studies. All of the studies reported a reduction in WT1 (Figure 2), and this reduction was statistically significant in 6 of the studies.6,14,15,17–19 The improvement in WT1 after implementation was highest in the study by Clark11 and lowest in the study by Wittmeier and colleagues18 (274 v. 5.5 d). When categorized by specialty, the average absolute reduction was highest in the “other” category and lowest for urgent referrals to internal medicine at (140 v. 12 days; Figure 3). However, the average percent reduction in WT1 across specialties was highest for surgery (57% relative reduction) and for urgent referrals to internal medicine (40% relative reduction) (Figure 4). Moderate-level and routine referrals to internal medicine were associated with lower percent reductions in WT1 (36% and 17% relative reductions, respectively).
On univariable linear regression, pre-implementation wait times were associated with an absolute reduction in WT1 (R2 = 0.5978, p = 0.002) (Figure 5). For every 1-day increase in the pre-implementation wait time, it is expected that the absolute reduction in WT1 will increase by 0.5 days (Figure 5). On a relative basis, there was a 0.065% relative reduction in WT1 for every 1-day increase in the pre-implementation wait time, although a significant amount of variability was not captured by the linear model (R2 = 0.062).
Of the 3 studies that reported on mandatory implementation of a single-entry model, the range of WT1 improvement was 5.5 to 47 days.14,18,19 The other 7 studies, which allowed for optional involvement, had a range of improvement in WT1 from 6 days to 9 months.6,10–12,15–17
Patient volume was measured in 4 of the studies,14,15,17,18 with variable results. One study found no change in referral volume for rheumatology and hematology practices after implementation of the single-entry model, but did find increased referral volumes for endocrinology, gastroenterology and general internal medicine practices.14 In the cardiology study, patient volume increased by 50% in the first year after implementation and by another 19% in the second year.15 In the study by Schacter and colleagues,17 there was a 22% reduction in referral volume in nephrology. Wittmeier and colleagues18 found that the referral volume for physiotherapy stayed the same after implementation of a single-entry model for a group of children with neurodevelopmental conditions, but increased for pediatric orthopedic clinics.
Patient and physician satisfaction
Appendix 3 (available at www.cmajopen.ca/content/9/2/E413/suppl/DC1) summarizes patient and physician satisfaction in the included studies. Three of the studies described patient satisfaction after implementation of a single-entry model,10,16,18 although only 1 study provided data from patients referred before and after implementation.18
All of the studies reported positive patient satisfaction or improvement in satisfaction with single-entry models. Van den Heuvel and colleagues16 found that patients who had the same surgeon for assessment and surgery (group 1) rated the importance of having the same surgeon higher than the group that did not have the same surgeon for surgery and assessment (group 2) (98.4% v. 48.3%). Regardless of whether patients had the same surgeon for both assessment and surgery, patients’ confidence in the surgeon was high in both groups (group 1, 100%; group 2, 86.2%; p = 0.009). As well, both groups felt that service was faster and better with a common waiting list.16 Wittmeier and colleagues18 found that patient satisfaction was high both before and after implementation of a central intake system (96.6% and 98%, respectively). As well, caregivers reported that implementation of a single-entry model provided more transparency for accessing services, more accurate information on wait times, better availability, improved communication and a reduction in service duplication.18
One study provided data on provider satisfaction after implementation of a single-entry model.6 After implementation of a central intake model, providers deemed referrals as having higher quality (before implementation, one-third of rheumatologists rated referrals as being of poor quality; after implementation, rheumatologists rated 19% of referrals as being of poor quality) and more complete (before implementation, 75% were not satisfied with the completeness of referral; after implementation, 68% rated the completeness of referral as moderate and 19% rated it as high).18
Interpretation
In this systematic review, we found that implementation of a single-entry model was consistently associated with a decrease in the wait time to initial outpatient visit to a specialist (WT1). The average percent reduction in WT1 was significant for surgery, for urgent referrals to an internal medicine specialist and for children with complex needs, which suggests that a centralized intake system may be more helpful for higher-priority referrals. Additionally, the evidence suggests that single-entry models were associated with greater absolute reductions in WT1 when implemented in situations with longer initial wait times. These findings should be considered hypothesis-generating, given the variability in implementation and reporting among the studies, as well as the risk of bias noted in each study.
In their 2017 systematic review, Damani and colleagues5 showed that single-entry models improved access to elective surgical procedures. For such surgical services, they found that a single-entry model resulted in a decrease in patients’ waiting times, an increase in the proportion of patients meeting wait time benchmarks and a decrease in the length of waiting lists.5 Our current review builds upon those results, indicating the potential benefit of single-entry models beyond surgical care and synthesizing the evidence related to implementation strategy, referral volumes, and both patient and provider satisfaction.
The range in effects observed for referral volume could be due to differences in the complexity of referrals, the nature of the field of practice, local referral patterns, education about appropriate referrals and the referring specialists’ comfort, ability and satisfaction with the new model.14,15,17,18 When reported, patient and provider satisfaction improved after implementation of a single-entry model.6,10,16,18 One study reported that the quality of referrals improved after implementation; however, it is not clear if this finding was due to use of a standardized referral form that was given to the referring physicians during the post-implementation period, or if it was due to the single-entry model.6 By comparison, Damani and colleagues5 found that single-entry models may leave specialists and referring physicians with a reduced sense of personal ownership over the referral system.
Another model, termed the specific timely appointment for triage (STAT) model, has been proposed and investigated for reducing wait times to appointments.27 This model is based on assumptions about the referral volume of a practice. STAT slots are protected in clinicians’ schedules, according to patient demand. More specifically, each physician creates a certain number of STAT time slots depending on the anticipated demand for referrals. As a result, new patients are booked into the STAT slots and are potentially seen faster.27 E-consultations represent another complementary option that makes specialist knowledge and advice more accessible to primary care.28,29
Limitations
The limitations of the available data that we identified through this review deserve consideration. The included studies came from only 3 countries (Canada, Australia and England), which limits the external validity of the findings. Only 3 studies reported on patient satisfaction, and only 1 study reported on provider satisfaction.
There was also considerable variability with respect to the reporting of results in the individual studies. For instance, for 3 of the included studies,10,11,19 no measure of variability was available (as shown in Figure 2), nor was an associated sample size reported. As such, we could not calculate weighted averages, because either the sample sizes were unknown or the sample sizes for specific categories (urgent, moderate-level or routine referrals) were not specified.
For certain studies, it was not possible to extract the associated uncertainty of the effect size observed. Furthermore, the sustainability of single-entry models (i.e., the ability of the models to persist over time) was not adequately assessed in any study. Unsustainable models can lead to poor quality of care, financial consequences and worsening of patient outcomes. 30 Similarly, few studies reported on implementation fidelity, and for those that did, efforts to ensure fidelity (or adaptation) were not adequately described.6,10,16 Likewise, the only indication of cost-effectiveness in our review came from the study by Leach and colleagues,12 who mentioned that their single-entry system was cost-neutral.
There may have been natural variations in WT1 in the pre-implementation period. An example of this occurred in the study by Macleod and colleagues,10 where a decrease in WT1 (from 162 to 127 d for hip replacement and from 203 to 164 d for knee replacement) was seen from the 2-month period August–September 2005 to the corresponding 2-month period August–September 2006, both of which were in the pre-implementation period. We chose to analyze the earliest pre-implementation and latest post-implementation values, to avoid the collection of peri-implementation artifactual data, and these natural variations in baseline WT1 might have affected the observed results.
We identified a serious or critical risk of bias across all included studies. Specifically, there was high risk of confounding in all studies. Eight articles used a simple before-and-after comparative study design, which did not allow us to determine whether differences between the 2 periods were due to any variable other than implementation of the single-entry model.
Means and standard deviations for the reduction in WT1 after implementation of the single-entry model were computed at the level of the cohort. Ecological fallacy contends that these estimates may not necessarily hold true at the level of the individual patient.
Because of heterogeneity in study design, outcome measures and populations, we did not conduct a meta-analysis. Publication bias was also a possibility in this review, but this source of bias is difficult to assess statistically because of limited reporting of standard errors within the included studies. In a related manner, we included studies whether or not they had been peerreviewed, because of the paucity of peer-reviewed literature in this setting. We did not consider any grey literature.
Given the substantial risk of confounding that exists secondary to patient-, provider- and system-level factors, wait times before and after implementation of a single-entry model should be compared in studies that control for confounding factors, with randomization, matching, restriction, stratification or multivariable regression, depending on context.31
Conclusion
This review showed that single-entry models for referral to specialist physicians and allied health professionals have the potential to decrease WT1, but there remains uncertainty about their efficacy, cost-effectiveness and sustainability. Furthermore, it remains uncertain whether these models can be applied to all specialties and across diverse settings. As well, single-entry models may affect not only average wait times across study cohorts, but also the variation in wait times, which should be the focus of further investigations. It is unknown whether improvements in WT1 through the implementation of a single-entry model significantly affects health outcomes. Studies evaluating single-entry models should feature methodologic or statistical methods to control bias.
Footnotes
Competing interests: None declared.
This article has been peer reviewed.
Contributors: All of the authors contributed to conception and design of the study and to acquisition, analysis and interpretation of the data. Milica Milakovic led the process of manuscript preparation, with substantive contributions from Ann Marie Corrado, Mina Tadrous, Mary Nguyen, Sandra Vuong and Noah Ivers. All of the authors gave final approval of the version to be published and agreed to act as guarantors of the work.
Funding: Ann Marie Corrado is supported by the Peter Gilgan Centre for Women’s Cancers at Women’s College Hospital, in partnership with the Canadian Cancer Society. Noah Ivers is supported as the Canada Research Chair in Implementation of Evidence-Based Practice and as a clinician scientist by the Department of Family and Community Medicine, University of Toronto.
Data sharing: All data contained in this manuscript are publicly available in the peer-reviewed publications included in the review.
Supplemental information: For reviewer comments and the original submission of this manuscript, please see www.cmajopen.ca/content/9/2/E413/suppl/DC1.
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY-NC-ND 4.0) licence, which permits use, distribution and reproduction in any medium, provided that the original publication is properly cited, the use is noncommercial (i.e., research or educational use), and no modifications or adaptations are made. See: https://creativecommons.org/licenses/by-nc-nd/4.0/
References
- © 2021 Joule Inc. or its licensors