The healthcare industry was slow to implement it solutions to improve productivity and efficiency.

Inquiry. 2022 Jan-Dec; 59: 00469580221095799.

Abstract

Background: Efficiency evaluation is an integral part of new medical reform and is necessary to solve the problem of limited and unbalanced medical resources. This study evaluated the efficiency of municipal-level Traditional Chinese Medicine hospitals by Data Envelopment Analysis application after a hierarchical medical treatment policy was implemented. We propose solutions to the problems existing in hospital operations and promote the utilization efficiency of medical resources in those hospitals. Methods: The sample included all municipal-level TCM hospitals in Gansu province from 2017 to 2019. The DEA-BCC model was employed to evaluate the relative efficiency of hospital operations, and the Manny-Whitney test was used to compare the input and output variables of technical efficiency efficient and inefficient hospitals. Results: From 2017 to 2019, the growth in the number of staff in secondary hospitals (25.88%) was lower than that in tertiary hospitals (31.98%). However, the increase in the number of beds (16.52%) in secondary hospitals was higher than that in tertiary hospitals (−0.30%). 5 (38.46%) achieved DEA efficient in secondary hospitals and 2 (40.00%) in tertiary hospitals. The means of technical efficiency, pure technical efficiency, and scale efficiency in secondary hospitals were 0.812, 0.887, and 0.908, respectively. The means in tertiary hospitals were 0.868, 0.926, and 0.935, respectively. The hospital areas were statistically different between the TE efficient and inefficient hospitals (P<0.05) in secondary hospitals. However, the number of outpatients between the two groups was statistically different (P<0.05) in tertiary hospitals. Conclusion: In this study, the medical and health services of municipal TCM hospitals in Gansu Province have made great progress. Due to the backward economy of Gansu Province, the classification of diagnosis and treatment of diseases was still based on Western medicine, resulting in the slow medical development of some municipal TCM hospitals. TCM hospitals should improve management efficiency, optimize hospital operation scale, improve the utilization efficiency of medical resources and promote efficient hospital development.

Keywords: data envelopment analysis, return scale, management policy, traditional Chinese medicine hospitals, efficiency evaluation

What Do We Already Know About This Topic?

Previous studies have shown that efficiency evaluation is an important part of new medical reform and is necessary to solve the problem of limited and unbalanced medical resources.

How Does Your Research Contribute to the Field?

This study aimed to evaluate the efficiency of municipal-level TCM hospitals after a hierarchical medical treatment policy was implemented, evaluate the relative efficiency of hospital operations, and determine the influencing factors of hospital efficiency using data envelopment analysis.

What Are Your Research’s Implications Towards Theory, Practice, or Policy?

The government should strive to narrow the gap in the utilization efficiency of medical resources in different regions. Hospital managers should improve management’s ability to promote the effective use of medical resources and pay attention to the introduction and training of professional and technical staff. This will result in improved medical technology ability and management ability.

Introduction

Healthcare reform is a challenging global issue, made more complex for China as a developing and populous country. Accompanied by aging, urbanization and other social and economic transformation process in China, the current medical service system remains irrational in medical treatment and resource allocation areas. The government and healthcare providers must improve the productivity, efficiency, and quality of medical and health service institutions to achieve comprehensive and balanced development of the public service system. 1 In the past few years, the government has formulated a series of public health care reform policies to promote the consistent long-term development of medical and health services and improve people’s health. To overcome the saturation of high-quality medical resources and slow development of basic medical institutions in big cities, China began implementing a graded diagnosis and treatment policy in 2013.2-4

Qinghai Province combined the implementation of a graded diagnosis and treatment system by strengthening medical insurance payment reforms. They pioneered the exploration and implementation of graded diagnosis and treatment systems in China. 5 More than 30 medical consortia were established to promote division of labor and cooperation among medical institutions at all levels in Beijing in 2013, and preliminary results were achieved. Gansu Province fully implemented the graded diagnosis and treatment system in 2015. The province used medical treatment, medical insurance, price, and other means to guide patients to seek local medical treatment. In 2017, the Health Commission of Gansu province issued the supplementary opinions further to improve the construction of graded diagnosis and treatment system. In particular, 150 diseases were selected and determined as the classified diagnosis and treatment diseases of municipal-level hospitals.6,7 Gansu is a typical economically underdeveloped region in western China. As inequality between regions is still apparent, resources are mainly concentrated in economically developed cities. Therefore, the number of patients in municipal-level hospitals increased rapidly in the short-term following policy implementation. As municipal-level hospitals undertake more obligations than their national and regional counterparts, further improvements in service quality and operational efficiency can only increase pressure.

Hospital services and scales have been a top research priority in recent years. This research allocation affects the health level of residents and plays an important role in the sustainable development of medical and health services.8-16 Similarly, research on the factors affecting hospital efficiency and improvement strategies has become the focus of analysis and discussion. It encourages hospitals to continue to work towards operational efficiency. Hence, effective performance evaluation has positive benefits for hospitals and can promote their development. There are many ways to evaluate performance using varied mathematical models. Sherman revealed that the most commonly used methods for assessing efficiency are as follows: ratio analysis, balanced score card (BSC), total factor productivity (TFP), regression analysis, production frontier approach (PFA), and data envelopment analysis(DEA). 17 Ratio analysis can only evaluate a single input and output factor, whereas BSC, TFP, and PFA are suitable for problems involving multiple inputs and a single output. DEA can simultaneously evaluate multiple input and output factors, making it more suitable for applications in complex medical institutions and the healthcare industry environments.18-21

In recently studies, Zheng 22 applied the non-parametric four-stage data envelopment analysis method (four-Stage DEA) to measure the relative efficiencies of Chinese public hospitals from 2010 to 2016 and determine how efficiencies were affected by eight factors. Ibrahim 23 evaluated the efficiency of healthcare system in Lebanon from 2000 to 2015 by applying a modified data envelopment analysis (DEA) model. Chen 12 offered a comprehensive assessment of the efficiency of public hospitals operating in China’s 31 regions. Based on a three-stage data envelopment analysis procedure, they assessed the impact of the third-round health system reform in 2009. Therefore, there is research value in hospital efficiency evaluation after specific policy implementation to provide data for hospital administrators to optimize resource allocation.

Hospital efficiency is an important indicator for hospitals and has significant continuous research value. As a typical Chinese province with unbalanced medical resource development, Gansu province has particular research significance after implementing the hierarchical medical treatment policy. The services and scale of municipal-level hospitals in Gansu Province need to be further evaluated after implementing the graded diagnosis and treatment policy because of the increase in inpatients. Meanwhile, traditional Chinese medicine (TCM) hospitals are the primary health service providers of TCM, and their development is more unbalanced than other hospitals at the same level. With the vigorous growth of TCM in China, research on the efficiency of TCM hospitals is of great significance. 24 According to literature reviews, the efficiency study of municipal-level TCM hospitals in China after policy implementation was severely lacking. This paper aims to evaluate the efficiency of municipal-level TCM hospitals by DEA after a hierarchical medical treatment policy was implemented. We propose solutions to the problems existing in hospital operations, improve the productivity of medical resources, and promote the utilization efficiency of medical resources in those hospitals. The results of this study may also provide a reference for the sustainable development of public health in various countries.

Materials and Methods

Classification of Public TCM Institutions

Public TCM institutions with fewer than 100 beds in China generally referred to community health service centers. Institutions with 100-500 beds were set as secondary hospitals, while tertiary hospitals were institutions with more than 500 beds.

The Data Source

In this study, we used data from the monitoring and direct reporting systems of a traditional Chinese medical service network. The data consisted of the hospitals’ basic facility information, financial statements, medical personnel, quantity of medical services reported by the hospitals, and quality control by National Administration of Traditional Chinese Medicine (NATCM), China. The sample included all municipal-level TCM hospitals of Gansu province from 2017 to 2019, including 13 secondary hospitals and five tertiary hospitals.

Methodology of DEA

DEA is a nonparametric method that evaluates the performance of mathematical planning models, including the relative efficiency of decision-making units (DMUs), using multiple input and output indicators.25,26 DEA has two models—one is the Charnes, Cooper, and Rhodes model (CCR), 27 the other is the Banker, Charnes, and Cooper (BCC) model. 28 CCR assumes that production is a constant return to scale (CRS), meaning that any increase in input proportionally increases the output level. 29 BCC assumes that production involves variable returns to scale (VRS). 30 The health services production process is not linear, and the VRS technical efficiency assumption may be more appropriate.31,32 The CCR and BBC models can both be divided into the “input” and “output” orientations. 13 The input-oriented model aims to reduce inputs, which is inconsistent with the current context of insufficient health resource investment in hospitals; therefore, the output-oriented model is adopted in this study.14,33

In the output-oriented BCC-DEA model, there are k independent DMUs, each producing m outputs Y(=[Y1,…, Yk]) by using n inputs X(=[X1, …, Xk]). Technical efficiency (TE) can be divided into pure technical efficiency (PTE) and scale efficiency (SE). Equation (1) was used to calculate the TE. If TE is equal to 1, the DMU is scale-efficient; if TE is less than 1, the DMU is inefficient. 34

Selection Input and Output Indicators of the DEA Model

The selection of variables was guided by a literature review on efficiency analysis and by considering the availability of the relevant data,35-38 which include three broad categories: labor, capital, and supplies. 39 In this study, the staff number,19,40-42 total hospital beds,19,41,42 and the hospital areas43,44 were selected as input variables based on the abovementioned literature reviews. The number of outpatients and inpatients45-47 and total revenue14,48 were selected as output variables.

Analytical Tool

The database was established with Excel, and SPSS 19.0 was used for statistical analysis. Descriptive statistics and Correlation analysis were performed on the input and output variables. The Manny-Whitney test was used to compare the difference in input-output variables between TE-efficient and TE-inefficient hospitals. The DEAP 2.1 was used for DEA to evaluate the efficiency of 18 municipal TCM hospitals.

Results

Descriptive Statistics and Correlation Analysis

The descriptive statistics and correlation analyses are shown in Table 1. By 2019, the secondary hospital had 3,196 employees, 3,604 beds, 22,085.14 m2 the total area, 587.37 million yuan total revenue, 1,620.88 thousand outpatients and 89,498 inpatients. This was an increase of 25.88%, 16.52%, 43.43%, 50.46%, 40.00% and 26.86% respectively compared with 2017 statistics. The tertiary hospital had 3,661 employees, 3,269 beds, 189,300.02 m2 total area, 923.04 million yuan total revenue, 1,677.19 thousand outpatients and 92,977 inpatients. This was an increase of 31.98%, −0.30%, 15.64%, 40.92%, 32.05% and 29.69% respectively compared with 2017 statistics. The increase in the number of staff in secondary hospitals was lower than that in tertiary hospitals; however, the increase in the number of beds was much higher than that in tertiary hospitals. The growth rates of the other items were the same as that in tertiary hospitals.

Table 1.

Descriptive statistics of input and output variables (2017-2019).

In this study, the input and output variables are relatively independent variables. The correlation coefficients of the input and output variables were analyzed (Table 2) and were strongly positively correlated (P<0.01). The high correlation between inputs and outputs is evident, which meets the isotonic property that the output does not decrease with the increase of input. 9 The correlation coefficient of input-output indicators is between 0.615 and 0.910.

Table 2.

Correlation analysis of variables (2017-2019).

Result of the DEA Model

Operational efficiency of the municipal-level TCM hospitals

HS1-HS13 was used to represent 13 municipal-level secondary TCM hospitals, and HT1-HT5 represented 5 municipal-level tertiary TCM hospitals. DEA-BCC was conducted for the two data groups, and the results are presented in Table 3.

Table 3.

The relative efficiency value of data envelopment analysis.

Among the secondary hospitals seen in Table 3, five hospitals (38.46%) achieved DEA efficiency, three (23.08%) were weak DEA efficient, and five (38.46%) were inefficient. In tertiary hospitals, three hospitals (40.00%) reached DEA efficiency, while two (40.00%) were weak DEA efficient, and one (20.00%) was inefficient. Meanwhile, the TE value of DEA-inefficient hospitals in tertiary hospitals was greater than 0.9, indicating a marginal invalid state. The DEA efficiency of Level 3 hospitals was essentially the same as Level 2 hospitals.

Seven hospitals (HS2, HS5, HS9, HS11, HS13, HT2 and HT3) were DEA efficient, and the return to scale were constant, implying that the development of these hospitals had entered a stable period. As long as the dynamic balance of input and output was maintained, the stable development of hospitals could be guaranteed. The DEA results of five hospitals (HS8, HS10, HS12, HT1, and HT4) were weakly efficient, and their PTE was efficient. Still, SE was inefficient, indicating that the hospitals’ health service and medical technology levels were compatible. Four hospitals (HS8, HS10, HT1, and HT4) had decreasing SE, and one (HS12) had increasing SE. The overall operation scale was too large or too small, resulting in weak DEA efficient. Still, all inputs should be reduced or expanded equally to change the scale efficiency from weak efficient to efficient in order to achieve DEA efficiency. Six hospitals (HS1, HS3, HS4, HS6, HS7, and HT5) were DEA inefficient, with no economies of scale. Among them, the return on scale of two hospitals (HS3 and HS4) increased, whereas the return on scale of four hospitals (HS1, HS6, HS7, and HT5) decreased. In secondary hospitals, the lowest TE and PTE were observed in HS3 (0.271, 0.335), and the lowest SE was observed in HS6 (0.696). Among tertiary hospitals, the lowest TE was HT5 (0.573). The PTE of all tertiary hospitals were efficient except HT5 (0.632), and the lowest SE was in HT1 (0.795).

From 2017 to 2019, the average value of TE, PTE and SE in secondary hospitals was 0.812, 0.887 and 0.908, respectively. In tertiary hospitals, the average TE, PTE and SE was 0.868, 0.926 and 0.935 respectively (Table 4). TE, PTE and SE in secondary hospitals increased by 6.90%, 2.48% and 4.41%, respectively, and TE, PTE and SE in tertiary hospitals increased by 15.21%, 7.99% and 6.95%, respectively. The growth rate of tertiary hospitals was significantly faster than that of secondary hospitals. Comparing the efficiency values of different hospital levels, the difference of PTE was statistically significant (P<0.05), and there was no significant difference in the other two items (P>0.05).

Table 4.

The data envelopment analysis average efficiency value with different level of hospitals.

The impact of TE validity on inputs and outputs

The 18 hospitals were divided into two groups according to whether TE was efficient, and Manny-Whitney test was conducted, as shown in Table 5. There was a statistically significant difference in total area of hospitals between the TE efficient group and TE inefficient group (P<0.05) in secondary hospitals. The other variables were not statistically significant (P>0.05) in secondary hospitals. There were no statistical differences in the variables between TE validity group and TE invalidity group in tertiary hospitals (P>0.05), except for the total number of outpatients (P<0.05).

Table 5.

The impact of data envelopment analysis validity on inputs and outputs (x¯ ±s).

Discussion

In this study, a comparative analysis of municipal-level TCM hospitals efficiency in post-reform revealed the efficiency of an implementing graded diagnosis and treatment policy in Gansu Province. Indeed, significant progress has been made in medical and health services of municipal TCM hospitals in Gansu Province. The results confirmed that all medical institution resources, such as the number of personnel, number of beds, hospital area, hospital income, and number of out and inpatients in secondary or tertiary municipal-level TCM hospitals, showed an upward trend, consistent with other studies.22,49 Due to the different functional positioning and numbers of secondary and tertiary hospitals in Gansu province, the impact of policy implementation on them will be more or less different. The number of beds and hospital area growth of tertiary hospitals were lower than those of secondary hospitals from 2017 to 2019, which may be related to more support of the graded diagnosis and treatment policy to low-grade hospitals.9,49 Given the results, managers of secondary hospitals should pay more attention to adopting the corresponding policies and measures which could improve efficiency compared to tertiary hospitals.

In addition, five (38.46%) secondary hospitals and three (23.08%) tertiary hospitals achieved DEA efficiency, whereas the remaining 10 hospitals were DEA inefficient. These results are consistent with a study conducted in Ghana that found 24% of hospitals were VRS technically efficient. 50 Another study conducted in China found that 71.4% of the urban hospitals in Guangxi were relatively inefficient. 51 Tertiary hospitals have a higher level of development than secondary hospitals, consistent with the results of a study in Taiwan. 13 Although Gansu Province has issued a series of graded diagnosis and treatment policies to support primary medical institutions and encourage medical personnel to work in primary level hospitals in recent years, there is still a trend of the slow development of basic hospitals.9,49 However, owing to poor conditions, low wages and poor development prospects of primary-level hospitals, medical personnel are reluctant to work in basic hospitals and prefer to go to high-level hospitals. For example, the minimum TE value in one secondary hospital was 0.273, the PTE value in this hospital was 0.355 and SE value was 0.811, indicating that the scale level of this hospital was good; The low efficiency was caused by the outdated technology. This hospital was located in ethnic minority area. The hospital’s overall efficiency was low because of economic backwardness, lack of medical personnel, severely inefficient technical level, and health resource waste. As an economically underdeveloped area, Gansu’s medical technology development lags behind economically developed areas. There are significant differences in economic and medical levels among different regions of the province due to different geographical locations. Second, the national policy of emphasizing western medicine and neglecting TCM has led to a deterioration in the development of TCM hospitals in Gansu Province. The state has recently emphasized the importance of developing and using TCM. As the main provider of TCM, TCM hospitals should use this opportunity to promote the efficient development of hospitals. This can be done by improving management efficiency, optimizing hospital operation scale, improving medical resource utilization efficiency, 37 and completely converting the existing medical resource input into output.

Comparing DEA scores with other regions in China and other countries can explain the development of medical and health resources in different regions to some extent. According to above results, the average of TE scores was 0.828, the average of PTE scores was 0.898, and the average of SE scores was 0.916 for the municipal TCM hospitals in Gansu Province from 2017 to 2019. These showed increasing trends, indicating that the implementation of graded diagnosis and treatment policy have played a significant role in improving the relative efficiencies of public hospitals. This demonstrates the feasibility and effectiveness of the public hospital reform policy. 22 However, the TE values of municipal TCM hospitals in Gansu Province were lower than those of other provinces. For example, from 2010 to 2014, the average TE values of public hospitals in Xinjiang were 1.000, 0.852, 0.953, 0.973 and 1.000, respectively; the average pure technical efficiency values were 1.000, 0.883, 0.970, 0.974 and 1.000, respectively; and the average SE values were 1.000, 0.966, 0.982, 0.999 and 1.000 respectively. 52 In 2012, the average TE, PTE and SE values of public hospitals in Tianjin were 0.893, 0.909 and 0.979, respectively. 53 The mean TE scores for Gansu Province are still higher than those for the Spanish region of Extremadura (0.833), 54 South Korea (0.886), Oman (0.692) and all of China (0.806). 55 The difference in PTE between secondary hospitals and tertiary hospitals was statistically significant. It can be considered that the difference in efficiency between secondary hospitals and tertiary hospitals mainly came from the difference in the management level of hospital managers and the technical level of doctors. Over the three years, the personnel growth rate of secondary hospitals (25.88%) was less than that of tertiary hospitals (31.98%). There are three main reasons for this result as follows. First, Gansu is located in the northwest of China, which has a relatively backward economy, inconvenient transportation and few training opportunities. Second, the diseases of graded diagnosis and treatment are mainly diseases treated by western medicine. There are few diseases treated by traditional Chinese medicine, which affects the total number of patients in the TCM hospital and reduces the opportunities for doctors to practice. Finally, Gansu has a large area and small population. Its population density is much lower than the economically developed areas of China, so the demand for health services declines. The technical difference is the difference of technological proficiency of medical personnel, and the technical progress of medical personnel comes from continuous practice and training. First, we should increase the opportunities for medical personnel to study in economically developed areas to develop their proficiency. Second, the graded diagnosis and treatment policy should increase the number of medical items and characteristic diseases treated by TCM. Third, the government should develop a regional economy, improve living standards, and pay more attention to personal health. Finally, hospitals can make full use of medical resources, improve the proficiency of medical staff, and enable operational efficiency.

There was a statistically significant difference in the total hospital area between the TE efficient and inefficient groups (P<0.05). It can be considered that the hospital area of TE-efficient group was larger than that of TE-inefficient group in secondary hospitals. As China’s policy is that the land belongs to the state, it is difficult for TE-inefficient hospitals to achieve TE efficient by increasing area investment. Other inputs can only be reduced in equal proportion to achieve TE validity. There was a statistically significant difference in the number of outpatient visits to tertiary hospitals (P<0.05). Since China’s current medical insurance policy reimburses hospitalization expenses more than outpatient expenses, many patients who could have been treated in outpatient care prefer hospitalization. This wastes limited medical resources, increases doctors’ work burden, and can result in inefficient hospital outputs. 19 Outpatient medical resources were not effectively utilized, while the inpatient medical resources were overloaded, resulting in scale efficiency (SE) inefficient of all medical resources in the hospitals. The government departments should reform the existing medical insurance policy, balance the proportion of outpatient reimbursement and inpatient reimbursement, and adopt the combination of single disease reimbursement and reimbursement according to the proportion of medical expenses.

Furthermore, the graded diagnosis and treatment policy should be divided into two types: diseases treated in outpatient and diseases treated in inpatient, and moderately control the hospitalization rate of outpatient patients. The relevant policy and measures could allow the outpatient and inpatient hospital resources to be fully utilized to improve the overall scale and efficiency of medical resources and achieve efficiency. Furthermore, the above advices and measures could effectively control the growth of medical expenses to reduce the financial burden on the government, the work burden on hospitals, and the disease burden on patients.

Conclusion

To date, no previous studies have examined the efficiency of municipal-level TCM hospitals after implementing a hierarchical medical treatment policy. Efficiency evaluation is an important part of the new medical reform and is necessary to solve the problem of limited and unbalanced medical resources. 22 Based on municipal TCM hospitals in Gansu Province panel data from 2017 to 2019, this study measured the TE, PTE and SE of municipal TCM hospitals by using the DEA-BCC model index. Furthermore, the differences of variables between TE efficient group and TE inefficient group were studied to find out the factors that affect TE efficient. From 2017 to 2019, the total amount of health resources in municipal TCM hospitals in Gansu Province increased steadily, and the overall equity of health care resource allocation was good. The validity of inputs and outputs of basic medical resources was more efficient in 2019 than in 2017. However, there were still great differences in regions between the TCM hospitals of Gansu Province.

Improving efficiency may be the best way to reduce hospital costs. 36 By 2019, all tertiary hospitals had achieved effective utilization of medical resources, which is efficient in DEA. However, six secondary hospitals (46.15%) are still in a weak efficient or inefficient state, so the inputs of health resources have not been fully utilized. Going forward, the government should address the problem of health resource utilization and strive to narrow the gap in the utilization efficiency of medical resources in different regions. 56

The graded diagnosis and treatment policy of Gansu Province are similar to the other parts of China, but there are great regional differences in health resources in Gansu Province and other Provinces.57,58 With the deepening of the graded diagnosis and treatment policy, the number of outpatients and inpatients in municipal hospitals will continue to increase over the next few years. Hospitals face an urgent need for transformation, development and efficiency improvement. In addition to supporting corresponding hardware facilities, hospital administrators should improve the working conditions of medical personnel, hire high-level medical personnel, pay attention to the introduction and training of professional and technical staff, 59 and improve management ability. These measures will improve technological capability and management ability.

Furthermore, this study suggests that the indicators and variables of other hospitals in Gansu Province should be extended according to different periods of graded diagnosis and treatment policy to further investigate the differences and determinants of TCM efficiency in hospitals in Gansu Province. Further research on TCM hospitals in other regions is needed to better understand the efficiency of TCM hospitals in China.

Limitations

This study has several limitations. First, hospitals were only evaluated over three years. Eighteen municipal TCM hospitals were evaluated after implementing the graded diagnosis and treatment policy. This reduced the stability and robustness of the evaluation results to some extent, and the study design still needs to be optimized. Second, the efficiency of municipal TCM hospitals may be affected by environmental factors, such as population composition, e.g., populations above the age of 65 or under the age of 15, local economic level, and health service cost. Finally, the selected variables may not be perfect, as the staff was not subdivided into doctors, nurses, and other personnel. However, despite its limitations, this study can be considered a useful preliminary study to explore the efficiency of municipal-level TCM hospitals using DEA.

Acknowledgments

The authors thank TCM monitoring and direct reporting network and all hospitals which supplied the datum. We would like to thank Editage (www.editage.com) for English language editing.

Footnotes

Author Contributions: Yuanyuan Li and Xixin Niu drafted the first version of the manuscript.

Wei Zhou and Jun Tian collected, processed and normalized the data.

Yuanyuan Li and Xixin Niu analyzed the data and interpreting the data.

Yuanyuan Li and Yongqiang Zhao revised the manuscript.

Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding: This work was supported by Traditional Chinese Medicine Research Project of Gansu Province. (No: GZKP-2020-15) and Lanzhou Science and Technology Development Guiding Plan Project(No:2020-ZD-44).

References

1. Huang J, Dai T. Public hospital reforms in China: the perspective of hospital directors. BMC Health Serv Res. 2019;19:142. [PMC free article] [PubMed] [Google Scholar]

8. Kirigia JM, Emrouznejad A, Cassoma B, Asbu EZ, Barry S. A performance assessment method for hospitals: the case of municipal-level hospitals in Angola. J Med Syst. 2008;32(6):509-519. [PubMed] [Google Scholar]

9. Wang X, Luo H, Qin X, Feng J, Gao H, Feng Q. Evaluation of performance and impacts of maternal and child health hospital services using Data Envelopment Analysis in Guangxi Zhuang Autonomous Region, China: a comparison study among poverty and non-poverty county level hospitals. Int J Equity Health. 2016;15(1):131. [PMC free article] [PubMed] [Google Scholar]

10. Rosko M, Al-Amin M, Tavakoli M. Efficiency and profitability in US not-for-profit hospitals. Int J Health Econ Manag. 2020;20(4):359-379. [PMC free article] [PubMed] [Google Scholar]

11. Ravaghi H, Afshari M, Isfahani P, Bélorgeot VD. A systematic review on hospital inefficiency in the Eastern Mediterranean Region: sources and solutions [published correction appears in. BMC Health Serv Res. 2019;19(1):948. [PMC free article] [PubMed] [Google Scholar]

12. Jiang S, Min R, Fang PQ. The impact of healthcare reform on the efficiency of public county hospitals in China. BMC Health Serv Res. 2017;17(1):838. [PMC free article] [PubMed] [Google Scholar]

13. Lin CS, Chiu CM, Huang YC, Lang HC, Chen MS. Evaluating the Operational Efficiency and Quality of Tertiary Hospitals in Taiwan: The Application of the EBITDA Indicator to the DEA Method and TOBIT Regression. Healthcare (Basel). 2021;10(1):58. [PMC free article] [PubMed] [Google Scholar]

14. Jing R, Xu T, Lai X, Mahmoudi E, Fang H. Technical Efficiency of Public and Private Hospitals in Beijing, China: A Comparative Study. Int J Environ Res Public Health. 2019;17(1):82. [PMC free article] [PubMed] [Google Scholar]

15. Li B, Mohiuddin M, Liu Q. Determinants and Differences of Township Hospital Efficiency among Chinese Provinces. Int J Environ Res Public Health. 2019;16(9):1601. [PMC free article] [PubMed] [Google Scholar]

16. Zhong J, Wang W, Wang H, et al. Distribution and determinants of hospital efficiency and relative productivity in county-level hospitals in rural China: an observational study. BMJ Open. 2021;11(7):e042326. [PMC free article] [PubMed] [Google Scholar]

17. Sherman HD. Hospital efficiency measurement and evaluation. Empirical test of a new technique. Med Care. 1984;22(10):922-938. [PubMed] [Google Scholar]

18. Kohl S, Schoenfelder J, Fügener A, Brunner JO. The use of Data Envelopment Analysis (DEA) in healthcare with a focus on hospitals. Health Care Manag Sci. 2019;22(2):245-286. [PubMed] [Google Scholar]

19. Sultan WIM, Crispim J. Measuring the efficiency of Palestinian public hospitals during 2010-2015: an application of a two-stage DEA method. BMC Health Serv Res. 2018;18(1):381. [PMC free article] [PubMed] [Google Scholar]

20. Chen Z, Chen X, Gan X, Bai K, Baležentis T, Cui L. Technical Efficiency of Regional Public Hospitals in China Based on the Three-Stage DEA. Int J Environ Res Public Health. 2020;17(24):9383. [PMC free article] [PubMed] [Google Scholar]

21. Pirani N, Zahiri M, Engali KA, Torabipour A. Hospital Efficiency Measurement Before and After Health Sector Evolution Plan in Southwest of Iran: a DEA-Panel Data Study. Acta Inform Med. 2018;26(2):106-110. [PMC free article] [PubMed] [Google Scholar]

22. Zheng W, Sun H, Zhang P, Zhou G, Jin Q, Lu X. A four-stage DEA-based efficiency evaluation of public hospitals in China after the implementation of new medical reforms. PLoS One. 2018;13(10):e0203780. [PMC free article] [PubMed] [Google Scholar]

23. Ibrahim MD, Daneshvar S. Efficiency Analysis of Healthcare System in Lebanon Using Modified Data Envelopment Analysis. J Healthc Eng. 2018;2018:2060138. [PMC free article] [PubMed] [Google Scholar]

24. Ren W, Fu X, Tarimo CS, Kasanga M, Wang Y, Wu J. The scale and structure of government financial investment in traditional medicine based on optimal efficiency: evidence from public traditional Chinese medicine hospitals (PTHs) of Henan province, China. BMC Health Serv Res. 2021;21(1):182. [PMC free article] [PubMed] [Google Scholar]

25. Li NN, Wang CH, Ni H, Wang H. Efficiency and Productivity of County-level Public Hospitals Based on the Data Envelopment Analysis Model and Malmquist Index in Anhui, China. Chin Med J (Engl). 2017;130(23):2836-2843. [PMC free article] [PubMed] [Google Scholar]

26. Rosko MD. Measuring technical efficiency in health care organizations. J Med Syst. 1990;14(5):307-322. [PubMed] [Google Scholar]

27. Sun J, Luo H. Evaluation on equality and efficiency of health resources allocation and health services utilization in China. Int J Equity Health. 2017;16(1):127. [PMC free article] [PubMed] [Google Scholar]

28. Zhang T, Lu W, Tao H. Efficiency of health resource utilization in primary-level maternal and child health hospitals in Shanxi Province, China: a bootstrapping data envelopment analysis and truncated regression approach. BMC Health Serv Res. 2020;20(1):179. [PMC free article] [PubMed] [Google Scholar]

29. Charnes A, Cooper WW, Rhodes E. Measuring the efficiency of decision-making units. Eur J Oper Res. 1978;2:429-444. [Google Scholar]

30. Banker RD, Charnes A, Cooper WW. Some models for estimating technical and scale inefficiencies in data envelopment analysis. Manag Sci. 1984;30:1078-1092. [Google Scholar]

31. Osei D, d'Almeida S, George MO, Kirigia JM, Mensah AO, Kainyu LH. Technical efficiency of public district hospitals and health centres in Ghana: a pilot study. Cost Eff ResourAlloc. 2005;3:9. [PMC free article] [PubMed] [Google Scholar]

32. Ahmed S, Hasan MZ, Laokri S, et al. Technical efficiency of public district hospitals in Bangladesh: a data envelopment analysis. Cost Eff ResourAlloc. 2019;17:15. [PMC free article] [PubMed] [Google Scholar]

33. Cooper W, Seiford L, Tone K. Data Envelopment Analysis a Comprehensive Text with Models, Applications,References and Dea-Solver Software. Berlin/Heidelberg, Germany: Springer; 2007. [Google Scholar]

34. Dong F, Featherstone A. Technical and Scale Efficiencies for Chinese Rural Credit Cooperatives: A Bootstrapping Approach in Data Envelopment Analysis. Center for Agricultural and Rural Development (CARD) Publications; 2004. [Google Scholar]

35. Varabyova Y, Schreyögg J. International comparisons of the technical efficiency of the hospital sector: panel data analysis of OECD countries using parametric and non-parametric approaches. Health Policy. 2013;112(1-2):70-79. [PubMed] [Google Scholar]

36. Kirigia JM, Asbu EZ. Technical and scale efficiency of public community hospitals in Eritrea: an exploratory study. Health Econ Rev. 2013;3(1):6. [PMC free article] [PubMed] [Google Scholar]

37. Mehrtak M, Yusefzadeh H, Jaafaripooyan E. Pabon Lasso and Data Envelopment Analysis: a complementary approach to hospital performance measurement. Glob J Health Sci. 2014;6(4):107-116. [PMC free article] [PubMed] [Google Scholar]

38. Gok MS, Sezen B. Analyzing the ambiguous relationship between efficiency, quality and patient satisfaction in healthcare services: the case of public hospitals in Turkey. Health Policy. 2013;111(3):290-300. [PubMed] [Google Scholar]

39. Jat TR, Sebastian MS. Technical efficiency of public district hospitals in Madhya Pradesh, India: a data envelopment analysis. Glob Health Action. 2013;6:21742-21748. [PMC free article] [PubMed] [Google Scholar]

40. Chen KC, Chen HM, Chien LN, Yu MM. Productivity growth and quality changes of hospitals in Taiwan: does ownership matter? Health Care Manag Sci. 2019;22(3):451-461. [PubMed] [Google Scholar]

41. Hsiao B, Chen LH, Wu HT. Assessing performance of Taiwan hospitals using data envelopment analysis: In view of ownership. Int J Health Plann Manage. 2019;34(1):e602-e616. [PubMed] [Google Scholar]

42. Kreng VB, Yang SW, Lin CH. Measuring health care efficiency with a tripartite configuration under the "National" Health Insurance system. Chin Med J (Engl). 2014;127(9):1633-1639. [PubMed] [Google Scholar]

43. Li H, Dong S, Liu T. Relative efficiency and productivity: a preliminary exploration of public hospitals in Beijing, China. BMC Health Serv Res. 2014;14:158. [PMC free article] [PubMed] [Google Scholar]

44. Wei X, Meng QY. Study on the efficiency of 160 Social Hospitals in China. Chinese Health Economics. 2017;36(06):82-86. [Google Scholar]

45. Hu HH, Qi Q, Yang CH. Analysis of hospital technical efficiency in China: Effect of health insurance reform. China Econ. China Economic Review. 2012;23:865-877. [Google Scholar]

46. Li RC, Tangsoc JC, See SL, Cantor VJM, Tan MLL, Yu RJS. A DEA-based Performance Measurement Mathematical Model and Software Application System Applied to Public Hospitals in the Philippines. DLSU Bus. Econ. Rev. 2016;25:166-196. [Google Scholar]

47. Barnum DT, Walton SM, Shields KL, Schumock GT. Measuring Hospital Efficiency with Data Envelopment Analysis: Nonsubstitutable vs. Substitutable Inputs and Outputs. J.Med. Syst. 2011;35:1393-1401. [PubMed] [Google Scholar]

48. Sun B, Zhang L, Yang W, Zhang J, Luo D, Han C. Data envelopment analysis on evaluating the efficiency of public hospitals in Tianjin, China. Trans. Tianjin Univ. 2016;22:182-188. [Google Scholar]

49. Li Q, Wei J, Jiang F, et al. Equity and efficiency of health care resource allocation in Jiangsu Province, China. Int J Equity Health. 2020;19(1):211. [PMC free article] [PubMed] [Google Scholar]

50. Jehu-Appiah C, Sekidde S, Adjuik M, et al. Ownership and technical efficiency of hospitals: evidence from Ghana using data envelopment analysis. Cost Eff ResourAlloc. 2014;12(1):9. [PMC free article] [PubMed] [Google Scholar]

51. Wang SH. Analysis of the efficiency of the municipal maternal and child health centers in Guangdong Province. Medicine and Society. 2015;07:10-12. [Google Scholar]

52. Liu DM, Wang JS, Wang QJ. Efficiency evaluation of general hospitals of second level or above in Binghai new area of TianJin. Modern Hospital. 2014;14:6-9. [Google Scholar]

53. Zhang H, Zhao L, Liu Q, Zhang XY, Zhang Y, Wang YG. The combination analysis on the efficiency of health resource allocation by DEA and SFA in China.2016;32(9):1195-1197. [Google Scholar]

54. Cordero Ferrera JM, Crespo Cebada E, Murillo Zamorano LR. The effect of quality and socio-demographic variables on efficiency measures in primary health care. Eur J Health Econ. 2014;15(3):289-302. [PubMed] [Google Scholar]

55. Allin S, Veillard J, Wang L, Grignon M. How can health system efficiency be improved in Canada? Healthc Policy. 2015;11(1):33-45. [PMC free article] [PubMed] [Google Scholar]

56. Cao J, Liu JB, Wang L. Evaluation of operational efficiency of county public hospitals in Xinjiang. Journal of Xinjiang Medical University. 2016;6:772-774. [Google Scholar]

57. Jin J, Wang J, Ma X, Wang Y, Li R. Equality of medical health resource allocation in china based on the gini coefficient method. Iran J Public Health. 2015;44(4):445-457. [PMC free article] [PubMed] [Google Scholar]

58. Wang Y, Li Y, Qin S, et al. The disequilibrium in the distribution of the primary health workforce among eight economic regions and between rural and urban areas in China. Int J Equity Health. 2020;19(1):28. [PMC free article] [PubMed] [Google Scholar]

59. Vitaliano DF. On the estimation of hospital cost functions. J Health Econ. 1987;6(4):305-318. [PubMed] [Google Scholar]

Articles from Inquiry: A Journal of Medical Care Organization, Provision and Financing are provided here courtesy of SAGE Publications