Article Text

Original research
Evaluating the decentralisation of the Spanish healthcare system: a data envelopment analysis approach
  1. Tamara Armenteros-Ruiz1,
  2. Alejandro Ballesteros-Ron1,
  3. Moisés Rodriguez-Mañero2,
  4. Francisco Reyes-Santías3,4
  1. 1Universidade de Santiago de Compostela Facultade de Ciencias Economicas e Empresariais, Santiago de Compostela, Spain
  2. 2Cardiology, Hospital Universitario de Santiago, Santiago de Compostela, Spain
  3. 3Organización de Empresas e Mercadotecnia, Universidad de Vigo, Ourense, Spain
  4. 4Hospital Clínico Santiago, Servicio Galego de Saude, Santiago de Compostela, Spain
  1. Correspondence to Francisco Reyes-Santías; francisco.reyes{at}uvigo.es

Abstract

Objectives The aim of the study was to answer whether the central government has been more efficient than the regional governments or vice versa. Likewise, through the analysis of the data, the aim was to shed light on whether decentralisation has had a positive impact on the efficiency of the hospital sector or not.

Design In this paper, we have used data envelopment analysis to analyse the evolution of efficiency in the last 10 Autonomous Regions to receive healthcare competences at the end of 2001.

Participants For this study, we have taken into account the number of beds and full-time workers as inputs and the calculation of basic care units as outputs to measure the efficiency of the Spanish public sector, private sector and jointly in the years 2002, 2007, 2012 and 2017 for the last Autonomous Regions receiving healthcare competences.

Results Of the Autonomous Regions that received the transfers at the end of 2001, the following stand out for their higher efficiency growth: the Balearic Islands (81.44% improvement), the Madrid Autonomous Region, which practically reached absolute efficiency levels (having increased by 63.77%), and La Rioja which, together with the Balearic Islands which started from very low values, improved notably (46.13%).

Conclusion In general, it can be observed that the transfer of responsibilities in the health sector has improved efficiency in the National Health Service.

JEL classification C14; I18; H21.

  • efficiency
  • national health system
  • devolution
  • data envelopment analysis
  • health decentralisation

Data availability statement

Data are available upon reasonable request.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

STRENGTHS AND LIMITATIONS OF THIS STUDY

  • The use of data envelopment analysis (DEA) methods in efficiency research shows comprehensive and practical results.

  • One limitation of this study is not to include health outcomes in the analysis.

  • Using full-time workers as input, regions with a greater weight of part-time staff may overestimate their efficiency results.

  • The use of basic care units as outputs may make it difficult to compare with other studies.

  • There are methodological limitations of DEA, derived from its deterministic character.

Introduction

Spain is a decentralised country in which the Autonomous Communities have the powers to administer and manage certain public services, including health. However, this has not always been the case. To understand the current situation, it is necessary to go back to 1977, the year in which the Ministry of Health and Social Security was created. Months later, by Royal Decree-Law 36/1978, a Social Security Management Entity was created, the National Health Institute, abbreviated as INSALUD, in charge of providing healthcare.1

During the process of political and economic change that took place at that time, the Spanish Transition, the approval of the Constitution in 1978 brought changes related to the decentralisation of powers, including in the area of health. Specifically, Article 43 recognises the right to health protection and Article 148.1.21 recognises health as a competence that can be assumed by the Autonomous Communities, leaving only the State with exclusive competence in external health and the general coordination of health (Article 149.1.16).

The constitution of the communities is carried out at different paces, so there are some that assume the functions and services carried out by INSALUD sooner than others, the process of transfer begins in 1981 and ends at the end of 2001. Thus, first, Catalonia (1981), Andalusia (1984), the Basque Country (1984), the Valencian Community (1987), Galicia (1990), the Community of Navarre (1990) and the Canary Islands (1994) received the competencies.

Meanwhile, Aragon, the Principality of Asturias, the Balearic Islands, Cantabria, Castile-La Mancha, Castile and Leon, Extremadura, La Rioja, the Community of Madrid and the Region of Murcia were under State administration through INSALUD, until they received the transfer of competences. After a long process, at the end of 2001, these last 10 Autonomous Regions received the transfers and by the following year were already administering and managing healthcare in their territory. Thus, INSALUD was liquidated and converted into a smaller entity, the Instituto Nacional de Gestión Sanitaria, abbreviated as INGESA,2 which would continue to administer and manage healthcare in the Autonomous Cities of Ceuta and Melilla.

Therefore, to summarise, our country currently has the National Health System, which brings together the public health networks of the 17 Autonomous Regions, and INGESA, the state administrator and manager of the Autonomous Cities.

Each Autonomous Community carries out the planning, administration and management of the health services in its territory, following the guidelines set out in the LGS (General Health Act), but with variability in terms of the portfolio of services for its citizens, while respecting the basic levels cited in Law 14/1986, LGS. The autonomous communities’ highest health management body is the Regional Ministry of Health, which is responsible for setting up a Health Service (from the point of view of both the service provider and the service funder), made up of outpatient centres (primary healthcare centres) and hospitals that provide the services planned in the autonomous community’s service portfolio. Each Autonomous Community divides the territory into Health Areas, which are the Basic Geographical and Functional Units of healthcare, each health area being autonomous and able to establish its own specific health plans and adapt resources to the needs of the population concerned. These health areas, provided for in the LGS, are created to cover approximately 200 000 inhabitants, with at least one Tertiary Hospital Centre and different Health Centres, approximately one for every 20 000 inhabitants.

The universal nature of our public healthcare system necessarily means that it is not linked to citizens’ ability to pay, unlike other types of contributory benefits offered by the Social Security System, which are directly affected by the social contributions made by the system’s potential beneficiaries. Consequently, as healthcare is treated as a unremarkable benefit of the social security system, its main source of financing is the transfers made by the corresponding public administrations (State, Autonomous Communities or Local Corporations), which come mainly from public sector tax revenues.

The decentralisation of the health system carried out in Spain is not an isolated event; other countries such as Italy, the UK, Portugal, the Philippines, etc, have also done so.3 4 These types of reforms have given rise to a debate in the literature about who plays a better role in managing healthcare: the state or the territories that make it up? In other words, in terms of the welfare and efficiency of the population, what is more favourable: a centralised or decentralised healthcare system?.

Numerous studies3–6 discuss the direct consequences that accompany health decentralisation, as well as its advantages and disadvantages.

The mere definition of the concept of decentralisation generates different positions and approaches that often complicate rather than facilitate the analysis7 8 defines decentralisation as ‘the transfer of planning, management and collection responsibilities and allocation of resources from the central government and its agencies to territorial units’ as well as Delegation as the transfer of decision-making and administrative power—including financial responsibilities —over public functions to autonomous organisations.9 10 It is the latter concept that best fits the decentralisation process that has taken place in the Spanish national health system.

Privatisation, on the other hand, would be the policy of having services provided by businesses, community groups, co-operatives, private voluntary associations, individuals, small informal enterprises and other non-governmental organisations. For this author, privatisation ranges from leaving the provision of goods and services entirely to economic competition to ‘partnerships’ between public agencies and private enterprises.11

Decentralisation is generally considered to improve efficiency in healthcare and influence healthcare by bringing governance closer to the population, allowing for feedback.5 It also fosters competition between territories that try to stand out and proceed in the best possible way, most of the time leading to increased spending, which is often accompanied by improved health outcomes.3 12 In that sense, it should take in account that, although Tiebout13 argued in his famous article that citizens ‘vote with their feet’ and choose the jurisdiction that offers them the best range of services, it is debatable whether citizen mobility is as typical in Europe as it is in the USA.14 While mobility enhances the benefits of decentralisation, it is not entirely dependent on it. Even in the absence of mobility, the efficient provision of a local public good is determined by the condition that the sum of marginal costs of substitution equals marginal costs, and this condition tends to vary across territories.15

However, when decision-makers increase spending, this can result in increased costs due to: duplication of inputs, where two neighbouring regions may share similar services; diseconomies of scale or even moral hazard, as they expect their debts to be covered by the central government.3

The aim of the study was to answer whether the central government has been more efficient than the regional governments or vice versa. Likewise, through the analysis of the data, the aim was to shed light on whether decentralisation has had a positive impact on the efficiency of the hospital sector or not.

Methodology and data

Variables used

We understand Devolution as the creation or reinforcement of levels of government lower than the state, to which broader responsibilities than the simply administrative ones are attributed for the development of certain functions, which is the case in Spain.10

In this paper, performance improvement means improving the efficiency (or productivity) of public services.16 In measuring performance, a distinction can be made between technical efficiency (‘doing more with less’) and allocative efficiency (‘doing the right thing in the right place’).

Technical efficiency describes a production process in which maximum output is achieved when inputs are fixed and technology is fixed. Allocative efficiency refers to the allocation of resources (finance, labour or physical capital) and is achieved when the combination of inputs and outputs is cost-minimising and/or profit-maximising.17 18

The concept of technical efficiency is similar to the concept of productivity. Productivity is usually defined as the ratio between the quantity of output and the quantity of inputs used. Productivity is much easier to calculate when the production unit analysed uses an input to produce a product. If a production unit uses several inputs to produce several outputs, inputs and outputs must be combined19 (as we have done with the calculation of the basic care units (BAU)).

In contrast to efficiency, which is the relationship between outcomes and inputs, effectiveness is the relationship between defined outcomes and defined inputs and depends on service quality.20

This paper has proposed the measurement of technical efficiency, understood as productivity.

The information on the variables used has been compiled from the Spanish Ministry of Health database.21–24 The period of analysis is divided into 5 year periods, from 2002, when the last 10 autonomous communities received health competencies and began to operate on their own, to 2017.

In order to examine the evolution of efficiency after the transfer of power, the number of beds and the number of full-time workers have been used as inputs to the model. These data have been chosen because the number of beds installed in hospitals has been used as a proxy variable for the capital factor in recent years in numerous studies.25 When distinguishing between the number of public and private beds, the corresponding percentages indicated in the Ministry’s database have been applied.

Similarly, the number of full-time workers has been used to represent the labour factor. This includes doctors, nurses, Medico Interno Residente (MIR (doctor in training for being consultant)), auxiliary nurses, senior health technicians, other health personnel and non-health personnel. As in the previous case, due to the need to compare the results of the public sector versus the private sector, after reviewing numerous official state documents26–29 over the last 20 years, there has been a trend in the sector indicating that eight out of every 10 workers belong to the public hospital network. Therefore, to the total number of full-time employees, we have applied a percentage of 80% to obtain the number of public workers, conversely 20% has been applied to find the figures for the private sector.

On the output side, the BAU, one of the first measures of hospital consumption, were taken into account. To calculate this index, a series of weightings were taken into account with respect to the variables that comprise it: 1 BAU=stays; 0.5 BAU=first consultations; 0.25 BAU=successive consultations and, finally, 0.5 BAU=non-admitted emergencies.30 For the calculation of non-admitted emergencies and number of stays financed by the public sector, since the corresponding percentages for 2002 are not explicit, the following data are taken into account: ‘Paid by Social Security’, ‘Paid by Companies collaborating with the SS’, ‘Paid by other Public Entities’, ‘Paid by Civil Servants’ Mutual Societies’ and ‘Others’.22 It should also be mentioned that, for the calculation of first consultations, in the absence of specific data by autonomous community, the average percentage corresponding to first consultations with respect to total consultations was used in 2012 and 2017.23 24

Data envelopment analysis (DEA)

Data envelopment analysis, known as DEA, is a non-parametric frontier method used to measure the efficiency of each organisation or organisational unit (decision-making units), which in this case corresponds to the Comunidades Autonomas (CAACs (Autonomous Regions)) analysed, by solving a linear programming problem31 for each unit under the assumption, in this study, of Constant Returns to Scale:

Embedded Image

Embedded Image

Embedded Image

Embedded Image

where y_rj is the quantity of output r produced by the hospitals of Autronomous Region (AC) j; x_ij the quantity of input i used by the hospitals of AC j; u_r the weight given to output r, (r=1, … t, where t is the number of outputs); v_i the weight given to input i, (where as in the previous case i=1, … m, where m is the number of inputs); j_0 AC under evaluation. Therefore, a CAAC is on the efficiency frontier if and only if, ∑_(_rˆ)ˆ▒u_r y_(r j0) is equal to unity, that is, it reaches the maximum efficiency levels.

This technique, widely used in the health sector,25 allows measuring several different types of efficiency: technical, allocative congestion and dynamic through the Malmquist index. In addition, it also allows for the observation of possible economies of scale.

In order to carry out the corresponding analysis of technical efficiency in the public, private and joint sector, a series of inputs and an output have been chosen, which have been discussed in greater detail in the previous subsection.

That said, the programme used to apply this analysis technique was DEAFrontier Software for Excel.

Patient and public involvement

No patient involved.

Results

Efficiency in the last 10 Autonomous Regions to receive transfers

Taking unity as the optimum value for efficiency and taking into account both the public and private sectors, it can be seen in table 1 that, in general, the devolved regions have worsened their efficiency since the devolution, with Castile and Leon, Aragon and the Principality of Asturias standing out. Only the Autonomous Community of Madrid improved, reaching maximum efficiency, and La Rioja, increasing its efficiency by a higher relative percentage.

Table 1

Efficiency of the NHS and the private sector in the last 10 autonomous communities to receive healthcare competencies

Unlike the previous case, table 2 only shows the efficiency data relating to the NHS. While the Region of Murcia stands out as the most efficient region throughout the period under study, most of the Autonomous Regions analysed, 60% to be precise, improved efficiency rates (they are closer to 1) after the transfer of competences prior to 2002. The Balearic Islands (36.95%), La Rioja (25.66%) and the Community of Madrid (18.60%) are the regions that have seen the greatest increase in efficiency in the use of available public resources. Only Castile and Leon, the Principality of Asturias and Aragon have worsened.

Only Catilla y León, the Principality of Asturias and Aragón have seen their efficiency decrease (table 3).

Table 2

Efficiency of the last 10 autonomous communities to receive healthcare competencies in hospitals belonging to the NHS

Table 3

Efficiency of the last 10 autonomous communities in receiving healthcare competencies in hospitals belonging to the private sector

In general, the results in this case are more diverse: 50% of the ACs worsen, with Extremadura and Castilla-La Mancha being the worst performers (the latter standing out if we consider the 2007 value); two of them remain constant practically throughout the entire period (Balearic Islands and La Rioja, with the exception of 2007 but then recovering) and the rest improve, with the Principality of Asturias and the Community of Madrid standing out as we have already mentioned, which progresses in such a way that it reaches levels very close to absolute efficiency.

Relative comparison, efficiency of all regions

In online supplemental table 1, it could be seen that Andalusia and Catalonia can be considered as benchmarks for practically the entire period, taking into account the Sistema Nacional de Salud (SNS (National Health System)) alone (by obtaining the index 1.000 in the DEA survey). First, the Region of Murcia, which managed to become a benchmark Autonomous Region with its optimal efficiency values, has improved significantly with respect to the other Autonomous Regions that received the transfers before 2002. Of the Autonomous Regions that received the transfers at the end of 2001, the following stand out for their higher efficiency growth: the Balearic Islands (81.44% improvement), the Madrid Autonomous Region, which practically reached absolute efficiency levels (having increased by 63.77%), and La Rioja which, together with the Balearic Islands which started from very low values, improved notably (46.13%). On the other hand, it is important to mention the reduction in the gap between the most efficient and the least efficient ACs over time. In 2002, the lowest value among the Autonomous Communities was 0.5183, belonging to the Balearic Islands, with respect to 1.000, which implies a difference in efficiency of 0.4817. Over the years, in 2017 this inequality is reduced to 0.7146 in Extremadura and the optimal unit, indicating this time a distance of 0.2854, which translates as a decrease in the differences of almost 40% between the lowest values.

As it could be seen in online supplemental table 2, likewise, we observe that, as a whole, the efficiency of the Autonomous Regions has improved and that after the transfer of competences, the differences in efficiency rates between the regions have been reduced. This is the case of the Balearic Islands, the Canary Islands and Cantabria. As shown in figure 1, in 2017 compared with 2002, the disparities between these three regions are greatly reduced and converge. Both Castillas also manage to reduce their inter-regional differences, with Castilla-La Mancha standing out. The Community of Madrid and the Region of Murcia converge at the same time, becoming in 2017 one of the reference ACs due to their high efficiency values.

Figure 1

Comparison of the efficiency values of the National Health System of all autonomous regions (including Ceuta and Melilla) in 2002 and 2017.

The blue line shows the reference ACs, that is, those with optimal efficiency values, while the dashed red line shows the average efficiency for that year, which is useful for easily visualising which ACs are above (or below) the average. It is interesting to perform the analysis from this perspective, since some regions may have improved their efficiency but worsened in comparison with the rest of the regions, because the latter have improved more, and vice versa. Thus, in the case of the Balearic Islands, which improved its efficiency to a great extent (81.44%, as mentioned above), its efficiency improved with respect to other regions that were relatively far behind it, for example, surpassing the Autonomous Community of Valencia, the Principality of Asturias and Galicia. The Community of Madrid improved its efficiency in 2017 with respect to 2002 by 63.77%, which places it at the top of the table, as shown in online supplemental table 3. On the other hand, although Castilla y León’s efficiency improved by approximately 7%, its relative position compared with the rest of the Autonomous Regions was reduced to the bottom five.

Online supplemental table 4 shows the combined data for the NHS and the private sector, which leads to the following results: on calculating the efficiency values of the 10 Autonomous Regions that received the competences at the end of 2001, with respect to the rest of the regions that already had them, it is found that 70% of them have seen their efficiency worsen. Aragon (−12.53%), the Region of Murcia (−10.70%) and Castile and Leon (−9.75%) stand out. In contrast to online supplemental table 1, the reference Autonomous Community is Catalonia. On the other hand, the Autonomous Region with the greatest improvement in efficiency is La Rioja (8.63%), followed by the Autonomous Region of Madrid (7.12%), which manages to achieve maximum efficiency. In this case, the Balearic Islands improved by only 3.01%, but it starts from higher values, close to 90% efficiency (figure 2).

Figure 2

Comparison of the efficiency values of the NHS and the private sector of all the autonomous regions (including Ceuta and Melilla) in 2002 and 2017. NHS, National Health Service.

Discussion

We are aware that it is difficult in this area to compare the results found with other studies due to the fact that DEA can give different results when the inputs and outputs used are not the same. Moreover, we have used global data from the health sector—in order to be able to draw conclusions, not only in the public sector (NHS), but also in the private sector and jointly, on the effects of decentralisation in the Spanish health sector—while in many other studies, a specific selection of hospitals has been carried out.32–34

As far as the public sector is concerned, our results show that most of the Autonomous Regions that were the last to receive health transfers improved their efficiency levels to their highest values between 2007 and 2012. However, if we consider the comparison of these regions as a whole, the highest figures are found in 2012. We believe that this behaviour is possible due to the positive impact of the incorporation of new management models and changes in the organisational structure of those Autonomous Regions that received the transfer of competences at the end of 2001, coinciding with the authors Granado Cabello and Vega Hidalgo.32 However, other authors such as Sbert and Gómez Vicens34 do not agree with this explanation, as they believe that, after the transfers, there is a period of adaptation that leads to an increase in costs and resources that are detrimental to productivity levels.

That said, it should be stressed that the introduction of these changes does not fully explain the increase in efficiency in the Autonomous Regions studied, as there are other socioeconomic factors that may influence efficiency. It is also necessary to question why, as we have seen, some regions do not improve as much as others. Despite the fact that, following decentralisation, the efficiency of the NHS improves in general—in its entirety if we compare all the Autonomous Regions as a whole—those territories that are less efficient may be due to factors such as ageing, geographical dispersion, wealth or the public spending policies of each region, among other variables. In this sense, we agree with Pérez-Romero, Ortega-Díaz, Ocaña-Riola and Martín-Martín.33

Despite these differences, it should be stressed that after the transfer of competences in the public health sector, there has been a positive impact which has led to a reduction in the gap between the most efficient and least efficient Autonomous Regions in Spain. Over the 15 years observed, the gap between Autonomous Regions has narrowed by approximately 40%. In view of this improvement, however, we would like to focus on two aspects relating to the private sector and waiting lists.

On the one hand, the data provided by the Ministry show that over the years, following the transfers, public provision has not only become more efficient, but has also increased with respect to private provision, even in regions where the private sector is very efficient. The case of the Community of Madrid stands out, which, despite the strong presence of the private sector, has increasingly increased the supply of public services. On the other hand, there is also the case of La Rioja, a territory in which the Private Sector is very efficient and yet the importance of public activities is increasing. In other words, we find that the evolution of public activity is increasing, except in the case of the Balearic Islands, where its weight is increasing in relation to the private sector. This can also be seen in the decrease in spending on concerts in a large part of the Autonomous Regions, as indicated by IDIS.35

Therefore, we can say that the transfers have boosted the public sector even in those Autonomous Regions with a strong presence of private activity, even if this is efficient. We believe that this trend may have a negative impact on citizens in the future because, with a permanent increase in health spending, not only in Spain but in other countries as well—derived from demographic factors, such as ageing, which affects Western Europe in particular, as pointed out by Jakovljevic et al,36 or cultural factors such as the desire for greater welfare—the public health system may be limited by the need for a larger budget and greater flexibility. Authors such as Kosycarz et al,37 propose a similar approach to improving public hospitals in Poland through public–private partnerships.

Moreover, these results can be explained by the behaviour of which, in most of the regions, the private sector has a negative influence on the data as a whole (it dragged down the positive results achieved by the Public Sector), because efficiency levels are lower than before devolution, contrary to the results of public hospitals alone. This inefficiency in some Autonomous Regions is probably due to the fact that the private sector in these regions was not market developed and depended to a greater extent on INSALUD (National Institute for Health—the public manager under the Ministry of Health of the Central Government, prior to the devolution). The Balearic Islands stand out for having the highest efficiency during the whole period considered, possibly due to their previous experience, as before the transfer of the competences, Balearic Islands already had a significant weight of the private sector in the healthcare system. Its case could be compared with that of Catalonia, both of which are similar in terms of the significant weight of the private sector in healthcare, which had already been reflected for many years.38

In that sense, Kruse et al,39 in a study of five European countries, present evidence that public hospitals have at least the same level of efficiency or more than private hospitals. Likewise, in a comparative study by Comendeiro-Maaløe et al40 of the performance of a private hospital in Spain and a private hospital licensed as a regional health service, the private hospital generally did not perform better than the public hospitals, although it did excel in some areas. However, according to Lucifora,41 managers of public hospitals often perform worse than managers of private hospitals. In the same sense, Perez-Romero et al.33

All of this is directly related to the problem of waiting lists. In particular, there are two cases in which the Autonomous Regions with the highest waiting list figures should increase their productivity by improving the management of their public sector, that is, Extremadura, Castile-La Mancha and Aragon. In the cases of the Region of Murcia or Cantabria, where their public sector is very efficient, they should consider the possibility that their private sector, which is being underutilised, could, according to article 66 of Law 14/1986, of 25 April, General Health,42 link private hospitals to the planning of the public sector, without them losing their ownership, thus alleviating waiting lists, as also argued by IDIS.35 Another possibility in this case could be to increase public resources in the face of such good management to reduce waiting lists.

Those ACs with lower levels of efficiency, as explained above, are probably not making efficient use of their resources and could offer greater capacity or, in other words, not have such high waiting times.

A case in point is Ceuta and Melilla which, after the creation of INGESA (Management Institute under the Ministry of Health of the Spanish Central Government), managed to improve their efficiency by 62.12%—probably due to the fact that they only have to manage the autonomous cities and, as there are not a greater number of territories, they can better focus on the needs of the autonomous cities—but if we make a relative comparison, they are below the rest of the Autonomous Regions. In this sense of a low level of efficiency of INGESA hospitals, there is evidence of saturation, lack of resources in relation to the population to be attended and waiting times, as stated in the study by Artundo Purroy.43

Concerning the methodology used in this study, various approaches have been taken in the national and international literature to identify explanatory factors for technical efficiency and productivity.44 Most studies compare efficiency figures between groups of units and explain them by linear regression. For example, in Iran, variability in efficiency in public hospitals was analysed by applying a multigroup DEA (Rezaee and Karimdadi, 2015) and correlation coefficients are frequently used in Spain to explore the relationship between efficiency and other factors.45–48

Perez-Romero et al49 combine multilevel regression models to explain the efficiency of hospitals in the Spanish public network, this being one of the main methodological innovations provided by this study of Analysis of technical efficiency in the hospitals of the Spanish National Health System.

Linked to the above, a traditional linear regression model useful for estimating the relationship between a dependent variable and multiple independent variables. It is based on correlations and is therefore useful for estimating the variance of an independent variable explained by dependent variables. It is not causal and cannot provide researchers with information about a specific individual. It is parametric and cannot be generalised to results at the extremes of the distribution. Is prone to bias due to omitted variables, multicollinearity and autoregression, although there are tests and extensions to increase robustness.50

On the other side, a non-parametric benchmarking method for analysing the efficiency of product production at a given input level. Provides a highly individualised benchmark for each individual in the group. Benchmarks are based only on existing input and output data for ‘equivalents’ or other individuals in the same population. May include multiple dependent variables or outcomes simultaneously. Can be combined with other methods to reduce limitations and improve own results. Can be used with a model-fitting approach to determine which input or dependent variable to focus on to achieve the greatest expected benefit for each individual. Sensitive to omitted variables and measurement error. There are methods to address these issues, but they are not as reliable as other methods. They are limited to the individual or population analysed, so the results cannot be generalised to other populations without subsequent analyses using other methods.50

Another methodological issue to consider is the difference between DEA and SFA. DEA is the most commonly used method in mathematical programming to estimate production frontiers. Stochastic frontier analysis (SFA) is the most representative method used in econometrics to estimate production frontiers.51 DEA is recognised as a powerful tool for efficiency analysis and benchmarking, and its estimates are used in a wide range of industries and activities, including healthcare.52 53 The main difference between DEA and SFA is that DEA is usually used to examine the relative efficiency of individual studies. SFA is used to examine absolute efficiency and the relationship between the determinants of input and output (cost) efficiency. Therefore, SFA is often used to assess the efficiency of for profit organisations. The DEA method measures the efficiency of public subjects by using the observed best performance compared with all subjects.54

We are aware that this study presents the methodological limitations of DEA, derived from its deterministic character, which has been confronted with the testing of various models.47 The limitations of the DEA methodology are that it does not measure error, it does not measure the relative differences between efficient suppliers, the use of many input and output variables is often considered flawed and that homogeneity in the units used is required.55 56

Conclusions: limitations and extensions

This article has analysed the effects of decentralisation in Spain, specifically on the last 10 Autonomous Regions that received the healthcare transfers at the end of 2001, with respect to the efficiency levels of the public, private and joint Sectors.

An improvement of 60% can be seen in the communities analysed if we only take into account the NHS, however, if we consider the results of both sectors we observe that the majority of the territories worsen.

If we take into consideration all the Autonomous Communities that make up the Spanish territory, we can observe an improvement in the public sector of the 10 communities analysed in terms of their relative position, with the following standing out: Region of Murcia, Community of Madrid and Balearic Islands. However, it should be noted that there are socioeconomic factors such as the level of ageing, geographical dispersion, spending policies or the wealth of each region, which could explain why some territories have not improved as much.

On the other hand, in the face of the economic crisis, our results show that 60% of the public sector was not affected, in fact, its efficiency increased. The years 2007 and 2012 stand out as the years in which the highest efficiency values were reached (2012 if all the Autonomous Regions in Spain are taken into account) and one of the reasons for this behaviour is the change in the management model after the transfers. Otherwise, 80% of the private sector saw a decrease in efficiency.

In the light of the above, we can affirm that the transfers have not favoured the privatisation of the system. This can be demonstrated by the fact that even in communities where private provision has a strong presence or is highly efficient—as in the case of the Community of Madrid and La Rioja—public provision has increased despite everything.

On the other hand, with regard to those regions which are not fully efficient, that is, which could generate more output with their current inputs and thus be more productive, two different cases can be identified. Extremadura, Aragon and Castile-La Mancha, which have waiting lists above the average for the Spanish regions, imply that they should, and need to, improve the management of their public resources (NHS). As for the Region of Murcia and Cantabria, where the public sector is very efficient, the private sector is notable for its under-utilisation of resources, which could be used to reduce the high waiting lists in both regions through public–private partnerships.

DEA measures multiple inputs and outputs and eliminates the need to construct production functions to estimate efficiency. This makes the use of DEA methods in efficiency research more comprehensive and more practical.

One limitation of this study is that it does not include health outcomes in the analysis, which we will try to develop in future papers.

Finally, it would be of great interest to extend our study once the Ministry of Health makes the data for the last few years available to the public, in order to compare efficiency between the Autonomous Regions before and after the health crisis. As well as the functioning and behaviour of hospitals during the pandemic.

Data availability statement

Data are available upon reasonable request.

Ethics statements

Patient consent for publication

Ethics approval

Not required.

References

View Abstract

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Contributors FR-S conceived of the study, its design, performed part of the literature review and coordinate the draft of the manuscript; TA-R and AB-R participated in the design of the study. TA-R, AB-R and MR-M performed part of the literature review and helped to draft the manuscript. FR-S is responsible for the overall content as the guarantor.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.