An Introduction to HCNA

The epidemiological approach to health care needs assessment
Andrew Stevens, James Raftery, Jonathan Mant

The need for needs assessment ...

Some form of health care needs assessment has always been necessary in health service planning. In the early 1990s, as a consequence of health service reforms in the United Kingdom and elsewhere, including the Netherlands, New Zealand, Australia and the United States,(1-7) it took on a more central role. In the UK, the late 1990s saw a second round of reforms, which stressed the importance of collaboration and partnership, while continuing to emphasise the role of health care needs assessment.(8)

Four overlapping periods of changing perspective on need can be identified.(9) The first may be characterised as a period of "social concern" in the 1960s - identifying gaps in health service provision relating to deprivation and patchy facilities. There followed a period of "rational planning" in the 1970s - attempting to plan services systematically, but with no formal needs focus. The Resource Allocation Working Party ("RAWP") review then placed a focus on spatial inequity i.e. the relative under-provision of services in different regions.(10),(11) Need was recognised and measured by surrogate means, notably demographic. The NHS and Community Care Act of 1991 by contrast required that need be identified so that service requirements could be specified fairly closely.(1) We might now add a fifth period of "collaborative action" - in the 2000s - in which the need for health care and the need for other interventions to improve health are to be collectively identified by a range of players, but principally health authorities, primary care groups and local government.(12)

The most important change, and indeed the period when needs assessment became established as a critical process in health care, was the transition from the 1980s to the 1990s, although this period has its roots in the policy context stemming from the 1970s.

The policy context

From the 1970s the expansion of public services and public expenditure that had characterised the post war era came under critical review. Prompted by the oil price shocks of the 1970s and the recourse of the UK to the International Monetary Fund (IMF), public expenditure became tightly controlled as Keynesianism was challenged by monetarism in the UK and in the US. Tax resistance in both countries also contributed to a fundamental reappraisal of the public-private relationships.

The 'new public management' offered an agenda for taking these issues forward.(13) In the UK its early manifestations included:

  • increased attention to financial control
  • stronger, more hierarchical management with target setting
  • an extension of audit, transparency, benchmarking and protocols
  • increased consumer responsiveness
  • deregulation of the labour market
  • reduction in the self regulating power of the professional
  • some empowerment of less bureaucratic and more entrepreneurial management
  • new forms of corporate governance, with a shift to a board of directors model(14)

This went beyond rhetoric with two thirds of formerly state-owned businesses transferred to the private sector, requiring in turn that either competition or regulation be established to stimulate efficiency.(15)
    
Given that the UK health sector was predominantly public in both finance and provision, it was a strong candidate for the kinds of reforms outlined above. Although the bulk of attention has been devoted to the structural reforms introduced in 1991, each of the above themes were picked up and continue to be played out in the NHS today.

The structural reforms of 1991 resulted from Working for Patients,(16) which was the product of a ministerial review established by Margaret Thatcher in 1988, when hospital bed closures and cancellations of elective surgery were being blamed on a perceived under-funding of the NHS. The review explored and rejected many options before focusing mainly on the delivery of services. It drew heavily on the ideas of Alain Enthoven and a key slogan was that 'money should follow patients'.(17) This encapsulated the idea that hospitals should receive funding in proportion to the number of patients treated, not as hitherto on the basis largely of historical patterns of allocation.

Competition was to be introduced between hospitals and with other providers including the small private sector. Core elements included:

  • separation of purchaser and provider roles within health authorities 
  • creation of self governing NHS Trusts 
  • transformation of Health Authorities to become purchasers 
  • introduction of 'fundholding' by groups of general practitioners 
  • the use of contracts to link purchasers and providers.

Central role of needs assessment in the NHS health care reforms
The creation of purchasers of health care in the 1991 National Health Service (NHS) and Community Care Act put the formal purchasing of health care centre stage in the new NHS. Although the reforms initially emphasised the increased freedom around the independent provider role through the creation of NHS Hospital Trusts, it later became obvious that cost-effective targeting of health care could not happen without a significant role for purchasers.(18-20) These were to be capitation funded, a move that had been started by the report of the 1976 Resource Allocation Working Party and its precursors.(10),(11) These new cost constrained purchasers required a mechanism for determining what services they should purchase and at what volume that was not simply a product of what was currently provided. This mechanism was to be 'needs assessment'.

An initial analysis of the role of district health authorities set needs assessment as the first of a series of tasks as follows:(18)

1. Assessment of the health needs of the local population, including a more positive emphasis on the views of that population;
2. Appraisal of service options for meeting those needs, including close cooperation with (the then) family practitioner committees and general practitioners, both in the short term and strategically;
3. Specification of the chosen pattern of service provision;
4. Choosing between providers and placing contracts compatible with the districts' cash limits;
5. Monitoring the provision of contracted services and the health of the population; and
6. Controlling expenditure on contracts within the districts' cash limits.

For needs assessment to anchor the process in this way, it was necessary to develop a protocol for the assessment of health care needs, and to drastically improve the information available to health authorities on baseline aspects of their service, and nationally available data relevant to their needs assessment activities. This series tackles those challenges by developing a protocol for health care needs assessment, and then using that protocol to provide data around the protocol headings for disease and client groups.

While the role of Health Authorities is changing again as a result of the latest reforms, and commissioning of services will increasingly become the responsibility of primary care groups,(8) there is continuity with the previous reforms. In particular, the responsibility for planning health services is kept separate from provision, and funding of health services will continue to be for a defined population, rather than for a service. Therefore, a protocol for health care needs assessment remains as relevant now as it did when the first edition of this series was published. Indeed, the audience for this material is now wider, as a greater proportion of primary health care professionals will assume a commissioning role.

Characteristics of health care needs assessment...

The requirements of the role of purchasing authorities (whether health authorities or primary care groups or others) has the following effects:

First, need for health care must be distinguished from the need for health. The need for health care is much more specific than the need for health. The latter concerns who is needy in general terms, and can be measured by morbidity, deprivation and socio-demographic measures. Health problems with no realistic treatments are included here. But these measures alone have little to say that helps the specification of health care services, except perhaps in distinguishing relative levels of need between large areas. The need for health care is much more specific and is now widely accepted to mean the population's ability to benefit from health care.(21-23) It depends on the potential of preventive or treatment services to remedy health problems.

Second, needs assessment for practical purchasing requires a useable level of detail for those who will subsequently specify services. The definition, the population's ability to benefit from health care, leaves open the level of detail at which health care is defined. However, it is important not to specify needs so generally that different populations and interventions cannot be distinguished, nor to specify needs in so much detail that the activity of health care needs becomes overwhelming. A reasonable compromise should be sought.

Third, need is quite different from supply and demand. Put simply, need is what people might benefit from, demand is what people would be willing to pay for in a market or might wish to use in a system of free health care, and supply is what is actually provided. Although this distinction is uncontroversial, the difficulty of measuring need makes it tempting to measure supply and demand as surrogates for need. This is complicated by the price being zero for services free at the point of use. Supply and demand are not tempered by each other as they might be in a market with a price mechanism. Furthermore supply is the consequence of historical patterns mixed with the consequences of political pressure for change. It is clearly misleading to measure the existing service provision as though it were an indicator for need. Similarly, the measurement of waiting lists, reflecting as they do demand mediated by doctor as agent, is also misleading. Figure 1 illustrates how need, demand and supply might overlap or differ.(9) It shows eight fields of services divided into (i) those for which there is a need but no demand and supply, (ii) those for which there is a demand but no need or supply, (iii) those for which there is a supply but no need or demand, and then (iv-vii) the various degrees of overlap. 

The diagram indicates where work is required not just in assessing health care needs, but also in attempting to make the three circles of need, demand and supply more congruent. This includes demand management and changing supply as well as better definition of need. Demand management may involve curtailing it where it is inappropriate (areas 2 and 5 in Figure 1), stimulating it (areas 1 and 6), or coping better with it (area 4).(24) Varied mechanisms with which demand can be influenced include: the accessibility and organisation of services, the provision of health information, education, and financial incentives.(25-27) Supply changes may require subtle mechanisms not easily captured in service agreements. Where the cause of the mis-match between supply and need is clinical practice, effective strategies to promote behaviour change among professionals are required. These can include educational outreach visits, reminders, interactive educational meetings, audit and feedback, use of local opinion leaders, local consensus processes and patient mediated interventions.(28) Even need can be shifted somewhat, given that research programmes can be altered, with new findings on pathology and degrees of benefit which matter to patients, and the identification of forms of health care that are effective.

Fourth, needs are probably best explored basing the assessment on disease groups. The logic is that a need arises when there is a lesion rather than when a person has reached a certain age, belongs to an ethnic sub-group, or because a particular service is provided. However, this is not an absolute rule. The ability to benefit from health care can be assessed at the level of the sub-population who may benefit from a particular intervention (provided competing interventions are considered). Such units can be reassembled around particular services, or population sub-groups such as demographic minorities. Some chapters in this series are therefore oriented around services such as family planning, and around mixed groups such as people with learning disabilities. In primary health care needs assessment it is often argued that a good starting point is around a particular intervention.(29)

Fifth, often the key element of health care needs assessment is the measurement of the effectiveness of interventions. The evidence-based medicine and evidence-based health care movements are relatively recent and it remains the case that clear information on effectiveness is often absent in service planning. But it cannot be argued that ineffective services are needed. Therefore, where effectiveness is in doubt, a first step is a gathering of effectiveness information.

Sixth, health care needs assessment is only ever artificially divorced from setting priorities in health care. Some "needs assessors" would prefer not to acknowledge resource shortages, and argue that all needs should be met. The untenability of this view as the proliferation of new potentially effective health care technologies continues apace becomes ever clearer. Needs assessment can be integral to prioritisation, because it is only a short step from need as the ability to benefit from health care to a utilitarian view of relative need as the relative ability to benefit per unit cost. This is not to deny an exploratory phase of needs assessment, a sort of scanning exercise, before such hard calculations are made, nor to deny that precision in quantifying priorities is very elusive.

Seventh, it is worth noting the distinctions between individual need and population need. Population need can be viewed as the sum of individuals' need. But the viability of this assumption is dependent on how the individual needs assessment is undertaken. If it strays into an assessment of demand, or it is unconcerned with proven ability to benefit, it is likely to distort assessed population needs. Clearly there are differences between the view of a carer dealing with (assessing the needs of) an individual, and a planner looking at a population. The former is likely to be a strong advocate for the patient, take no account of people who are in need but do not come to the clinic, and (as regards relative need) take little account of costs. The circumstances in which individual needs assessment is a practical means of assessing health care needs at a population level are those in which individual patients are few, highly costly, very heterogeneous and countable (i.e. not hidden from the view of routine data).

Eighth, one can also distinguish between needs for (public sector) services other than health care and services for health care. "Benefit" in the former tends to be more open-ended. In health care, increasing inputs of care can be associated with zero benefit or negative benefit (harm). The limits of benefit are not so clear with education, housing or transport (although even here diminishing returns and even negative benefit is evident sometimes). However, other public sector services have an impact on health, and with a collaborative approach to health care needs assessment across different sectors, the relative contribution of different investment (relative needs assessment) will be important.

Ninth, needs assessment itself incurs costs. This means that short-cuts can be necessary, and indeed it is argued below that surrogate measures (making comparisons and taking a corporate view) have a valid place in health care needs assessment. 

Aim of health care needs assessment

The overall aim of health care needs assessment is to provide information to plan, negotiate and change services for the better and to improve health in other ways. In other words the assessment can be done with an eye to any activities which have an impact on health, whether directly in the hands of health services or not. The working definition of health care need as the population's ability to benefit from health care reflects this (and can be expanded to cover "services" more widely).

It is worth noting that each element of the definition is important:

Table 1: The need for health care: the population's ability to benefit from health care
The population's ability to benefit from health care equals the aggregate of individuals' ability to benefit. For most health problems this will be deducible from epidemiological data, rather than from clinical records.
The ability to benefit does not mean that every outcome is guaranteed to be favourable, but rather that need implies potential benefit which on average is effective.
The benefit is not just a question of clinical status, but can include reassurance, supportive care and the relief of carers.* Many individual health problems, especially infectious diseases and long-term disabilities, have a social impact via multiple knock-on effects or via a burden to families and carers. Consequently, the list of beneficiaries of care can extend beyond the patient.
Health care includes not just treatment, but also prevention, diagnosis, continuing care, rehabilitation, and palliative care.

*Diagnosis and reassurance constitute an all important component of primary and ambulatory care including accident and emergency services where a high proportion of people may require no more than a negative diagnosis.

Objectives of health care needs assessment

(1) The principal objective of health care needs assessment is to specify services and other activities which impinge on health care. The principal activities involved in health care needs assessment are therefore:

the assessment of incidence and prevalence (how many people need the service/intervention),
the effectiveness and cost-effectiveness of their services (do they confer any benefit, and if so at what cost ie what is the relative benefit), and
the baseline services (changing provision for the better necessitates knowledge of the existing services, both to know which services ought to change and to identify opportunities for the release of resources to enable the change to happen).
These three components - incidence and prevalence, health service effectiveness, and baseline services form the basis of "triangulation" (see Figure 2) whereby health care purchasers and planners can determine the policy directions they wish to pursue. They form the three main elements of the protocol used to structure the needs assessment in subsequent chapters of this series.

There are, however, also other objectives in health care needs assessment which flow from the aim of planning, negotiating and changing services for the better.

(2) Improving the spatial allocation of resources. This was the principal objective of national needs assessment in the UK at the time of the Resource Allocation Working Party and before, right up to the 1990 NHS reforms. It seems a reasonable supposition that if broadly equal populations are to receive services, the most efficient deployment of services will be to give them broadly equal resources. This supposition works well at a macro level, but weakens as the scale gets smaller - because the chances of small areas having equal needs, other things being equal, reduces. And given that resources will continue to be allocated between sub-national units, spatial allocation continues to be important.

(3) Thirdly, target efficiency (the accurate targeting of resources to those in need) is often a central activity of needs assessors. Strictly the measurement of target efficiency is the measurement of whether or not, having assessed needs, resources have been appropriately directed. In this sense, target efficiency is related to audit. But, it is always important to know whether, having defined the need, those who get a service need it, and those who need it get it.

A number of new objectives for health care needs assessment have been suggested following the expansion of needs assessment into general practice. They include (in various guises) the three above, but to these can be added:

(4) The gathering of general intelligence to get a perspective on population health and population health needs. This objective is, of course, important not just for new primary care needs assessors, and in many respects can be considered the first stage of needs assessment, rather than a separate objective.

(5) Fifth, the objective of health care needs assessment to stimulate the involvement and ownership of different players in the process has been noted. The more members of the primary care team and others are involved in the assessment, the more likely attention will be paid to the findings of the activity. Again, this argument could be extended to needs assessment undertaken outside primary care. 

Scales of needs assessment

Although the aim of needs assessment remains the same at all scales, the principal objectives and the process are likely to vary according to the scale of assessment: these can be summarised as follows:

  • National (circa 50 million)
  • Regional (circa 5 million)
  • Local Authority/health authority (circa 500, 000)
  • Primary Care Group (circa 50, 000 to 100, 000)
  • Individual General Practice (circa 5000 to 10, 000).

National needs assessment

There are many national health care concerns. National needs assessment is necessary for areas of legislative change. These include modifications of health services - particularly including elements of the public health agenda such as seat-belt and tobacco control legislation. It also applies to elements of planning affecting the national economy - including, for example, very large capital investments - and to politically and media sensitive areas such as those issues raised by "post-code prescribing". Indeed, part of the rationale for the establishment of the UK's National Institute for Clinical Excellence was to end 'unacceptable geographical variations in care'.(30) National needs assessment is also the level for the assessment of spatial equity between large sub-national regions. 

Regional health care needs assessment

Despite both a policy of centralisation and a wish to delegate planning to a unitary level of health authority below that of the region, regional planning has been remarkably durable. There are certain services for which the region is an obvious scale of activity. These concern not just such large spatial issues such as fluoridation, but also for medical specialties where provision needs to be at the scale of a population of several million. It is also a useful scale for co-operation between health authorities and local government - especially at a time of regional devolution.

Spatial equity, specific service planning (sum of) and target efficiency are all relevant at the regional level.

Health authority/local authority needs assessment

This is the traditional level of health care needs assessment. There is, however, a big difference between the traditional agenda of health authorities and of local authorities: the former with a tradition of technical planning - increasingly for effective and efficient services and the latter with a tradition of working with the politics of local democracy. The scope of the services provided by both differs as well, and the combined agenda addressing principally service specification, but also target efficiency, is very large and will need to be highly selective.

Primary care group needs assessment

In the UK planning at this level is relatively recent. It is likely to have elements of both health authority scale planning, and of individual practitioner planning. This has both opportunities for service specification, and of individual clinical insights, and can make use of the, potentially fertile, practice register data available at individual practitioner level.

Individual practitioner needs assessment

The individual practitioner has long had much promise as a needs assessor, given his/her access to case registers, his/her role as a consumer of secondary care, and therefore at arm's length from it, and his/her feel for a patient perspective on service. However, these advantages are tempered by the difficulties of needs assessment at this level, including the conflict of needs assessment with general practitioners' business interests, and the ease with which practitioners can ignore unseen patients.

Needs assessment activities at this scale can only include service specification for the most prevalent of diseases, and of primary care services; but target efficiency (audit) can be reviewed intensely. 

Different types of health care needs assessor/"assessments"

It should also be recognised that technical needs assessors do not have a monopoly on the words "needs assessment". Those who might consider themselves needs assessors could include:

  • Politicians - both national and local,
  • Clinicians - both generalist and specialist
  • Patients, as well as
  • Technocrats.

The different perspectives of these assessors will obviously influence the characteristics of the assessment. In theory all can undertake valid assessments but it is worth examining any product against understood criteria.

The following questions have been identified in judging assessments:(31)

1. Is there a clear context of allocating scarce resources? Needs assessments that fail to acknowledge resource limitations are common, but are of restricted value to health care commissioners. This can be a problem with individual clinical needs assessment, which can put great pressure on health budgets and squeeze the care available to patients with weak advocates. Some population approaches also fail to acknowledge resources used. This is a difficulty, for example, with specialty-specific documents recommending levels of service within a single specialty.

2. Is the needs assessment about priority setting within the context of a variety of competing needs or is it about advocacy for a single group or individual? This is closely related to the resource context question. Specialty-specific documents, client group surveys and even policy directives which focus on single groups often represent advocacy rather than balanced contributions to priority setting. Surveys about, for example, the needs of a particular ethnic minority are of limited help in guiding health care planners unless seen in the context of equivalent surveys of other groups. Policy recommendations based on lobbying would be much more prone to distorting resource use than policy directives based on research.

3. Is the needs assessment exploratory or definitive? Some approaches to needs assessment are exploratory in that they highlight undefined or under-enumerated problems. This is particularly true of lifestyle surveys that estimate the size of risk groups such as alcohol abusers or teenage smokers. Exploratory surveys are best thought of as just a first stage in a more specific needs assessment process.

4. Is the determination of the most important needs expert or participatory? Technocratic needs assessment tends preferentially to be expert, although the Oregon experience demonstrates that participatory approaches and expert ones can be merged. Expert approaches seek to be as objective as possible, although objectivity soon reaches its limits. 

Approaches to needs assessment

The approach to needs assessment based on the triangulation of incidence and prevalence, effectiveness and cost effectiveness, and existing services (Figure 2) we have labelled 'the epidemiological approach to needs assessment'. This method is described more fully below.

Needs assessment will usually aim to make incremental changes to existing services. The epidemiological approach to needs assessment can usefully be supplemented by other tools. Indeed, in view of the shortage of information both on effectiveness and on prevalence, and because of the size of the task of reviewing and applying such information even when it is available, health care purchasers have tended to use two other simple methods: the 'comparative' and the 'corporate' approach.(22)

Comparative approach to needs assessment

The comparative approach to needs assessment contrasts the services received by the population in one area with those elsewhere. Comparisons can be powerful tools for investigating health services, especially in the context of capitation-based funding. Variations in costs and service use may be appropriate depending on local circumstances, but with capitation funding of health care, gross departures from the mean require justification. The literature on differential rates of surgery for example shows that the more loosely defined the clinical indications are for a particular problem, the more likely considerations other than need and benefit are to influence levels of activity undertaken.(32),(33)

Comparative service provision should take account of local population characteristics including demographic and morbidity data, such as provided by the English Public Health Common Data Set.(34) To the extent that such sources are beginning to provide detailed mortality and morbidity information, they may start to act as population outcomes data. The use of such data in this way, however, relies on the assumption that health care is a major determinant of mortality and morbidity, which may not be justified.(35)

The corporate approach to needs assessment is based on the demands, wishes and alternative perspectives of interested parties including professional, political and public views (see Figure 3). While such an approach blurs the difference between need and demand, and between science and vested interest, it also allows scope for managing supply and demand at the same time as assessing need as affected by local circumstances. It would be surprising if important information were not available from those who have been involved in local services over many years. In the National Health Service context, this corporate approach has been widely used, and was encouraged in both the 1989 reforms with its 'local voices',(36) and the emphasis on partnership and collaboration in the 1997 white paper.(8)

A protocol for (the "epidemiological approach" to) needs assessment...

Each of the chapters in this series has been written following a standard protocol, that utilises the headings shown in Table 2. The approach is based on the belief that non-local epidemiological data are valuable to local needs assessment, and that both costs and cost-effectiveness have to be considered. While need is a function of benefit, not of cost, the purpose of population needs assessment is to help decide between competing priorities. Such decision making requires information on both.

Table 2: Components of the epidemiological approach to needs assessment
1 Statement of the problem
2 Sub-categories
3 Prevalence and incidence
4 Services available and their costs
5 Effectiveness and cost-effectiveness of services
6 Quantified Models of care and Recommendations
7 Outcome measures, audit methods and targets
8 Information and research requirements

Statement of the problem

A necessary first step is a precise statement of the problem and its context, including major issues and controversies relevant to health care commissioners. It is not possible (or desirable) to divorce the process of health care needs assessment from contemporary controversies, though a broad population based needs assessment should also provide an appropriate context and perspective from which such controversies can be viewed. Thus, the emergence of new drugs is a relevant contextual issue in a health care needs assessment of dementia, but a comprehensive needs assessment will not consider these drugs in isolation from other aspects of dementia services, such as provision of basic nursing care and carer support (see chapter on dementia).

Sub-categories

There are many different ways of sub-dividing a disease, such as by aetiology, pathology, anatomy, severity, or prognosis. In the context of health care needs assessment, what is most useful to a planner or commissioner of health care is a sub-categorisation that is predictive of requirements for services. The most appropriate sub-categorisation will depend upon the disease in question. Thus, aetiological sub-categories are chosen for diabetes (type 1, type 2 and gestational diabetes), severity sub-categories for dementia, and presence or absence of health problems and dependence for alcohol misuse.

Prevalence and incidence

Prevalence and incidence forms the first corner of the needs assessment triangle (Figure 3). It is a truism to state that identification of the frequency of occurrence of disease is a core part of the epidemiological approach to needs assessment. However, in isolation of information about treatments available and their effectiveness, prevalence and incidence are not synonymous with need.

Prevalence and incidence are most useful in health care needs assessment when they can be directly related to sub-categories that predict service requirements. Thus, the prevalence of radiological osteoarthritis is a poor predictor of need, whereas prevalence based on symptoms and clinical features is a better estimate of the number of people who might benefit from hip replacement surgery (see chapter on osteoarthritis of hip and knee).(37) This approach, which involves the identification of the number of people in a population with a condition that would benefit from treatment as opposed to simply identifying the number of people with the condition has been termed the 'epidemiology of indications'.(38) However, epidemiologists have in general been more interested in the aetiology of diseases than the scope for benefit; so prevalence and incidence data on sub-categories relevant to service planning are often not available.

The source material for this section comes either from the epidemiological literature, or from official statistics, such as Cancer Statistics: Registrations,(39) and the Health Survey for England.(40) One caveat on using national data or data from epidemiological surveys carried out in other parts of the country is that incidence and prevalence varies by such factors as age, sex, region, socio-economic status and ethnicity. Therefore, appropriate adjustments need to be made to estimate the frequency of disease in one locality from these data. 

Services available and their costs

Services available form a corner of the needs assessment triangle (Figure 3). Although current services are only weakly related to need, it is important to understand them since local levels are required for comparative analysis, and they are the starting point for change. Data about both structure (how many specialists per unit of population) and process (how many people treated per unit of population) are relevant to this section. Health resource groups offer a possible "currency" for measuring health care activity (41) and combining such data with finance data in a programme budgeting approach can assist the sensible analysis of existing services.(42) Data sources include audits and surveys, and official statistics, in particular the hospital episode statistics (HES) for secondary care and GP morbidity surveys (43) for primary care. Costing studies of health care remain relatively sparse, but the availability of official data such as the National Health Service Reference Costs, a product of the 1997 white paper, and Trust Financial Returns, allow some cost estimates to be made.

Effectiveness and cost-effectiveness of services

The availability of data concerning the third element of the health care needs assessment triangle, effectiveness and cost effectiveness of services, has improved dramatically in recent years. Initiatives such as those of the Cochrane Collaboration and the Evidence Based Medicine movement have led to a growing recognition of the importance of randomised controlled trials and systematic reviews in the evaluation of health care. It is beyond the scope of this series to present new systematic reviews of the evidence, but each chapter draws from systematic reviews that have been carried out, and the key studies in the topic area. Authors have been asked to grade the evidence for an intervention in terms of the size of the effect and the quality of the supporting evidence as shown in Table 3. 

Table 3: Grading of evidence of effectiveness

SIZE OF EFFECT
A The procedure/service has a strong beneficial effect.
B The procedure/service has a moderate beneficial effect.
C The procedure/service has a measurable beneficial effect.
D The procedure/service has no measurable beneficial effect.
E The harms of the procedure/service outweigh its benefits.
QUALITY OF EVIDENCE
I-1 Evidence from several consistent, or one large, randomised controlled trial.
I-2 Evidence obtained from at least one properly designed randomised controlled trial.
II-1 Evidence obtained from well-designed controlled trials without randomisation, or from well designed cohort or case-control analytic studies.
II-2 Evidence obtained from multiple time series with or without the intervention. Dramatic results in uncontrolled experiments (such as the results of the introduction of Penicillin treatment in the 1940s) could also be regarded as this type of evidence.
III Opinions of respected authorities, based on clinical experience, descriptive studies, or reports of expert committees.
IV Evidence inadequate and conflicting. 

The population benefit achieved by health care depends not just on the efficacy of the service under study conditions, but also on its effectiveness in real life and its acceptability to patients. It can be argued that it is difficult to generalise the results of some randomised controlled trials since all the types of patients to whom the results would be of potential relevance may not be included.(44) In these circumstances, the findings of non-randomised studies may be of use since they are generally less selective in terms of recruitment. However, a non-randomised study is an inherently weaker design in terms of internal validity since it is prone to selection bias in that treatment allocation is likely to be influenced by factors that might affect outcome. While some of these differences can be adjusted for, it is not possible to adjust for factors that are unknown, unmeasured or unmeasurable.

Quantified Models of care and Recommendations

Since need is derived from incidence and prevalence on the one hand and effectiveness on the other, it is tempting to seek a simple formula combining both in order to generate estimates of the need for services. Recommendations would logically emerge from any disparities between the estimates of need and current service provision. For most diseases and treatments however, no such logic exists for the following reasons:

  • Inadequate data on incidence and prevalence
  • Inadequate data on effectiveness and cost-effectiveness
  • Lack of agreement on thresholds for intervention
  • Severity levels may be ill-defined
  • Treatment pathways are complex, with numerous filters.

Given these uncertainties and the need to quantify services when planning, a more flexible approach to models of care based on needs has been developed in some of the chapters in this series. Most include recommendations drawn from incidence and prevalence and effectiveness findings. These are often, quite reasonably, at the margin, rather than as gross service transformations.

Outcome measures, audit methods and targets

The principal objective of health care needs assessment is the specification of services and other activities that impinge upon health care. Under the New NHS,(8) health care commissioners will negotiate long term agreements with NHS Trusts. It is intended these are based on specific services, and include health and quality objectives. Authors have the opportunity to suggest what measures and targets might be used to monitor such long term agreements. The new national performance framework puts forward six areas of performance:(8)

  • Health improvement
  • Fair access
  • Effective delivery of appropriate health care
  • Efficiency
  • Patient/carer experience
  • Health outcomes of NHS care

Information and research requirements

A health care needs assessment can help to clarify what information and research priorities should be in a given area, both in terms of epidemiology and effectiveness research. With the development of the National Research & Development Strategy, and the National Health Technology Assessment programme, a greater proportion of clinical research in the UK is now carried out in response to specific calls for research to answer questions that have been identified as NHS priorities. Epidemiological health care needs assessment is one process by which such questions can be identified. 

Conclusion...

 

While the organisational context of health care needs assessment has changed in recent years, the process remains a core component of health service planning. In this chapter, a protocol for the epidemiological approach to needs assessment has been outlined. Each of the following chapters adheres to this protocol, though more information is available for some topic areas than others. The key target audience is people involved in the planning of health services. In England & Wales, this includes both primary care groups and health authorities as bodies charged with the commissioning of local health services and development of health strategy. Health care systems in the twenty first century will need to address the challenges posed by demographic change, technological development and changing public expectations within a context of limited resources. An epidemiological approach to health care needs assessment provides a rational framework within which these issues can be tackled.

References...

 

  1. House of Commons. National Health Service and Community Care Act. London: HMSO, 1990.
  2. Organization for European Corporation and Development. The Reform of Health Care. A comparative analysis of seven OECD countries. Health Policy Studies No. 2. Paris: OECD, 1992.
  3. Borren P, Maynard A. Searching for the Holy Grail in the Antipodes. The Market Reform of the New Zealand Health Care System. University of York Centre for Health Economics, Discussion Paper. York, 1993.
  4. Matthews L. Health reforms in New Zealand. Br Med J 1991; 303: 327.
  5. Leeder SR, Alexander J. Australia's national health strategy. Br Med J 1992; 305:1042-1043.
  6. Pepper Commission. A call for action. US Bipartisan Commission on Comprehensive Health Care, Washington. US Government Printing Office, 1990.
  7. Roberts J. Clinton outline plan to fix American health care system. Br Med J, 1993; 307: 819-820.
  8. Secretary of State for Health. The New NHS. Cm 3807. The Stationery Office, 1997.
  9. Stevens A, Gabbay J. Needs assessment, needs assessment. Health Trends 1991; 23: 20-23.
  10. Department of Health and Social Security. Sharing resources for health in England. Report of the Resource Allocation Working Party. London: DHSS, 1976.
  11. Buxton MJ, Klein R. Allocating health care resources: a commentary on the Report of the resources allocation working party. London: HMSO, 1978.
  12. Stevens AJ, Bickler G. Health care needs assessment and health improvement programmes. In Rawaf S and Orton P. Health Improvement Programmes. London, RSM Press 2000.
  13. Hood C A. Public management for all seasons. Public Administration 69, Spring 3-19, 1991.
  14. Ferlie E, Ashburner L, Fitzgerald A, Petttigrew A. The new public management in action. Oxford: Oxford University Press.
  15. Foster C D, Plowden F J. The state under stress. Open University Press, Buckingham, 1996.
  16. Department of Health, 1989. Working for Patients. London HMSO.
  17. Enthoven A. Reflections on the management of the NHS. Nuffield Provincial Hospitals Trust. London 1985.
  18. National Health Service Management Executive. Role of District Health Authorities - analysis of issues. London: Department of Health, 1989.
  19. Audit Commission. Their health, your business: the new role of the District Health Authority. London: HMSO, 1993.
  20. Mawhinney B, Nichol D. Purchasing for health. A framework for action. London: NHSME, 1993.
  21. Culyer AJ. Need and the National Health Service. London: Martin Robertson, 1976.
  22. National Health Service Management Executive. Assessing Health Care needs. London: Department of Health, 1991.
  23. Matthew GK. Measuring need and evaluating services. In: McLachlan G, (ed.) Portfolio for health. London: Oxford University Press, 1971 (Problems and progress in medical care: essays on current research, 6th series).
  24. Pencheon D. Matching demand and supply fairly and efficiently. Br Med J 1998; 316:1665-67.
  25. Coulter A. Managing demand at the interface between primary and secondary care. Br Med J 1998; 316:1974-6.
  26. Gillam S. Managing demand in general practice. Br Med J 1998; 316:1895-8.
  27. Rogers A, Entwistle V, Pencheon D. A patient led NHS: managing demand at the interface between lay and primary care. Br Med J 1998; 316:1816-19.
  28. Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. Br Med J 1998; 317:465-468.
  29. Scottish Needs Assessment Programme. Needs Assessment in Primary Care. Glasgow, SNAP 1998.
  30. Dobson F. About NICE. Foreword. NICE web site: www.nice.org.uk, accessed on 9/10/2000.
  31. Stevens AJ, Raftery J eds. Health care needs assessment, Second series. Oxford: Radcliffe, 1997.
  32. Saunders D, Coulter A, McPherson K. Varieties in hospital admission rates, a review of the literature. London: King's Fund Centre, 1989.
  33. Wennberg JE, Malley AG, Hanley D et al. An assessment of prostatectomy for benign urinary tract obstruction. Geographic variations and the evaluation of medical care outcomes. J Am Med Assoc 1988; 259: 3027-3030.
  34. Department of Health. Public health common data set 1996, incorporating health of the Nation indicators and population health outcome indicators. 4 volumes. Guildford, University of Surrey, National Institute of Epidemiology, 1997.
  35. McKeown T. The role of medicine. Oxford: Blackwell, 1979.
  36. National Health Service Management Executive 1992. Local voices. London: DoH.
  37. Frankel S, Eachus J, Pearson N et al. Population requirement for primary hip-replacement surgery: a cross-sectional study. Lancet 1999; 353: 1304-09.
  38. Frankel S. The epidemiology of indications. J Epidemiol Community Health 1991; 45:257-59.
  39. Office for National Statistics. Cancer statistics: registrations, 1992. Series MB1 no 25. London: the Stationery Office, 1998.
  40. Prescott-Clarke P, Primatesta P (eds). Health Survey for England 1996. London: the Stationery Office 1998.
  41. Buckland R W. Healthcare resource groups. A more sensitive and less costly approach to contracting [editorial]. BMJ. 308(6936):1056, 1994 Apr 23.
  42. Lockett T, Raftery J, Richards J, in Honigsbaum F, Richards J, Lockett T (eds). Priority setting in action. Purchasing Dilemmas. Oxford: Radcliffe Medical Press, 1995.
  43. Morbidity Statistics from General Practice, 4th National Study, 1991-1992, Series MB5 No. 3, London: ONS © Crown Copyright 1995
  44. McKee M, Britton A, Black N, MCPherson K, Sanderson C, Bain C. Interpreting the evidence: choosing between randomised and non-randomised studies. BMJ 1999; 319: 312-5.