Policy Analysis Tool
Policy Analysis Tool
2. What is policy?
Defining policy is rather like the elephant you know it when you see it but you cannot easily define it (Cunningham, 1963, cited in Keeley and Scoones, 1999:4). Policy is complex and dynamic, and the term embraces a range of different aspects. Policy statements (e.g. white papers) are what one might think of firstly as policy. But what led to their formulation, and are they always put into practice? The processes by which policy is informed and formulated are also highly significant. Measures for policy implementation (e.g. laws, regulations, or programmes) are necessary to ensure that policy can be put into practice. Furthermore, policy and policy making is conditioned and shaped by the political, social and economic environment, as well as historical factors. Policy does not happen in isolation. It is not formulated and implemented solely by policy makers in government offices. A range of institutions, such as markets or the legal system, and organisations such as NGOs or bureaucracies, mediate a messy relationship between policy and peoples livelihoods. This is the interface where policy and people meet. An analysis of policy for sustainable livelihoods (SL) requires an understanding of the livelihood priorities of the poor, the policy sectors that are relevant to them, and whether or not appropriate policies exist in those sectors. The policy priorities of poor people will be realised more effectively if they have the capacity to articulate their demands and
Policy Process and actors Social Capital How policy is made, and Peoples capacity to influence the policy process. Finally, policy is made and whoimplemented at a variety of is influences the process. How people influence articulate demand or levels: international and regional, national and sub-national (state, provincial or local). influence the policy process. the policy process Livelihood Strategies The policies that constrain An understanding of policy Institutions and must, therefore, or enable poor people perspective. for sustainable adopting the strategies they Policy analysis organisations
The linkages and paths of influence between these levels are also significant for understanding policy. Policy Context
Political, social and
economic envrionment in be broad in its definition, and dynamic in its which policy is made. livelihoods, in addition to investigating what policies exist, attempts to The interface between understand the relationship between policy (and policy-making policy and people. Policy Statement processes) and the livelihoods of poor people. Figure 1 illustrates the range of elements Livelihood Options Written or formal statement sustainable The policies be taken into account in a policy analysis. Furthermore, policy analysis for to that govern of policy intent sanctioned access to livelihoods should consider the extent to which policy and policy making support the assets and wider by government. livelihood options. principles for best practice development intervention advocated by the sustainable How policy influences livelihoods approach (i.e. participatory, holistic, dynamic, building on strengths, linking people's livelihoods Policy raised Livelihood context micro and sustainable). Some of the broader questionsMeasuresby policy macro to Programmes, regulations, Policies that worsen or analysis for SL will therefore include the following: improve the vulnerability context in which people What are operate. laws, etc. for implementation of policy.
poor peoples livelihood priorities and what policies affect them? is policy made and implemented? Are the methods supportive of the SL principles? People-centred analysis for SL Policy-centred analysis for SL What institutions and organisations mediate the interface between policy and people? In which ways do particular policies impact on peoples livelihood strategies? How do poor people participate in the policy making process or ensure effective policy implementation?
How
sustainable. Policy analysis should aim to assess the extent to which these principles are being employed in policy work (e.g. are the views of poor people given voice in policy processes? Are policies highly sectoral or do they make cross-sectoral linkages?), in order to identify areas for improvement. The SL framework aids policy analysis in drawing attention to the possible ways in which policy impacts on different aspects of poor peoples livelihoods: their livelihood assets; the vulnerability context within which they operate; and their capacity to choose effective livelihood strategies. Direct relationships between policy and impacts in these areas are hard to prove, but insightful linkages can be made.
Shaped by policy narratives Pluralist Informed by actor networks Political Influenced by practice
from mistakes, and a range of other influences. Different stories evolve to describe events. Some gain more authority and have more influence on policy decisions than others. Many actors and interest groups can influence the policy process. There may be a range of mechanisms by which these different voices are heard. Certain individuals or institutions spread and maintain narratives through chains of persuasion and influence and inform policy. Power relations between citizens, experts, and political authorities mean that policy making is not neutral. Both personal politics and party politics influence policy decisions Projects, and the practices of front line staff can have a strong influence on policy
(Keeley and Scoones, 1999). Understanding policy processes helps in explaining the persistence of certain types of policy, particularly those that seem ineffective or unsuitable at the field level. It also helps to reveal whose knowledge and whose power are significant in informing and deciding policy. Understanding the existing processes of policy making are important for making them more participatory and people centred. A range of contextual factors shape and condition policy. These relate to the social, political and economic environment, and might include factors such as institutional capacity, history of resource use and policy, economic conditions (local, national or international), or pressure from civil society (Mayers and Bass, 1999). Looking at changes in the policy context over time can add valuable insights to the policy analysis.
Institutional analysis
Why do policy statements often say one thing, but quite another is observed in the field? How do the realities of the micro-level situation get fed into the policy making process? Institutions (rules, procedures and norms of society) and organisations (government, private sector and civil society) form the interface between policy and people. Firstly, the impact of policy on people and their livelihoods is mediated by organisations and institutions, such as markets, laws, the media, NGOs or bureaucracy. For example, macro-economic policy is transmitted through markets (devaluation increases the price of goods in the market); or forest management policy is mediated by the front line workers of the forest department. Often the impact of a policy will depend on the extent and nature of peoples interaction with those organisations and institutions (Shankland, 2000). Secondly, institutions and organisations mediate citizens influence on the policy process. Again, the market place, civil society organisations, media, interactions with bureaucracies, etc, provide people with opportunities to articulate demands, express dissatisfaction, and challenge dominant ideas that inform policy. For example, NGO projects illustrate alternative policy options in practice; or research may challenge dominant policy narratives.
policies impact upon these two: governing access to assets, regarding provision of services, or managing response to shocks such as drought or floods. Understanding the context and assets available to poor people will help to locate priority policies and policy sectors. Policy outcomes influence peoples choice of livelihood strategies by changing their perception of the opportunities and constraints which they face in pursuing different strategies, and the returns which they can expect from them (Shankland, 2000). Hence, people are not passive victims or beneficiaries of policy, but choose how to respond, within the context of constraining factors. It is, however, notoriously difficult to attribute causality between policy change, changes in livelihood strategies, and improved livelihood outcomes. Social capital is traditionally viewed as patterns of horizontal social networks and solidarity relationships, i.e. between household, group or community members. Here, however, the interpretation is broadened to include vertical links between people and groups unequally endowed with power and resources (Shankland, 1999:14). Hence, the term political capital may be considered more appropriate. Analysis should aim to understand poor peoples capacity to influence the policy process through a range of institutions and organisations.
Table 1: Example methods for analysing different elements of policy and policy process. Element of analysis Example methods Interviews, policy mapping, policy ranking, visioning. Policy priorities Power analysis, social maps, strategy flow diagrams, institutional analysis Social capital Stakeholder analysis, actor network analysis, key informant interviews Policy process and actors Document analysis, time lines, policy mapping Policy context Document analysis, key informant interviews Policy statements Document analysis, key informant interviews Policy measures Institutions & organisations Institutional analysis, social maps, power analysis Semi-structured interviews, preference ranking, strategy flow diagrams Livelihood strategies
Analysis of documents For finding out about existing policy a good place to start is government policy documents and ministerial White Papers, although such documents do not always exist even though there is an official policy in place. In such cases memos, draft papers, and statements from key decision makers may be useful sources. Some key questions to address in policy analysis might be: do the policies that exist match the types of policy areas identified as important to poor peoples livelihoods? Do policy documents outline realistic measures and budgets for implementation? Policy on paper does not necessarily mean there is policy in practice, or the policy described may not impact on livelihoods in the way it was intended. These issues need to be verified using other methods. Analysis of policy documents only helps in understanding policy content on paper this is not sufficient without an analysis of context, processes, measures and impacts.
Other document sources relevant for analysing livelihood priorities include Statistical Reports, GIS studies, Participatory Poverty Assessments, and Sustainable Livelihoods Analyses. These can help illustrate who the poor and vulnerable groups are, and what policy areas most affect them. Questionnaires Questionnaires can be effective in gaining a broad picture of peoples views on policy issues. They are useful for collecting a large sample of views for comparison according to different stakeholder groups. The Granada Forest Department produced a questionnaire to provide input into its Forest Policy review process. Sample questions from the questionnaire are illustrated in Box 2. Box 2 Granadas forest policy questionnaire (selected questions)
Should
the forest department be working with farmers to help reduce soil erosion? Unimportant 1 2 3 4 5 Important Should the forest department be working with hunters to jointly manage wildlife populations? Unimportant 1 2 3 4 5 Important Should forest products that are sold by Government be subsidised? YES/NO Do you depend on the forest for your livelihood or for some of your income? YES/NO Does soil erosion affect you in any way? YES/ NO What should be done about it? Please add your thoughts and comments about any forestry or forest-related issues below (or on an attached sheet) Source: Mayers, J. and S. Bass (1999) Policy that works for forests and people. IIED: London.
Interviews and workshops Semi-structured interviews are effective for consulting and discussing with key informants both those involved in making or influencing policy, as well as those impacted by policy. Oral case histories can be compiled by asking the interviewee to tell a story of a particular incident with policy relevance, or of a policy process they were involved in. This can reveal insights into the actors involved, the context, the policy content and the impacts. Bear in mind, however, that many policy actors may have other political or personal agendas that may influence their responses in interview, and hence such information should be cross-referenced. For example, asking whether a donor supported policy is effective, is likely to elicit a positive response if the interviewer is perceived as having donor connections. Workshops, focus group discussions, and village or community meetings are other fora for bringing together groups of stakeholders, with either similar or contrasting perspectives in a particular policy issue. A range of participatory methods for eliciting information have been developed, many of which are described in the sub-sections below. Time lines In key informant interviews or groups discussions, time lines can be constructed to clarify the ordering of events over time that led to say a policy change, or change in livelihood strategy. This method can highlight key catalysts, or chance events that led to change, as well as helping to gain an understanding of long periods without apparent
change. The wider discussion around the making of a time line should also be captured, and interesting issues raised can be explored in more detail using other methods. Again, different stakeholders may have contrasting understandings of whether changes have occurred, and may identify mismatches between changes in policy at the macro level and changes on the ground. Stakeholder Analysis Stakeholder analysis is a technique to identify and assess the importance and interests of key people, groups, or institutions that significantly influence policy making processes or are influenced by policy. The method can be used flexibly to investigate and analyse a whole range of stakeholder interests, characteristics, relative power, and circumstances (see table 2).
Increasing production via progressive farmers Sustaining effective programmes and funding
Low High
High High
Medium Medium
Low Medium
Source: Based on an example in Grimble, R (1998) Stakeholder methodologies in natural resource management. Socio-economnic methodologies best practice guidelines. NRI/DFID.
Policy mapping Policy maps can be used to map lines and directions of influence in the policy environment. It is a good visual technique, helping to open up discussion. An example of a generic policy influences map, taken from Mayers and Bass (1999) is illustrated below (figure 2). More complex maps can be created, e.g. showing the influence of different policy actors on the policy making process. Figure 2: A generic policy influences map. Macro Economic Policies Policies Affecting Land use Policies Influencing Demand for Forest Products Forest Management Policies
Source: Adapted from Mayers, J. and S. Bass (1999) Policy that works for forests and people. IIED: London, p 262.
Headloaders
Institutional analysis VFC A range of mapping exercises2 can be used to explore institutional and organisational Commercial Agencies Quarry relationships. Based on the principle of circles representing organisations, institutions, Owners NTFP projects and actors, the connections or distance between them can illustrate different Collectors -5 +4 +2 +4 types of relationships. Connections can be represented through overlapping circles, or +2 by connecting lines. +4 Poachers/
Hunters
Consultants, NGO
Figure 3 below illustrates one such type of mapping exercise in which the size of the -1 +1 circle illustrates the relative importance of the interest group, and the thickness and Bigtime direction of the arrow that connects it with the issue in question denotes the strength and Foresters Smugglers Village Collie, +4 -1 only for Logging direction of the relationship. A broken line denotes an informal relationship. Plus/minus Dysfunctional Groups signs can be added to show whether the influence is positive or negative.
+1
Dalapathi
Artisans
Figure 3:
+3 +3 -5 -4 +2
-3
Important Leaders
+2
Politicians
+2
KEB
Govt.Depts.
Policy ranking The significance of certain policies or policy issues can be ranked in order, or ranked against one another. in order to reveal which policy issues or sectors are most relevant to peoples livelihoods. This can be carried out by people affected by those policies, as well as by those in positions of authority who might influence decisions in those policy areas. Policy matrices Matrices can be used for cross-referencing a range of factors in order to identify relationships and influences. The example below illustrates the relationships between different stakeholders in a forest are in NE Thailand, and the impact of environmental policy on them. During a stakeholder workshop the matrix was developed to identify the conflicts and complementarities between the stakeholders. Table 3. Policy matrix of conflicts and complementarities Government NGOs Wood-based Non-resident departments industries land owners Government departments NGOs Wood-based industries Non-resident land owners Local people Local people
C C C C
Conflicts of interest are represented by complementarities by and co-operative action by C. Source: Grimble, R. (1998) Stakeholder methodologies in natural resource management. Socioeconomic methodologies best practice guidelines. NRI/DFID
Policy strategy analysis Flow diagrams can be used to trace and analyse the strategies used by actors, for instance, to influence policy, or to gain access to a restricted resource. The normal course of events is described, and the alternative routes that can be accessed when barriers are encountered. Other participatory methods Other participatory methods that can be used or adapted to investigate policy issues include: resource tenure and rights maps indicating ownership of land or resources; mobility maps showing seasonal movement, migration trends, etc; visioning exercises to elicit livelihood priorities; flow diagrams to map policy strategies; and time-lines to draw up policy/livelihood changes over time.
6. Methodological issues
As already noted, policy is a complex issue. In this section some of the methodological implications of those complexities are highlighted, in order to bring them to the attention of the policy analyst.
Policy
affects different groups in different ways Poor and vulnerable groups experience policy impacts in various ways. The analysis will need to differentiate between impacts on different stakeholder groups (e.g. women, minorities, etc.), and consider unintended or indirect impacts on non-stakeholder groups.
Institutional/organisational
environment is not uniform Policy in practice can vary greatly between different parts of a country or province, according to local variations in the institutional/organisational environment. This environment can also change over time, without change in policy statements. Hence, geographical and temporal dimensions should be taken into account for a comprehensive analysis.
Policy
and policy making are macro, meso and micro processes. Policies that impact on livelihoods may come from a number of levels: international (e.g. environmental legislation); regional (e.g. trade agreements); national; sub-national (state or provincial); and local (made by decentralised authorities). Furthermore, policies of neighbouring countries can effect livelihoods strategies or assets, e.g. migration or pollution. It is important to differentiate between these levels, and the paths of influence between them, in the policy analysis.
Policy
is highly political Policy processes are influenced by personal and party politics, and peoples understandings of a policy process will be influenced by their particular agendas and perspectives. Hence, asking similar questions are likely to elicit a range of responses from different people. For this reason it is important to cross-reference and triangulate sources in order to get as accurate a picture as possible of any particular policy issue.
6. Acknowledgements
I would like to acknowledge the valuable input and comments of Alex Shankland, and his permission for me to draw heavily on his paper Analysing Policy for Sustainable Livelihoods, and on his ideas during discussions.
7. References
Bird, Pippa (no date) Mapping the institutional landscape. Grimble, Robin (1998) Stakeholder methodologies in natural resource management. Socio-economnic methodologies best practice guidelines. NRI/DFID Keeley, James and Ian Scoones (1999) Understanding Environmental Policy Processes: A Review. IDS working Paper 89. IDS: Brighton
Mayers, James and Stephen Bass (1999) Policy that works for forests and people. IIED: London. Shankland, Alex (2000) Analysing Policy for Sustainable Livelihoods. Research Report 49. IDS: Brighton.