Author Archives: Sarah Osman

30 Jun

Policy reform for social change: lessons from abortion law reform in sub-Saharan Africa

Since 2000, 21 sub-Saharan African countries have reformed their penal codes or passed laws to expand the legal grounds for abortion (Bankole et al, 2020). This is a tremendous achievement which has had and will continue to have an immensely positive impact on African women’s sexual and reproductive health and rights (SRHR).

A conducive policy environment is often a prerequisite for social change. One of the areas where this is highly evident is in SRHR and especially when it comes to access to abortion.

If we apply the socio-ecological model (SEM) to access to abortion services, we find that in several geographies, the most prominent barrier is a restrictive policy environment. When we look closer, we can see that in order for an individual’s access to services to increase, we will also need to work at additional levels (individual, interpersonal, community, health-facility) to enable service access and uptake.

In this piece, I’d like to zoom into how change in abortion laws in sub-Saharan Africa was achieved over the past two decades. There are some important lessons to be learnt on effective strategies that can transform health equity. Here are a few policy change tactics that have contributed to the recent policy reforms (Bankole et al, 2020).

Tactic 1: Using an international policy that countries have ratified.

Undoubtedly, one of the key success factors in abortion law reform in Africa is the Maputo Protocol, which is the African Union’s main legal instrument for protecting women’s rights. It clearly states that Member States shall “protect the reproductive rights of women by authorising medical [here, ‘medical’ means ‘safe’] abortion in cases of sexual assault, rape, incest, and where the continued pregnancy endangers the mental and physical health of the mother or the life of the mother or the foetus” (Bankole et al, 2020). The Maputo Protocol provides a solid legal foundation to demand legal access to abortion, to preserve a woman’s health including her mental health. In recent years, the Maputo Protocol has been used as the basis to expand as well as achieve law reform in several countries, most recently the Democratic Republic of Congo and in Rwanda.

Tactic 2: Timing to coincide with policy windows.

One of the first African countries to have progressive abortion laws was South Africa, which decriminalised abortion in 1996. The tactic employed by advocates at the time was to build coalitions around the formulation of the post-Apartheid constitution to highlight how unsafe abortion impacted Black South African women. This proved to be a very effective tactic and the Termination of Pregnancy Act, with one of the rarest provisions of abortion upon request, is still in force.

Other examples of seizing opportune timing come from Kenya and Somalia. In both countries, reforms to expand abortion laws happened when constitutional amendments were being made. Although the legal scope is not as large as it is in South Africa, it still enabled moving the needle from a total ban on abortion for it to at least be permitted to save a woman’s life.

Tactic 3: Advocacy by government officials.

Government officials taking up advocacy on polarising issues such as abortion is an important tactic in policy reform. This is because their support for issues both legitimises the work being done by civil society actors as well as offers access to support from colleagues who can continue intragovernmental advocacy. In the case of abortion law reform in Mauritius, one of the most influential moments was the speech by the then Minister of Gender Equality, Child Development and Family Welfare, on the health care challenges faced by young women in Mauritius including unsafe abortion.  

Tactic 4: Expanding the interpretation of the law.

Rather than creating new laws, some African countries have reformed interpretations of the current laws (Ethiopia, Ghana and Zambia). In these instances, it comes down to who, for example, should assert that a woman was raped when she seeks as abortion. In many countries, a woman will have to prove that she was raped, which is in and of itself an enormous access barrier. However, countries like Ethiopia have reformed the law to state that a woman’s claim that she was raped is sufficient grounds to grant her an abortion.  This, along with clear and expanded clinical guidelines, decreased unsafe abortion-related morbidity by 10% in just six years.

Social and behaviour change is as important as the existence of legal frameworks.

Bankole et al (2020) note that “law reform alone far from guarantees that women will get the safe procedures that they are legally entitled to. Implementation of a law matters far more than its wording, and many obstacles prevent new laws from changing entrenched behaviours. Failure to inform the public, health care providers and government officials about what a new law entails is a common barrier to implementation.”

It is important to further understand how countries with restrictive abortion laws have managed to change the tide, because while it is not the end all of service access, it is crucial to have a legal framework to ensure that services provided are of high quality and for personnel to be trained to provide the best service. However, if we do not work across the socio-ecological model when it comes to safe abortion access, we will not succeed. The painful reality is that even in countries with progressive laws such as South Africa, women still opt for unsafe providers due to psychological, social and structural barriers.  

Please read the excellent Guttmacher report From Unsafe to Safe Abortion in Sub-Saharan Africa: Slow but Steady Progress.

31 May

Evaluating projects with a behavioural perspective

According to the leading evaluation resource, Better Evaluation, “evaluation, in its broadest sense, refers to any systematic process to judge merit, worth or significance by combining evidence and values”. Just as evaluations are a key part of the process of any behaviour change intervention, they are also key in traditional international development projects and programmes.  Virtually all international development organisations commission (external) evaluations. In theory, these project or programme evaluations are supposed to offer insights into what worked during implementation, for who and under what circumstances. However, often, they are delivered to the commissioning organisation, passed on to the donor, and rarely looked at again.

My suspicion is that one of the main reasons that evaluation reports are rarely used, or not used efficiently, is because they do not ask the right questions. In my (very biased) opinion, evaluations should at a minimum include behaviour change questions. Ideally however, they should start with a behavioural perspective.

The OECD Development Assistance Committee (DAC) evaluation criteria are now standard in almost every evaluation. In 2020, the OECD updated their evaluation criteria to include an additional sixth criterion, coherence. Coherence focuses on how well a project fits in with or adds to other ongoing projects, as well as local policies.

The OECD calls for the ‘thoughtful application’ of the criteria, but if you ask anyone in the sector, they will admit that most of the time, the evaluation questions are copy/pasted without much thought. Part of the reason is that evaluations are seen as a tick-box exercise rather than a valuable part of intervention implementation and future intervention design.

If we look at criteria such as relevance, effectiveness and sustainability, there are often missed opportunities in how these criteria are interpreted. For example, while assessing relevance, evaluators will often look at whether an intervention is relevant to the needs of a community from a technical standpoint. In other words, if community members have a problem generating income, offering them goods to sell as a means of income-generation would be a relevant solution. However, if one was to return some time after the evaluation was completed, they may find that the community members have used the majority of the goods for their own sustenance because that was their main priority at the time. If, on the other hand, a behavioural perspective was first considered, an evaluation would assess the extent to which the intervention was co-designed with the intended audience for a nuanced solution that helps to address their current needs as well as future needs.

Effectiveness is another tricky criterion to evaluate because NGO outcomes are notoriously vague and unspecific, and they leave a lot of room for interpretation. The conclusions on the effectiveness of an intervention end up being vague because the defined objectives themselves are vague. One of the most innovative solutions I came across that addresses the problem of vagueness in the evaluation process comes from E. Jane Davidson and her innovative technique of evaluation rubrics.

A rubric is a framework that sets out criteria and standards for different levels of performance and describes what performance would look like at each level.  Rubrics have often been used in education for grading student work, and in recent years have been applied in evaluation to make transparent the process of synthesising evidence into an overall evaluative judgement (Oakden, 2013).

This adapted approach helps us to dig down on, for example, what has really changed in people’s behaviour as a result of what we introduced. For example, our outcome might read ‘partner organisation builds capacity’, but the question is, what in their behaviour will tell us the extent to which their capacity was built and what values will we put to the varying degrees of these changes.

Sustainability questions also often leave a lot to be desired. A quick Google search shows just how unsustainable many development programmes are. Again, if we ask the right questions, we can do better in the next iteration of an intervention. For example, a hallmark of sustainability should be the extent to which adopting new tools, services, trainings, stipends, or whatever else is offered under the intervention, at a minimum, follows the principles of the EAST framework: Easy, Attractive, Social and Timely.

One way in which many evaluations can be made more informative and user-friendly would be to incorporate behavioural intervention design frameworks as a way of assessing the extent to which an intervention truly made a difference in a community. For the novice in behavioural science, using the socio-ecological model as an entry point to understanding social change will offer a lot of depth and nuance, and move us away from sole descriptive facts to evaluative conclusions that effectively guide better programme design.

On that note, I leave you with evaluation questions that Davidson (2012) recommends for better quality, to-the-point and usable evaluation reports:

  1. Was the programme needed and is it still needed? How well does it address the most important root causes? Is it still the right solution?
  2. How well designed and implemented is the programme?
  3. How valuable are the outcomes for the intended groups?
  4. What works best for whom, under what conditions, why and how?
  5. How worthwhile was it overall? Which parts or aspects of the programme generated the most valuable outcomes for the time, money and effort invested?

Do you have other ideas about how we can make evaluations more useful? Share your thoughts with me here!

 Davidson, E.J. (2012). Actionable evaluation basics: Getting succinct answers to the most important questions. Real Evaluation.  

 Oakden, J. (2013). Why rubrics are useful in evaluations.

28 Apr

High fidelity project implementation: Why it matters and how to monitor it

Imagine one of your partner organisations just launched a financial literacy programme and wants to work with you to get the word out to young people to attend the trainings. You design a Facebook and Instagram campaign that runs for 3 months. Let’s say that at baseline, 50 people were attending the trainings, and after the campaign the same number of people were attending the trainings: 50.

It would be very tempting to conclude that the campaign didn’t work because the number of attendees didn’t increase. But this is not accurate because we don’t know whether the campaign was implemented with fidelity.

Fidelity of implementation is the degree to which an intervention is carried out the way it was designed. Monitoring implementation fidelity, though a crucial part of an intervention, is often ignored. Without monitoring fidelity, we can’t really say with any certainty whether interventions work or not. In the Behavioural Drivers Model, this is referred to as ‘the black box of behaviour change programming’ (Unicef, 2019, pg. 3).

Why monitoring intervention fidelity matters

Continuing with our example above of the social media campaign we designed, consider the four scenarios below. In all four cases, let’s assume that we monitored fidelity.

In the first scenario, fidelity was high and the outcome was also positive. In this case, we can be confident that our intervention, as it is designed, works for the purpose we designed it for.

In the second scenario, we can’t draw conclusions about the effectiveness of our intervention, because we didn’t implement it the way it was designed. For example, maybe we planned to post three times per day on Instagram but did not do that throughout the implementation period.

In the third scenario, we have good reason to believe that our campaign is not effective in getting young people to attend the financial literacy training. It may be because there are factors we did not design for or the modality is not correct. In any case, we have great information that, the campaign, as it is currently designed, does not work and we can draw important lessons as we move forward.

In the final scenario, although the outcome was positive, we don’t know whether we can take any credit for our campaign, because it wasn’t implemented as designed. Perhaps there was another parallel intervention that caused this positive outcome.

As we can see, scenarios 2 and 4 would be particularly troubling. In scenario 2, we may incorrectly draw the conclusion that our campaign doesn’t work at all, and throw it out, meanwhile, it may not have worked in that instance because we didn’t implement it with fidelity. Scenario 4 would also be unfortunate because without measuring fidelity, we would think that our campaign is fantastic and continue to implement it piecemeal, and never really know whether it works or not, or what exact aspects work.

Monitoring fidelity

According to Finney et al (2021), there are five criteria that one should look at when assessing implementation fidelity.

As a starting point, we want to have a theory of change that explains why we think the intervention will work in the way that we designed it: the programme differentiation. Second, we want to monitor how well we adhered to implementing the different features of the intervention. Third, we need to check the standards to which we implemented the intervention and ensure that the quality was high. Fourth, we need to check whether the full dosages of the intervention were administered. And finally, we need to note how responsive our target audience was to the project.

Who should monitor implementation fidelity?

To get an objective perspective on fidelity, it would be good to have multiple check-in points of project implementation. For example, the programmes department responsible for roll-out should have a robust monitoring system that would allow them to track project implementation. It would also be good to have regular feedback loops with the intended audiences on how much of the dosage is reaching them, by, for example asking them how many posts they see in their feed or how often they interact with a component of the project. Finally, it would also be important to verify the five implementation fidelity components by an external evaluator.

In conclusion, implementation fidelity is essentially just as important as implementing the project at all. Without it, we would be left with little information on whether what we are doing works and to what extent.

Has implementation fidelity impacted a project you worked on recently? Share your thoughts with me here!

References

Finney, S. J., Wells, J.B. & Henning, G. W. (2021) The Need for Program Theory and Implementation Fidelity in Assessment Practice and Standards. National Institute for Learning Outcomes Assessment

Kok, G. (2014). Practical Guideline to Effective Behavioral Change. The European Health Psychologist, 16(5), 156–170.

UNICEF. (2019). The Behavioural Drivers Model.

31 Mar

Debunking and Pre-bunking: A brief overview of the application of Inoculation Theory to combat misinformation

In 1964, social psychologist William McGuire wondered how resistance to persuasive messages can be built. Motivated by the idea of recovering brainwashed American prisoners of war, he came up with the analogy of looking at a persuasive message as an infectious disease. Inoculation Theory postulates that attitudes can be inoculated against persuasive attacks by building the ‘cognitive immune system’, the same way that one can build biological immunity. Similarly to a biological vaccination, this psychological vaccination can be brought about by exposing individuals to a persuasive message that contains weakened versions of the argument.

Recently, work by Compton et al (2016) and van der Linden (2022) has highlighted the mounting evidence for the design of messages to counter misinformation using Inoculation Theory. One of the many exciting features of Inoculation Theory is that it can be used to both treat misinformed individuals (debunk) as well as psychologically vaccinate against future misinformation (pre-bunk).

This piece summarises the key tenets of the application of Inoculation Theory to treat against as well as prevent infection with misinformation.

Designing debunking messages

Research by van der Linden (2022) has shown that one of the major determining factors to whether a debunk message is effective or not is the quality of its design. To this end, he offers four steps to designing a successful debunk message.

Lead with the facts

Misinformation spreads because it is repeated. The repetition of information is effective for two reasons. First, people think that information that they encounter repeatedly is true, also known as the illusory truth effect. Secondly, information that is repeated becomes more available in our short-term memory, also known as processing fluency. Therefore, the first step towards designing an effective debunk message is to lead with the facts. The information needs to be simple and sticky, while maintaining accuracy. What will make the information sticky will of course depend on the target audience. The key thing is to lead with the correct information, and not the false information.  For example, a factual message could be “the IUD is a safe and convenient contraceptive method preferred by hundreds of thousands of African women.”

Warn about the myth

Following the inoculation analogy, for people to build cognitive immunity against false information, they need to be exposed to a safe dose of false information. At the second stage, one needs to present the target audience with a warning of the type of false information that they may encounter, along with a low dose of the message that should only be presented once. For example, the low-dose false message could be “the IUD is not made for African women.”

Expose the manipulation technique

It is then important to explain to people why this myth is not true and the way in which the information has been designed to mislead them. The motivation of the communicator should be clearly explained as well as how they used their words to try to trick the audience into believing the false information. In our example, the culprit could be exposed as trying to elicit in-group/out-group emotions amongst African women by making them falsely believe that IUDs are not for them, while there is ample scientific evidence on its perfect safety for African women and that in fact hundreds of thousands of African women already use one.

Present the fact again

The message should end with presenting the fact again to reinforce it. It should also include a credible alternative explanation. For our IUD example, we could include a video by an African WHO-affiliated doctor who explains the safety of the IUD along with an interview with an African woman who uses one and vouches for how happy she is with it.

Designing pre-bunking messages

The pathway to prophylactic messages is slightly different in that one starts with variations of the false message. One type of messaging triggers a response to a threat, while another offers a low dose of falsehood, or a pre-bunk.

Forewarning of impending misinformation

Psychological inoculation can be triggered through a motivation threat response, where one attempts to defend themselves against the threat of the false information. Going back to our IUD example, we could present women with a message such as “there is an intentional false message being spread in your social media network about IUDs” and adding that this is purely fictional and a source of proof that it is incorrect information.

Refutational pre-emption

The second way is to present the pre-bunk message in the form of a low dose of the false information. This could be same type of message used in debunking where we warn about the myth, e.g. “the IUD is not made for African women”. This is then followed by truthful refutations.

The application of Inoculation Theory to message design is not only highly effective, but it also has some remarkable additional features (Compton et al., 2016) that make it feasible and efficient for use in international development:

  • Psychological vaccination against one type of misinformation has been shown to provide umbrella protection from other types of misinformation. It is as though cognitive pathways are trained to resist misinformation in general.
  • Inoculated individuals engage in post-inoculation talk, which leads to the spread of the correct information, and when enough people are psychologically vaccinated, it can lead to a kind of herd immunity against misinformation.
  • Treatment messages can be delivered quickly and early to prevent known threats. For example, this could be exceptionally useful for areas such as promoting information for soon-to-be parents to improve child protection.
  • Interventions can be designed to promote the active generation of cognitive antibodies to misinformation through games that give players the chance to get into the mind of a misinformation designer.
  • Messages can be delivered with brief or little interpersonal interaction, which means that they can effectively be used in mass media campaigns sustainably and cost-effectively.

Have you used Inoculation Theory in your work? Share your insights with me here!

Compton, J., Jackson, B., & Dimmock, J. A. (2016). Persuading others to avoid persuasion: Inoculation theory and resistant health attitudes. Frontiers in Psychology, 7(February), 1–9. 

van der Linden, S. (2022). Misinformation: susceptibility, spread, and interventions to immunize the public. Nature Medicine, 28(3), 460–467. 

28 Feb

Characteristics of impactful information campaigns

I recently came across an incredible article from Abdul Latif Jameel Poverty Action Lab (J-PAL) that summarised their review of what designing an effective information campaign looks like. In social and behaviour change, we are tempted to design complicated, multi-layered interventions. But can information campaigns work too?

Information is a fundamental part of behaviour change. However, the way that this information is conveyed is crucial. The format, dosage, framing, structure, and delivery are amongst many factors that influence the impact of the piece of information being delivered. Often, we think that campaigns have been effective because they increased knowledge, but most of the time, they have changed other important behavioural determinants as well and that is why they were successful. To illustrate this, I will share two examples from the J-PAL review that used information as a medium and that were successful in changing behaviour.

Sugar Daddies

According to the Health Belief Model, risk perception (perceived susceptibility) is one of the key determinants of whether one takes on a protective behaviour or not. Risk information therefore needs to be carefully shared to increase perceived susceptibility. A study by Dupas (2011) showed how an HIV risk information campaign reduced unsafe sex with older men amongst Kenyan teen girls by up to 61%. Given that unsafe sex with older men is one of the key drivers of HIV infection rates amongst adolescent girls in Africa, this result is remarkable. So, what characteristics of this information campaign made it so successful?

  1. “Relative Risk Information Campaign”. Although the campaign was designed to disseminate information (increase knowledge) it also had a specific focus on ‘relative risk’. The information was presented using examples from a nearby city that teens could relate to.
  2. Presenting data in a familiar scenario. Because the information was presented using statistics of people that the target audiences could relate to, they managed to build a mental risk model of how this could play out in their own lives and how they could protect themselves.
  3. Use of videos. A 10-minute video was shared with the target audiences that contributed to grabbing attention through modelling.
  4. Group discussions. Group discussions after watching the videos likely contributed to reinforcing knowledge as well as impacting attitudes towards older men who have sex with younger women.

Increasing insurance coverage

According to the Extended Parallel Process Model, people will go through a number of stages when processing a preventative health message. First, they will assess how big the threat is and how susceptible they are to it. Second, they will assess whether there is something that they can do about it and whether that thing is available or accessible. If either of these steps fails, the message will be rejected.

In France, low-income youth are unlikely to use primary health care and have a higher prevalence of physical and mental health conditions than wealthier youth. One of the barriers to their access of the health system is the fact that they are not registered in the universal health insurance system. Crépon and Pernaudet (2019) designed and tested an information intervention that not only got low-income youth to enrol in the health insurance scheme, but one of the intervention arms doubled the number of those who saw a psychologist afterwards. What worked?

  1. Making things easy. The intervention was offered at the same place where young people came for job seeking support. They could see a social worker (one arm of the intervention) or a social a worker and a doctor (second and more successful arm of the intervention) at the same place.
  2. Tailored information dissemination. The information sessions were offered one-on-one, which meant that clients could get information tailored to their specific situation and needs.
  3. Personalisation. The social workers and doctors were able to stay in touch with each client over a one-year period, keeping the opportunity for personal communication open.
  4. Credibility. The fact that the information about seeking health services came from a credible source (a doctor) probably increased the persuasiveness of the message.

What is interesting about these two examples is how impactful a well-designed information campaign can be. At the surface, it may seem like all that was done was, well, information dissemination, but in fact, both interventions had elements that targeted several behavioural determinants and that is most likely why they were effective.

J-PAL (2021) conclude with some key characteristics of successful information campaigns.

  • Pairing specific information with actionable steps encourages take-up of healthy behaviours.
  • Choosing effective messengers for the local context is critical for building confidence and trust to encourage behaviour change.
  • Peers and other members of a social network are often powerful means of spreading information about health products and behaviours.
  • Using technology, including entertainment media, SMS messages and social media such as Twitter and WhatsApp, can amplify the reach of messages.
  • When the perceived cost of behaviour change is high due either to financial or nonfinancial costs, information alone is often ineffective at changing behaviour.

Have you come across some well-designed information campaigns? Share them with me here!

References

Abdul Latif Jameel Poverty Action Lab (J-PAL). (2021). “Designing information campaigns to increase adoption of healthy behaviors.” J-PAL Policy Insights. Last modified August 2021. https://doi.org/10.31485/pi.0805.2021.

Crépon, B. and Pernaudet, J. (2019). “Correcting Beliefs to Increase Health Investments: A Field Experiment Among Disadvantaged Youths.” Working Paper, October 2019

Dupas, P. (2011). “Do Teenagers Respond to HIV Risk Information? Evidence from a Field Experiment in Kenya.” American Economic Journal: Applied Economics 3: 1–34.

Maloney, E.K., Lapinski, M.K., Witte K. (2011). “Fear Appeals and Persuasion: A Review and Update of the Extended Parallel Process Model: Fear Appeals and Persuasion”. Social and Personality Psychology Compass. 5 (4): 206–219.

Skinner, C. S., Tiro, J., & Champion, V. L. (2015). The Health Belief Model. In K. Glanz, B. Rimer & K. Viswanath (Eds.), Health behavior: Theory, research, and practice (5th ed., pp. 131–167). San Francisco, CA, US: Jossey-Bass.

30 Jan

Useful behavioural mindsets

Success in applying behavioural methods to projects requires a bit more than following specific guidelines prescribed in books. At the heart of an impactful social and behaviour change project is the way in which the project team and the organisation view and think about what they are doing. With a new year ahead of us, here are five behavioural mindsets to consider.

Be open to considering another discipline’s approach to the issue.

To start, it is useful to step aside from your area of expertise and consider the problem you are trying to address from the perspective of other disciplines such as social psychology, behavioural economics or anthropology, some of the disciplines that inform behavioural science. At the centre of all projects is people needing to change their behaviour, and training in your field of expertise may not offer sufficient tools to deal with human behaviour. For example, if you are managing an agricultural project to improve farm yields, distributing improved seed varieties alone may not be enough to get farmers to use them. Looking at the issue from a behavioural lens will help to identify factors that may impact how the project runs.

Be open to the fact that scientific rigour can lead to creative solutions.

It may sound counterintuitive, but you will discover that the process of scientifically analysing an issue will lead to creative solutions. The behavioural design process of identifying key behaviours, sub-behaviours and behavioural barriers can seem tedious and over-the-top. But if you see the process through and match the correct behaviour change tactics to the barriers you identified, often, you will find completely new approaches that you haven’t considered before. For example, we may discover that we have been approaching an issue from a very high-level place, e.g. “let’s change how a community views contraception” rather than what is actually happening in the experience of contraception use, e.g. “how can we give young women the skills to negotiate condom use when they need to?”. These two approaches will naturally lead to completely different interventions.

Be open to failure because it is great evidence.

In development work, the stakes are very high because we are dealing with people’s lives. The heightened stakes make us very fearful of making any kind of mistake. We translate this by designing large-scale projects with enormous outcome statements, and the ostrich effect comes into action causing us to avoid the possibility of getting information on whether the intervention is actually working. A behavioural approach to programme design would allow us to prototype a small number of potential solutions at a small scale first and scale those that seem promising. Some of the solutions will fail, but that’s great because we got some very useful information. Fostering an experimental mindset in an organisation is a great investment.

Be ready to overhaul and rethink your strategic plan.

You know that five-year strategic plan your team gave input on two years ago? How many times have you revisited it since it was published? The interventions that you are designing will have ripples and effects, some negative and some positive. Life is happening and things are constantly changing, so your strategic plan needs to be malleable and adaptable. The Asia Foundation has a fabulous resource on how to revisit your strategy, called Strategy Testing.

Be communicative about your projects, your approach and your results.

As we all know, one of the best ways to learn is exchanging ideas with others about what we did and what happened. One of the things that often surprises me is how little organisations know about what their colleagues are doing in other countries, but even in other departments. The best way to further test an innovation is to try it somewhere else in the organisation that has similar conditions. Fostering an environment of knowledge exchange internally is vital. Often, there is also latent knowledge and expertise across teams that can help you further design your project. Sharing project processes and outcomes externally is just as crucial. A great example of this is how the global Johns Hopkins projects Breakthrough RESEARCH and Breakthrough ACTION have created a mega resource for learning across disciplines and countries on how to apply behavioural science in global development.

For more, I highly recommend the article by Naru & Laffan (2021) on their experience fostering a behavioural mindset in the OECD, which can be found in the 2021 Behavioural Economics Guide.

Have you recently adopted any of these mindsets? What has your experience been? Share your thoughts with me here!

22 Dec

Behaviour change tactics in action: real world examples

Amongst the most critical steps in the behaviour change intervention design process are (1) choosing a behaviour change tactic that has evidence of changing the behavioural determinant that you identified and (2) that you use that behaviour change tactic bearing in mind the implementation parameters for that tactic, that is, understanding the conditions under which the behaviour change tactic will be effective (Kok et al., 2016).

In this article, I share five examples of the operationalisation or practical implementation of some behaviour change tactics (aka ‘methods of behaviour change’, ‘behaviour change techniques’ or ‘behaviour change principles’) in development projects.

Behavioural journalism

Behavioural journalism is an effective technique in changing social norms about topics that may be regarded as taboo. It uses mass media to share stories of behaviour change based on authentic interviews with the target group.

A great example of this is the youth sexual and reproductive health project Merci Mon Héros. The format centres around young people sharing stories of times they faced difficulties related to sex, contraception or relationships. They share stories of how they got help from an older person in the community: a parent, extended family member or community member. Both tell their side of the story and detail how they made the change they needed to make. The videos end with a call to action to use contraception and learn more about sexual and reproductive health. You can read about the preliminary impact of the project here.

Scenario-based risk information

A key factor in people’s decision to take up a preventive or curative heath service is that their risk perception, or the perception that they are at risk of experiencing negative consequences due to inaction, must be high. However, risk perception must be high in conjunction with high self-efficacy and response efficacy. That is, it needs to be clear what people can do to avoid the harmful outcome and hold a belief that the solution presented will indeed be useful in mitigating the harmful outcome.

A good example of how risk perception can be carefully increased is the use of scenario-based risk information. This tactic allows people to create a mental picture of how a future harmful incident can occur by allowing them to create their own mental scenarios. This can be done verbally or in written form, through the description of specific scenarios, or through vignettes. It can also be done using a combination of visual  cues and text, as in the example below of a visual aide created to help people gauge the level of risk they are taking in contracting Covid-19 when they engage in specific activities.

Normative feedback

A tactic that can work well in changing behaviour at the individual or group level by increasing motivation is normative feedback. It works by presenting information about what others who are similar to the target audience are doing. In this sense, it also works by influencing perceptions about descriptive norms (what others like us do).

Below is an example of how MSI Reproductive Choices, tested normative feedback in their clinics in Nepal. Depending on the current clinic status, the posters would suggest ways to improve or commend high-performing centres. The aim was to increase nurse’s counselling and offering of post-abortion family planning (PAFP) and inform women of the choice to get a long-acting reversible contraceptive (LARC) such as an intra-uterine device or implant. Every month, clinics got feedback on how they performed in comparison with three other similar clinics. Green indicated good performance and red indicated poor performance. You can read about the impact of the intervention here.

Self-revaluation

Attitudes have strong underlying belief components influenced by perceptions of the self as well as the community that one lives in. Programmes that want to change attitudes towards products or services must address attitudes at the individual level as well as a person’s experiences externally.

An effective approach to changing attitudes is self-revaluation. It works by allowing individuals to reflect rationally and emotionally on their self-image and their lives with or without the service or product being promoted. Since it often leads to awareness-raising as well, it is important that the process is guided by a person that can offer direct access to the service or product.

Another great example comes from MSI Reproductive Choices in Pakistan. The Improving Reproductive Health Through Awareness, Decision and Action (IRADA) project was built around three steps, the first of which used self-revaluation. It included facilitated “photo discussions to promote self-reflection on critical life-choices, using a timeline to help women understand their life-course and daily routines; drawing body maps to understand their own bodies and role of contraception; and social maps to identify environmental barriers to women’s mobility.” Full details are available here.

Developing new social network linkages

Social networks are often critical to the uptake of services and products. When the usual tactics are not working or when a new product or service needs to be introduced, creating new social networks is often crucial.

A fantastic example of how this can be done is a tuberculosis (TB) case detection project in Nigeria. It developed new networks to increase TB testing through:

  • Chemists or medicine-dispensing stores, which gave TB testing referral cards to clients who they suspected of having TB.
  • Religious leaders who disseminated messages on how to spot TB symptoms to get tested.
  • Community members, using social support messaging, to recognise symptoms and get tested.

You can watch the full video here.

Do you have examples of behaviour change tactics? Share them with me here!

Breakthrough RESEARCH (2021). Findings from the Merci Mon Héros social listening endline report. Population Council, Washington DC.

Kok, G., Gottlieb, N. H., Peters, G. J. Y., Mullen, P. D., Parcel, G. S., Ruiter, R. A. C., Fernández, M. E., Markham, C., & Bartholomew, L. K. (2016). A taxonomy of behaviour change methods: an Intervention Mapping approach. Health Psychology Review, 10(3), 297–312. https://doi.org/10.1080/17437199.2015.1077155

MSI Reproductive Choices (2018). Evidence and Insights.

11 Nov

HCD x SBC: Applying human-centred design approaches to social & behaviour change project design

There is a growing understanding that people should not only be involved in informing behaviour change intervention design but should also be the co-architects of interventions. After all, much of the work we do is centred at the community level where key decisions that affect individual behaviours are being made.

Behavioural design and social and behaviour change (SBC) frameworks are increasingly being applied by NGOs. They offer excellent guidance on how to analyse complex development challenges and offer structure in approaching the issues. But there is growing understanding that we need to expand our toolbox and broaden the engagement of people in intervention design.

A recent publication by Empatika, Nutrition International and Save the Children International (2021) describes their work in using a method they call people-driven social and behaviour change: “People-driven SBC design is a process which builds on some fundamental principles, probably the most significant being that engaging people in their own behaviour change process builds their motivation and confidence to change.”

Another publication by Breakthrough ACTION (2020) looked at where human-centred design (HCD) approaches have been used effectively in family planning programme design. Some of the key insights include:

  • HCD helped create awareness and facilitate meaningful dialogue with policymakers and public-private partnership collaborators.
  • The HCD process provided a fresh perspective on drivers of specific behaviours.
  • Journey maps are a great tool for understanding and designing service delivery systems.
  • HCD allowed the project to better understand the challenges and opportunities providers face in delivering services.

In my practice, I’ve come to value the incorporation of HCD approaches into behavioural design and SBC processes in assisting my clients to think about the problems that they want to address. In many cases, HCD tools have helped me make behavioural design more accessible to beginners. I’ve also come to see that while behavioural design and SBC frameworks bring rigour and focus to addressing challenges, they are not very good at including the direct participation of the target audiences in understanding the challenges better or in intervention design. HCD techniques by contrast push us to include the people we are working for at all stages of the process, including intervention design.

So, how can we get better at being more people-driven in our project and intervention design? At each step of the behavioural design process, HCD has some great tools we can apply.

Definition phase

One of our challenges is the limited tools we use in data collection. Focus group discussions are great tools for offering insights on the aspects of the problem we should focus on. Surveys are great in helping us gather large amounts of data. While these two tools are the most used in SBC problem-definition stages, they do not offer sufficient insights on how decisions are made in the moment. An HCD data collection method that offers much better-quality understanding of lived experience is immersion. While immersion is time-consuming and difficult, it is worth the investment to understand complex problems that the people we are working for experience. We still face serious challenges in designing programmes that are not fully responsive to the needs of communities and individuals. It follows then that we need to immerse ourselves in their experience instead of relying on their recollection of events which will likely be incomplete.  If we absolutely do not have time for immersion, we should at least be using observation (either directly or through peers) to gain insights on what is going on.

Diagnosis phase

At this stage, we want to understand which factors/determinants are making people do certain things. As SBC professional, we are tempted to do this with other experts in a closed room once we collected some data. We are likely to gain valuable information in choosing the right theories to guide our intervention design when we involve people in walking us through their decision-making process. Here we can use simple exercises like card sorting and resource flows to gain better insights on barriers and on how decisions are being made, which in turn will make us much better equipped at identifying relevant theories and diagnosing the problem efficiently.

Design phase

Incorporating HCD principles in the intervention design stage will not only increase the likelihood of getting fresher ideas, but the ideas generated are likely to work in the communities because they are generated by the audience themselves. It will help us to pull-back from talking at people.  At this stage, an important role for us as behavioural designers and SBC professionals is to ensure that evidence-based tactics are used to address the barriers we identified. We can then use a large array of HCD tools to generate ideas for interventions aligned with the tactics we identified, including How Might We, storyboards, co-creation sessions , role play and most importantly prototyping. A key barrier that many NGOs face is the fear of testing something preliminary because it has not been vetted across the organisation and because a full array of staff has not been consulted. Moving towards a mindset of ‘the goal is to make something tangible that is good enough to get your idea across’ is a mindset that I believe could be transformative for many NGOs.

Testing phase

At the intervention testing stage, SBC practitioners can also learn a lot from HCD methods. One of my favourites is live prototyping, which is essentially piloting the intervention at a small scale for a period of time. Again, some of the challenges that NGOs will face at this stage is feeling that a complete baseline study or census needs to be done first, and again, a mindset of ‘this is good enough to test’ needs to come in play. An older, underutilised version of live prototyping is trials for improved practices (TIPS) which offers more detail on what live prototyping looks like in development settings.

In conclusion, HCD has so much to offer SBC practitioners and if HCD tools are used carefully and in conjunction with upholding the rigour and science behind SBC, we are likely to design more impactful projects.

Have you used HCD techniques in a recent SBC project? Share your insights with me here!

References:

Breakthrough ACTION (2020). Leveraging Human-Centered Design for Family Planning: Lessons and considerations. 

Empatika, Nutrition International & Save the Children International (2021). Study Brief: People-Driven SBC Design in BISA Project Formative Research.

IDEO (2015). The Field Guide to Human-Centered Design.

Manoff Group (n.d.). Trials of Improved Practices (TIPS): Giving Participants a Voice in Programme Design

18 Aug

Funding for social and behaviour change projects: Key donors to follow

Social and behaviour change (SBC) is increasingly being seen as an important approach to analysing global development challenges, with powerful tools for better quality programme design. The field is growing rapidly, and luckily, an increasing number of donors are investing in behavioural science or SBC projects. Here is a quick overview of the key SBC donors to follow and the thematic areas they fund. I also recommend this fantastic article on recent moves to formalise and coordinate work being done by various SBC donors.  

USAID: Health and education

USAID is the leading SBC donor. It funds several important initiatives, including The Compass for SBC, Breakthrough ACTION and RESEARCH and Think BIG. Administrator Samantha Power is also a strong advocate for the integration of behavioural science in global development.

Bill & Melinda Gates Foundation: Health and family planning

Gates Foundation fund many SBC projects and play an active role in growing the field of behavioural science for global development. For example, they funded the research that produced the excellent CUBES framework.

GIZ: Agriculture and nutrition

Another active donor in the SBC space is Germany’s GIZ.  Their key interest has been in funding SBC initiatives in agriculture and nutrition. They published an excellent SBC guide in 2019, and in 2020, co-hosted a series of webinars on SBC in the field of nutrition and agriculture.  

AmplifyChange: Sexual and reproductive health and rights

AmplifyChange recognises the central role that social norms play in realising sexual and reproductive health and rights. Several of its grantees are experts in social norms transformation, and the Fund has a dedicated learning platform, AmplifyChange Learn, where grantees can exchange their successful experiences.

Wellcome Trust: Health

The Wellcome Trust is funding one of the most significant initiatives in the behaviour change space, the Human Behaviour Change Project. This is a donor worth following for research-focused funding on behaviour change.

Children’s Investment Fund Foundation: Health

CIFF look for organisations that can help them to achieve their impact. One of these impact areas is ‘transformational change’ which includes sustained behaviour change. They have funding a number of behaviour change projects in nutrition, sexual and reproductive health and rights and hygiene.

Ministry of Foreign Affairs, the Netherlands: Migration and development

The Dutch Ministry of Foreign Affairs has an increasing interest in how behavioural science can be harnessed to improve messaging to migrants using irregular channels, for better protection outcomes. The funding concept note refers to ‘raising awareness’ but hopefully it will be expanded to more comprehensive understanding of SBC in the future.

William and Flora Hewlett Foundation: Family planning

Hewlett Foundation have a focus on behavioural science to improve access to and uptake of family planning methods. In particular, they use behavioural economics in their approach with their grantees. The Foundation is also a sponsor of next year’s SBCC Summit.

David and Lucile Packard Foundation: Social and environmental change

Behavioural and brain sciences play a central role in Packard Foundation’s work. To support grantees in applying this approach to their work, they funded the fabulous publication Heartwired, a fantastic guide for advocates working for social change.

It is wonderful to see so many donors embracing the value that behavioural science can have in the space of global development. Hopefully this will inspire other donors to include a behavioural approach to their programme design and grant-making strategies.

Have I missed other donors in this list? Leave me a comment on LinkedIn!

19 Jul

Tips for designing social and behaviour change projects


Tips for designing social and behaviour change projects

Social and behaviour change (SBC) is an evidence-based, theory-driven process that identifies factors that influence people’s behaviour and addresses these by using approaches that are most likely to produce positive changes in behaviour. There is increasing recognition of how an SBC approach can benefit global development programme design. Incorporating a behavioural lens to development programming has been one of the reasons why we have been able to achieve difficult things like reducing HIV infection rates and increasing the number of people who use insecticide-treated bed nets, even if challenges still exist. Other sectors of global development like child protection, education and migration can also benefit from behavioural design. The key lies in the approach that is taken from the outset to designing projects. If a systematic, behavioural approach is followed, it is likely that the quality of the projects will be high.

If you are in the beginning of your journey to incorporate behavioural thinking into your project design, I will share some tips to help you along the way. Incorporating behavioural science does not have to be a taxing process and can be done with systems and tools that you already have at your disposal.  

Tip 1: Get the right people in the room.

When designing new projects, diverse perspectives are important. You will want colleagues who have worked with communities, government, service providers and in partnership with other civil society organisations. Additionally, it is crucial to have a subject matter expert in the room. It is always recommended to have a colleague with some understanding of behavioural science around. This could be the SBC advisor, the person who just completed a course in human-centred design or someone who has worked on communication for development projects. If you do not have team members with this expertise, hire an applied behavioural scientist or SBC consultant from the outset. They will provide excellent direction on the overall approach of building your project. The team should not be too big – a maximum of six or seven people is ideal.

Tip 2: Mine your data and existing research for behavioural insights.

Most NGOs have a plethora of data that, with the right skillset, can be mined for behavioural insights. Some of the best documents to get information from include:

  • Needs assessments for projects targeting the same groups and thematic areas.
  • Recent stakeholder analyses.
  • Routine monitoring and other project reports.
  • Recent external or internal evaluations.

A key aspect is being able to match behavioural determinants with their theoretical construct equivalent. For example, survey questions asking about confidence or skill level in conducting a task will give insight on the degree of self-efficacy the target has in carrying out specific tasks. Questions around trust in service providers or infrastructure can give insight into structural barriers. Insights on cognitive biases can also be mined if you have information on who people seek information from most often (messenger effect).

The next step is to do a semi-systematic review of the literature to get information on what factors research has shown to be most salient in your area of interest. As far as possible, search for meta-analyses and reviews first before delving into individual studies. Third party data or datasets may also be available from resources such as the Demographic and Health Survey Programme. It is tempting to commission new research right away, but it is much more valuable to first take stock of all the information available to you, so that whatever research you commission next is focused on filling key knowledge gaps.

Tip 3: Use behaviour maps.

Before building your logical framework or results framework, get in the habit of using behaviour maps first. Behaviour maps are a conceptual representation of the steps that need to be taken to reach a desired goal or behaviour. They are a great tool to help you:

  • Focus on key behaviours to change (at the individual, interpersonal, community or societal levels).
  • Map out all the crucial steps an individual or a group of people have to take to reach the desired change.
  • Identify at which point of the process your project is likely to have the most impact.

The Manoff Group offers an excellent guidance template on how to develop a behaviour map (they call it a ‘Behaviour Profile’). It also helps designers interrogate what has to happen around the person or group of people to facilitate the behaviour.

With your team in place, some key questions to ask are:

  1. What is the exact behaviour you want the person/people to do?
  2. What positive existing things do you want to promote?
  3. What inhibits the behaviour?
  4. What can you do about these inhibitors?
  5. What are the empirically verified tactics you can use to influence the behavioural determinants?

Tip 4: Identify relevant theoretical frameworks and build a theory of change.

Once you have a good idea of what factors are influencing your behaviours of interest, you want to start building a model of how the determinants you identified work to influence the behaviour. The complexity of global development work means that you need to take a multi-theory approach, that is, no one theory will be able to sufficiently explain everything that is influencing the behaviour. For example, if you are designing a programme on how to engage parents to read more with their children, you may find relevant determinants from the Theory of Planned Behaviour, Learning Theory and Behavioural Economics. Once you land on the key determinants and understanding the theoretical parameters, you can build your theory of change and logic model. This will also make it easy for you to build your logical and results framework.

Tip 5: Plan for some form of testing.

A high-quality SBC project requires some form of pre-testing. Do this with whatever means are available to you. While randomised control trials are often viewed as the gold standard, they are not the only way to get good quality evidence for how and under what conditions your intervention works. A quasi-experimental design, such as some form of comparative effectiveness, where you compare how your target group who received the intervention compares with another group that is as similar as possible on a set of key criteria, and was not exposed to the intervention, is a widely accepted good quality approach. The World Bank for example applies quasi-experimental designs, which they call ‘nimble evaluations’. If this is too complex, then the standard qualitative and quantitative methods will do. The bottom line is, do not roll anything out without testing it first!

These five tips are central to the design of any good SBC project. Please check out my other articles for additional resources to help in your behavioural design journey and feel free to get in touch if you have questions!