Skip to main content
SpringerLink
Log in

Methodological Practices in Research on Arts-Based Programs in International Development: A Systematic Review

  • Original Article
  • Published:
The European Journal of Development Research Aims and scope Submit manuscript

Abstract

International development initiatives increasingly use programmes involving arts participation to facilitate desired outcomes, such as improved psycho-social wellbeing and conflict resolution. Research into the effectiveness of these interventions has increased commensurately. However, this research has not necessarily been of high quality. This article reports a systematic review of 67 studies of arts-based international development initiatives, to examine the research methods used and the quality of their application. Methodological strength and integrity were analysed against criteria important for research quality in this field, including use of participatory methods, clarity of research question, methodological rigour and system, supportable claims of causal links and supportable generalisations. The findings indicate that only one-third of studies employed robust methods. Challenges include inappropriate selection of research methods to match stated research questions, lack of adequate reporting of data to allow readers to assess the validity of claims, and overly strong claims made with insufficient support.

Les initiatives du développement international font de plus en plus appel aux méthodes artistiques participatives dans leurs programmes pour apporter les résultats souhaités, tels que l’amélioration du bien-être psychosocial et la résolution des conflits. La recherche sur l’efficacité de ces interventions a augmenté de façon proportionnelle. Cependant, cette recherche n’est pas nécessairement de haute qualité. Cet article présente une revue systématique de 67 études d’initiatives de développement international axées sur les arts afin d’examiner les méthodes de recherche utilisées et la qualité de leur utilisation. La force et l’intégrité méthodologiques ont été analysées selon des critères importants pour la qualité de la recherche dans ce domaine. Ces critères comprennent: l’utilisation de méthodes participatives; la clarté de la question de recherche; système et rigueur méthodologiques; des revendications de liens de causalité ainsi que des généralisations défendables. Les résultats indiquent que seulement un tiers des études utilisaient des méthodes robustes. Les défis incluent : le choix inadéquat des méthodes de recherche par rapport aux questions de recherche énoncées, le manque de données rapportées pour permettre aux lecteurs d’évaluer la validité des affirmations, et des affirmations trop fortes avec preuves insuffisantes à l’appui.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

N.B. Articles marked with an asterisk were included in the systematic review

  • *Abah, O., J. Okwori, and O. Alubo. 2009. Participatory theatre and video: acting against violence in Northern Nigeria. IDS Bulletin 40 (3): 19–26.

    Article  Google Scholar 

  • *Al-Krenawi, A., and N. Slater. 2007. Bedouin-Arab children use visual art as a response to the destruction of their homes in unrecognized villages. Journal of Humanistic Psychology 47 (3): 288–305.

    Article  Google Scholar 

  • *Arts Access Australia. 2006. Hamutuk (Connections) East Timor-Australia arts and disability cultural exchange. Sydney: Arts Access Australia. www.ccd.net/projects/browse.html?projectID=1124346608. Accessed 30 Aug 2009.

  • *Bagamoyo College of Arts, Tanzania Theatre Centre, R. Mabalac, and K.B. Allen. 2001. Participatory action research on HIV/AIDS through a popular theatre approach in Tanzania. Evaluation and Program Planning 2002 (1): 333–339.

    Google Scholar 

  • *Bergh, A. 2010. I’d like to teach the world to sing: Music and conflict transformation. PhD diss., University of Exeter, UK.

  • *Betiang, L. 2010. Theatre of rural empowerment: The example of Living Earth Nigeria Foundation’s Community Theatre Initiative in Cross River State, Nigeria. Research in Drama Education: The Journal of Applied Theatre and Performance 15 (1): 59–78.

    Article  Google Scholar 

  • BetterEvaluation. 2016. Generalise findings. http://betterevaluation.org/plan/synthesize_value/generalize_findings. Accessed 10 May 2016.

  • Blom, L., L. Judge, M. Whitley, L. Gerstein, A. Huffman, and S. Hillyer. 2015. Sport for development and peace: Experiences conducting U.S. and International Programs. Journal of Sport Psychology in Action 6 (1): 1–16.

    Article  Google Scholar 

  • *Braden, S., and M. Mayo. 1999. Culture, community development and representation. Community Development Journal 34 (3): 191–204.

    Article  Google Scholar 

  • *Boneh, G. 2013. This is my story: A model for creating performance engaging artists and people living with HIV/AIDS. Matatu: Journal for African Culture & Society 43: 187–202.

    Article  Google Scholar 

  • *Bryant, A. 2006. Summary report of results from HAI evaluation of Bibi Bulak Community Drama. Washington, DC: Health Alliance International.

    Google Scholar 

  • *Casale, M., and J. Hanass-Hancock. 2011. Of drama, dreams and desire: Creative approaches to applied sex education in southern Africa. Sex Education 11 (4): 353–368.

    Article  Google Scholar 

  • *Chamberlain, R., M. Chillery, L. Ogolla, and O. Wandera. 1995. Participatory education theatre for HIV/AIDs awareness in Kenya, 69–74. London: PLA Notes, IIED.

    Google Scholar 

  • *Chinyowa, K.C. 2011. Theatre as laboratory for HIV/AIDS education: the case of Amakhosi Theatre’s play, Vikele. In Acting on HIV: Using drama to create possibilities for change, ed. D.A. Francis, 67–77. Bloemfontain, SA: Sense.

    Chapter  Google Scholar 

  • *Chinyowa, K.C. 2007. By whom and for whom? An aesthetic appraisal of selected African popular theatre workshops. Studies in Theatre and Performance 28 (1): 13–24.

    Article  Google Scholar 

  • Chipatiso, R. 2013. Evaluation of applied drama and theatre in HIV/AIDS interventions: A case study of themba interactive. Matatu: Journal for African Culture & Society 43 (1): 251–267.

    Article  Google Scholar 

  • Cochrane Library. 2018. Cochrane Library. http://www.cochranelibrary.com/.

  • Cooney, A. 2011. Rigour and grounded theory. Nurse Researcher 18 (4): 17–22.

    Article  Google Scholar 

  • *Cooper, T., S. Bahn, and M. Giles. 2012. Investigating the social welfare indicators of Aboriginal Regional Art Centres: A pilot study. Perth: Edith Cowan University.

    Google Scholar 

  • *Cornejo, X.Y. 2008. In the art of revolution: Integrating community arts into the existing development work of non-government organisations in Guatemala and El Salvador. MA diss., University of Southern California.

  • Cultural Development Network. 2016. Cultural development planning framework, Melbourne: Cultural development network. www.culturaldevelopment.net.au/planning. Accessed 16 June 2016.

  • *Dalrymple, L. 2006. Has it made a difference? Understanding and measuring the impact of applied theatre with young people in the South African context. Research in Drama Education: The Journal of Applied Theatre and Performance 11 (2): 201–218.

    Article  Google Scholar 

  • Davies, R., and Dart, J. 2005. The ‘Most significant change’ (MSC) technique. UK: Care International. www.mande.co.uk/docs/MSCGuide.pdf. Accessed 14 May 2011.

  • *de Quadros, A., and P. Dorstewitz. 2011. Community, communication, social change: Music in dispossessed Indian communities. International Journal of Community Music 4 (1): 59–70.

    Article  Google Scholar 

  • DFAT. 2014. Office for Development Effectiveness. Canberra: Department of Foreign Affairs and Trade. http://www.ode.dfat.gov.au/. Accessed 29 Aug 2014.

  • *Dunphy, K. 2011. Evaluating the Scared Cool project: Understanding peacemaking through creativity and personal development in Timor-Leste. UNESCO Observatory Refereed e-Journal 2 (2): 1–20.

    Google Scholar 

  • *Dunphy, K. 2013a. The role of participatory arts in social change in Timor-Leste. PhD diss. Deakin University. www.manyhands.org.au/resources.

  • *Dunphy, K. 2013b. The contribution of creativity to human development in a new nation: a case study of Afalyca community art centre, Timor-Leste. Creativity and Human Development. Creativity eJournal. http://www.creativityjournal.net/index.php/contents/articles/item/153-the-contribution-of-creativity-to-human-development-in-a-new-nation-a-case-study-of-afal…#.VNnoeU0cQ5s. Accessed 10 Feb 2015.

  • Dunphy, K. 2015. A holistic framework of evaluation for arts engagement. In Making culture count: The politics of cultural measurement, ed. L. Macdowall, M. Badham, E. Blomkamp, and K. Dunphy, 243–263. London: Palgrave.

    Chapter  Google Scholar 

  • Dunphy, K., and V. Ware. 2017. Evaluation practices in participatory arts in international development: Findings of a systematic literature review. In: Contemporary Perspectives in Art and International Development, eds. P. Stupples, and K. Teaiwa, pp. 221–237. London: Routledge. ISBN 9781138024700.

  • *Durden, E. 2010. Staging empowerment? An investigation into participation and development in HIV and AIDS theatre projects. PhD diss., University of KwaZulu-Natal.

  • *Etherton, M., and T. Prenkti. 2006. Drama for change? Prove it! Impact assessment in applied theatre. Research in Drama Education: The Journal of Applied Theatre and Performance 11 (2): 139–155.

    Article  Google Scholar 

  • Estrella, M.A. 2010. The vital importance of the arts in personal development. Museum International 62 (3): 26–30.

    Article  Google Scholar 

  • Evans, J.R., R. Wilson, B. Dalton, and S. Georgakis. 2015. Indigenous participation in Australian Sport: The perils of the ‘Panacea’ proposition. Cosmopolitan Civil Societies Journal 7 (1): 53–79.

    Google Scholar 

  • *Fontes, C., and R. Wilson-Grau. 2008. English-language summary of Evaluación del Programa Arte y Cultura de Hivos en Centro América Período 2002–2006. La Haya: Hivos.

    Google Scholar 

  • *Fontes, C., R. Wilson-Grau, and R. Davies. 2010. How do you DOEN? Stories of change from the culture sector in Africa. Amsterdam: DOEN Foundation.

    Google Scholar 

  • *Francis, D.A. 2010. ‘Sex is not something we talk about, it’s something we do’: Using drama to engage youth in sexuality, relationship and HIV education. Critical Arts: South-North Cultural and Media Studies 24 (2): 228–244.

    Article  Google Scholar 

  • *Ghosh, S., R. Patil, S. Tiwari, and A.P. Dash. 2006. A community-based health education programme for bio-environmental control of malaria through folk theatre (Kalajatha) in rural India. Malaria Journal 5: 123.

    Article  Google Scholar 

  • *Gray, A. 2008. Dancing in our blood: Dance/movement therapy with street children and victims of organized violence in Haiti. In Dance, human rights and social justice: Dignity in motion, ed. N. Jackson and T. Shapiro-Phim, 232–236. Maryland: Scarecrow.

    Google Scholar 

  • Grincheva, N. 2016. Sustainable development in cultural projects: Mistakes and challenges. Development in Practice 26 (2): 236–250. https://doi.org/10.1080/09614524.2016.1135878.

    Article  Google Scholar 

  • *Haaken, J., J. Wallin-Ruschman, and S. Patange. 2012. Global hip-hop identities: Black youth, psychoanalytic action research, and the moving to the beat project. Journal of Community & Applied Social Psychology 22 (1): 63–74.

    Article  Google Scholar 

  • *Hagen-Zanker, J., and R. Mallett. 2013. How to do a rigorous, evidence focused literature review in international development. Overseas Development Institute and the Secure Livelihoods Research Consortium (SLRC). http://www.odi.org/sites/odi.org.uk/files/odi-assets/publications-opinion-files/8572.pdf. Accessed 17 Apr 2016.

  • *Harris, D.A. 2010. When child soldiers reconcile: Accountability, restorative justice, and the renewal of empathy. Journal of Human Rights Practice 2 (3): 334–354.

    Article  Google Scholar 

  • *Harvey, B., J. Stuart, and T. Swan. 2000. Evaluation of a drama-in-education programme to increase AIDS awareness in South African high schools: A randomised community intervention trial. International Journal of STD and AIDS 11 (2): 105–111.

    Article  Google Scholar 

  • *Impey, A. 2002. Culture, conservation and community reconstruction: Explorations in advocacy ethnomusicology and participatory action research in Northern KwaZulu Natal. Yearbook for Traditional Music 34: 9–24.

    Article  Google Scholar 

  • *Islam, K.S., S.A. Sachchu, R. Sandani, C. Bullough, N. Siraj, P. Dimrnock, and R.B. Johanson. 2001. Using village theatre to increase knowledge about eclampsia in Bangladesh. Journal of Obstetrics & Gynaecology Research 27 (4): 199–204.

    Article  Google Scholar 

  • *James, S. 2008. Human rights education and transformation through the arts. Human Rights Education in Schools: 93–102.

  • *Johnston, E.A. 2007. Healing Maori through song and dance? Three case studies of recent New Zealand music theatre. MA diss., University of Canterbury.

  • *Kalisa, C. 2006. Theatre and the Rwandan genocide. Peace Review: A Journal of Social Justice 18: 515–521.

    Article  Google Scholar 

  • *Katitjin, K. 2010. Evaluation of indigenous hip hop projects. Perth: Centre for Indigenous Australian Education and Research, Edith Cowan University.

    Google Scholar 

  • *Klotz, P. 2002. Edutainment for development and sexual health. Sexual Health Exchange 1: 1–2.

    Google Scholar 

  • *Ljubinkovic, A. 2010. Healing dimensions of Somali poetry in response to military humanitarian intervention. Journal of Poetry Therapy: The Interdisciplinary Journal of Practice, Theory, Research and Education 23 (3): 131–155.

    Article  Google Scholar 

  • *Mavrocordatos, A. 2004. Theatre for life: Health information, community mobilisation and child rights—a qualitative evaluation. Winchester, UK: University College Winchester.

    Google Scholar 

  • *McCoy, B.F. 2008. Holding men: Kanyirninpa and the health of Aboriginal men. Canberra: AIATSIS, Aboriginal Studies Press.

    Google Scholar 

  • *McNiff, S. 2007. Empathy with the shadow: Engaging and transforming difficulties through art. Journal of Humanistic Psychology 47 (3): 392–399.

    Article  Google Scholar 

  • Moher, D., A. Liberati, J. Tetzlaff, and D.G. Altman. 2009. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine 6 (7): e1000097. https://doi.org/10.1371/journal.pmed1000097.

    Article  Google Scholar 

  • Morra-Imas, L., and R. Rist. 2009. The road to results: Designing and conducting effective development evaluations. Washington: World Bank.

    Book  Google Scholar 

  • *Munier, A., and M. Etherton. 2006. Child rights theatre for development in rural Bangladesh: A case study. Research in Drama Education: The Journal of Applied Theatre and Performance 11 (2): 175–183.

    Article  Google Scholar 

  • *Mwansa, D., and P. Bergman. 2003. Drama in HIV/AIDS prevention: Some strengths and weaknesses: A study in Botswana, Tanzania, South Africa, Kenya, Ethiopia, and Uganda. Swedish International Development Cooperation Agency (Sida): Stockholm.

    Google Scholar 

  • *Niederstadt, L. 2009. Fighting HIV with juggling clubs: An introduction to Ethiopia’s circuses. African Arts Spring: 76–87.

  • *Niner, S. 2006. The reassertion of customary practices in Timor-Leste and the implications for traditional handcrafts production. Exploring the tensions of nation building in Timor-Leste. SSEE Research Paper No. 1 / 2007, 41–47, Melbourne: University of Melbourne.

  • *Niner, S. 2009. Women’s handcrafts and development in Timor- Leste: looking to the future. Dili, TL: Women for Peace.

    Google Scholar 

  • *Nogueira, M.P. 2006. Reflections on the impact of a long term theatre for community development project in Southern Brazil. Research in Drama Education: The Journal of Applied Theatre and Performance 11 (2): 219–234.

    Article  Google Scholar 

  • *Nwadigwe, C.E. 2007. ‘Meet us at the other side of the river’: Performance venue and community education among migrant fishermen in Nigeria. Research in Drama Education: The Journal of Applied Theatre and Performance 12 (1): 65–77.

    Article  Google Scholar 

  • *Oddie, D. 2007. The ARROW programme: Genesis, ideas, growth and aspiration. Caribbean Quarterly 53 (1/2): 168–180.

    Article  Google Scholar 

  • OECD. 2011. The Busan partnership for effective development co-operation. Paris: Organisation for Economic Co-operation and Development. www.oecd.org/dac/effectiveness/busanpartnership.htm. Accessed 29 Aug 2014.

  • *Omar, W. 2008. From storytelling to community development. In Telling Stories to Change the World: Global voices on the power of narrative to build community and make social justice claims, ed. R. Solinger, M. Fox, and K. Irani, 193–200. New York, London: Routledge.

    Google Scholar 

  • *Onyeji, C. 2004. Igbo rural women in Africa as creative personalities: musical processing of socio-economic solidarity. Journal of the Musical Arts in Africa 1: 84–101.

    Article  Google Scholar 

  • *Palmer, D. 2010. Ngapartji Ngapartji: The consequences of kindness. Adelaide: Murdoch University and Big hART.

    Google Scholar 

  • *Pattman, R., A. Kezaabu, and Y. Sliep. 2011. Real men, sick wives and others: Dramatic explorations of men and their potential as caregivers in the context of HIV/AIDS in rural KwaZulu-Natal, South Africa. In Acting on HIV: Using drama to create possibilities for change, ed. D. Francis, 79–90. Bloemfontain, SA: Sense.

    Chapter  Google Scholar 

  • *Quan-Baffour, K.P. 2007. Using folk media in HIV/AIDS prevention in rural Ghana. Muziki: Journal of Music Research in Africa 4 (2): 209–223.

    Article  Google Scholar 

  • *Risi, L., J.P. Bindman, O.M.R. Campbell, J. Imrie, K. Everett, J. Bradley, and L. Denny. 2004. Media interventions to increase cervical screening uptake in South Africa: An evaluation study of effectiveness. Health Education Research 19 (4): 457–468.

    Article  Google Scholar 

  • *Seguin, A., and C. Rancourt. 1996. The theatre: An effective tool for health promotion. World Health Forum 17 (1): 64–69.

    Google Scholar 

  • Sen, A. 1999. Development as freedom. Westminster: Knopf.

    Google Scholar 

  • *Şişmanyazici-Navaie, N. n.d. Creative change worldwide. Art for Global Development.

  • *Şişmanyazici-Navaie, N., and E. Etili-Serter. 2008. Making the ‘arts’ and ‘net’ work to help achieve MDGS: an art4development.net story. UNESCO Observatory refereed E-Journal, Multi-Disciplinary Research in the Arts 1(2): 149–160.

  • *Skinner, D., and C.A. Metcalf. 1991. An evaluation of an education programme on HIV infection. AIDS Care 3 (3): 317–317.

    Article  Google Scholar 

  • *Sloman, A. 2011. Using participatory theatre in international community development. Community Development Journal 47 (1): 42–57.

    Article  Google Scholar 

  • Snilstveit, B., S. Oliver, and M. Vojtkova. 2012. Narrative approaches to systematic review and synthesis of evidence for international development policy and practice. Journal of Development Effectiveness 4 (3): 409–429.

    Article  Google Scholar 

  • *Stepakoff, S. 2007. The healing power of symbolization in the aftermath of massive war atrocities: Examples from Liberian and Sierra Leonean survivors. Journal of Humanistic Psychology 47 (3): 400–412.

    Article  Google Scholar 

  • *Stupples, P. 2011. Breaking the frame: arts in international development. PhD diss., Massey University.

  • *Stupples, P. 2014. Creative contributions: The role of the arts and the cultural sector in development. Progress in Development Studies 14 (2): 115–130.

    Article  Google Scholar 

  • *Sutherland, A. 2013. Dramatic spaces in patriarchal contexts: Constructions and disruptions of gender in theatre interventions about HIV. Matatu: Journal for African Culture & Society Issue 43: 177–185.

  • *Swain, D. 2009. Dancing for peace in Angola: Using movement based expressive arts therapy as a tool for social action. In Dance therapy collections 3, ed. K. Dunphy, J. Guthrie, and E. Loughlin, 165–171. Melbourne: Dance Therapy Association of Australia.

    Google Scholar 

  • UNDP. 2014. Human development report 2014: Sustaining human progress: Reducing vulnerabilities and building resilience. New York: United Nations Development Programme.

    Book  Google Scholar 

  • Vogel, I. 2012. Review of the use of ‘Theory of change’ in international development. London: UK Department of International Development, DFID.

    Google Scholar 

  • Waddington, H., H. White, B. Snilstveit, J.G. Hombrados, M. Vojtkova, P. Davies, et al. 2012. How to do a good systematic review of effects in international development: a tool kit. Journal of Development Effectiveness 4 (3): 359–387.

    Article  Google Scholar 

  • Ware, V., and Dunphy, K. Under review. How do arts programs contribute in international development? Findings of a systematic review of outcomes.

  • *Wheeler, J. 2009. ‘The life that we don’t want’: Using participatory video in researching violence. IDS Bulletin 40 (3): 10–18.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Arts and Education, Deakin University Melbourne-Burwood Campus, 321 Burwood Hwy, Burwood, VIC, 3125, Australia

    Vicki-Ann Ware

  2. Creative Arts Therapy Research Unit, Victorian College of the Arts, University of Melbourne, 234 St Kilda Rd, Southbank, 3006, Australia

    Kim Dunphy

Authors
  1. Vicki-Ann Ware
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kim Dunphy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vicki-Ann Ware.

Ethics declarations

Conflict of Interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Appendix: Databases and Other Search Sources

Appendix: Databases and Other Search Sources

Databases:

  • Academic Search Complete

  • EBSCO Host databases

  • PAIS, PAIS International, APAIS

  • OECD, SourceOECD, OECD iLibrary

  • CAIRSS, CAIRSS for Music

  • Arts and Humanities Citation Index

  • Expanded Academic ASAP

  • ProQuest Dissertations and Theses

  • United Nations University Collection

  • Arts Hub, CSA Illumina, MLA International, ERIC, PsychINFO, Bibliography of Asian Studies

  • IIMP (International Index to Music Periodicals)

  • JSTOR

  • Thomson Reuters Web of Knowledge

  • OVID SP

  • ACLS Humanities E-book

  • African Journals Online

  • Blackwell Synergy

  • Wiley Online

Journals:

  • Development in Practice

  • Development and Change

  • Journal of Development Communication

  • Journal of Development Effectiveness

  • International Journal of Community Music

  • Journal of Arts in Communities

  • Journal of Humanistic Psychology

  • Area studies journals, including Journal of African Studies, Journal of Asian Studies and Journal of Southeast Asian Studies

Other sources:

  • Google Scholar

  • APO policy research briefing

  • Commonwealth Foundation website

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ware, VA., Dunphy, K. Methodological Practices in Research on Arts-Based Programs in International Development: A Systematic Review. Eur J Dev Res 31, 480–503 (2019). https://doi.org/10.1057/s41287-018-0164-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1057/s41287-018-0164-1

Keywords

Search

Navigation