Evaluation of interventions

This blog is trying to transform new information I received into knowledge

I have to ask myself, what has been learned from my intervention and my reflections on it? What went wrong? How I corrected that or maybe I didn’t correct it? I need to find ways to ensure that my evaluation is both objective and purposeful.

Ways of data collecting

  • Qualitative Observation (collect information by observing the target group to learn more about the project)
  • Video Recordings (focused on groups intercating with “melding experiment”
  • Photos of suggestions filled in by stakeholders on sticky notes
  • Final Interview (Through asking stakeholders questions and writing on paper about their experience of the interaction and suggestions)
Qualitaive observation

By qualitative observing my stakeholders, I find out which interactions are enjoyable and which are annoying – a permanent feedback process.

Observations may help explain behaviors as well as social context and meanings because the evaluator sees what is actually happening.

Ericsson et al, 1993

The 22 stakeholders who participated in this offline intervention were observed and collected reactions and feedback. Through my observations, the faces of each of the 22 participants expressed surprise at the intervention, and each of them enjoyed the interaction, which means that the direction of the intervention through the combination of embroidery materials and interaction is exciting and confirms that the direction is feasible.

In addition, I received a lot of encouragement and likes by posting my intervention video online on Reddit in the embroidery community and on Tik Tok, where the intervention video has 632 likes.

However, I observed that when they touched the crocodile clips to try to interact with the computer, they would impatiently try multiple touches if they were not sensitive,which indicated that I need to explore conductive materials in the embroidery itself, such as conductive thread, or other more sensitive conductive materials for the audience to interact friendly with.

At the same time, since the poster that attracted stakeholders to this intervention was “free hand-made embroidery”, when stakeholders were attracted to it, they would come up to me and ask what it was about, and then I would give them embroidery bookmarks first and then invite them to my intervention. This process suggests that my stakeholders may be suspicious or doubtful towards the statement and I need oral explaine this, so next time I should indicate on the poster ” Experience Tech+Embroidery, Get Free Embroidery”, which will make my stakeholders more clear of their participation.

Interview

Through a short interview with each stakeholder who experienced the intervention offline,and the following questions were asked

  • Do you prefer the embroidered bookmark on the left, or the interactive embroidery on the right? (Closed, fixed-response question (Structured))
  • What would you suggest for this interactive embroidery? (Standardized, open-ended question)

Reargarding the first question, 22 stakeholders who participated in the offline intervention said that interactive embroidery was more to their liking than normal embroidery bookmarker, and suggesting that the way of embroidery craft + technology is the future.

Regarding the second open-ended answer, because of the issue of crocodile clip sensitivity, some were suggesting a more user-friendly experience. Then some were suggesting that it could be animated accordingly to the embroidery and then influenced by the interaction. Others suggested that the overall appearance of the interaction could be improved and made more aesthetically pleasing. These suggestions I need to accpet and try to overcome so that before the next intervention to make an iterative piece.

# AC Knowledge # AC Enquiry # AC Process


Bibliography

Atsdr.cdc.gov. 2022. Chapter 7: Evaluation Methods | Principles of Community Engagement | ATSDR. [online] Available at: <https://www.atsdr.cdc.gov/communityengagement/pce_program_methods.html> [Accessed 25 August 2022].

McNiff, J. 2002. Action research for professional development; Concise
advice for new action researchers; 3rd Edition. Jean McNiff.

Delve. 2022. What is Qualitative Program Evaluation? — Delve. [online] Available at: <https://delvetool.com/blog/programevaluation> [Accessed 25 August 2022].

Leave a Reply

Your email address will not be published. Required fields are marked *