Algowatch toolkit
The project had a three-pronged research objective, focused on students, teachers and intermediaries (librarians, curators…) seen as multipliers in the deployment of MIL initiatives in non-formal education. It used prior research in which teachers in particular report that lack of training, lack of pertinent resources, and lack of support from their administration are obstacles to their engagement in MIL and AI-literacy. Though there were some differences across the partner countries, the research results successfully show that these lacks can be addressed with a series of competence-based resources and activities, in a 3–4-hour intervention in secondary schools (20 in all, for students 15+).
For the students, the test results showed significant gains in knowledge acquisition (identifying AI deepfakes, riding recommendation algorithms), but mitigated gains at attitude change related to strategies to fight disinformation and push for platform regulation (probably due to a shift from excessive confidence to an increased critical awareness of the challenges associated with combating disinformation. However, their evaluation of the intervention overall showed a high level of effectiveness and satisfaction with the workshops and the embedded resources as well as the competences and knowledge of their teachers.
For the teachers, they overwhelmingly felt empowered by the Algowatch toolkit and reported a change in the support from their administration. They particularly appreciated the glossary and the slideshow, as well as the set of posters, all deemed easy to use and suitable for classroom constraints. They noted the impact on their teaching relationship with students, as the intervention improved dialogue with youth about their everyday use of algorithms. They encountered difficulties in the 3-4 hour block format, difficult to integrate into timetables and they pointed at program constraints due to the lack of MIL in the official school curriculum.
For the intermediaries, the results show that many of them felt they lacked sufficient financial and technological resources, and while some felt competent, others expressed a strong need for more training to understand and effectively convey complex and rapidly evolving AI concepts and contents. Additional support in the form of digital tools, comprehensive training, and networking opportunities was felt as crucial for enhancing their capacity to organize and deliver educational content. Most of them included schools and teachers in their networking process, thus coming full circle with the school intervention.
The overall findings highlight the need to design MIL interventions in a holistic manner, involving teachers, multipliers, designers and academics, inside and outside schools, as critical strategic actors to engage with rapidly evolving AI- systems.
If you are interested in using the toolkit (an Open Educational Resource), don’t hesitate to contact us: contact@savoirdevenir.net