Pilot Project: Assessing Trustworthiness of the use of Generative AI for higher Education.
“I, personally and as president of ENSA (European Education New Society Association), fully endorse and support this pilot project of the well known Z-inspection® initiative. It is time to assess the impact and potential of generative AI on Universities and, in this respect, I believe the Z-inspection process, in combination with the European Commission ALTAI and UNESCO policy guidance, is best placed to achieve significant and inspiring results.“
This pilot project of the Z-inspection® initiative (https://z-inspection.org) aims at assessing the use of Generative AI in higher level education considering specific use cases.
For this pilot project, we will assess the ethical, technical, domain-specific (i.e. education) and legal implications of the use of Generative AI-product/service within the university context.
We follow the UNESCO guidance for policymakers on Geneative AI and education. In particular the policy recommendation: Pilot testing, monitoring and evaluation, and building an evidence base.
Expected Output: a number of best practices, a white paper and a peer reviewed journal article on the various best practices, and a set of recommendations for each specific use case. Such recommendations could be also useful for helping clarify the Guidelines that policy makers and universities are creating for this.
Participants (over 170 participants from around the world! See list below)
– Affiliated Labs: https://z-inspection.org/affiliated-labs/
– Members of the Z-inspection® initiative: https://z-inspection.org
– Ministries and Universities
– Specialized agencies
– Individuals
NEW! SELECTED USE CASES
Use Case 1:
Use of AI in Marking and Providing Feedback to Graduate Students for Individual Written Assignments in Health Informatics Courses.
Institution:
Dalla Lana School of Public Health, University of Toronto, Canada
Stakeholders:
Dr. Karim Keshavjee, Assistant Professor, Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto
Jennifer Tin, Adjunct Professor, IHPME, Dalla Lana School of Public Health, University of Toronto
Parisa Osivand, Adjunct Lecturer, IHPME, Dalla Lana School of Public Health, University of Toronto
Description of the use case: Marking and providing feedback on narrative assignments is time consuming and cognitively taxing. This leads to delayed and terse feedback that may not be satisfactory to the learner. Can AI be used to speed up marking and provide more substantive feedback to learners?
LINK to Overview of the Use Case (LinkedIn)
………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………….
Use Case 2:
Leveraging Generative AI in Enhancing Outcome-Based Education (OBE) in Higher Education
Higher Education institution:
– D.Y. Patil College of Engineering Akurdi, Pune, India.
Stakeholders:
- Dr. Vinayak Kottawar, Head of the Department of Artificial Intelligence & Data Science
- Adarsh Srivastava, Scientific Advisor Z-Inspection Trustworthy AI Lab Pune
- Gokul Gawande, Scientific Advisor Z-Inspection Trustworthy AI Lab Pune
- Ishwar Chavan, Scientific Advisor Z-Inspection Trustworthy AI Lab Pune
Description of the use case:
At D.Y. Patil College of Engineering, Pune (Akurdi Campus), faculty and students have jointly developed an internal tool/application to support various facets of outcome-based education (OBE). This tool facilitates the creation of topic-level course outcomes, course outcomes, and the mapping of course and program-level outcomes. It also helps in identifying curriculum gaps, designing assessments based on Bloom’s Taxonomy levels and industry requirements, and developing course delivery plans. Additionally, it aids in crafting diverse teaching-learning pedagogies to enhance student-centered learning.
The tool integrates Google’s Gemini (Free Version) as the Large Language Model (LLM) in the backend, using its API for the frontend interface. The user interface is intuitive for teachers, offering sufficient input and output context lengths to generate educational content effectively. The institute has also embedded guidelines to ensure that the tool is used within the intended educational context.
…………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………
Distributed steering committees
The pilot project is lead by distributed steering committees by geographical areas, as follows:
– Africa :
Members
Tal Edgars, Prof. Dr.
UNESCO Inclusive Policy Lab expert.
Chairman of the National Master Plan Task team in South Africa in Social Entrepreneurship and Social Development. Group Executive Chairman GBSH Consult Group.
City of Johannesburg, South Africa.
Expertise: Strategy, Economics, Ethics and Governance, AI and 4IR, Sustainable Finance and Taxonomy Modelling
Stella Namuganza,
Uniklinikum Bonn, Germany.
Expertise: digital health technologies
Omigbile Olamide, Project Associate, Centre for Health Ethics Law and Development,
Lagos, Nigeria
Expertise: Programs l Data Management l Research.
– Australia, Malaysia :
Members
Caslon Chua, Acting Department Chair,
Computing Technologies, School of Software and Electrical Engineering, Department of Computer Science and Software Engineering
Swinburne University of Technology, Melbourne, Australia
Expertise: Computer Science
Catarina Moreira, Associate Professor | UNESCO Co-Chair AI&XR, Lead Research Scientist, HTI
Human Technology Institute, (HTI), University of Technology Sydney
Expertise: explainable AI, more specifically explainable user interfaces and counterfactual explanations; causality and probabilistic graphical models; eye-tracking for deep learning
Sian Lun Lau, Professor and Head, Department of Engineering, Associate Dean (Internationalisation)
Cluster Lead, Sunway DataXSight Research Cluster, School of Engineering and Technology, Sunway University, Malasya
Expertise: Computer Science
Expertise: Computer Science
– Canada:
Members:
Somaieh Nikpoor , The Trustworthy AI Lab @ TIM, Carleton University (Ottawa, Canada)
Expertise: ethics, certified Z-Inspection® instructor.
Andreane Sabourin Laflamme, Ethical Assessment for Trustworthy AI at LEN.IA – AI & Digital Ethics Lab (Montréal, Québec, Canada).
Expertise: ethics,
Frédérick Bruneault , Ethical Assessment for Trustworthy AI at LEN.IA – AI & Digital Ethics Lab (Montréal, Québec, Canada).
Expertise: ethics, certified Z-Inspection® instructor
– Europe and UK:
Coordinators:
Elisabeth Hildt , The Trustworthy AI Lab at L3S Research Center Leibniz, University Hannover (Hannover, Germany)
Expertise: ethics, certified Z-Inspection® instructor
Magnus Westerlund , The Laboratory for Trustworthy AI at Arcada University of Applied Sciences (Helsinki, Finland). Finland
Expertise: AI, certified Z-Inspection® instructor
Henrika Franck , The Laboratory for Trustworthy AI at Arcada University of Applied Sciences (Helsinki, Finland). Finland
Expertise: ethics,
Emilie Wiinblad Mathez , Switzerland
Expertise: law, human rights, certified Z-Inspection® instructor
Members
Alen, Anette K , Faculty of Law University of Helsinki, Finland
Expertise: Law
Alessio Gallucci, The Netherlands
Expertise: AI , certified Z-Inspection® instructor
Frode Ramstad Johansen , Trustworthy AI Lab at the University College Østfold, (Fredrikstad, Østfold, Norway)
Expertise: Innovation
Pedro Kringen, Trustworthy AI Lab at the University College Østfold, (Fredrikstad, Østfold, Norway)
Expertise: certified Z-Inspection® instructor
Pedro Moreno Sanchez, Trustworthy AI for healthcare Lab, Tampere University (Finland)
Expertise: certified Z-Inspection® instructor
– India:
Members:
Gawande, Gokul, The Trustworthy AI in Practice lab at the DY Patil College of Engineering, Akurdi Campus, (Pune, India)
Expertise: technical aspects and overall team oversight activities in India.
Srivastava, Adarsh, The Trustworthy AI in Practice lab at the DY Patil College of Engineering, Akurdi Campus, (Pune, India)
Expertise: technical aspects and overall team oversight activities in India.
Himanshi Allahabadi , The Trustworthy AI in Practice lab at the DY Patil College of Engineering, Akurdi Campus, (Pune, India)
Expertise: Generative AI from a broad sociotechnical perspective. More specific NLP and LLMs.
Divya Dwivedi, Advocate, Supreme Court of India
Expertise: Law.
Sharmistha Chatterjee, The Trustworthy AI in Practice lab at the DY Patil College of Engineering, Akurdi Campus, (Pune, India)
Expertise: AI/ML, Cloud Computing, MLOps, building large-scale distributed ethical AI systems, Responsible AI, LLMs
Ishwar Chavan, The Trustworthy AI in Practice lab at the DY Patil College of Engineering, Akurdi Campus, (Pune, India)
Expertise: AI technical, ML technical aspects.
Vinayak Kottawar , D Y Patil College of Engineering, India
Expertise: AI technical, SME (Education)
Alessio Gallucci, The Netherlands
Expertise: AI, certified Z-Inspection® instructor
South Korea:
Nam-Jong Paik, MD, PhD
Professor
Seoul National University,
Seoul National University Bundang Hospital
Department of Rehabilitation Medicine, Department of Clinical Medical Sciences, College of Medicine
Department of Health Science Technology, Graduate School of Convergence Science and Technology
Interdisciplinary Program in Bioengineering, College of Engineering
South Korea
Expertise: Medicine
Se-young Jung
Chief Information Officer, Seoul National University Bundang Hospital
Associate Professor, Seoul National University Bundang Hospital
Department of hospital information,
South Korea
Expertise: Medicine
Tae In Park, PhD, Academic-Industrial Cooperation Professor,
Seoul National University College of Medicine
Medical Big Data Research Center (MBRC)
SNU Project Group for Education and Research in Medical AI (SNU AI.MED)
South Korea
Expertise: International Development
Jason J. Jung
Full Professor, Director of Knowledge Engineering Laboratory,
Chung-Ang University (Seoul, Korea) South Korea
Expertise: AI, Computer Science
Sira Maliphol
Assistant professor of Technology and Society at The State University of New York, Songdo, Incheon.
South Korea
Expertise: Technology and society
Cornelius Kalenzi
Postdoctoral Researcher,
Korea Policy Center for the Fourth Industrial Revolution, Korea Advanced Institute of Science and Technology (KAIST)
South Korea
Expertise: digital innovations including artificial intelligence.
– USA:
Members
Megan Coffee, NYU Grossman School of Medicine, USA
Expertise: certified Z-Inspection® instructor
Elisabeth Hildt , The Ethical and Trustworthy AI Lab at Illinois Institute of Technology’s Center for the Study of Ethics in the Professions (Chicago, USA).
Expertise: ethics, certified Z-Inspection® instructor
Andy Spezzatti, Taltrics and AI for Good Foundation, USA
Expertise: AI technical.
Renee Wurth, University of Pennsylvania, USA
Expertise: data scientist, certified Z-Inspection® instructor
Advisory Board
Kiran Bhujun, Professor, Director of the Tertiary Education and Scientific Research Division of the Ministry of Education, Tertiary Education, Science and Technology of the Republic of Mauritius.
Yves Deville, Professor, Université catholique de Louvain. Senior Advisor to the President for the Digital University at UCLouvain. Belgium
Julio Cesar Duhalde, Technical, economic and legal advisor at the Ministry of Economy – Buenos Aires, Argentina.
Erja Heikkinen, PhD, Director General (temp), Ministry of Education and Culture, Helsinki, Finland
Lambert Hogenhout, Chief Data, Analytics and Emerging Technologies, United Nations, New York, USA.
Jonathan Michie OBE FAcSS, Professor of Innovation and Knowledge Exchange, University of Oxford, Pro-Vice-Chancellor (without portfolio), President of Kellogg College, University of Oxford, UK.
Irina Mirkina, AI Lead, Office of Innovation, UNICEF, Stockholm, Sweden.
Victor Ochen, The African Youth Initiative Network (AYINET). Member of the Advisory Group to the United Nations High Commissioner for Refugees at United Nations- Lira, Uganda.
Sung Jae Park, Ph.D. Research fellow, Korean Educational Development Institute (KEDI). Former Senior Advisor to the Deputy Prime Minister and Minister of Education of the Republic of Korea. Seoul, South Korea.
Gerald Santucci, President, EUROPEAN EDUCATION NEW SOCIETY ASSOCIATION (ENSA)- France.
Willy Tadema, AI Ethics Lead, Rijks ICT Gilde (RIG), Ministry of Interior and Kingdom Relations; AI policy advisor, Ministry of Interior and Kingdom Relations; Member of the Dutch National Standards Body for AI (NEN), The Netherlands.
Peter J. Wells, Head of Education Southern Africa, UNESCO- Harare, Zimbabwe.
Approach
An interdisciplinary team of experts will assess the trustworthiness of Generative AI for selected use cases in High Education using the Z-Inspection® process: https://z-inspection.org
Z-Inspection® is a holistic process based on the method of evaluating new technologies, where ethical issues need to be discussed through the elaboration of socio-technical scenarios. In particular, Z-Inspection® can be used to perform independent assessments and/or self-assessments together with the stakeholders owning the use case.
For the context of this pilot project we define ethics in line with the essence of modern democracy i.e. “respect for others, expressed through support for fundamental human rights”. We take into consideration that “trust” in the development, deployment and use of AI systems concerns not only the technology’s inherent properties, but also the qualities of the socio-technical systems involving AI applications.
Specifically, we consider the ethics guidelines for trustworthy artificial intelligence defined by the EU High-Level Expert Group on AI, which defined trustworthy AI as:
(1) lawful – respecting all applicable laws and regulations
(2) ethical – respecting ethical principles and values
(3) robust – both from a technical perspective and taking into account its social environment
And we use the four ethical principles, rooted in fundamental rights defined in [13], acknowledging that tensions may arise between them:
(1) Respect for human autonomy
(2) Prevention of harm
(3) Fairness
(4) Explicability
Furthermore, we also consider the seven requirements of Trustworthy AI defined by the High Level experts group set by the EU. Each requirement has a number of sub-requirements as indicated in Table 1.
Table 1. Requirements and sub-requirements Trustworthy AI.
1 Human agency and oversight Including fundamental rights, human agency and human oversight
2 Technical robustness and safety Including resilience to attack and security, fall back plan and general safety, accuracy, reliability and reproducibility
3 Privacy and data governance Including respect for privacy, quality and integrity of data, and access to data
4 Transparency Including traceability, explainability and communication
5 Diversity, non-discrimination and fairness Including the avoidance of unfair bias, accessibility and universal design, and stakeholder participation
6 Societal and environmental wellbeing Including sustainability and environmental friendliness, social impact, society and democracy
7 Accountability Including auditability, minimization and reporting of negative impact, trade-offs and redress.
While we consider the seven requirements comprehensive, we believe additional ones can still bring value. Two of such additional requirements proposed by the Z-Inspection® initiative are “Assessing if the ecosystems respect values of Western Modern democracy” and “Avoiding concentration of power” .
………………………………………………………………………………………………………………………………………………………..
From the UNESCO guidance for policymakers on AI and education sets out policy recommendations in seven areas:
(https://unesdoc.unesco.org/ark:/48223/pf0000376709)
1. A system-wide vision and strategic priorities
2. Overarching principle for AI and education policies
3. Interdisciplinary planning and inter-sectoral governance
4. Policies and regulations for equitable, inclusive, and ethical use of AI
5. Master plans for using AI in education management, teaching, learning, and assessment
6. Pilot testing, monitoring and evaluation, and building an evidence base
7. Fostering local AI innovations for education
……………………………………………………………………………………………………………………………………………………………….
from the Guidelines for the use of AI in teaching at the University of Helsinki Academic Affairs Council 16.2.2023
(https://teaching.helsinki.fi/instructions/article/artificial-intelligence-teaching)
“Large artificial intelligence (AI)-based language models such as Chat GPT, Google Bard, and DeepL have evolved to the point where they can produce human-like text and conversations and correct and transform text at such a high level that it can be difficult to distinguish the result from human- generated text. It is foreseeable that more such models will emerge, and their functionalities will continue to evolve, so their existence should be taken into account in university teaching and research.
The existence of large language models should be seen as an opportunity. Degree programmes and teachers are encouraged to use AI in their teaching and to prepare students for a society of the future where AI methods will be widely used.
As AI brings new possibilities for producing text whose origin and reliability is unclear, they should be used in a controlled way. Use may be restricted in teaching in situations where the use would not promote student learning.
At EU level, an AI regulation is under preparation, which will also apply to AI systems in education. In addition, there is an ethical policy on AI and its use, as well as an ethical code for teachers1 . The University’s guidelines may be further specified in the light of future regulation and technological developments.”
______________________________________________________
Resources
1. Policy paper. Generative artificial intelligence in education. UK: The Department for Education’s (DfE) position on the use of generative artificial intelligence (AI) in High Education. Link to .PDF
2. Do Foundation Model Providers Comply with the Draft EU AI Act? Stanford researchers evaluate foundation model providers like OpenAI and Google for their compliance with proposed EU law on AI. Link
They identified a final list of 12 requirements and scored the 10 models using a 5-point rubric. The methodology for the study can be found here.
3. Leading universities in the UK (the Russell Group universities) have developed a set of principles on the use of generative AI tools in education. Here is the link.
4. Frontier AI Regulation: Managing Emerging Risks to Public Safety arXiv:2307.03718 [cs.CY] LINK
5. Zhaki Abdullah, Students, teachers will learn to properly use tools like ChatGPT: (Singapore Education Minister) Chan Chun Sing, Straits Times, 12 February 2023, LINK
6. U.S. Department of Education, Office of Educational Technology, Artificial Intelligence and Future of Teaching and Learning: Insights and Recommendations, Washington D.C., May 2023, LINK
7. Japanese schools to be allowed limited use of generative AI, Kyodo News, 22 June 2023, LINK
8. Higher Education Webinar: Implications of Artificial Intelligence in Higher Education , Tuesday, June 27, 2023, Council on Foreign Relations, LINK
9. Novelli, C., Casolari, F., Rotolo, A. et al. Taking AI risks seriously: a new assessment model for the AI Act. AI & Soc (2023). LINK
10. Academic without Borders, Bimonthly Newsletter n°59, July 2023.
11. On the use of artificial intelligence and in particular of ChatGPT in higher education. (UNESCO). Link to .PDF
12. KU Leuven, Responsible use of Generative Artificial Intelligence (GenAI) in research.These guidelines will be updated with new information and insights to keep them in line with the rapidly evolving technology (last updated June 24, 2023). The further integration of teaching and research guidelines is still on the agenda. LINK
14. The Norwegian Consumer Council published a detailed report “Ghost in the machine – Addressing the consumer harms of generative AI” outlining the harms, legal frameworks, and possible ways forward. In conjunction with this launch, the Norwegian Consumer Council and 14 consumer organizations from across the EU and the US demand that policymakers and regulators act. https://storage02.forbrukerradet.no/media/2023/06/generative-ai-rapport-2023.pdf
15. University of Melbourne: Inquiry into the use of generative AI in the education system. Submission to the House Standing Committee on Employment, Education and Training 14 July 2023. https://about.unimelb.edu.au/__data/assets/pdf_file/0032/396446/UoM-Submission-Inquiry-into-Generative-AI-in-Education-FINAL.pdf
16. Cornell University: Generative Artificial Intelligence for Education and Pedagogy.July 18, 2023. https://teaching.cornell.edu/sites/default/files/2023-08/Cornell-GenerativeAIForEducation-Report_2.pdf
17. The University of North Carolina at Chapel Hill: Teaching Use Guidelines for Generative Artificial Intelligence, https://provost.unc.edu/wp-content/uploads/2023/07/Teaching-Generative-AI-Use-Guidance_UNC-AI-Committee-June-15-202348.pdf
18. University of Sydney: 13 March, 2023 Students answer your questions about generative AI – part 2: Ethics, integrity, and the value of university. https://educational-innovation.sydney.edu.au/teaching@sydney/students-answer-your-questions-about-generative-ai-part-2-ethics-integrity-and-the-value-of-university/
19. The Berkman Klein Center for Internet & Society at Harvard University: Exploring the Impacts of Generative AI on the Future of Teaching and Learning https://cyber.harvard.edu/story/2023-06/impacts-generative-ai-teaching-learning
20. Stanford University: Pedagogic strategies for adapting to generative AI chatbots. Eight strategic steps to help instructors adapt to generative AI tools and chatbots. June 19, 2023, Center for Teaching and Learning. https://docs.google.com/document/d/1la8jOJTWfhUdNna5AJYiKgNR2-54MBJswg0gyBcGB-c/edit
21. Council of Europe: ARTIFICIAL INTELLIGENCE AND EDUCATION A critical view through the lens of human rights, democracy and the rule of law.November 2022
https://rm.coe.int/artificial-intelligence-and-education-a-critical-view-through-the-lens/1680a886bd
22. ANU Centre for Learning and Teaching: Chat GPT and other generative AI tools: What ANU academics need to know February 2023. https://teaching.weblogs.anu.edu.au/files/2023/02/Chat_GPT_FAQ-1.pdf
23.Guidance for Generative AI in education and research | UNESCO, 7 September 2023
25. UNESCO Guidance for generative AI in education and research, 2023
………………………………………………………………………………………………………………………………………………………………………………………………………………………….
Participants
| First Name | Last Name | Affiliation | Country |
| Aastha | Pant | Monash University, Melbourne, Victoria | Australia |
| Catarina | Moreira | Queensland University of Technology (QUT) | Australia |
| Subrata | Chakraborty | University of New England, Armidale , New South Wales | Australia |
| Vishal | Rana | Griffith University, Queensland | Australia |
| Caslon | Chua | Swinburne University of Technology, Melbourne | Australia |
| Chris | McCarthy | Swinburne University of Technology, Melbourne | Australia |
| Enzo | Palombo | Swinburne University of Technology, Melbourne | Australia |
| Bita | Zaferanloo | Swinburne University of Technology, Melbourne | Australia |
| Luc | Desaunettes | Université Catholique de Louvain (UCLouvain), Louvain-la-Neuve, | Belgium |
| Enguerrand | Marique | Université Catholique de Louvain (UCLouvain), Louvain-la-Neuve, | Belgium |
| Diana | Mocanu | Université Catholique de Louvain (UCLouvain), Louvain-la-Neuve, | Belgium |
| Rashidian | Niki | Universitair Ziekenhuis Gent | Belgium |
| Rob | HEYMAN | Vrije Universiteit Brussel | Belgium |
| Alain | Strowel | UCLouvain and University Saint-Louis, Brussels, | Belgium |
| Anthony | Novaes | Universidade Presbiteriana Mackenzie , São Paulo | Brazil |
| Gustavo | de Assis Costa | Federal Institute of Education, Science and Technology of Goiás – Campus Jataí | Brazil |
| Todor | Ivanov | DXC Technology, Sofia | Bulgaria |
| Tess | Buckley | Trustworthy AI Researcher, Association of AI Ethicists, Humans for AI, Z-Inspection® Initiative | Canada |
| Andréane | Sabourin Laflamme | École des médias at the Université du Québec à Montréal (UQAM) | Canada |
| Emmanuelle | Marceau | École de santé publique de l’Université de Montréal (ESPUM) and Cégep du Vieux Montréal | Canada |
| Cameron | Pierson | Leibniz Universität Hannover | Canada |
| Parisa | Osivand | University of Toronto | Canada |
| Frédérick | Bruneault | École des médias at the Université du Québec à Montréal (UQAM) | Canada |
| Tony | Bailetti | Carleton University, Ottawa, Ontario | Canada |
| Niko | Hildebrandt | McMaster University, Hamilton, Ontario, | Canada |
| Charles | Selva-Rivero | Université de Montréal, Montreal | Canada |
| Somaieh | Nikpoor | Carleton University, Ottawa, Ontario | Canada |
| Martin | Petrin | Western University, Canada | Canada |
| Stoyan | Tanev | Carleton University, Ottawa, Ontario | Canada |
| Liana | Razmerita | Copenhagen Business School (CBS) | Denmark |
| Helle | Collatz Christensen | University of Copenhagen | Denmark |
| Christoffer | Bjerre Haase | University of Copenhagen | Denmark |
| John | Brandt Brodersen | University of Copenhagen | Denmark |
| Boris | Düdder | University of Copenhagen | Denmark |
| Daniel | Hershcovich | University of Copenhagen | Denmark |
| Sonia Claudia | da Costa Sousa | Tallinn University | Estonia |
| David | Lamas | Tallinn University | Estonia |
| Laine | Sami | Aalto University | Finland |
| Markku | Suksi | Åbo Akademi University | Finland |
| Camilla | Wikström-Grotell | Arcada University of Applied Sciences, Helsinki | Finland |
| Mark | van Gils | Tampere University, Faculty of Medicine and Health Technology, | Finland |
| Linda | Mannila | University of Helsinki, Helsinki, | Finland |
| Pedro | Moreno Sánchez | Tampere University, Faculty of Medicine and Health Technology, | Finland |
| Anette | Alén | University of Helsinki | Finland |
| Jarno | Tuominen | University of Turku | Finland |
| Leonardo | Espinosa | Arcada University of Applied Science, Helsinki | Finland |
| Matteo | Stocchetti | Arcada University of Applied Science, Helsinki | Finland |
| Magnus | Westerlund | Arcada University of Applied Sciences, Helsinki | Finland |
| Hanna | Sormunen | Finnish Tax Administration, Helsinki | Finland |
| Valérie | Saintot | University of Gloucestershire | France / UK |
| Paul | Gardiner | Documentum, Inc. SKEMA Business School | France |
| Barbara | Seeliger | University Hospitals of Strasbourg | France |
| Eunika | Mercier-Laurent | University of Reims Champagne Ardenne (URCA) and lab CReSTIC | France |
| Emmanuel | Goffi | Human Technology Foundation, Paris | France |
| Birgitta | Dresp | CNRS, University of Strasbourg | France |
| Valerie | Bürger | Berlin Institute of Health Charité (BIH) | Germany |
| Vince | Istvan Madai | Berlin Institute of Health Charité (BIH) | Germany |
| Dagmar | Monett Díaz | Berlin School of Economics and Law (HWR Berlin) | Germany |
| Ulrich | Kühne | Hautmedizin Bad Soden | Germany |
| Eduard | Buzila | Otto-von-Guericke- Universität Magdeburg | Germany |
| Ludwig Christian | Hinske | Universitätsklinikum Augsburg | Germany |
| Stephan | Braun | Universitätsklinikum Münster | Germany |
| Marie | Alavi | University of Applied Sciences Ostwestfalen-Lippe | Germany |
| Thilo | Hagendorff | University of Stuttgart | Germany |
| Daniel | Amthor | Amelia LLC, NY, Frankfurt | Germany |
| Gemma | Roig | Goethe University Frankfurt | Germany |
| Dennis | Vetter | Goethe University Frankfurt | Germany |
| Elisabeth | Hildt | Leibniz, University Hannover | Germany |
| Michael | Leyer | Philipps-Universität , Marburg | Germany |
| Florian | Möslein | Philipps-Universität , Marburg | Germany |
| Stella | Namuganza | Uniklinikum Bonn | Germany. |
| Holger | Volland | brand eins Medien AG | Germany |
| Wolfgang | Nejdl | Leibniz, University Hannover | Germany |
| Karsten | Tolle | Goethe University Frankfurt | Germany |
| Mathias | Mentzing | Anima_Alma Network | Germany |
| Alessandro | Donati | Germany | |
| Sven | Schuchardt | divico GmbH, Stuttgart | Germany |
| Marios | Kaplanis | Aristotle University of Thessaloniki (AUTH) | Greece |
| Nikos | Laloumis | Information Technologies Institute/CERTH, Thessaloniki | Greece |
| Tanusree | De | Accenture | India |
| Himanshi | Allahabadi | Elucidata | India |
| Sharmistha | Chatterjee | Patil College of Engineering,Pune | India |
| Divya | Dwivedi | Supreme Court of India | India |
| Gokul | Gawande | Roche Information Solutions India Pvt. Ltd. | India |
| Ishwar | Chavan | Patil College of Engineering, Pune | India |
| Vinayak | Kottawar | Patil College of Engineering,Pune | India |
| Usha | Rengaraju | Patil College of Engineering,Pune | India |
| Adarsh | Srivastava | Roche Information Solutions | India |
| George | Kararigas | University of Island | Island |
| Joseph | David | Sapir Academic College | Israel |
| Lorenzo | Bachi | Sant’Anna School of Advanced Studies, University of Pisa, Pisa | Italy |
| Lucia | Billeci | Institute of Clinical Physiology – IFC, National Research Council, Pisa | Italy |
| Diletta | Huyskes | Fondazione Bruno Kessler (FBK) | Italy |
| Francesco | Balzan | Università di Bologna | Italy |
| Alberto | Signoroni | Università di Brescia | Italy |
| Davide | Farina | University of Brescia | Italy |
| Mattia | Savardi | University of Brescia | Italy |
| Simona | Cacace | University of Brescia | Italy |
| Andrea | Loreggia | University of Brescia | Italy |
| Silvia | Zullo | University of Bologna | Italy |
| Gizem | Gezici | KDDLab, Scuola Normale Superiore, Pisa | Italy |
| Gayane | Aghakhanyan | University of Pisa | Italy |
| Monique | Munarini | University of Pisa | Italy |
| Claudio | Fanni | Università di Pisa | Italy |
| Roberto | Francischello | Università di Pisa | Italy |
| Francesca | Caputo | University of Pisa | Italy |
| Dania | Cioni | University of Pisa | Italy |
| Emanuele | Neri | University of Pisa | Italy |
| Lorenzi | Tumminello | University of Pisa | Italy |
| Giovanni | Sartor | CIRSFID-Alma AI, University of Bologna, Bologna, and European University Institute, Law Department, Firenze | Italy |
| Alice | Stocco | Ca Foscari Univ. Venice | Italy |
| Yueh-Hsuan | Weng | FRIS, Tohoku University, Sendai City, Miyagi Prefecture | Japan |
| Lilian | Olivia | Founder-SafeOnline Women Kenya (SOW-Kenya), Advocate of the High Court of Kenya, Nairobi | Kenya |
| Yasaman | Yousefi | University of Luxemburg | Luxembourg |
| Sian | Lun Lau | Sunway University | Malaysia |
| Mark | TeeKit Tsun | Swinburne University of Technology | Malaysia |
| Bee | Theng Lau | Swinburne University of Technology | Malaysia |
| Omigbile | Olamide | Centre for Health Ethics Law and Development, Lagos | Nigeria |
| Dotun | Bhadmus | Health Ethics and Law Consulting, Lagos | Nigeria |
| Faith | Faith Babajamu | Centre for Health Ethics Law and Development, Lagos | Nigeria |
| Frode | Ramstad Johansen | Østfold University College | Norway |
| Gunnar | Andersson | Østfold University College | Norway |
| Joanna | Karajanov | Kanna AS, Oslo | Norway |
| Pedro | Kringen | Z-Inspection® Initiative, Oslo | Norway |
| Reda | Hemdan Mahmoud Hassan | Nord University Business School, Bodø, | Norway |
| Katarzyna | Kaczmarek-Majer | Polish Academy of Sciences | Poland |
| Mickie | De Wet | Z-Inspection® Initiative | Portugal |
| Assiatu | Jalloh | Fourah Bay College – University of Sierra Leone | Sierra Leone |
| Ralf | Beuthan | Myongji University | South Korea |
| Alvaro | Fuentes | Jeonbuk National University | South Korea |
| Patrick | Osewe | Asian Development Bank | South Korea |
| Jason | Jung | Chung-Ang University | South Korea |
| Se-young | Jung | Department of hospital information, Seoul National University Bundang Hospital. | South Korea |
| Ilha | Yune | Department of hospital information, Seoul National University Bundang Hospital. | South Korea |
| Cornelius | Kalenzi | Korea Advanced Institute of Science and Technology (KAIST) | South Korea |
| Hyunjoo | JUNG | Seoul National University | South Korea |
| GiEun | Kim | Seoul National University | South Korea |
| Heejin | Kim | Seoul National University | South Korea |
| Jaemin | Lee | Seoul National University | South Korea |
| Seunggeun | Lee | Seoul National University | South Korea |
| Hyunwoo | Park | Seoul National University | South Korea |
| Nam-Jong | Paik | Seoul National University – Bundang Hospital | South Korea |
| Hyun-Woo | Shin | Seoul National University College of Medicine Department of Biomedical Sciences, Seoul National | South Korea |
| Seongwook | Heo | Seoul National University Law School | South Korea |
| Jihae | Suh | Seoul National University of Science and Technology, | South Korea |
| Jayden | Yoon | South Korea | |
| Kyu Sup | HAHN | Seoul National University | South Korea |
| Dongjin | Lee | Seoul National University | South Korea |
| Sira | Maliphol | The State University of New York, Songdo, Incheon | South Korea |
| Jose María | Alonso-Moral | Universidade de Santiago de Compostela, CiTIUS, Santiago de Compostela | Spain |
| Guillermo | De Haro Rodriguez | IE Business School, Madrid | Spain |
| Karin | Tafur | Z-Inspection® Initiative | Spain |
| Walter | Osika | Karolinska Institutet, Stockholm | Sweden |
| Emilie | Wiinblad Mathez | UNHCR, the UN Refugee Agency, Z-Inspection® Initiative | Switzerland |
| Duuk | Baten | SURF , Utrecht, Amsterdam | The Netherlands |
| Alesssio | Gallucci | Eindhoven University of Technology, Z-Inspection® Initiative | The Netherlands |
| Roger | Bons | Open University, AT Heerlen | The Netherlands |
| Mark MC | Hoogenboom | M@rk, Groningen | The Netherlands |
| Nadine | Roijakkers | Open University, AT Heerlen | The Netherlands |
| Camilla | Terzi | University of Groningen , Groningen | The Netherlands |
| Charles E. | Binkley | Hackensack Meridian School of Medicine, Edison | U.S.A |
| Judy | Wawira Gichoya | Emory University School of Medicine | U.S.A |
| Shomit | Ghose | University of San Francisco, San Francisco and UC Berkeley | USA |
| Renee | Wurth | Harvard School of Public Health, Z-Inspection® Initiative | U.S.A |
| Angelos | Chatzimparmpas | Northwestern University | U.S.A |
| Megan | Coffee | NYU Grossman School of Medicine and Columbia Mailman School of Public Health | U.S.A |
| Jesmin | Jahann Tithi | Z-Inspection® Initiative , Intel | U.S.A |
| Pablo | Garcia Molina | Georgetown University | U.S.A |
| Lambert | Hogenhout | Office for Information and Communications Technology (OICT) in the United Nations Secretariat, New York | U.S.A |
| Sonoo | Thadaney Israni | Stanford University Medicine, Stanford University | U.S.A |
| James | Brusseau | Philosophy, Pace University | U.S.A |
| Jody | Ranck | Chilmark Research | U.S.A |
| Andy | Spezzatti | Taltrics, AI for Good Foundation | U.S.A |
| Reddy | Sridhar | Los Angeles | U.S.A |
| Paul | Waller | Thorney Isle Research | United Kingdom |
| Eleanore | Hickman | University of Bristol | United Kingdom |
| Jonas | Bozenhard | University of Oxford | United Kingdom |
| Anum | Paracha | Birmingham City University | United Kingdom |