Case Study: AI Mastery in Healthcare
Otti conducted a learning solution titled “Metacognition for AI Efficiency in Healthcare” for the Ministry of Health Malaysia (MOH) on the 21st and 22nd of October 2024. This case study investigates the initiative’s background, implementation, outcomes, and assessment of its overall impact and effectiveness.
Healthcare Professionals In Need of AI Upskilling
Healthcare professionals are the cornerstone of our nation’s wellbeing, yet their demanding workloads often limit opportunities for AI-focused upskilling. This is a significant concern, as AI is crucial across industries, including healthcare, where automation and augmentation through AI can reduce heavy workloads.
Studies have shown that clinicians spend up to 49% of their day doing documentation.¹ AI can address this by streamlining administrative and documentation processes.² Furthermore, AI can significantly reduce the cognitive load on healthcare providers by synthesising vast amounts of medical data into coherent summaries and intuitive visualisations, enabling faster and more accurate decision-making. Other key usages of AI in healthcare include assistance in medical diagnostics, treatment planning and remote patient monitoring, ultimately improving patient outcomes and reducing the burden of healthcare workers.³
Customised Learning Solution for Healthcare Professionals
To address this need, the Bahagian Pembangunan Kompetensi (BPK) of the Ministry of Health Malaysia (MOH) engaged Otti to conduct a workshop titled “Metacognition for AI Efficiency in Healthcare.” The primary objectives of the workshop were to:
Provide participants with a solid understanding of AI fundamentals and to enable them to master generative AI tools.
Empowering them to effectively integrate these technologies into healthcare practices.
To increase productivity, enhanced efficiency, and improved decision-making across healthcare operations, ultimately leading to better patient outcomes and streamlined workflows.
Two cohorts: A total of 50 healthcare professionals were trained in person at Otti’s training campus. Learners were guided through 4 modules which advanced their understanding of metacognition, enabling them to improve the outputs of their AI usage. They were also guided through the strengths and limitations of generative AI vs human intelligence.
Practical and interactive healthcare project-based learning was used to facilitate retention and mastery of the learnings. For instance, participants were tasked with drafting a realistic healthcare document using Generative AI.
Workshop Outcomes: ‘Eye opening & Practically Useful’
The results of pre- and post- assessments showed meaningful improvements in participants skills, mindset, metacognition and AI mastery:
26%
increase in ability to utilise fundamental AI skills and knowledge to achieve their work goals.
29%
increase in mindset and confidence in mastering new digital competencies.
30%
increase in metacognitive engagement – strategic higher-order thinking more effectively in their professional roles and AI usage.
Navigating AI's Healthcare Future
This impact case study demonstrates that developing fundamental AI competencies, unique human strengths, and growth mindset significantly benefits healthcare professionals. This foundation allows them to handle complex tasks more efficiently, reduce administrative burdens, and ultimately devote greater attention to patient needs.
References
-
Budd, J. (2023). Burnout related to electronic health record use in primary care. Journal of primary care & community health, 14, 21501319231166921.
-
Pavuluri, S., Sangal, R., Sather, J., & Taylor, R. A. (2024). Balancing act: the complex role of artificial intelligence in addressing burnout and healthcare workforce dynamics. BMJ Health & Care Informatics, 31(1), e101120.
-
Yelne, S., Chaudhary, M., Dod, K., Sayyad, A., & Sharma, R. (2023). Harnessing the power of AI: a comprehensive review of its impact and challenges in nursing science and healthcare. Cureus, 15(11).
The results align with the goal of equipping participants with core AI competencies and a growth mindset. Beyond mastering current generative AI tools like ChatGPT, participants gained foundational AI knowledge, enabling them to adapt quickly to new technologies. Their improved metacognitive skills sharpened strategic and critical thinking, vital for optimising AI outputs and managing risks like bias and hallucinations.
88% of participants provided a workshop rating above 8, describing the workshop as eye-opening, practical, and exceeding expectations. They also reported heightened awareness of both human and AI strengths, allowing them to synergise these assets for enhanced performance.
Furthermore, a net promoter score of 9.42 out of 10 demonstrates the workshop's value and participants' strong endorsement.