Loading…
Welcome to Open Education Global Conference!

to bookmark your favorites and sync them to your phone or calendar.

strong>Artificial Intelligence [clear filter]
arrow_back View All Dates
Friday, November 15
 

1:30pm AEST

Invited Presentation: What will education feel like in 2034?
Friday November 15, 2024 1:30pm - 1:55pm AEST
P4
Since changing roles from CEO to Head of Research at Moodle, Martin has had a lot more time in the past year to go deeper into new technologies and especially to study how they might affect education in general.

This presentation will cover:

- the long-term trends he's seeing around education and where that will probably take us in the next ten years and more.
- the main trends for the future of the Moodle platform, particularly for incorporating AI
- A discussion about a potentially important OER project for Open Education Global, on which your feedback is sought.

Included in [Session 11A]: Artificial Intelligence


Speakers
avatar for Martin Dougiamas

Martin Dougiamas

Founder and CEO, Moodle/OpenEdTech/OEGlobal
At this conference, I’m mostly here to learn from all of you!  Looking forward to getting to as many sessions as possible.  I have an invited session on Friday, as well, and I’d love you to come and talk with me about the future!Since 2001 I’ve been best known as that Australian... Read More →
Friday November 15, 2024 1:30pm - 1:55pm AEST
P4 BCBE, Glenelg St & Merivale St, South Brisbane QLD 4101, Australia

1:55pm AEST

Exploring the Notions of Open AI in Education [ID 29]
Friday November 15, 2024 1:55pm - 2:35pm AEST
P4
AI pervades various facets of society, including education. In the open education domain, the notion of open AI, distinct from the entity OpenAI, is attracting attention. However, the precise connotations of "open" in conjunction with "AI" remain subject to diverse interpretations, reflecting conceptual tensions and longstanding differences around concepts of “open” in respective domains.

In a blog post last year, prominent edtech expert David Wiley wrote, “when people talk about whether or not generative AI should be “open,” they could be talking about whether the foundation models should be open, whether the modified model weights that result from fine-tuning should be open, and/or whether the prompts (which includes templates, embeddings, etc.) should be open” (Wiley, 2023). In a similar direction, focusing on licensing for different aspects of AI technology, the Open Source Initiative are currently developing an “open-source AI” definition (Open Source Initiative, 2024). On the other hand, in broader literature, definitions of open education and open technology encompass a wide range of concepts, where “open” could mean: “ethical” (Holmes et al., 2022), “inclusive” and “innovative” (Bozkurt, 2023), “co-created” and “learner-driven” (Walberg and Thomas, 1972), “non-proprietary” (Berners-Lee, 2023), “decentralised” (Crowston and Howison, 2005), “accessible without barriers” (Knox, 2013), “available to join”, “shared”, “not tightly controlled” (Weller, 2020), “available in the public domain or under an open license” (UNESCO, 2022), “interpretable” and “visible” (Conati, Porayska-Pomsta, and Mavrikis, 2018), and many others.

This indicates that “open AI” and “open-source AI” are overlapping but not identical concepts. “Open-source AI” seems to be about the tangible aspects of systems, whereas “open AI” is broader and potentially includes context of how systems can be used, who can use them, and what for. Rather than trying to resolve these debates into a single taxonomy/typology, we propose a meronomic, holistic account of openness in AI education which explores the relationship between definitions with respect to part-whole relationships. This will facilitate diverse contributions and critical discussion.

In this panel session, participants will have the opportunity to engage in the panel discussion and ask questions regarding the dimensions of openness of AI in education.

The agenda includes:
  • 10 minutes: introductions, pre-recorded 1-slide lightning presentations from experts, panel reactions
  • 10 minutes: panel interaction and debate
  • 15 minutes: Q&A with panel members based on thoughts submitted by the audience (with backup questions prepared by the moderators).
  • 5 minutes: closing discussion and synthesis.
Experts who agreed to contribute so far include David Wiley, Anne-Marie Scott, Aras Bozkurt, Chrissi Nerantzi and Leo Havemann. Some of them might join virtually. They will be provided with prompts ahead of time for their initial statements. Robert Farrow, an experienced moderator, will chair the panel discussion. During the discussion, delegates will be able to contribute reflections and questions through a back channel and these will be integrated into the discussion.

Included in [Session 11A]: Artificial Intelligence

References

Berners-Lee, T. (2023). Frequently asked questions by the Press – Tim BL (w3.org). Available at https://www.w3.org/People/Berners-Lee/FAQ.html (Accessed: 2 May 2024)

Bozkurt, A. (2023). Generative AI, Synthetic Contents, Open Educational Resources (OER), and Open Educational Practices (OEP): A New Front in the Openness Landscape. Open Praxis, 15(3), pp. 178–184. DOI: https://doi.org/10.55982/openpraxis.15.3.579

Conati, C., Porayska-Pomsta, K. and Mavrikis, M., 2018. AI in Education needs interpretable machine learning: Lessons from Open Learner Modelling. arXiv preprint: https://arxiv.org/abs/1807.00154

Crowston, K. and Howison, J. (2005). The social structure of Free and Open Source software development. First Monday, Volume 10, Number 2 - 7 February 2005 Available at: https://firstmonday.org/ojs/index.php/fm/article/download/1207/1127 (Accessed: 2 May 2024)

Holmes, W., Porayska-Pomsta, K., Holstein, K., Sutherland, E., Baker, T., Shum, S.B., Santos, O.C., Rodrigo, M.T., Cukurova, M., Bittencourt, I.I. and Koedinger, K.R. (2022). Ethics of AI in education: Towards a community-wide framework. International Journal of Artificial Intelligence in Education, pp.1-23. DOI: https://doi.org/10.1007/s40593-021-00239-1

Knox, J. (2013). Five critiques of the open educational resources movement. Teaching in Higher Education, 18(8), pp. 821–832. DOI: https://doi.org/10.1080/13562517.2013.774354

Open Source Initiative (2024). The Open Source AI Definition – draft v. 0.0.8. Available at: https://opensource.org/deepdive/drafts/the-open-source-ai-definition-draft-v-0-0-8 (Accessed: 2 May 2024)

UNESCO (2022). Understanding Open Science. UNESDOC Digital Library. DOI: https://doi.org/10.54677/UTCD9302

Walberg, H.J. and Thomas, S.C. (1972). Open education: An operational definition and validation in Great Britain and United States. American Educational Research Journal, 9(2), pp.197-208. DOI: https://doi.org/10.3102/00028312009002197

Weller, M. (2020). 25 years of ed tech. Athabasca University Press. DOI: https://doi.org/10.15215/aupress/9781771993050.01

Wiley, D. (2023). An analogy for understanding what it means for generative AI to be “Open”. Open Content. https://opencontent.org/blog/archives/7289

Author Keywords
Open AI, Open-source AI, Artificial Intelligence, Open data, Open-source technical platforms
Speakers
avatar for Robert Farrow

Robert Farrow

Senior Research Fellow, The Open University
Open Education through a philosophical lens / Co-Director, Global OER Graduate Network / Co-Editor, JIME / Friendly Person https://scholar.google.co.uk/citations?user=j3-x3WwAAAAJ&hl=en
avatar for Vi Truong

Vi Truong

Lecturer in Information Studies, Charles Sturt University
VV

Vidminas Vizgirda

The University of Edinburgh
Friday November 15, 2024 1:55pm - 2:35pm AEST
P4 BCBE, Glenelg St & Merivale St, South Brisbane QLD 4101, Australia

2:35pm AEST

Implementing Large Language Models for Student Essay Assessment in MOOCs: Exploring Effectiveness of Prompt Engineering Methods [ID 61]
Friday November 15, 2024 2:35pm - 2:50pm AEST
P4
The burgeoning integration of Large Language Models (LLMs) such as ChatGPT into the fabric of Massive Open Online Courses (MOOCs) has highlighted a promising new direction for enhancing automated essay assessment processes. This research delves into the practical implementation of LLMs for evaluating student essays within MOOC frameworks, focusing primarily on exploring advanced prompt engineering strategies.

We investigate a spectrum of methodologies, including few-shot learning, Chain-of-Thought (CoT) prompting, and fine-tuning techniques, to discern the most effective strategies for harnessing the capabilities of LLMs in this educational domain. Drawing from the latest advancements in natural language processing (NLP), our study examines the ability of LLMs to deliver accurate, efficient, and scalable assessments of student submissions.

MOOCs typically host hundreds to thousands of students per course, presenting significant logistical challenges regarding assignment evaluation. The volume of essays that require assessment can be overwhelming for instructors, making it virtually impossible to provide detailed, timely feedback without technological assistance. The deployment of LLMs promises not only to enhance the grading efficiency and maintain consistency in evaluation standards across large cohorts.

The primary objective of this study is to explore the application of generative AI (GAI) in assisting with essay grading, utilizing open courses hosted at ewant, the largest MOOCs platform run by National Yang Ming Chiao Tung University (NYCU) in Taiwan . This course, "Required Credits for University Students - Emotional Education" is taught by Professor Chen Fei-Chuan at National Yunlin University of Science and Technology, Taiwan. Since its first delivery in 2015, this course has been offered 137 times, with nearly 20,000 students enrolled. From both qualitative and quantitative perspectives, this course represents an optimal choice for the study, offering substantial potential for further research and development. Assignments in this course predominantly involve open-ended questions without standard answers, encouraging students to reflect, discuss, share, and synthesize their personal experiences based on the knowledge acquired during the course. This type of unstructured assignment is better suited for introducing GAI than structured assignments in science and engineering courses with definitive answers.

This research aims to leverage a data-driven approach to develop a GAI system that replicates the grading standards and performance of the instructors or teaching assistants (graders), thereby assisting future educators in efficiently grading large volumes of written assignments. By analyzing the strengths and drawbacks of multiple prompt engineering and fine-tuning methods in automating essay evaluations, the study aims to establish a dataflow pipeline for AI-assisted essay grading, with the expectation of generalizing this process to other courses of a similar nature. Additionally, this research proposes recommendations for designing more effective and scalable automated essay assessment systems tailored for contemporary online education platforms.

Overall, this study aims to provide a comprehensive analysis of the potential of LLMs in transforming the landscape of essay assessment in MOOCs, thereby contributing valuable insights into the optimization of educational technologies in a GAI era.



Included in [Session 11A]: Artificial Intelligence

References
Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., ... & Amodei, D. (2020). Language models are few-shot learners. Advances in neural information processing systems, 33, 1877-1901.

Kojima, T., Gu, S. S., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022). Large language models are zero-shot reasoners. Advances in neural information processing systems, 35, 22199-22213.

Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., & Zettlemoyer, L. (2022). Rethinking the role of demonstrations: What makes in-context learning work?. arXiv preprint arXiv:2202.12837.

Wei, J., Bosma, M., Zhao, V. Y., Guu, K., Yu, A. W., Lester, B., ... & Le, Q. V. (2021). Finetuned language models are zero-shot learners. arXiv preprint arXiv:2109.01652.

Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., ... & Zhou, D. (2022). Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35, 24824-24837.

Author Keywords
Artificial Intelligence, Large Language Models, Prompt Engineering, Assessment, MOOCs
Speakers
avatar for Ken-Zen Chen

Ken-Zen Chen

Associate Dean/Associate Professor, National Yang Ming Chiao Tung University/ewant Open Education Platform
Dr. Ken-Zen Chen is an Associate Professor in the Institute of Education at National Yang Ming Chiao Tung University in Taiwan starting September, 2015. Prior to joining NYCU, Dr. Chen was an instructional Design Consultant/Research & Retention Analyst at eCampus Center, Boise State... Read More →
LL

Liang Lee

National Yang Ming Chiao Tung University
Friday November 15, 2024 2:35pm - 2:50pm AEST
P4 BCBE, Glenelg St & Merivale St, South Brisbane QLD 4101, Australia
 
Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.
Filtered by Date -