Education Commons^™

The Unreasonable Effectiveness Of Large Language Models In Zero-Shot Semantic Annotation Of Legal Texts, Jaromir Savelka, Kevin D. Ashley

Articles

The emergence of ChatGPT has sensitized the general public, including the legal profession, to large language models' (LLMs) potential uses (e.g., document drafting, question answering, and summarization). Although recent studies have shown how well the technology performs in diverse semantic annotation tasks focused on legal texts, an influx of newer, more capable (GPT-4) or cost-effective (GPT-3.5-turbo) models requires another analysis. This paper addresses recent developments in the ability of LLMs to semantically annotate legal texts in zero-shot learning settings. Given the transition to mature generative AI systems, we examine the performance of GPT-4 and GPT-3.5-turbo(-16k), comparing it to the previous …

Eight Steps To Facilitating More Equitable Education In Undergraduate Sciences, Gintarė Lübeck, Michael K. Seery, Barry J. Ryan

Articles

Pedagogical practices can influence students’ confidence and ability beliefs and affect their ambition to persevere in science. Given the continuing need to diversify science and retain students in scientific programmes, science education must be tailored to cater to the needs of varied student groups. Since early experience in university programmes can be decisive in determining students’ further academic and professional choices, pedagogies employed in undergraduate science courses can be particularly influential in supporting science careers. Undergraduate science instructors are therefore encouraged to consider their approaches to teaching and learning from a variety of perspectives that could help empower students from …

All Things Merge Into One, And A River Runs Through It: Exploring The Dimensions Of Blended Learning By Developing A Case Study Template For Blended Activities, Damian Gordon, Paul Doyle, Anna Becevel, Tina Baloh

Articles

The BLITT (Blended Learning International Train the Trainer) Project is focused on developing a training programme to equip teachers to become proficient in championing the use of Blended Learning in the classroom. The training programme will be developed in two phases, in the first phase involves the development of a series of case studies relevant to Blended Learning, followed by a second phase where the BLITT training programme will be designed and developed, using input from these cases. In developing the blended learning case studies, two key documents were identified as being essential, first, a case study tracking template to …

Ungrading, Supporting Our Students Through A Pedagogy Of Care, Shaun Ferns, Robert Hickey, Helen Williams

Articles

The awarding of grades or marks to student work is traditionally considered a fundamental feature of assessment. Grades became more widely established in the twentieth century becoming ubiquitous across most educational institutions. There is increasing evidence to suggest that grades are not effective tools for promoting or measuring learning. One alternative approach for promoting and measuring learning is "Ungrading," in which no letter grades or marks are given to students. Instead, they are replaced with formative feedback provided through strategies such as individual feedback, peer review and self-assessment. An Ungrading approach promises increased learner motivation, a reduction in stress, and …

Synergies In Scholarship At The Research Teaching Nexus At Tu Dublin: Building Research Synergies Into Teaching Activity Workshop, Deirdre Mcquillan

Articles

Objective of workshop is to provide and recognise possibilities for research synergies for individuals attending and to help participants develop more research supportive personal teaching philosophies. The workshop is evidence based and drawn from a survey of academics at TU Dublin in early 2021 on research synergies at the research teaching nexus.

Synergies In Scholarship At The Research Teaching Nexus, Deirdre Mcquillan

Articles

Survey instrument for examining research synergies in scholarship at the research teaching nexus

Impact Of A National Professional Development Programme For Out-Of-Field Teachers Of Mathematics In Ireland., Merrilyn Goos, Máire Ní Riordáin, Fiona Faulkner, Ciara Lane

Articles

Out-of-field teaching refers to the practice of assigning teachers to teach subjects that do not match their training or education. This paper reports on a study evaluating the impact of a national professional development programme for out-of-field teachers of post-primary school mathematics in Ireland – the Professional Diploma in Mathematics for Teaching. Evidence of impact was collected from three surveys. Two surveys evaluated changes in the prevalence of out-of-field teaching before and six years after the introduction of the programme. The third survey investigated programme graduates’ beliefs about mathematics, mathematics teaching and mathematics learning, and reported changes in teaching practices. …

Communities Of Practice As A Solution For The Implementation Gap In Internationalisation Of The Curriculum., Deirdre Ryan, Fiona Faulkner, Robert Flood, Dominic Dillane

Articles

The educational benefits of internationalisation in higher education are of paramount importance for all students. Despite an increasing presence of best practice guides and internationalisation strategies, there appears to be a significant implementation gap in terms of lecturers’ engagement with internationalisation in their teaching practice. Through an Action Research-informed Community of Practice approach, this study aims to provide new insights into lecturers’ engagement with Internationalisation of the Curriculum by examining their own perspectives, an area which has been underdeveloped to date. The Community of Practice provided an effective way of raising lecturers’ awareness of Internationalisation of the Curriculum, while simultaneously …

Designing Analog Learning Games: Genre Affordances, Limitations And Multi-Game Approaches, Owen Gottlieb, Ian Schreiber

Articles

This chapter explores what the authors discovered about analog games and game design during the many iterative processes that have led to the Lost & Found series, and how they found certain constraints and affordances (that which an artifact assists, promotes or allows) provided by the boardgame genre. Some findings were counter-intuitive. What choices would allow for the modeling of complex systems, such as legal and economic systems? What choices would allow for gameplay within the time of a class-period? What mechanics could promote discussions of tradeoff decisions? If players are expending too much cognition on arithmetic strategizing, could that …

Asynchronous Assistance: A Social Network Analysis Of Influencing Peer Interactions In Peerwise, Tomas Shields, Geraldine Gray, Barry J. Ryan

Articles

This mixed methods, investigative case study explored student patterns of use within the online PeerWise platform to identify the most influencing activities and to build a model capable of predicting performance based on these influencing activities. Peerwise is designed to facilitate student peer-to-peer engagement through creating, answering and ranking multiple choice questions; this study sought to understand the relationship between student engagement in Peerwise and learning performance. To address the research question, various usage metrics were explored, visualized and modelled, using social network analysis with Gephi, Tableau and Python. These findings were subsequently analyzed in light of the qualitative survey …

Measuring The Mathematical Problem Solving And Procedural Skills Of Students In An Irish Higher Education Institution – A Pilot Study, Fiona Faulkner, Mark Prendergast, Cormac Breen, Michael Carr

Articles

In 2010 the Irish second level mathematics curriculum underwent a period of significant change when a new mathematics curriculum was introduced. Some preliminary research has been carried out into the impact, if any, that this mathematics curriculum is having on students mathematics performance which have suggested that students’ procedural skills are declining year on year however their problem solving skills may have improved (Treacy and Faulkner 2015). Additional research in this area also highlighted that students willingness to engage in problem solving activities may have improved (Prendergast et al 2017). However preliminary analysis on the impact of the reformed mathematics …

The Student Experience Of Final Year In An Undergraduate Degree Programme In Education Studies., Roisin Donnelly, Julie Ui Choistealbha, Marian Fitzmaurice

Articles

This case study explores the student experience of the final year of a four-year undergraduate degree in ‘Education Studies’, with a focus on the perceived impact of curriculum design of the programme. The context is an Irish college of education, and the programme structure has been designed to allow for flexibility to accommodate varying student interests and professional pathways. As the first full iteration of the programme came to a close, it was considered an opportune time to ascertain if the programme was meeting its curriculum design objectives in terms of preparation for the chosen professional pathway post-graduation from both …

Acts Of Meaning, Resource Diagrams, And Essential Learning Behaviors: The Design Evolution Of Lost & Found, Owen Gottlieb, Ian Schreiber

Articles

Lost & Found is a tabletop-to-mobile game series designed for teaching medieval religious legal systems. The long-term goals of the project are to change the discourse around religious laws, such as foregrounding the prosocial aspects of religious law such as collaboration, cooperation, and communal sustainability. This design case focuses on the evolution of the design of the mechanics and core systems in the first two tabletop games in the series, informed by over three and a half years’ worth of design notes, playable prototypes, outside design consultations, internal design reviews, playtests, and interviews.

Automatically Extracting Meaning From Legal Texts: Opportunities And Challenges, Kevin D. Ashley

Articles

This paper examines impressive new applications of legal text analytics in automated contract review, litigation support, conceptual legal information retrieval, and legal question answering against the backdrop of some pressing technological constraints. First, artificial intelligence (Al) programs cannot read legal texts like lawyers can. Using statistical methods, Al can only extract some semantic information from legal texts. For example, it can use the extracted meanings to improve retrieval and ranking, but it cannot yet extract legal rules in logical form from statutory texts. Second, machine learning (ML) may yield answers, but it cannot explain its answers to legal questions or …

Using Ai To Analyze Patent Claim Indefiniteness, Dean Alderucci, Kevin D. Ashley

Articles

In this Article, we describe how to use artificial intelligence (AI) techniques to partially automate a type of legal analysis, determining whether a patent claim satisfies the definiteness requirement. Although fully automating such a high-level cognitive task is well beyond state-of-the-art AI, we show that AI can nevertheless assist the decision maker in making this determination. Specifically, the use of custom AI technology can aid the decision maker by (1) mining patent text to rapidly bring relevant information to the decision maker attention, and (2) suggesting simple inferences that can be drawn from that information.

We begin by summarizing the …

Direct Instruction And Its Extension With A Community Of Inquiry: A Comparison Of Mental Workload, Performance And Efficiency, Giuliano Orru, Luca Longo

Articles

This paper investigates the efficiency of two instructional design conditions: a traditional design based on the direct instruction approach to learning and its extension with a collaborative activity based upon the community of inquiry approach to learning. This activity was built upon a set of textual trigger questions to elicit cognitive abilities and support knowledge formation. A total of 115 students participated in the experiments and a number of third-level computer science classes where divided in two groups. A control group of learners received the former instructional design while an experimental group also received the latter design. Subsequently, learners of …

Evaluating The Effectiveness Of A Focused Debate On The Development Of Ethical Reasoning Skills In Pharmacy Technician Students., Seana Hogan, Julie Dunne

Articles

Objective. To evaluate the effectiveness of debating an ethical dilemma on the development of ethical reasoning skills in pharmacy technician students.

Methods. A mixture of qualitative and quantitative methods was used. This included analysis of before and after 5-minute papers, a sentiment survey, thematic analysis of student reflective writing and a qualitative questionnaire by an independent observer.

Results. Twenty-five students participated in the study. The 5-minute papers showed improvement in student learning. In the sentiment survey, 83% of students agreed or strongly agreed that they had a better understanding of ethical dilemmas following the debate. The main theme identified from …

Empowering Students To Perform An Enhanced Role In The Assessment Process: Possibilities And Challenges, Paul Dervan

Articles

Assessment is key to student learning. This paper examines the case for increased participation by higher education students in the assessment process to deepen learning and improve learner motivation. While increased student participation may not solve all problems relating to assessment, a review of the literature dealing with enhancing the role of students in the assessment process, and original research conducted amongst academics and students at the author's institution, suggests improvements can be made leading to increased student satisfaction, motivation and competency. This paper therefore argues for change in the approach to assessment by empowering students to become partners in …

Finding Lost & Found: Designer’S Notes From The Process Of Creating A Jewish Game For Learning, Owen Gottlieb

Articles

This article provides context for and examines aspects of the design process of a game for learning. Lost & Found (2017a, 2017b) is a tabletop-to-mobile game series designed to teach medieval religious legal systems, beginning with Moses Maimonides’ Mishneh Torah (1180), a cornerstone work of Jewish legal rabbinic literature. Through design narratives, the article demonstrates the complex design decisions faced by the team as they balance the needs of player engagement with learning goals. In the process the designers confront challenges in developing winstates and in working with complex resource management. The article provides insight into the pathways the team …

Introduction: Jewish Gamevironments – Exploring Understanding With Playful Systems, Owen Gottlieb

Articles

The study of Judaism, Jewish civilizationi, and games is currently comprised of projects of a rather small set of game scholars. A sample of our work is included in this issue.

Time Travel, Labour History, And The Null Curriculum: New Design Knowledge For Mobile Augmented Reality History Games, Owen Gottlieb

Articles

This paper presents a case study drawn from design-based research (DBR) on a mobile, place-based augmented reality history game. Using DBR methods, the game was developed by the author as a history learning intervention for fifth to seventh graders. The game is built upon historical narratives of disenfranchised populations that are seldom taught, those typically relegated to the 'null curriculum'. These narratives include the stories of women immigrant labour leaders in the early twentieth century, more than a decade before suffrage. The project understands the purpose of history education as the preparation of informed citizens. In paying particular attention to …

Design-Based Research Mobile Gaming For Learning Jewish History, Tikkun Olam, And Civics, Owen Gottlieb

Articles

How can Design-Based Research (DBR) be used in the study of video games, religious literacy, and learning? DBR uses a variety of pragmatically selected mixed methods approaches to design learning interventions. Researchers, working with educators and learners, design and co-design learning artifacts and environments. They analyze those artifacts and environments as they are used by educators and learners, and then iterate based on mixed methods data analysis. DBR is suited for any "rich contextualized setting in which people have agency." (Hoadley 2013) such as formal or informal learning environments.

The case covered in this chapter is a mobile Augmented Reality …

Work Placement Reflective Assessments And Employability Enhanced Through Highlighting Graduate Attributes, Julie Dunne

Articles

This paper reports on a study which investigated the effect of activities to promote awareness of specific prioritised graduate attributes on the quality of reflection displayed in student work-placement reflective blog assessments. The focus of the paper is on the results from a thematic analysis of reflective writing assisted by NVivo software from a control and research group, using the a priori codes of ‘reflection’ and ‘graduate attributes’, as part of a Participatory Action Research study. The findings show an increase in reflection associated with graduate attributes in the research group compared to the control group. More importantly, there is …

Recruitment And Selection Strategies In Optometric Education Towards Addressing Human Resource Disparities In Sub-Saharan Africa, Vanessa Moodley, James Loughman, Kovin S. Naidoo

Articles

The dire need for eye care services and a dearth of human resources (HR) in sub-Saharan Africa motivated the setting up of new optometry programmes. However, to make a meaningful impact, geographical, gender, economic and educational disparities must additionally be addressed. A qualitative study utilizing purposive sampling to select academic leadership and students from optometry programmes in sub-Saharan Africa was conducted. Individual and focus group interviews produced data that were coded and analysed using a deductive thematic analysis approach. The themes that emerged as contributing to disparities in access through recruitment and selection were institutional barriers (student intake numbers, programme …

Enhancing The Academic And Social Learning Of Irish Undergraduates Through Emotional And Social Skills Development., Aiden Carthy, Celesta Mccann, Sinead Mcgilloway, Colm Mcguinness

Articles

This paper considers the potential merits of emotional competency coaching for undergraduate students. We outline the findings from our previous work which showed, for example, that a sample of First Year undergraduate students failed to engage with coaching primarily because it was not a mandatory aspect of the curricula. An analysis of the National Framework of Qualifications (NFQ) - which details the specific learning outcomes that must be achieved by all Irish academic syllabi found that this framework makes scant reference to the development of social and emotional skills. Therefore, a revised working model of the NFQ is proposed, which …

Wikis As Platforms For Authentic Assessment, Pamela L. Eddy, April Lawrence

Articles

Calls for accountability focus attention on assessment of student learning. Authentic assessment involves evaluating student learning as students perform real world tasks. We present a four-stage conceptual framework for authentic assessment. We argue first that evaluation is a process rather than a static one-time event. Second, authentic assessment involves evaluating experiential learning. Third, multiple evaluators assess student work, including self-assessment or review by a public audience. Finally, authentic assessments offer more learner choice. Wikis, as user-friendly web spaces that support easy web authoring for individuals or for collaborative groups, provide a platform for both student learning and authentic assessment.

Reflections On A Decade Of Global Rankings: What We've Learned And Outstanding Issues, Ellen Hazelkorn

Articles

Ten years after the first global rankings appeared, it is clear that they have had an extraordinary impact on higher education. While there are fundamental questions about whether rankings measure either quality or what’s meaningful, they have succeeded in exposing higher education to international comparison. Moreso, because of the important role higher education plays as a driver of economic development, rankings have exposed both an information deficit and national competitiveness. Accordingly, both nations and institutions have sought to maximise their position vis-á-vis global rankings with positive and perverse effects. Their legacy is evident in the way rankings have become an …

Teaching Law And Digital Age Legal Practice With An Ai And Law Seminar: Justice, Lawyering And Legal Education In The Digital Age, Kevin D. Ashley

Articles

A seminar on Artificial Intelligence ("Al") and Law can teach law students lessons about legal reasoning and legal practice in the digital age. Al and Law is a subfield of Al/computer science research that focuses on designing computer programs—computational models—that perform legal reasoning. These computational models are used in building tools to assist in legal practice and pedagogy and in studying legal reasoning in order to contribute to cognitive science and jurisprudence. Today, subject to a number of qualifications, computer programs can reason with legal rules, apply legal precedents, and even argue like a legal advocate.

This article provides a …

Exploring Supports Provided For Student Eportfolio Development In A Professional Development Context, Muireann Okeeffe

Articles

This small scale study aimed to explore and establish if support strategies implemented to enhance student ePortfolios were helpful to students and to identify useful ways of supporting ePortfolio development with future cohorts of students. This action research study was informed through focus group discussion and individual interviews with students.

The importance of reflection for the development professional practice and of creative abilities is discussed. The substantial benefits of creativity within education are investigated and characteristics of creativity that might be developed with students’ ePortfolios are revealed. Specifically this paper seeks to foster Crafts (2011) four characteristics of creativity, pluralities, …

Assessing A Young Writer’S Story, Julie Patterson

Articles

Now that's a story! Find out what this 1st grader is doing well and what our writer-in-residence would teach next.