Educational Assessment, Evaluation, and Research Commons^™

Profess 12: Project Report 5: The Profess 12 Summer School - Evaluation, Una Beagon, Ruchita Jani, Janet Mckennedy, Brian Bowe, Margaret Morgan, Rosalind M Henry

Reports

This report outlines the evaluation of the summer school which was a key element of the PROFESS 12 project. The key steps involved in the 5-day summer school along with the method by which the feedback and the reflections of the participants of the summer school were collected is described here. Thereafter, the reflections received in the form of audio and text files are analysed and themes identified from the experience of the summer school participants are explained in detail.

The survey responses from the feedback on the summer school participation are also shown graphically. This analysis helped us identify …

Exploring The Significance Of The Traditional Chef’S Uniform In Making Sense Of Professionalism In Culinary Arts Using Interpretative Phenomenological Analysis, Orla Mc Connell

European Journal of Food Drink and Society

Previous studies have found that professionalism is an important success factor for chefs. Yet, research on what professionalism “means” to chefs, and how they “make sense” of it, is currently underexplored. While there is some evidence of the significance of the traditional chef’s uniform in professional identity formation, it also needs further consideration. Culinary arts lecturers and chefs have already contributed to these discussions, but the student voice remains largely unknown. Alongside this, there is no prior research specifically on professionalism in culinary arts in Ireland. Therefore, a research gap emerged, which this paper intends to address. Using interpretative phenomenological …

The University Education Model Collection 2024: “A University Way Of Being”, Fionnuala Darby, Shaun Ferns, Barry J. Ryan

Group Reports

The University Education Model (UEM) revolutionises our approach to education; this approach is grounded in transformative learning opportunities and experiences for all. The UEM is central to the TU Dublin Strategic Intent, which itself is informed by the UN Sustainable Development Goals (SDGs), and in the case of the UEM, SDG 4 Quality Education. Embedding the UEM into our practice, processes and culture will empower TU Dublin to cater for the largest number of diverse learners, producing the most sought after, digitally literate, graduates.

The central focus of UEM are our learners, grounded in the three components that comprise the …

Developing Research Culture Among Staff Under Conditions Of Organizational Change, Mariia Perelygina, Denise O'Leary

Conference papers

This paper focuses on encouraging the growth of a research culture within a school of hospitality and tourism in one third-level institution in Ireland. The aim of the initiative is to increase engagement of staff members in impactful research, leading to benefits for individual staff members and a greater research profile for the school. Taking an action research approach, a plan of initiatives was designed and implemented to develop research culture. The paper examines the phenomenon of changing the organizational culture at the department level in a higher education institution undergoing a large amount of organisational change. The initiative is …

Improve Engagement With Full Labs And Motivated Students: Interactive Labs Via Low Stakes Assessment, Susan Mckeever, Patricia O'Byrne, Amanda O'Farrell

Academic Posters Collection

Poor engagement and attendance is an endemic problem at third level, particularly post covid. Our approach shows how the use of regular in-lab assessment and challenges can dramatically increase student participation and learning. Using three case studies, we demonstrate how we have successfully used this low-stakes assessment approach to improve student outcomes, across a range of modules.

Eight Steps To Facilitating More Equitable Education In Undergraduate Sciences, Gintarė Lübeck, Michael K. Seery, Barry J. Ryan

Articles

Pedagogical practices can influence students’ confidence and ability beliefs and affect their ambition to persevere in science. Given the continuing need to diversify science and retain students in scientific programmes, science education must be tailored to cater to the needs of varied student groups. Since early experience in university programmes can be decisive in determining students’ further academic and professional choices, pedagogies employed in undergraduate science courses can be particularly influential in supporting science careers. Undergraduate science instructors are therefore encouraged to consider their approaches to teaching and learning from a variety of perspectives that could help empower students from …

Could The Inclusion Of Certain Building Information And Modelling Aspects Into The Leaving Certificate Engineering Syllabus, Aid The Transition Of Students Into Third Level Education, When Choosing A Course Within The Construction Industry, Joseph Boyle, Deborah M. Brennan

Capstone Reports

The paper investigates the effects of implementing several Building Information and Modelling (BIM) aspects into the Leaving Certificate Engineering Syllabus and examines the impact this has on students choosing third level Architectural Engineering and Construction (AEC) industry courses with the desire of improving the shortage in the sector. The method and content of the study was based on academic research on second level education in other European countries through the lens of a Literature Review. A sixteen-week pilot program was trialed with over one hundred students at Senior Cycle. The outcomes of the study were critically evaluated through stakeholder interviews …

Circlet Guide For Facilitators: Online Continuing Professional Development Module: Embedding Community Engaged Research And Learning In Higher Education Curricula, Catherine Bates, Sinead Mccann, Caroline Mcgowan

Books/Book chapters

This guide contains all the resources needed to implement a postgraduate Continuing Professional Development (CPD) module for lecturers who wish to build, or enhance, community engaged research and learning (CERL) projects in the modules they teach, as part of the Higher Education curriculum. CERL (or service-learning, as it can be known) is a high-impact activity in Higher Education (Kuh, 2008), increasing student engagement and learning. CERL also supports community goals, and makes teaching more interesting for lecturers.

This module is designed to build capacity among participants for CERL, including developing relevant knowledge, skills, attitudes and values. Our approach to this …

The Development Of A Template For Structuring Case Studies About Blended Learning, And An Associated Evaluation Check Sheet, Damian Gordon, Paul Doyle, Anna Becevel, Tina Baloh

Conference Papers

The Blended Learning International Train the Train Project is focused on the development of a training programme to equip teachers to become proficient in the training others in Blended Learning, which is an approach to teaching that combines online teaching with face-to-face teaching; and aims to leverage the benefits of both. The programme will be developed in two phases, in the first phase a series of case studies relevant to Blended Learning will be developed, followed by a second phase where the training programme with be designed and developed. In developing the blended learning case studies, two key documents were …

Rubrics - Creating Transparency For Effective Teaching And Learning, Seamus Harrington

Other Resources

No abstract provided.

All Things Merge Into One, And A River Runs Through It: Exploring The Dimensions Of Blended Learning By Developing A Case Study Template For Blended Activities, Damian Gordon, Paul Doyle, Anna Becevel, Tina Baloh

Articles

The BLITT (Blended Learning International Train the Trainer) Project is focused on developing a training programme to equip teachers to become proficient in championing the use of Blended Learning in the classroom. The training programme will be developed in two phases, in the first phase involves the development of a series of case studies relevant to Blended Learning, followed by a second phase where the BLITT training programme will be designed and developed, using input from these cases. In developing the blended learning case studies, two key documents were identified as being essential, first, a case study tracking template to …

An Exploratory Case Study Into Understanding Teaching Practice And Towards Enhancing Transformative Learning And Graduate Employability At Tu Dublin, Ellen Kampinga

Masters

This research focuses on understanding and enhancing the educational practice towards using pedagogies like transformative learning to enhance graduate employability at a new technological university, TU Dublin, during the coronavirus (COVID-19) pandemic. It was found that teaching practice depends significantly on the lecturer, the discipline area, the graduate skills that are sought after in each module and discipline, and the context of the delivery. The PAGE (Pedagogy Assisting Graduate Employability) framework developed from this research, aims to visualise the connection between the teaching process, pedagogy, and graduate employability. Application of the framework will offer insight into how each unique lecturer …

Ungrading, Supporting Our Students Through A Pedagogy Of Care, Shaun Ferns, Robert Hickey, Helen Williams

Articles

The awarding of grades or marks to student work is traditionally considered a fundamental feature of assessment. Grades became more widely established in the twentieth century becoming ubiquitous across most educational institutions. There is increasing evidence to suggest that grades are not effective tools for promoting or measuring learning. One alternative approach for promoting and measuring learning is "Ungrading," in which no letter grades or marks are given to students. Instead, they are replaced with formative feedback provided through strategies such as individual feedback, peer review and self-assessment. An Ungrading approach promises increased learner motivation, a reduction in stress, and …

Lessons From The Classroom – Assessing The Work Of Postgraduate Students To Support Better Hygrothermal Risk Assessment, Joseph Little, Beñat Arregi, Christian Bludau

Conference papers

The widespread adoption of transient simulation modelling tools by building design professionals to support hygrothermal risk assessment of building design specifications is a crucial component in a multi-pronged drive to reduce moisture risk in buildings. Structured upskilling is essential. Much can be learnt about the ways practitioners use such tools by reviewing the work of professional postgraduate student groups. Such review could inform the creation of a user protocol. Peer-review under the responsibility of the organizing committee of the ICMB21.

Synergies In Scholarship At The Research Teaching Nexus At Tu Dublin: Building Research Synergies Into Teaching Activity Workshop, Deirdre Mcquillan

Articles

Objective of workshop is to provide and recognise possibilities for research synergies for individuals attending and to help participants develop more research supportive personal teaching philosophies. The workshop is evidence based and drawn from a survey of academics at TU Dublin in early 2021 on research synergies at the research teaching nexus.

Ungrading Uncovered: How Going Gradeless Can Support Learner Diversity In Higher Education, Shaun Ferns, Robert Hickey, Helen Williams

Other resources

The awarding of grades or marks to student work is traditionally considered a fundamental feature of assessment. Traditional grades, the awarding of numeric values to student work, date back to the 1600s where Harvard used exit grades to measure and categorize students (Smallwood, 1935). Grades became more widely established in the education sector at the beginning of the twentieth century to deal with increased numbers of students and as a means of communication between educational institutions and third parties, a form of universal measurement. Although becoming ubiquitous across most educational spectrums in the second half of the twentieth century, there …

Authentic Assessment Framework May 2021 Version, Jen Harvey, Derek Dodd

Reusable Resources

The TU Dublin Authentic Assessment (AA) framework was designed to be used as a general guide.for staff undertaking assessment redesigns as part of a University Initiative under the IMPACT SATLE 1 funding call.

The Framework builds on the work of Gulikers et al, (2006) and Villerarroel et al (2020) and is structured across four dimensions: ‘Realism’, ‘Cognitive challenge’, ‘metacognition’, and ‘feedback processes’.

The resource provides a set of ideas that can be used to build the four dimensions into programme based Authentic Assessment strategies and practices.

Synergies In Scholarship At The Research Teaching Nexus, Deirdre Mcquillan

Articles

Survey instrument for examining research synergies in scholarship at the research teaching nexus

Impact Of A National Professional Development Programme For Out-Of-Field Teachers Of Mathematics In Ireland., Merrilyn Goos, Máire Ní Riordáin, Fiona Faulkner, Ciara Lane

Articles

Out-of-field teaching refers to the practice of assigning teachers to teach subjects that do not match their training or education. This paper reports on a study evaluating the impact of a national professional development programme for out-of-field teachers of post-primary school mathematics in Ireland – the Professional Diploma in Mathematics for Teaching. Evidence of impact was collected from three surveys. Two surveys evaluated changes in the prevalence of out-of-field teaching before and six years after the introduction of the programme. The third survey investigated programme graduates’ beliefs about mathematics, mathematics teaching and mathematics learning, and reported changes in teaching practices. …

Communities Of Practice As A Solution For The Implementation Gap In Internationalisation Of The Curriculum., Deirdre Ryan, Fiona Faulkner, Robert Flood, Dominic Dillane

Articles

The educational benefits of internationalisation in higher education are of paramount importance for all students. Despite an increasing presence of best practice guides and internationalisation strategies, there appears to be a significant implementation gap in terms of lecturers’ engagement with internationalisation in their teaching practice. Through an Action Research-informed Community of Practice approach, this study aims to provide new insights into lecturers’ engagement with Internationalisation of the Curriculum by examining their own perspectives, an area which has been underdeveloped to date. The Community of Practice provided an effective way of raising lecturers’ awareness of Internationalisation of the Curriculum, while simultaneously …

Towards The Development Of A Framework For The Inclusion Of Peer Assessment In Irish Medical Science Undergraduate Education, Mary Mcgrath

Doctoral

Assessment of learning is integral to all programmes in Higher Education (HE). While one purpose of assessment is to confirm achievement of standards, another is to support student learning. When educational programmes adopt an assessment strategy that is inclusive of ‘assessment for learning’ the role of assessment supporting learning can be expanded and sustained more effectively. Peer Assessment (PA) is an example of an assessment approach that can support and enrich student learning. The advantages and benefits of PA are strongly established in the published literature.

This research study aimed to investigate and develop a framework for the inclusion of …

Hublinked: A Curriculum Mapping Framework For Industry, Paul Doyle, Cathy Ennis, Anna Becevel, Stephane Maag, Radu Dobrin, Mojca Ciglarič, Yunia Choi, Alan Fahey, Deirdre Lillis

Conference Papers

A key aim of HubLinked is to improve the effectiveness of University-Industry linkages between CS faculties and ICT companies. One of the problems identified as core to the Project was to match Learning Outcomes from different curricula with the requirements dictated by the ICT industry with the final aim to enhance students Graduate Skills and employability. Based on agreed core U-I linkage attributes, lower-level curriculum L0s have been designed and reviewed by industry partners. To enable the replication of this process, a tool was designed to make the comparison of graduates' skills from different institutions easily accessible. Using this tool …

Asynchronous Assistance: A Social Network Analysis Of Influencing Peer Interactions In Peerwise, Tomas Shields, Geraldine Gray, Barry J. Ryan

Articles

This mixed methods, investigative case study explored student patterns of use within the online PeerWise platform to identify the most influencing activities and to build a model capable of predicting performance based on these influencing activities. Peerwise is designed to facilitate student peer-to-peer engagement through creating, answering and ranking multiple choice questions; this study sought to understand the relationship between student engagement in Peerwise and learning performance. To address the research question, various usage metrics were explored, visualized and modelled, using social network analysis with Gephi, Tableau and Python. These findings were subsequently analyzed in light of the qualitative survey …

Measuring The Mathematical Problem Solving And Procedural Skills Of Students In An Irish Higher Education Institution – A Pilot Study, Fiona Faulkner, Mark Prendergast, Cormac Breen, Michael Carr

Articles

In 2010 the Irish second level mathematics curriculum underwent a period of significant change when a new mathematics curriculum was introduced. Some preliminary research has been carried out into the impact, if any, that this mathematics curriculum is having on students mathematics performance which have suggested that students’ procedural skills are declining year on year however their problem solving skills may have improved (Treacy and Faulkner 2015). Additional research in this area also highlighted that students willingness to engage in problem solving activities may have improved (Prendergast et al 2017). However preliminary analysis on the impact of the reformed mathematics …

The Student Experience Of Final Year In An Undergraduate Degree Programme In Education Studies., Roisin Donnelly, Julie Ui Choistealbha, Marian Fitzmaurice

Journal Articles

This case study explores the student experience of the final year of a four-year undergraduate degree in ‘Education Studies’, with a focus on the perceived impact of curriculum design of the programme. The context is an Irish college of education, and the programme structure has been designed to allow for flexibility to accommodate varying student interests and professional pathways. As the first full iteration of the programme came to a close, it was considered an opportune time to ascertain if the programme was meeting its curriculum design objectives in terms of preparation for the chosen professional pathway post-graduation from both …

Online Assessment Format For Bim Skills At The Worldskills Russia National Championship 2020: Experiment And Results, Alexey Andreev

Level 3

This article describes a new online format for WorldSkills Competitions based on Digital Construction-BIM (Building Information Modelling) Skills at the Russian National Final 2020. The COVID-19 epidemic has affected many aspects of our lives. Locked down cities, remote on-line education, mask-wearing in public spaces, are all our today’s reality. As a result, the vast majority of WorldSkills National Championships which initially were planned for 2020 were postponed to 2021, including in Ireland, the UK and most other participating countries. There were new requirements for the 2020 Competition Venues, for infrastructure, and even for Competition Rules due to Covid 19 restrictions. …

Teacher Learning And Continuous Professional Development., Fiona Faulkner, John Kenny, Coral Campbell, Cosette Crisan

Books/Book Chapters

This chapter discusses teacher learning and professional development of out-of-field teachers from the point of view of the literature. It examines what makes this kind of learning and development effective and explores the ideas surrounding the varying rationale for the introduction of such teacher learning and professional development opportunities. Classical approaches to professional development are discussed in addition to several emerging international models of professional development that are currently being employed in the Republic of Ireland, England and Australia for in-service out-of-field teachers of mathematics predominantly but also a range of other subject disciplines (in the case of South Korea). …

An International Comparison Of K-12 Computer Science Education Intended And Enacted Curricula, Katrina Falkner, Sue Sentance, Rebecca Vivian, Sarah Barksdale, Leonard Busuttil, Elizabeth Cole, Christine Liebe, Francesco Maiorana, Monica M. Mcgill, Keith Quille

Conference Papers

This paper presents an international study of K-12 Computer Science implementation across Australia, England, Ireland, Italy, Malta, Scotland and the United States. We present findings from a pilot study, comparing CS curriculum requirements (intended curriculum) captured through country reports, with what surveyed teachers (n=244) identify as enacting in their classroom (the enacted curriculum). We address the extent that teachers are implementing the intended curriculum as enacted curriculum, exploring specifically country differences in terms of programming languages and CS topics implemented. Our findings highlight the similarities and differences of intended and enacted CS curriculum within and across countries and the value …

Direct Instruction And Its Extension With A Community Of Inquiry: A Comparison Of Mental Workload, Performance And Efficiency, Giuliano Orru, Luca Longo

Articles

This paper investigates the efficiency of two instructional design conditions: a traditional design based on the direct instruction approach to learning and its extension with a collaborative activity based upon the community of inquiry approach to learning. This activity was built upon a set of textual trigger questions to elicit cognitive abilities and support knowledge formation. A total of 115 students participated in the experiments and a number of third-level computer science classes where divided in two groups. A control group of learners received the former instructional design while an experimental group also received the latter design. Subsequently, learners of …

Assessment Strategies To Promote Peer Learning In An Online Course, Pauline Rooney, Caitríona Ní Shé

Papers, presentations and other resources

The value of peer learning in higher education is now well recognised. Just as we continually learn from eachother in our everyday lives, so our students also learn from eachother as part of informal and formal learning experiences. Within educational programmes, peer learning is facilitated through a variety of pedagogical strategies which promote active participation, collaboration and the sharing of knowledge and ideas. With the increasing ubiquity of social networking and online learning platforms, new opportunities for facilitating peer learning, have emerged. Within online courses – where students often study at geographically disparate locations – peer learning strategies assume arguably …