Educational Assessment, Evaluation, and Research Commons^™

‘Freedom To Learn-Independent Campus’And Pre-Service Teachers Proffesional Identity Development, Lemmuela Alvita Kurniawati, Vinanda Kristianti

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

In response to the implementation of Merdeka Belajar (Freedom to Learn)- Kampus Merdeka (Independent Campus), this study aimed to investigate the perceived impacts of Freedom to Learn-Independent Campus (henceforth FLIC), on pre-service Teacher Professional Identity (henceforth, TPI) development. A qualitative research method by using a thematic analysis was used to analyze the data. Homogeneous online focus group discussions with three different groups of participants joining FLIC program were conducted to collect the data. There were twelve pre-service teachers who joined FLIC program involved in this study. The findings were elaborated under three themes. The themes were becoming and being didactical …

Physical Education: Study Of Different Perceptions Of Students On The Concept Of Physical Education In First Middle School And Vocational Middle School, Mu’Arifin Mu’Arifin, Mashud Mashud, Zsolt Nemeth

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This research aims to measure the truth level of the perception of the students on the physical education concept, and to figure out the difference perception between male and female students at the junior high school and vocational high school levels. Method used is survey with the use of closed inventory questionnaire. This study is conducted on two populations, that are 3700 students of X class at Vocational High School in the Regency of Banyuwangi and 750 students of VIII class at Junior High School in the Regency of Pacitan. Study sample is taken by purposive so that it is …

Penguatan Karakter Bernalar Kritis Berbasis Integratif Moral Untuk Siswa Sekolah Dasar Dalam Program Kampus Mengajar Di Indonesia, Nursalam Nursalam, Suardi Suardi

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

The research objective is to produce a model for strengthening character education based on critical reasoning moral integration for elementary school students in campus teaching activities in Makassar City. This research uses mixed research methods, using questionnaires, observations, interviews and documentation, then analyzed qualitatively and quantitatively. The results showed that strengthening the character of critical reasoning based on moral integrative and social collaboration was in the very frequent category at all stages of moral knowing, feeling, sinverbal, action, habitus and culture from various campus teaching activities such as task assignment, giving direction, thinking together, and carry out tasks according to …

Integrating Electronic Portfolio Assessment Into Teaching Materials: An Exploratory Study On Speaking Course Syllabus Development, Moh. Taufik, Nur Mukminatien, Suharyadi Suharyadi, Sari Karmina, Bambang Yudi Cahyono, Tengku Intan Suzila Bt Tengku Sharif

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

The ICT advancement provokes the possibility of developing speaking skill through portfolio assessment which was commonly attributable mostly to writing skill. Hence, an exploratory study adopting ADDIE model was conducted to develop an electronic portfolio assessment integrated into teaching materials. A triangulated technique of data collection: questionnaire respondents, interviews and data from evaluation sheets was gathered. Statistical descriptive analysis, discourse and content analysis were conducted and positive possibilities were found to ffacilitate the development of speaking skills through electronic portfolio assessment.

Developing Intercultural Communicative Competence In Foreign Language Classrooms: A Study Of Efl Learners In China, Li Liu, Bo Jiang, Ziwei Guo

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

Intercultural communicative competence (ICC) has been accentuated with the wave of globalization. Universities in China have highlighted ICC in language classrooms. Following Byram’s (1997) ICC model (including knowledge, skills and attitudes), this study focuses on the efficacy of explicit instruction in developing ICC among EFL (English as a Foreign Language) learners in classrooms in China, and to discover how this development is related to the English proficiency. This research therefore has two purposes: (1) to use a mix of quantitative and qualitative methods to assess ICC including questionnaire through self and others after explicit instruction. And (2) to investigate the …

Identifying Basic Aircraft Structures Using Project-Based Learning In Esp Context: Is It Effective?, Dewanti Ratna Pertiwi, Ndaru Atmi Purnami

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

English for specific purposes (ESP) is a branch of English instruction prepared to facilitate the students master English used in a particular field. In aerospace field, one of the objectives of ESP is mastering basic aircraft structures as the fundamental knowledge for further development such as aircraft maintenance and management. Mastering a number of technical terms in aerospace is challenging since they are not commonly used in daily life. Thus, a strategy is needed. Project-based learning (PBL) is proposed as an appropriate technique for engineering students due to its advantages; facilitating communication, creativity, collaboration, and critical thinking. Nevertheless, identifying whether …

The Dominant Soft Skills That Affect Readiness Of Vocational Graduate In Entering Construction Labor Market, Nathanael Sitanggang, Putri Lynna Adelinna Luthan, Felix Andika Dwiyanto, Satrio Dwi Sanjaya

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This study aims to recognize the dominant soft skills factors that influence the readiness of vocational education graduates to enter the job market in the field of construction. The method used is survey study including samples that consisted of 40 workers graduated from State University of Medan civil engineering diploma 3. The instruments used were the soft skills and the competence readiness questionnaire with reliability coefficients of 0.93 and 0.98. Furthermore, the multiple regression analysis techniques is used to test the hypothesis. The results shows that the soft skills readiness influencing 74% the vocational education skills readiness in entering the …

Evidence Based Practice: Assessing The Educational Outcome, Michelle Brady Dr., Des Gallagher

Pacific Journal of Health

Healthcare providers and patients strive for optimal outcomes with a growing trend to embed the principles of evidence-based practice (EBP) into mainstream care delivery by practicing dentists. The foundations of future best practice are built at dental school. How do we evaluate the outcome of an EBP syllabus?

This study describes the use of the KACE assessment tool to assess the learning outcomes of final year DDS students who had completed an EBP program. The use of a validated instrument to measure four dimensions, knowledge, attitudes about it, familiarity with sources for accessing evidence and confidence in critical appraisal skills …

More Work, Less Reward: The Minority Tax On Us Medical Students, Marija Kamceva, Baffour Kyerematen, Sabina Spigner, Samuel Bunting, Simiao Li-Sauerwine, Jane Yee, Michael Gisondi

Journal of Wellness

Introduction: Minority tax is defined as the burden of time and resources placed on minority persons to represent and advocate for their communities. We determined whether medical students underrepresented in medicine (URM) or from historically excluded (HE) populations experience a minority tax and characterized its effects.

Methods: This cross-sectional survey of US medical students occurred November 2020 - June 2021. We used Mann-Whitney U tests to compare metrics between URM and HE participants and their peers. The primary outcome was time invested in activism/diversity initiatives versus other work. Secondary outcomes included measures of microaggressions, discrimination, institutional culture, anxiety/depression, …

Teachers’ Assessment Literacy And Design Competence Framework, Sladana Krstic, Sarah Manlove, Sarah Richardson

2021-2030 ACER Research Conferences

Teachers play a central role in facilitating learning and empowering learners (Pastore & Andrade, 2019). They must possess a high level of assessment literacy to properly fulfil their role of implementing teaching and facilitating students’ learning (Hattie, 2009). Without it, the quality of educational provision can be impacted (Looney et al., 2018). The expectations placed on teachers in relation to their assessment knowledge and skills tend to focus on their ability to design and implement assessment with students, and to use assessment data to inform teaching practices (Brookhart, 2011). Much of the emphasis in the literature is on the mechanical …

Assessing Reading: How Assessment Can Be Used To Target Teaching And Enhance Understanding Of Reading Comprehension, Sandra Knowles

2021-2030 ACER Research Conferences

The skills demonstrated by a proficient reader are not easy to untangle. Current research acknowledges that reading comprehension is a highly complex area of ability, one that needs to be understood as the coordination of several integrated processes. Using example test questions and data, this presentation explores how assessment can help us make sense of reading comprehension in a way that curricula and commonly used teaching strategies cannot. Assessment is evidence that informs us about the skills involved in the reading process, how they relate to each other, and how they develop in complexity. When assessment is understood in this …

Evidence-Informed Early Language And Literacy Practice: Implementation Of A New Formative Assessment For Early Language And Literacy Development, Sarah Groom, Mary-Ruth Mendel, Eric Brace, Philippa Pryor

2021-2030 ACER Research Conferences

With one in five Australian children starting school developmentally vulnerable, there is a need in this critical period for visibility over children’s oral language and early literacy development. The Australian Literacy and Numeracy Foundation (ALNF) partnered with a Northern Territory primary school to implement the Early Language and Literacy Development Index (ELLDI), a newly-created valid and reliable assessment which places children on a progression scale for oral language and early literacy development and provides meaningful, accessible recommendations for educational practice. Twenty-three children in the school’s transition cohort were measured using the ELLDI at the beginning and end of the school …

Making Learning Visible: Moving From Nouns To Verbs, Diane Debacker

2021-2030 ACER Research Conferences

This presentation focuses on the need to make learning visible for all constituents – learners, educators, employers, policymakers and future employees – with a focus on the work of the Center for Certification and Competency-Based Education (C3Be) at the University of Kansas (USA). As K–12 and higher education move to a post-pandemic world, it’s imperative we find different ways to identify learner outcomes and evaluate learning. By moving from nouns to verbs; by moving from course titles to competencies; by moving from transcripts to learner outcomes, learning becomes visible. International educator and founding director of C3Be, Dr Diane DeBacker shows …

Assessment Moderation: Is It Fit For Purpose?, Lenore Adie

2021-2030 ACER Research Conferences

This presentation outlines the different practices and purposes of assessment moderation and analyses the benefits and issues of these. Two projects are presented; each seeks to improve teacher judgement. Both attempt to redefine what we mean by moderation and how moderation can be conducted to reach diverse and dispersed groups. The first draws on a current Australian Research Council project that is exploring the development of scaled exemplars, the use of commentaries of judgement decisions, and the use of digital platforms to support teachers grading student work. The second draws on the work of the Graduate Teacher Performance Assessment (GTPA) …

The Transformational Change Of Adaptive Assessment, Jarrod Hingston, Toby Newton

2021-2030 ACER Research Conferences

Organisational change theory often discusses the differences between adaptive change and transformational change; adaptive change being the process of incremental shifts that are intended to drive improvement, while transformational change requires major alterations in processes. In 2019, ACER embarked on a mission to develop a new adaptive testing and reporting system, with the goal of delivering an assessment that would improve the precision of results for every student. While the intention was to introduce an adaptive change in the assessments, the project truly transformed the way that ACER delivers assessments and reports results, a result recognised by the project being …

Sharing And Securing Learners' Performance Standards Across Schools, Richard Kimbell

2021-2030 ACER Research Conferences

Assessing learners’ performance makes very different demands upon teachers depending on the purpose and the context of the assessment. But common to all assessment is some sense of what ‘quality’ looks like. Most often teachers engage in formative assessments in the classroom, and the familiar standards of the classroom are adequate for this purpose. However if teachers are to undertake external, nationally regulated assessment then some sense of a national standard of quality is required. But there are very limited mechanisms by which teachers can acquire this understanding, so they use their best judgement, and standards vary from school to …

An Innovative Method For Teachers To Formatively Assess Writing Online, Dr Sandy Heldsinger, Stephen Humphry

2021-2030 ACER Research Conferences

Assessment is an integral component of effective teaching and a teacher’s professional judgement influences all routine aspects of their work. In the last 20 years, there has been considerable work internationally to support teachers in using assessment to improve student learning. However, there is a pressing issue that impedes teacher professional judgement being exploited to its full potential. The issue relates to teacher assessments in the context of extended performances such as essays and arises from the complexity of obtaining reliable or consistent teacher assessments of students’ work. Literature published in the United States, England and Australia details evidence of …

Using Pat Data To Inform Teaching And Learning, Marc Kralj, Rachel Felgate, Shani Sniedze, Caithlin Power, Grant Barclay, Darren Leech

2021-2030 ACER Research Conferences

ACER works with thousands of Australian schools to set up Progressive Achievement Test (PAT) functionality, assign and administer tests, and to assist teachers to understand and interrogate the resulting test data and act upon findings. This session provides participants with an opportunity to hear about a school’s journey, and discuss this with the ACER team and our PAT school guest. ACER researchers have evaluated and documented assessment implementation and professional development opportunities, observing this school’s ability to track student and educator progress over time, which is a critical element in ACER’s Progressive Achievement approach. ACER’s educational consultants will demonstrate how …

Reimagining Classroom Assessment And Feedback To Meet Learner Needs, Fabienne Van Der Kleij

2021-2030 ACER Research Conferences

The power of classroom assessment and feedback to improve student learning outcomes has long been recognised. Yet, decades of research have yielded disappointing and often conflicting outcomes. This presentation challenges traditional conceptions of classroom assessment and feedback as teacher-driven practices. To meet learner needs better, it proposes a student-centred perspective in which students are active and have agency. By drawing on an extensive study of feedback reviews, this presentation illustrates how conceptualisations of feedback have changed over recent decades. This paper provides key insights into how classroom assessment and feedback practices can be changed in ways that are sustainable, afford …

Acer Models Of Writing: Changing The Assessment Mindset, Juliette Mendelovits, Judy Nixon

2021-2030 ACER Research Conferences

This presentation outlines different models of writing assessment that have a proven track record in various programs delivered by ACER. These models include holistic scoring, and partial analytical scoring on a number of criteria. The writing prompts for these models assume extended pieces of writing. The presentation will also introduce a new and alternative model of writing assessment that ACER has implemented in several large-scale assessments. This model is built on shorter pieces of writing from each student, designed to give more accurate and diverse insights into students’ proficiency in writing in a range of text types, within the constraints …

Reimagining The Purpose Of Assessment, Geoff N. Masters

2021-2030 ACER Research Conferences

Assessment is commonly understood as the process of judging how well students have learnt what they have been taught. It comes at the end of a sequence that begins with a curriculum or course syllabus. Teachers are expected to deliver this body of specified content, students are expected to learn it, and assessment is the process of judging and grading students on how well they have learnt what teachers have taught. This is a common view of assessment among students, parents and many teachers. I will argue in this presentation that this traditional understanding of what it means to learn …

Research Conference 2022: Reimagining Assessment: Proceedings And Program, Kylie Burns (Ed.)

2021-2030 ACER Research Conferences

The focus of this year’s Research Conference is on the use of assessment to support improved teaching and learning. The conference is titled ‘reimagining assessment’ because we believe there is a need to transform the essential purposes of educational assessment to provide better information about the deep conceptual learning, skills, competencies, and personal attributes that teachers and schools now have as objectives for student learning and development. Reimagined assessments must now be focused on monitoring learning across this broader range of intended outcomes and provide quality information about the points individuals have reached in their long-term development.

Relationships Between And Student Perceptions Of Self-Efficacy, Growth Mindset, And Mathematics Identity Of Adolescents In A Rural South Georgia Charter School, Carrie Cooper Pierce

Theses and Dissertations

This mixed methods study investigated the relationships between the constructs of self-efficacy, growth mindset, and mathematics identity among middle school students at a South Georgia charter school. Constructivist grounded theory was used to investigate the strength of these constructs along with student perceptions of what factors make one a math person. The study was an explanatory sequential design consisting of an online survey followed by student interviews. Ninety-one students participated in the survey. Multiple linear regression was used to determine whether a correlation existed between the variables as well as among student subgroups. Self-efficacy was found to be a predictor …

Could The Inclusion Of Certain Building Information And Modelling Aspects Into The Leaving Certificate Engineering Syllabus, Aid The Transition Of Students Into Third Level Education, When Choosing A Course Within The Construction Industry, Joseph Boyle, Deborah M. Brennan

Capstone Reports

The paper investigates the effects of implementing several Building Information and Modelling (BIM) aspects into the Leaving Certificate Engineering Syllabus and examines the impact this has on students choosing third level Architectural Engineering and Construction (AEC) industry courses with the desire of improving the shortage in the sector. The method and content of the study was based on academic research on second level education in other European countries through the lens of a Literature Review. A sixteen-week pilot program was trialed with over one hundred students at Senior Cycle. The outcomes of the study were critically evaluated through stakeholder interviews …

Effect On Student Achievement For Middle School Math Students Using Blackboard, Canvas And Schoology In The State Of Virginia, Rosa Ann Woodley-Richard

Doctoral Dissertations and Projects

The purpose of this quantitative, causal-comparative research was to compare the differences in middle-school student achievement for grade 7 math students among three different learning management systems: Blackboard, Canvas, and Schoology. The instrument was the Virginia Grade 7 Math Standards of Learning test. The population included students in the 7th grade attending a public school in the state of Virginia. The participants were the individual school districts. The study examined the means between the pass rates of the three learning management systems to see if there was a significant difference. The independent variable included the three learning management systems: Blackboard, …

A Study Of Composite Concert Assessment Ratings Of Asboa Affiliated Ensembles From 2003 To 2019, Alyssa Perry

Student Theses and Dissertations

The purpose of this study was to examine composite ratings at Arkansas School Band and Orchestra Association (ASBOA) sanctioned concert assessments from 2003 to 2019. ASBOA divides the state into nine geographic regions to group schools for ASBOA events. All schools in a single region who choose to participate in ASBOA activities perform at concert assessment together and compete against each other at all-region auditions. In 2011, a region realignment occurred to make the number of students participating in each region in various ASBOA activities, specifically all-region and all-state bands, more equal. As a result, ASBOA adjusted the geographic regions, …

Lesbian, Gay, And Bisexual Students Experiencing Homelessness And Substance Use In The School Context: A Statewide Study, Hadass Moore, Kris De Pedro

Education Faculty Articles and Research

PURPOSE

This study explored differences between lesbian, gay, and bisexual (LGB)-housed and homeless students regarding substance use patterns on and off school grounds and the unique contribution of homelessness to substance use in school.

METHODS

Data were from the 2013-2015 California Healthy Kids Survey, a statewide survey of school protective factors and risk behaviors. A representative sample of 9th- and 11th-grade students (N = 20,337) was used. Comparisons between housed (n = 19,456) and homeless (doubled up: n = 715; acute homeless: n = 166) LGB students were conducted. We used chi-square tests to compare rates of lifetime, past-30-day, and …

Revisiting Ethnic Differences In In-Person Learning During 2021-2022, Alison Heape, Andrew Camp, Gema Zamarro

Education Reform Faculty and Graduate Students Publications

In the spring of 2020, the COVID-19 pandemic closed schools throughout the United States, forcing a shift to remote learning that lasted the rest of the academic year. In the fall of 2020, schools reopened using combinations of in-person, hybrid, and remote learning models with great geographic variability in access to in-person learning. A growing body of research shows important racial differences in the use of in-person learning during the 2020-2021 school year, with Black and Hispanic students returning to in-person learning at lower rates than white students (Camp and Zamarro, 2021; Kurmann and Lalé, 2022). This in-person learning gap …

区分问题解决专家与新手的关键因素：数据挖掘方法, Song Li Jin, Kwok Cheung Cheung, Pou Seong Sit

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

数字化环境下的问题解决能力被广泛认为是21世纪的核心技能之一。许多重要因素会影响该能力表现：有些因素针对于特定的问题并与问题解决的过程相关，而其它非问题特定的因素则与问题解决者的知识、技能、态度、信念以及学习环境相关。本研究旨在分析经合组织 (OECD) 国际学生评估项目 (PISA) 2012 年研究中基于计算机的示例问题解决测验的过程数据，挖掘能将学生区分为“问题解决专家”与“问题解决新手”的关键因素。PISA 2012 的受试学生包括来自42 个经济体的11,599 名15 岁学生。研究使用了多级逻辑回归来 分析问题解决过程和学生问卷数据；其次级数据分析采用了涉及分类和回归树的数据挖掘方法。研究结果表明有五个可区分专家与新手的重要因素。

Important Factors Discriminating Between Problem-Solving Experts And Novices: A Data Mining Approach, Song Li Jin, Kwok Cheung Cheung, Pou Seong Sit

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

Digital problem-solving competence is widely recognized as one of the core skills of the 21st century. A number of important factors influence this competence; some are task-specific pertaining to the problem-solving processes while others are non-task-specific related to knowledge, skills, attitudes and beliefs of the problem solvers, as well as the student learning environment. This study sought to determine important factors that classify student problem-solver as “high-performing expert” versus “low-performing novice”, using computer-generated log files of an exemplary digital problem task assessed in Organization for Economic Co-operation and Development (OECD)’s Programme for International Student Assessment (PISA) 2012 Study. The participants …