Education Commons^™

Evaluating The Intersection Of Continuous Growth And Assessment In The Field Of English As A Second Language, Madison Johnson

All Graduate Reports and Creative Projects, Fall 2023 to Present

This teaching portfolio contains a compilation of the author’s personal teaching experiences and research interests while in the Master of Second Language Teaching (MSLT) program at Utah State University (USU). The sections of this portfolio highlight collaboration with current USU professors in the field of teaching English as a second language and the author’s personal experiences working in a second-grade elementary school classroom as well as teaching English in a community education setting. Much of the mentioned research focuses on the subfield of second language assessment. This is an area of interest to the author as an area for personal …

Comparing Cognitive Theories Of Learning Transfer To Advance Cybersecurity Instruction, Assessment, And Testing, Daniel T. Hickey Ph.D., Ronald J. Kantor

Journal of Cybersecurity Education, Research and Practice

The cybersecurity threat landscape evolves quickly, continually, and consequentially. This means that the transfer of cybersecurity learning is crucial. We compared how different recognized “cognitive” transfer theories might help explain and synergize three aspects of cybersecurity education. These include teaching and training in diverse settings, assessing learning formatively & summatively, and testing & measuring achievement, proficiency, & readiness. We excluded newer sociocultural theories and their implications for inclusion as we explore those theories elsewhere. We first summarized the history of cybersecurity education and proficiency standards considering transfer theories. We then explored each theory and reviewed the most relevant cybersecurity education …

Teaching And Assessing With Taxonomies, Tony Shannon

International Journal for Business Education

The development of taxonomies which articulate learning outcomes are necessary to disconnect the silos among educators, employers and learners (Mathews, 2019; Uranis et al.) What are taxonomies? A taxonomy is a systematic classification of objects. Why do they matter? Without systematic classification and coding it is difficult to compare or combine objects. How are they relevant to teaching and learning? In the years after the Second World War, educational psychologists saw the progress made in the biological sciences with taxonomies and started to apply them in education. Among the first to appear in the mid-50s was the work of Bloom.

The Language Of 21st Century Skills: Next Directions For Closing The Skills Gap Between Employers And Postsecondary Graduates, Gabe A. Orona, Ou Lydia Liu, Richard Arum

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The onus of preparing skilled employees for the modern workforce is largely placed on institutions of higher education. However, recent surveys consistently show a skills gap between what employers’ desire and what graduates possess. This review engages this discussion in the context of measuring and assessing 21^st century skills. We begin by succinctly reviewing literature pertaining to the skills gap, including what types of skills are commonly referenced, before moving to examine literature indicating the relations between current 21st century skills and job-related outcomes. Finally, we conclude with recommendations for higher education researchers examining skill development. Our recommendations cover …

Developing Rubrics Using The New Oru Outcomes, Kim Boyd, Trevor Ellis, Leighanne Locke, Terry Shannon, Rachael Valentz

Professional Development Resources

The development and examples of key program assessments (KPAs) are shared. Dr. Boyd opens the presentation. Dr. Shannon (B.S. Sports Management) begins by providing an overview of aligning program and ORU outcomes. Prof. Locke (B.S. Mathematics) walks through how current assignments were chosen to be used as key program assessments and then how the rubrics were revised to improve alignment. Dr. Valentz (B.S. Nursing) discusses how to improve the foundational alignment between program outcomes and the criterion (rubric row headings) used to measure them. She shares how criterion can be contextualized in different assignments and demonstrates in Brightspace, by D2L, …

Aligning Metaliteracy With Self-Directed Learning To Expand Assessment Opportunities, Trudi E. Jacobson, Thomas P. Mackey, Jako Olivier

University Libraries Faculty Scholarship

Metaliteracy is a holistic model that emphasises information-related knowledge attainment whilst challenging individuals to take charge of their learning strategies and goals. It prepares learners to become informed consumers and responsible producers of information. Metacognition is a core concept in metaliteracy, just as it is in swelf-directed learning (SDL) and in methods of assessment appropriate to SDL, such as assessment as learning (AaL) and assessment for learning (AfL). This congruence provides clear avenues for using metaliteracy’s framework in ways that support SDL. The first part of the chapter explores metaliteracy and its connections with SDL and assessment. The remainder of …

Teaching For Knowledge Transfer: Best Practices From A Graduate-Level Educational Psychology Distance Learning Program, Bobby Hoffman

University of South Florida (USF) M3 Publishing

One measure of effective instruction is the ability to solve authentic real-world problems by effectively transferring and applying classroom and textbook knowledge. While many students can productively earn high grades and learn course content, they are not always able to apply the knowledge they gain. As such, this quasi-experimental study compared the comprehensive exit exam results of learners across instructional modalities who completed a prominent graduate-level educational psychology program. ANCOVA revealed superior knowledge transfer for blended-learning students compared to those who completed distance education and significantly greater transfer of declarative, procedural, and self-regulatory knowledge by the blended-learning students. This paper …

Oer Project: Bsba Capstone Refresh Materials, Monika Hudson

USF OER Faculty Grant

Slideshow presented by Dr. Monika Hudson for USF's Open Access Week, 2020.

Measuring Numeracy: Validity And The Programme For The International Assessment Of Adult Competencies (Piaac), Samuel L. Tunstall

Numeracy

A tension raised in recent scholarship is that between numeracy as a social practice and numeracy as a functional skill set. Such frameworks for conceptualizing numeracy pose a challenge to assessment because what individuals do with numeracy is not the same as what individuals can do (or express) in an assessment setting. This study builds on work related to numeracy assessment through a validity examination of a portion of a well-known assessment: the OECD’s Programme for the International Assessment of Adult Competencies (PIAAC). In following a path set out by standards for assessment, I ask: What does the PIAAC numeracy …

The Primary Dilemma: Determining And Overcoming Barriers To A Focus On Prekindergarten Through Grade 3, Sarah Turner Lukas, Sarah Turner Lukas

Dissertations

In 2017, reporters of national data in regard to reading ability among American, fourth grade students indicated low proficiency and achievement gaps. These results were also consistent within the state and district under study. There is a need to increase the focus on prekindergarten and primary grade education taking place prior to the grades in which federally mandated, accountability assessments for student learning take place. The purpose of this study is to determine the potential barriers to a paradigm shift at the state and district levels from a focus on state-assessed grade levels to prekindergarten and primary grade levels. The …

Effects Of Pre-Tests And Feedback On Performance Outcomes In Massive Open Online Courses:What Works And What Doesn’T?, Maria Janelli

Dissertations, Theses, and Capstone Projects

This experimental study examined the effects of pre-tests and feedback on learning outcomes in a five-week massive open online course (MOOC). The participants (N = 399) were adults from around the world who self-enrolled in the American Museum of Natural History’s (AMNH) climate change MOOC (called Our Earth’s Future) offered on the Coursera platform. Participants were randomly assigned to one of four conditions. Learners in the first treatment group took pre-tests without receiving feedback. Learners in the second treatment group took pre-tests and received basic (correct/incorrect) feedback. Learners in the third treatment group took pre-tests and received elaborate feedback. The …

Perceptions Of Assessment In Norwegian Occupational Therapy Students, Tore Bonsaksen, Astrid Gramstad, Gry Mørk, Susanne G. Johnson

Journal of Occupational Therapy Education

In addition to securing minimum standards of learning among students, assessment is increasingly used as a tool to improve students’ learning. Assessment quality is measured as part of the Course Experience Questionnaire; however, the original ‘appropriate assessment’ scale has demonstrated ambiguous psychometric properties. The current study aimed to gain knowledge about occupational therapy students’ perceptions of assessment, and this was achieved by examining the factor structure and internal consistency of the six items on the ‘appropriate assessment’ scale. Students from six Norwegian universities (n = 187, response rate 61.3 %) completed the scale and reported demographic information. The factor …

Winning The War On State-Sponsored Propaganda: Results From An Impact Study Of A Ukrainian News Media And Information Literacy Program, Erin Murrock, Joy Amulya, Mehri Druckman, Tetiana Liubyva

Journal of Media Literacy Education

From 2015-2016, IREX implemented a media literacy training program called Learn to Discern (L2D) that trained Ukrainian citizens to critically analyze news media messages and identify misinformation. In 2017, IREX conducted a quasi-experimental impact evaluation of news literacy skills, knowledge, and behavior using a stratified random sample of L2D participants and non-participants (n=412). The groups were matched for gender, age, region and education levels. A news literacy assessment was administered to both groups via an online survey. The assessment required participants to analyze an objective news article and a disinformation-based news article; demonstrate knowledge of the news media environment; and …

Free, Quick & Easy: Utilizing Google Apps To Assess & Communicate Learning, Josette M. Kubicki, Thomas Weeks, Jennifer Putnam-Davis

Georgia International Conference on Information Literacy

The Reese Library team utilizes a range of Google’s free applications (apps) to create, evaluate, and share assessment results of library instruction to faculty and students. The apps have also been utilized for team project work. Reception from faculty has consistently been positive, due to the ease of collaboration in developing assessment and sharing results so they can see at a glance the learning that has taken place in sessions.

Attendees will gain a comprehensive overview of the workflow undertaken of the creation, delivery, analysis, and dissemination of assessment and results, with time for hands-on practice. Finally, strategies will be …

Listening To Our Graduate Students' Feedback: Graduate Student Exit And Alumni Surveys, Alison W. Hong-Novotney

Cal Poly Humboldt theses and projects

Student and alumni surveys have become some of the most widely-used methods of assessment of student learning in higher education. While the majority of literature on student surveys and assessment focuses on undergraduate students, this study looks specifically at why graduate student exit and alumni surveys can be valuable tools within a comprehensive assessment plan. Listening to the feedback of current and former graduate students, and then acting upon that feedback, is crucial for the engagement and success of this unique population of students who bring their particular strengths and needs to their educational experiences. This study examined how master’s …

Assessing Transformative Learning: Toward A Unified Framework, Robert Charles Cox

Doctoral Dissertations

This study describes the development, administration, and results of an exploratory, 30- item instrument to assess aspects of transformative learning attributable to an educational program. The instrument, TRansformative Outcomes and PrOcesses Scale (TROPOS), assesses four subscales associated with transformative learning: criticality, attitude toward uncertainty, social support, and transformative outcomes. Potential instrument items were derived from a literature review. A panel of experts evaluated these items for inclusion in the study. Study participants were alumni of the same master’s degree program who graduated during the past 10 years, 2007-2016 (N=119). This study …

An Exploration Of Rpl In Higher Education In Ireland With Particular Focus On Quality Assurance, Deirdre Goggin, Irene Sheridan, Phil O'Leary

Conference Papers

This paper focuses on examining the practice of Recognition of Prior Learning (RPL) a provision which allows a learner present previously acquired relevant learning for assessment for credit. In general all forms of learning are formally recognised within an RPL system which includes informal, non formal and formal learning. The key misconception within higher education can be that RPL requires a different quality assurance system than that of conventional assessment methods.

This paper explores current assessment policies and practices in Ireland with a particular focus on the structural realities required to deliver good practice with RPL provision for summative purposes. …

E-Learning Tools For Andragogy: A Scale Model Of Technology-Based Active Learning, Ying Wang, Kai S. Koong, Jun Sun

Information Systems Faculty Publications and Presentations

Andragogy is an educational philosophy on how to facilitate active learning for adult students. It requires instructors to engage students in various learning activities, including problem solving, essay writing, discussions, group projects, and so on. The challenge is how to facilitate student participation and assess learning outcomes. The emergence of e-learning tools, such as Discussion Board, Wiki, Blogs, and Wimba provide technical support for the new learning approach. Based on the review of information systems and education literature, this study develops a taxonomy of e-learning tools. In particular, it proposes a scale model based on the premise that e-learning tools …

A Career Preparation System Accountability System, Kevin M. Hollenbeck

Reports

No abstract provided.

The Evolution Of Portfolios In Teacher Education, Nancy D. Turner

Essays in Education

Portfolios have been used in many fields of study to highlight the best work of individuals. In teacher education, portfolios serve as an authentic assessment, in that they contain artifacts representative of the preservice teacher’s performance in the classroom. As teachers are accountable for an in-depth understanding and implementation of teaching standards, portfolios can become the avenue for documenting how these standards are being met. The teacher preparation program at Saint Mary’s College, Notre Dame, Indiana has utilized portfolios since 1994. Over the years, these portfolios have evolved from their inception to a performance-based evidence that indicates the attainment of …