Education Commons^™

Comparing Cognitive Theories Of Learning Transfer To Advance Cybersecurity Instruction, Assessment, And Testing, Daniel T. Hickey Ph.D., Ronald J. Kantor

Journal of Cybersecurity Education, Research and Practice

The cybersecurity threat landscape evolves quickly, continually, and consequentially. This means that the transfer of cybersecurity learning is crucial. We compared how different recognized “cognitive” transfer theories might help explain and synergize three aspects of cybersecurity education. These include teaching and training in diverse settings, assessing learning formatively & summatively, and testing & measuring achievement, proficiency, & readiness. We excluded newer sociocultural theories and their implications for inclusion as we explore those theories elsewhere. We first summarized the history of cybersecurity education and proficiency standards considering transfer theories. We then explored each theory and reviewed the most relevant cybersecurity education …

Teaching Reproducibility To First Year College Students: Reflections From An Introductory Data Science Course, Brennan L. Bean

Journal on Empowering Teaching Excellence

Access the online Pressbooks version of this article here.

Modern technology threatens traditional modes of classroom assessment by providing students with automated ways to write essays and take exams. At the same time, modern technology continues to expand the accessibility of computational tools that promise to increase the potential scope and quality of class projects. This paper presents a case study where students are asked to complete a “reproducible” final project in an introductory data science course using the R programming language. A reproducible project is one where an instructor can easily regenerate the results and conclusions from the submitted …

Establishing The Validity And Reliability Of The Locus Assessments, Tim Jacobbe, Bob Delmas, Brad Hartlaub, Jeff Haberstroh, Catherine Case, Steven Foti, Douglas Whitaker

Numeracy

The development of assessments as part of the funded LOCUS project is described. The assessments measure students’ conceptual understanding of statistics as outlined in the GAISE PreK–12 Framework. Results are reported from a large-scale administration to 3,430 students in grades 6 through 12 in the United States. Items were designed to assess levels of understanding as well as components of the statistical problem solving process as articulated in the GAISE framework. We discuss details of how the model used to develop the LOCUS assessments guided the gathering of evidence for validity and reliability arguments. Three types of validity evidence are …

Student Self-Grading Form, Brett Whysel

Open Educational Resources

This is a word document that students use at the beginning, midpoint, and end of a semester to set relevant goals, measure progress towards goals, and self-grade. It is intended to build motivation, metacognition, and accountability. Instructors may use it on its own or to supplement other assessment tools, and improve the accuracy, validity, and fairness of final grades.

Meas: Exploring Links Between Implementation And Standards Mastery, Noah Silver

Honors Projects

In order to effectively enhance a student’s mathematical understanding and development in the field of mathematics, students need to engage in problem solving. Model eliciting activities, or MEAs, provide students with tasks that promote higher level thinking and the ability to utilize mathematics outside of the classroom; they also align and promote the utilization of the Common Core State Standards and Standards for Mathematical Practice. Research suggests that the language and motivation promoted by MEAs enriches engagement and increases student ability and performance of traditional and real-world mathematics. Use of technology further supports these goals. Through the analysis of checkpoint …

Cross-Disciplinary Learning Index: A Quantitative Measure Of Cross-Disciplinary Learning About Energy, Todd Haskell, Emily Borda, Andrew Boudreaux

Physics & Astronomy

The structure of many science programs at the college level assumes that students are able to draw on and integrate ideas from multiple disciplinary contexts. However, most assessment tools focus on learning in the context of a single discipline. We describe the development and validation of an instrument to measure how well students are able to combine energy ideas from different disciplines into a coherent understanding of a phenomenon. The final version of the instrument consists of a pair of multiple-choice online assessments, along with a metric calculated from the assessment scores: the cross disciplinary learning index (CDLI). The items …

Physics Inventory Of Quantitative Literacy: A Tool For Assessing Mathematical Reasoning In Introductory Physics, Suzanne W. Brahmia, Alexis Olsho, Trevor I. Smith, Andrew Boudreaux, Philip Eaton, Charlotte Zimmerman

Physics & Astronomy

One desired outcome of introductory physics instruction is that students will develop facility with reasoning quantitatively about physical phenomena. Little research has been done regarding how students develop the algebraic concepts and skills involved in reasoning productively about physics quantities, which is different from either understanding of physics concepts or problem-solving abilities. We introduce the Physics Inventory of Quantitative Literacy (PIQL) as a tool for measuring Quantitative Literacy, a foundation of mathematical reasoning, in the context of introductory physics. We present the development of the PIQL and evidence of its validity for use in calculus-based introductory physics courses. Unlike …

Evaluating The Trustworthiness Of Online Sources: Assessment For Students Of Universitas Indonesia, Yasmine Anabel Pandjaitan

International Review of Humanities Studies

In 2019’s presidential election in Indonesia, the Internet was flooded by unverified and contradicting claims, which only blurred the lines between fact, opinion, and straight-out hoax. This research investigates how an educated group (college students) evaluates online sources in the context of Indonesia’s political campaigns. An assessment was designed for the students to judge the credibility of five political news articles appearing online in April 2019, the election month. The framework used was inspired by similar assessments conducted by the Stanford History Education Group, researchers who study digital literacy among American students. For this research, fifty students from five faculties …

Designing Performance Tasks In Mathematics Using Technological Tools, Ma. Louise Antonette N. De Las Peñas, Debbie Marie Versoza, Maria Alva Q. Aberin, Agnes Garciano, Jumela F. Sarmiento, Mark Anthony C. Tolentino

Mathematics Faculty Publications

In the Philippines, the performance task is one of the major summative assessments in the K to 12 curriculum. This paper discusses how performance tasks may utilize mathematical apps within the context of blended learning. Guidelines on designing performance tasks; as well as the GRASPS framework; are discussed. Performance tasks that cut across various grade levels and strands of mathematics are presented. These involve divisibility (Numbers); integer and polynomial operations (Algebra); triangle centers (Geometry); and statistics (Statistics). The performance tasks described in this paper can provide an initial idea for the design of other summative assessments and contribute to the …

Designing Research-Based Instructional Materials That Leverage Dual-Process Theories Of Reasoning: Insights From Testing One Specific, Theory-Driven Intervention, Mila Kryjevskaia, Mackenzie R. Stetzer, Beth A. Lindsey, Alistair Mcinerny, Paula R. L. Heron, Andrew Boudreaux

Physics & Astronomy

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] Research in physics education has contributed substantively to improvements in the learning and teaching of university physics by informing the development of research-based instructional materials for physics courses. Reports on the design of these materials have tended to focus on overall improvements in student performance, while the role of theory in informing the development, refinement, and assessment of the materials is often not clearly articulated. In this article, we illustrate how dual-process theories of reasoning and decision making have guided the ongoing development, testing, and analysis …

Data And Assessment Management In Collegiate Recreation, Jeana Carow

Graduate Theses and Dissertations

Collegiate recreation programs and centers typically provide traditional programming space in addition to a range of physical activity spaces and resources, as a valuable part of the student experience. The external pressures of identifying and communicating departmental value and impact on the campus community has resulted in collegiate recreation departments’ use of data to communicate the effectiveness and impact of their work. The purpose of the study was to identify the data collection and assessment management practices of collegiate recreation departments, particularly focusing on the organization of data and assessment strategies as well as data collection, storage, reporting, analyzing, and …

Analyzing The Retention Of Knowledge Among General Chemistry Students, James T. Kingsepp

USF Tampa Graduate Theses and Dissertations

General chemistry is a survey course meant to form a foundation for students’ to build upon as they progress into chemistry sub-disciplines. The effectiveness of this foundation rests heavily on students’ abilities to retain or relearn concepts from the course. This study seeks to investigate the utility of a measure of general chemistry students’ knowledge retention across the time period of one semester. This approach was enacted in five different courses of either first or second semester general chemistry. The results showed that one-quarter to one-half of students exhibited a high rate of retention across the semester. A smaller group, …

Math 3100: Communication And Proof - Assessment, Shawn Mcmurran, Min-Lin Lo, Corrine Johnson, Laura Wallace

Q2S Enhancing Pedagogy

As a group, we hope through this FLC project to develop a course that promotes departmental SLOs, as well as University learning outcomes for a writing-intensive course. We focused on our new foundational course (MATH 3100 Mathematical Thinking: Communication and Proof). This course, designated as a writing-intensive course, introduces students to disciplinary ways of thinking and communicating in mathematics with emphasis on the construction of valid mathematical arguments, critiques of arguments, and structure of professional mathematical writing including typesetting. We would like to develop a library of useful materials that faculty members can adapt in their classrooms in order to …

Are We At A Watershed Moment For The Quantitative Literacy Movement?: Review Of Shifting Context, Stable Core: Advancing Quantitative Literacy In Higher Education, By Luke Tunstall, Gizem Karaali, And Victor Piercey, Eds., Maura Mast

Numeracy

Luke Tunstall, Gizem Karaali, and Victor Piercey, eds. 2019. Shifting Concepts, Stable Core: Advancing Quantitative Literacy in Higher Education. Math Notes 88. (Mathematics Association of America, MAA Press). Print ISBN 978-0-88385-198-2. Electronic ISBN 978-1-61444-324-7.

The thematic approach of the edited MAA Notes volume Shifting Contexts, Stable Core: Advancing Quantitative Literacy in Higher Education is that the “construct” of quantitative literacy is now fairly stable, but the contexts in which quantitative literacy is taught (and practiced) continue to change. Several chapters give the reader much to consider regarding what constitutes the foundation of this stable core and, relatedly, how quantitative …

Paired Measures Of Competence And Confidence Illuminate Impacts Of Privilege On College Students, Rachel M. Watson, Edward Nuhfer, Kali Nicholas Moon, Steven Fleisher, Paul Walter, Karl Wirth, Christopher Cogan, Ami Wangeline, Eric Gaze

Numeracy

We seek to understand how the experiences of groups that differ in gender, ethnicity, and sexual orientation produce college-level educational performances that differ from the experiences of the dominant majority group. We employ two datasets: a National Database of 24,701 participants and a Paired-Measures Database with 3,323 participants. Both datasets provide demographic information, socioeconomic conditions of status as first-generation student, English as a first language, and interest in majoring in science, and competency scores on understanding science as a way of knowing obtained from the Science Literacy Concept Inventory. The Paired-Measures Database includes additional self-assessed competence ratings that enabled quantifying …

Sulitest®: A Mixed-Method, Pilot Study Of Assessment Impacts On Undergraduate Sustainability-Related Learning And Motivation, Alicia Mason

Faculty Submissions

A United Nations international collaboration between the Education for Sustainable Development (ESD) and the Principles for Responsible Management Education (PRME) resulted in the creation of Sulitest® (aka Sustainability Literacy Test) an open, online training and assessment tool freely available to higher education institutions globally. This study analyzes the effectiveness of the newly developed Sulitest® to not only measure sustainability literacy of higher education student populations, but also act as a catalyst for boosting affective learning outcomes by: (a) generating interest in sustainability-related issues, (b) improving sustainability-related understandings, and (c) enhancing students’ interests in the subject matter. In order to do …

Effective Evaluation Of The Non-Technical Skills In The Computing Discipline, Maurice Danaher, Kevin Schoepp, Ashley Ater Kranov

All Works

© 2019, Journal of Information Technology Eucation Research. Aim/Purpose Assessing non-technical skills is very difficult and current approaches typically assess the skills separately. There is a need for better quality assessment of these skills at undergraduate and postgraduate levels. Background A method has been developed for the computing discipline that assesses all six non-technical skills prescribed by ABET (Accreditation Board for Engineering and Technology), the accreditation board for engineering and technology. It has been shown to be a valid and reliable method for undergraduate students Methodology The method is based upon performance-based assessment where a team of students discuss and …

The Gaise College Report: The American Statistical Association Meets Sound Pedagogy In Central Virginia, Beverly Wood

Beverly Wood

Research in undergraduate statistics education often centers on the introductory course required for a large percentage of college students. While acknowledging the diverse setting, audience, and purpose of introductory courses, existing research assumes that courses offered by different disciplines share the same goals and teaching practices. The purpose of this study is to examine the objectives for student outcomes and pedagogical delivery of introductory statistics courses in various academic departments to provide explicit evidence for this assumption. The American Statistical Association’s Guidelines for Assessment and Instruction in Statistics Education (GAISE) are meant to apply to all introductory courses. The College …

Guidelines For Assessment And Instruction In Statistics Education (Gaise) College Report 2016, Robert Carver, Michelle Everson, John Gabrosek, Nicholas Horton, Robin Lock, Megan Mocko, Allan Rossman, Ginger Holmes Roswell, Paul Velleman, Jeffrey Witmer, Beverly Wood

Beverly Wood

In 2005 the American Statistical Association (ASA) endorsed the Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report. This report has had a profound impact on the teaching of introductory statistics in two- and four-year institutions, and the six recommendations put forward in the report have stood the test of time. Much has happened within the statistics education community and beyond in the intervening 10 years, making it critical to re-evaluate and update this important report. For readers who are unfamiliar with the original GAISE College Report or who are new to the statistics education community, the full …

Breaking The Language Barrier: Equitable Assessment In General Chemistry, Eshani Lee

UNLV Theses, Dissertations, Professional Papers, and Capstones

Because language provides the framework through which knowledge is constructed, it is crucial to consider the ways in which students with limited English proficiencies are able to express their understanding. English language learners (ELLs) make up a significant portion of the student body in the education system and represent many ethnic and racial minorities in STEM (Science, Technology, Engineering & Mathematics) fields (Burke & Mattis, 2007). Despite the national push to build a more diversified, STEM-ready workforce, there is little research that considers the way ELLs are assessed in STEM courses at the postsecondary level. Literature reports that science tests …

Towards A Context Agnostic Platform For Design And Assessment Of Educational Games, Tyler Baron, Corey Heath, Ashish Amresh

Ashish Amresh

The majority of the games designed for improving, acquiring or transferring knowledge rely heavily on building game mechanics that are grounded deeply in the content or subject matter being taught. There is a growing need for educational practitioners and pedagogical experts to have the ability to easily map learning outcomes by choosing from a pallet of functioning game mechanics without having the need to redesign them from scratch. In this paper, we present the current state of the art in context agnostic design and assessment of educational games, and propose three strategies that educators can take advantage of during the …

Does The Test Work? Evaluating A Web-Based Language Placement Test, Avizia Long, Sun-Young Shin, Kimberly Geeslin, Erik Willis

Faculty Publications

In response to the need for examples of test validation from which everyday language programs can benefit, this paper reports on a study that used Bachman’s (2005) assessment use argument (AUA) framework to examine evidence to support claims made about the intended interpretations and uses of scores based on a new web-based Spanish language placement test. The test, which consisted of 100 items distributed across five item types (sound discrimination, grammar, listening comprehension, reading comprehension, and vocabulary), was tested with 2,201 incoming first-year and transfer students at a large, Midwestern public university. Analyses of internal consistency and validity revealed the …

Automated Optical Mark Recognition Scoring System For Multiple-Choice Questions, Murtadha Alomran

Theses: Doctorates and Masters

Multiple-choice questions are one of the questions commonly used in assessments. It is widely used because this type of examination can be an effective and reliable way to examine the level of student’s knowledge. So far, this type of examination can either be marked by hand or with specialised answer sheets and scanning equipment. There are specialised answer sheets and scanning equipment to mark multiple-choice questions automatically. However, these are expensive, specialised and restrictive answer sheets and optical mark recognition scanners.

This research aims to design and implement a multiple-choice answer sheet and a reliable image processing-based scoring system that …

The Introduction Of Informal Cooperative Learning Into Our Programming Laboratories, Guity Ravai, Ludmila Nunes, Ronald Erdei

IMPACT Presentations

Presented at the Women in Engineering ProActive Network (WEPAN) Change Leader Forum: Creating a Mindset for Action in Westminster, CO, USA

The Introduction Of Informal Cooperative Learning Into Our Programming Laboratories, Guity Ravai, Ronald Erdei, Ludmila Nunes, Sahithya Kodam

IMPACT Presentations

Presentation given at the Midwest SoTL Conference. Discusses the effects of implementing informal cooperative learning techniques in an introductory programming course.

Real Data Is Messy... And Manageable, Beverly Wood, Carl Clark

Publications

Using real data in an introductory statistics course is a delicate balance between reality and manageability. The internet is awash with data that is useful for students to answer questions of interest to them but it is not always formatted as neatly as textbook data. The ASA's recently endorsed GAISE College Report 2016 points to the plausibility of considering multivariable thinking even if only at a rudimentary level. With both messy and multivariable data in mind, we present some activities/projects and sources for data to give introductory students the opportunity to engage with real data.

Leveraging Competency Framework To Improve Teaching And Learning: A Methodological Approach, Venky Shankararaman, Joelle Elmaleh

Research Collection School Of Computing and Information Systems

A number of engineering education programs have defined learning outcomes and course-level competencies, and conducted assessments at the program level to determine areas for continuous improvement. However, many of these programs have not implemented a comprehensive competency framework to support the actual delivery and assessment of an individual course. This paper highlights how a competency framework can be used across the life cycle of a course to effectively deliver and assess course content, and give valuable, timely feedback to students thus, improving teaching, student motivation and learning. A framework for leveraging course competencies during course design and delivery is presented, …

Development And Testing Of An Assessment To Measure Spatial Thinking About Enhanced Greenhouse Effect, Heather Jean Skaza

UNLV Theses, Dissertations, Professional Papers, and Capstones

Americans, in general, do not behave in environmentally sustainable ways. We drive cars and fly in planes that emit planet-warming carbon. We purchase food in nearly indestructible packaging that is not recycled or repurposed. We do not consider the environmental impact of the “stuff” stuffed into our grocery and department stores, most of which is made of materials that had to be dug out of the ground, leaving rivers and skies full of pollution in its place. Citizens have a responsibility to understand complex global and local environmental problems. A person’s ability to think about the way that an environmental …

Guidelines For Assessment And Instruction In Statistics Education (Gaise) College Report 2016, Robert Carver, Michelle Everson, John Gabrosek, Nicholas Horton, Robin Lock, Megan Mocko, Allan Rossman, Ginger Holmes Roswell, Paul Velleman, Jeffrey Witmer, Beverly Wood

Publications

In 2005 the American Statistical Association (ASA) endorsed the Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report. This report has had a profound impact on the teaching of introductory statistics in two- and four-year institutions, and the six recommendations put forward in the report have stood the test of time. Much has happened within the statistics education community and beyond in the intervening 10 years, making it critical to re-evaluate and update this important report. For readers who are unfamiliar with the original GAISE College Report or who are new to the statistics education community, the full …

Gaiseing Into The New Guidelines, Robert Carver, Megan Mocko, Jeffrey Witmer, Beverly Wood

Publications

The first GAISE College Report came out in 2005. Over the past ten years our discipline has changed in many ways, including but not limited to what type of data is easily available, the technology that we use, as well as how we teach students. In this presentation we will briefly start with how the new GAISE 2016 guidelines and goals have changed, including the two new emphases of statistical thinking: giving students experience with multivariable thinking and with the investigative process. So how do you start to implement these new ideas? In this presentation, we will demonstrate an activity …