Education Commons^™

Information Literacy Across The Curriculum: A Faculty Professional Development Program, Jaime Corris Hammond

Instructional Design Capstones Collection

Information literacy is a set of skills that encompass conducting research, evaluating sources and authority, and ethically using information. While information literacy as a concept has existed for 50 years, higher education has struggled to meaningfully incorporate it into college curricula. The concept of “across the curriculum” instruction, most notably Writing Across the Curriculum (WAC), empowers faculty to incorporate skills outside of their discipline to increase learning. This information literacy program uses the concept of “across the curriculum” instruction, an American Association of Colleges and Universities (AAC&U) High Impact Practice, to incorporate and contextualize these skills in a variety of …

Toward Cs1 Content Subscales: A Mixed-Methods Analysis Of An Introductory Computing Assessment, Miranda C. Parker, Matt J. Davidson, Yvonne S. Kao, Lauren Margulieux, Zachary Tidler, Jan Vahrenhold

Learning Sciences Faculty Publications

Background and Context. There is a constant, demonstrated need for valid and reliable assessments in computing education research. While there exist assessments at a course-based level (e.g., CS1, Data Structures, Discrete math, etc.), instructors and researchers would also like concept-based subscales that are more fine-grained. However, assessments designed and validated at the course level need additional work to determine whether they can reliably and validly measure individual concepts.

Objectives. In this paper, we explore the content and factor structure of an existing CS1 assessment, the Second CS1 (SCS1) assessment, which consists of nine CS1 concepts and three question types (definitional, …

Faculty Experiences Using Synchronous Videoconference Technology To Assess Student Psychomotor Performance, Heather Disney

Walden Dissertations and Doctoral Studies

Psychomotor skills are an essential aspect of physical therapy (PT) education. Recent studies supported using videoconference technology (VCT) for psychomotor instruction, but research on the use of VCT for psychomotor assessments is limited. Determining VCT’s usefulness for psychomotor exams is vital to establish best pedagogical practices. The purpose of this basic qualitative study was to explore the faculty experience using synchronous VCT to assess PT student’s psychomotor skills. The conceptual framework for this study was the unified theory of acceptance and use of technology (UTAUT). The research question investigated how PT educators described the psychomotor skill assessment of students using …

The Blaeser Training Taxonomy, Timothy Blaeser

Doctorate in Education

This research was undertaken to determine the efficacy of using andragogy, assessment, and quality control for training in a modern industrial workplace, with findings indicating that these modern training techniques can be implemented with success in this context. While andragogy, pioneered by Knowles, has been used in many areas of adult education, it has not been found to be commonly used in the industrial workplace. The study focused on Finnish trainers using the Blaeser Training Taxonomy – a training program utilizing elements of andragogy and assessment wrapped into quality control. Using a mixed methods questionnaire, trainers reported their training results, …

Communicating About Computational Thinking: Understanding Affordances Of Portfolios For Assessing High School Students’ Computational Thinking And Participation Practices, Deborah A. Fields, Debora Lui, Yasmin Kafai, Gayithri Jayathirtha, Justice Walker, Mia Shaw

Instructional Technology and Learning Sciences Faculty Publications

Background and Context: While assessment of computational thinking concepts, practices, and perspectives is at the forefront of K-12 CS education, supporting student communication about computation has received relatively little attention.

Objective: To examine the usability of process-based portfolios for capturing students’ communication about their computational practices regarding the process of making electronic textile projects.

Method: We examined the portfolios of 248 high school students in 15 introductory CS classrooms from largely underserved communities, using a formal rubric (top-down) to code computational communication and an open-coding scheme (bottom-up) to identify computational practices described.

Findings: Students demonstrated stronger …

Training Design Enhancement Through Training Evaluation: Effects On Training Transfer, Elham Arabi

UNLV Theses, Dissertations, Professional Papers, and Capstones

With recurring changes in the society, in terms of economy and technology, companies need to ensure that their human capital is aligned with these transformations in order to sustain in a competitive industry. To date, organizations view training as a requirement to increase their employees’ efficiencies and productivity, and reduce their attrition rates. Despite investment in employee training, research shows a lack of transfer of learning to job and as a result minimal return on investment. This issue is due to many barriers, but can be addressed by learning professionals. Poor learning design and training evaluation practices have been identified …

No More Babbling! Providing “Just In Time” Instructions, Examples, And Project Development Guidance On Key Assessments Using The Sound Booth, Susan R. Adams, Kristen Allen

Center for Academic Technology (CAT) - Presentations

This poster highlights a project that was funded by an Academic Technology Innovation Grant (ATIG) awarded from the Center for Academic Technology (CAT) at Butler University.

Does Class Size Matter?: An Exploration Into Faculty Perceptions Of Teaching High-Enrollment Online Courses, Patrick R. Lowenthal, Rob Nyland, Eulho Jung, Joanna C. Dunlap, Jennifer Kepka

Educational Technology Faculty Publications and Presentations

Class size has been a popular topic for decades. There is renewed interest in this topic now with the growth of online learning. Online courses can accommodate hundreds, if not thousands, of students in a single course. Very little research, though, has been conducted recently on class size in online courses and the research that has been conducted is mixed. As the demand for online courses increases, so likely will class size. In this exploratory study, we investigated the perceptions and experiences of 37 faculty teaching high-enrollment online courses. In the following article, we report the results of our inquiry, …

How To Create A Stunning Video Orientation By Hand, Rachel S. Evans

Articles, Chapters and Online Publications

This article describes the multi-faceted approach UGA Law Library took with their fall 2018 first year student orientation. It describes the process of the creating a virtual tour experience, pairing it with a hybrid face-to-face event, and assessing the impact of all aspects of the orientation. The creation of the video itself involved a multi-media approach using a combination of visual arts and technology to animate a product that has a longer expiration than traditional video or in-person library orientations offer.

Problems And Promises Of Using Lms Learner Analytics For Assessment, Valerie Beech, Eric A. Kowalik

Eric A. Kowalik

The Iterative Development And Use Of An Online Problem-Based Learning Module For Preservice And Inservice Teachers, Peter Rillero, Laurie Camposeco

Interdisciplinary Journal of Problem-Based Learning

Teachers’ problem-based learning knowledge, abilities, and attitudes are important factors in successful K–12 PBL implementations. This article describes the development and use of a free, online module entitled Design a Problem-Based Learning Experience. The module production, aligned with theories of andragogy, was a partnership between the recipients of a grant using PBL to enhance English language learner education and the Sanford Inspire Program. A multistage evaluation design was used in the iterative process of module creation. Starting with an initial white paper, the module’s conceptualization, development, pilot testing, and refinement are described, along with the current use statistics. The URL …

Electronic Rubric Grading: Establishing A Foundation For The Future, Jayzona A. Alberto, Jorge Godinez Jr.

The Emerging Learning Design Journal

Many institutions of higher education measure learning outcomes through performance-based assessments or rubrics, resulting in the exploration of innovative methods to administer these types of assessments (Anglin, Anglin, Schumann & Kaliski, 2008). At Western University of Health Sciences – College of Dental Medicine, performance-based assessments have been transformed into interactive, electronic versions in which faculty graders use their computers or mobile devices to submit scored rubrics complete with feedback for the students. A major advantage of the software, ExamSoft, we utilize is the ability to link learning outcomes to assessments, resulting in generating robust reports that display longitudinal data for …

Design And Assessment Of Deep And Active Learning In Science, Technology, Engineering, And Mathematics (Stem) Education, Juhong Christie Liu Ph.D., Elizabeth Johnson Ph.D., Jin Joy Mao Ph.D.

Libraries

This presentation draws academic significance from a focused literature review and initial data for learning design in Science, Technology, Engineering, and Mathematics (STEM) education. The presenters will discuss strategies of fostering deep, active learning, alignment with assessment, and development of assessment instruments and methods. The presenters will share the design and development of an assessment kit to measure learning outcomes that matter in the 21st century STEM education. Through shared evidence and interactive reflection, the audience will take away up-to-date design strategies for deep and active learning as well as assessment in STEM education. The project is sponsored by National …

Evaluation Instruments And Good Practices In Online Education, Sally J. Baldwin, Jesús Trespalacios

Educational Technology Faculty Publications and Presentations

Chickering and Gamson’s (1987) Seven Principles for Good Practice in Undergraduate Education offers extensively researched and validated tenets for best practices in higher education. After a review of the literature, twenty-eight evaluation instruments currently used to design and review online courses in higher education institutions were collected and divided into categories, based on geographical reach and the type of institution for which they were developed. This study investigates how evaluation instruments used in higher education assess the Seven Principles for Good Practice in Undergraduate Education, and what other items are addressed in the evaluation of courses. Findings show that national …

Stitching Codeable Circuits: High School Students' Learning About Circuitry And Coding With Electronic Textiles, Breanne Krystine Litts, Yasmin B. Kafai, Debora A. Lui, Justice T. Walker, Sari A. Widman

Instructional Technology and Learning Sciences Faculty Publications

Learning about circuitry by connecting a battery, light bulb, and wires is a common activity in many science classrooms. In this paper, we expand students’ learning about circuitry with electronic textiles, which use conductive thread instead of wires and sewable LEDs instead of lightbulbs, by integrating programming sensor inputs and light outputs and examining how the two domains interact.We implemented an electronic textiles unit with 23 high school students ages 16–17 years who learned how to craft and code circuits with the LilyPad Arduino, an electronic textile construction kit. Our analyses not only confirm significant increases in students’ understanding of …

Authentic Science In Education: Studies In Course-Based Research At The United States Military Academy, Anthony M. Chase

Open Access Dissertations

This dissertation consists of two studies at the United States Military Academy. Both studies involve the use of Course-based Undergraduate Research Experiences (CUREs). These experiences give students the ability to engage in undergraduate research at an early point in their academic career by replacing traditional laboratory activities with semester-long research projects. Both studies show an implementation of this type of instruction from the Center for Authentic Science Practice in Education (CASPiE). Study 1 shows the specific method of implementation at the military academy and explores learning-based outcomes. Primarily the outcome of critical thinking is demonstrated. Critical thinking is a construct …

Session J: Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge

Dr Michael J Timms

There is an increasing interest in using digital technologies to create interactive learning environments (ILEs) that both teach and assess student skills that are hard or impossible to assess using ‘static’ items such as traditional, multiple-choice questions. These interactive learning environments try to do two things simultaneously: firstly, to monitor the learning of the student in real time, providing feedback to help the student progress through the learning task; and secondly, to use the information gathered during the learning to make judgements about where the student is in learning of the topic. Essentially, ILEs draw upon the same source of …

Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge

2009 - 2019 ACER Research Conferences

There is an increasing interest in using digital technologies to create interactive learning environments (ILEs) that both teach and assess student skills that are hard or impossible to assess using ‘static’ items such as traditional, multiple-choice questions. These interactive learning environments try to do two things simultaneously: firstly, to monitor the learning of the student in real time, providing feedback to help the student progress through the learning task; and secondly, to use the information gathered during the learning to make judgements about where the student is in learning of the topic. Essentially, ILEs draw upon the same source of …

Down The Rabbit Hole: An Initial Typology Of Issues Around The Development Of Moocs, Apostolos Koutropoulos, Panagiotis Zaharias

Current Issues in Emerging eLearning

MOOCs have experienced an unprecedented explosion of publicity. This publicity indicates both optimism that they may be the panacea for whatever ails higher education, as well as caution and trepidation that this may in-fact be some sort of new fad in higher education. In this wave of optimism, and subsequent wave of pessimism, we believe that there is something good to examine about MOOCs and that they do hold potential for certain educational arenas. That said, we don’t want to blindly dive into the MOOC optimism camp. We have critically examined the literature, from both academic peer-reviewed and academic press …

Digital Interactive Games For Assessment: A Study Of The Effectiveness Of A Digital Game As A Measure Of Students' Understanding Of Boolean Logic, Mohammad Ali Haji

Electronic Theses and Dissertations

Digital games have been used mostly for entertainment but recently researchers have started to use digital games in other areas such as education and training. Researchers have shown that digital games can provide a compelling, creative, and collaborative environment for learning. However, the popularity of computers and the Internet brings this question to mind: Are the assessment methods falling behind and remaining traditional? Will the traditional methods of learning and knowledge assessment be sufficient for this new generation who are starving for new technology? This study investigates the effectiveness of using a digital interactive game as an assessments method - …

Using An Open Software System (Sakai) To Develop Student Portfolios, Linda L. Beith, Stephen White, Gregory Laramie

Staff Publications

E-portfolios are digital collections of artifacts that represent the achievements and reflections of individuals. They offer a unique view into student learning and allow educators and external accreditors to assess student progress towards established standards as well as reviewing their program’s performance in supporting that progress. Students benefit from assembling their e-portfolios through the process of reviewing their own work with a critical eye, choosing pieces of their work that best represent their abilities, and reflecting on the transformative nature of their University experience, both in class and through extra-curricular, service learning, internships and international activities. An e-portfolio provides a …

The Development Of A Content Analysis Model For Assessing Students’ Cognitive Learning In Asynchronous Online Discussions, Dazhi Yang, Jennifer C. Richardson, Brian F. French, James D. Lehman

Educational Technology Faculty Publications and Presentations

The purpose of this study was to develop and validate a content analysis model for assessing students' cognitive learning in asynchronous online discussions. It adopted a fully mixed methods design, in which qualitative and quantitative methods were employed sequentially for data analysis and interpretation. Specifically, the design was a "sequential exploratory" (QUAL→ quan) design with priority given to qualitative data and methods. Qualitative data were 800 online postings collected in two online courses. Quantitative data were 803 online postings from the same two courses but from different discussion topics and different weeks. During the qualitative process, a grounded theory approach …

Interaction Online: Above And Beyond The Requirements Of Assessment, Meg O'Reilly, Diane Newton

Dr Meg O'Reilly

Today’s literature is filled with new paradigms for learning, specifically in relation to the increasing adoption of computer-mediated techniques for interactive learning. In many cases, learning may now be enhanced through the experience of a shared online environment for critical discussion, knowledge building and the establishment of supportive social communities. Research data obtained from social science students at Southern Cross University over two semesters reveals students’ perceptions of the importance of online discussion whether these are assessable or not. This paper presents some findings and explores the impact of the emergence of a student-centred social learning environment.

New Trends In Automatic Assessment: Ontology Matching, Maria Mitina, Patricia Magee, John Cardiff

Conference Papers

Instant individual feedback represents a result of assessment which allows for considerable improvements in both teaching and learning. In this paper we present the application of ontology matching techniques in automatic correction of students’ answers for SQL tests, which will provide teachers with instant feedback to facilitate manual correction and marking and which they can pass to the students. Students experience many problems learning SQL due to the necessity to memorise database schemas, unclear feedback from the database engine on the execution of the query, etc. The program environment utilising the described approach is designed to solve the abovementioned problems …

Interaction Online: Above And Beyond The Requirements Of Assessment, Meg O'Reilly, Diane Newton

Dr Meg O'Reilly

Today’s literature is filled with new paradigms for learning, specifically in relation to the increasing adoption of computer-mediated techniques for interactive learning. In many cases, learning may now be enhanced through the experience of a shared online environment for critical discussion, knowledge building and the establishment of supportive social communities. Research data obtained from social science students at Southern Cross University over two semesters reveals students’ perceptions of the importance of online discussion whether these are assessable or not. This paper presents some findings and explores the impact of the emergence of a student-centred social learning environment.

Delivering High Stakes Assessments In A Computerized Testing Center, Philip Wilhauk, Tim Doughty, Ron Knight, Tony Paolo

SIDLIT Conference Proceedings

In August 2005, the University of Kansas Medical Center launched its new 135 seat Computerized Testing Center (CTC). Since that time, the facility has successfully hosted over 30,000 individual high-stakes test sessions using LXR. This presentation will discuss the challenges involved in planning and managing such a facility including pilot testing, security, reliability, scalability, scheduling and support. It will also address the impact the CTC has had on paper/pencil testing.