Educational Assessment, Evaluation, and Research Commons^™

Introduction: Reframing The Inequality Debate Toward Opportunity And Mobility, Norman Eng, Allan Ornstein

Publications and Research

No abstract provided.

Education Inequality: Broadening Public Attitudes Through Framing, Norman Eng

Publications and Research

Research over the last 50 years have been remarkably consistent when it comes to addressing education inequality: background factors like family and socioeconomics matter to school success. Yet policies remain narrowly focused on school-based reforms like testing, standards, and charter schools due in large part to America’s limited understanding of education and inequality. I argue that scholars, as the experts, are ultimately responsible for changing how policymakers and the public think about these issues—a duty they have yet to embrace. In this connection, the use of framing can help education researchers broaden attitudes and stimulate political will. Drawing mainly from …

Thiscollegestory.Com: How Interactive Writing Media Influenced The Way First-Year Students Made Sense Of Their College Transition, Philip Kreniske

Dissertations, Theses, and Capstone Projects

Drawing on insights from Bakhtin (1986) that demonstrated the significance of writing as an interaction, and building on recent developments in narrative analysis that offer insights into narrator’s sense making processes (Daiute, 2014; Lucic, 2013); this research explores how freshmen in an educational opportunity program used interactive writing media to make sense of their transition to college. The exploration involved three main questions and each question concerns students’ development over time:

• First, did college students’ writing in two different media (blogs and word-processed text) differ and did these differences change over time?
• Second, how did the narrators and audience interact …

Evaluating The Validity Of Technology-Enhanced Educational Assessment Items And Tasks: An Empirical Approach To Studying Item Features And Scoring Rubrics., Ally Thomas

Dissertations, Theses, and Capstone Projects

With the advent of the newly developed Common Core State Standards and the Next Generation Science Standards, innovative assessments, including technology-enhanced items and tasks, will be needed to meet the challenges of developing valid and reliable assessments in a world of computer-based testing. In a recent critique of the next generation assessments in math (i.e., Smarter Balanced), Rasmussen (2015) observed that many aspects of the technology “enhancements” can be expected to do more harm than good as the computer interfaces may introduce construct irrelevant variance. This paper focused on issues surrounding the design of TEIs and how cognitive load …

The Effects Of Descriptions And Images Of Antecedent Stimuli And Outcomes To Correct Responses In Task Analysis Instruction, Bryan C. Tyner

Dissertations, Theses, and Capstone Projects

Task analysis (TA) instruction is commonly used for teaching behavior chains; however, little research informs best practices for TA instruction. Data regarding the effects of instructional variables on responding may enhance TA efficacy and learner performance. Linking TA instruction to the three-term contingency may facilitate the development of control by stimuli that are naturally present while completing complex tasks; therefore, this study employed a two-by-two factorial design to analyze the relative effects of supplementing TA instruction with descriptions and images of: (factor A) antecedent stimuli relevant to each instructed discrete response and (factor B) the outcomes of accurately completing instructed …

Perceptions Of Fidelity And Adaptation In Evidence-Informed Interventions By Women Of Color Sexuality Health Educators, Sara C. Flowers

Dissertations, Theses, and Capstone Projects

Sexuality health educators (SHEs) adapt interventions to the participants’ needs in the dissemination and implementation of comprehensive sexuality education (CSE) programming. However, there is a lack of understanding of how, why and when SHEs make such adaptations. Success or failure of the transfer of prevention technology to practitioners occurs by determining community capacities and preparedness to adopt/adapt high-impact interventions to effectively manage implementation. Experts argue for evidence-informed interventions (EII), as opposed to evidence-based interventions (EBI), as the best way to incorporate research in applied settings. EBIs are solely guided by recommendations from current evidence, whereas EIIs recognize and incorporate the …

The Consequences Of The State Implementation Of A Nationally Standardized Teacher Performance Assessment As A Certification Requirement: A Mixed Methods Study, Deborah Greenblatt

Dissertations, Theses, and Capstone Projects

The edTPA (Teacher Performance Assessment) is a nationally distributed and scored standards-based teacher performance assessment being promoted throughout the country (AACTE, n.d.-a). This mixed methods study investigated the experiences of New York City teacher candidates and teacher educators with the elementary education edTPA portfolio. It was found that teacher candidates experienced various supports and challenges based on their personal demographics, school of education, and student teaching placements. Additionally, the edTPA affected participants' personal, professional, academic and student teaching experiences. Furthermore, the study revealed ways that implementation of the edTPA affected teacher educators and the teacher education curriculum.

Based on the …

How Do Open Educational Resources (Oers) Impact Students? A Qualitative Study At New York City College Of Technology, Cuny, Cailean Cooney

Dissertations, Theses, and Capstone Projects

This thesis reports on findings from a study conducted with students using open educational resources as the primary course material in their Health Psychology course. The study took place at New York City College of Technology (City Tech), of the City University of New York (CUNY), a comprehensive college located in Brooklyn. Students were assigned the OER by their course instructor, who developed it as part of a library funded pilot initiative. Two research instruments were employed to collect qualitative data from students: a survey and one-on-one interviews with a smaller student sample. Both survey and interview items asked students …

The Role Of Calibration Bias And Performance Feedback In Achievement Goal Regulation, Krista R. Muis, Philip H. Winne, John Ranellucci

Publications and Research

Do achievement goals change across time in response to performance feedback? Does goal orientation relate to calibration of estimated to actual achievement? We studied these issues over three tasks spanning a semester-long course where ninety-nine undergraduates received feedback about performance on each task. Learners were consistently and quite substantially biased in estimating performance with bias inversely related to actual performance. Goal orientation was not stable across time as a function of task, and it varied in some tasks in relation to calibration accuracy. These findings demonstrate goal orientations are sensitive to task and feedback. Moreover, goal orientation had varying and …

High Impact Practices: Student Engagement And Retention, Giselle Bonet, Barbara R. Walters

Publications and Research

Community college students face special challenges that can impede their academic progress, resulting in lower grades and persistence than students in selective four-year colleges. Kingsborough Community College in Brooklyn, New York, successfully addresses these challenges with learning communities: small cohorts of students in a blocked program of study, which includes developmental or basic English, a one-credit student skills course, and a social or behavioral science course. This research analyzes the short-term effects of the model by comparing a sample of 267 students enrolled in four learning community and four regular sections of sociology and psychology classes. The results demonstrate a …

Hostos Online Learning Assessment: A Survey Of Student Perceptions, Kate Wolfe, Sarah Hoiland, Kate Lyons, Carlos Guevara, Kristopher B. Burrell, Jacki Disanto, Sandy Figueroa, Aaron Davis, Iber Poma, Wilfredo Rodriguez, Linda L. Ridley

Publications and Research

The Office of Education Technology (EdTech) at Hostos Community College and faculty members from various departments created the Hostos Online Learning Assessment (HOLA) Task Force to design a survey for gathering and assessing data about students’ perceptions of their online learning experiences. The task force wanted to utilize the survey results to identify strengths and weaknesses in online instruction and student preparedness for the online learning environment. Student perceptions of online learning are integral to building upon current best practices and also gauging the preparedness of the students for the online learning environment, particularly in an urban, Hispanic-serving community college. …

Studies In The Creation And Implementation Of School Cultures: Two New York City Stand-Alone Charter Schools, Olivia-Beate A. Franzini

Dissertations, Theses, and Capstone Projects

In the last thirty years the United States has seen a rise in charter school education and with that an influx of discussion over the best way to successfully educate college and career ready students. Many of these charter schools have their own unique philosophy on education and disciplinary codes to aid in the attainment of their success. The following case studies were conducted through participant observation in two start-up charter schools. At the time of study both institutions were in their second year of creation. These schools have opposing philosophies on education; the first School “A” is an independent …

Taking Stock Of Cuny Esl: What A Survey Of Esl Faculty And Adminstrators Says About The Past, The Present, And The Future, Effie Paptzikou Cochran, Lubie Grujicic-Alatristie

Publications and Research

This report provides a summary of a survey of CUNY ESL faculty and administrators in an attempt to assess CUNY ESL programs’ achievements and to offer an insight into current challenges. In the new millennium, with educational, financial, political, and linguistic concerns on the rise, taking stock of where we are in English as a second language instruction in higher education and planning for the future are at once prudent and pressing.

“I Am More Productive In The Library Because It’S Quiet”: Commuter Students In The College Library, Mariana Regalado, Maura A. Smale

Publications and Research

This article discusses commuter students’ experiences with the academic library, drawn from a qualitative study at the City University of New York. Undergraduates at six community and baccalaureate colleges were interviewed to explore how they fit schoolwork into their days, and the challenges and opportunities they encountered. Students identified physical and environmental features that informed their ability to successfully engage in academic work in the library. They valued the library as a distraction-free place for academic work, in contrast to the constraints they experienced in other places—including in their homes and on the commute.

Infusing Locally Relevant Video To Support Teacher Learning, Leslie Lieman, Aliex Ross, Jeanne Peloso, Nancy Cubetz, Laura Baecher

Publications and Research

No abstract provided.

Benefits Of Hybrid Classes In Community Colleges, Joel Barker

Publications and Research

This article discusses hybrid courses and their impact on educational facilities, their students, and instructors. Instructors now have over ten years of data related to hybrid courses and by trial and error have devised different strategies to plan and execute lesson plans via partly online forums. Programs are in place that gives students the opportunity to excel; these types of courses promote a unique balance of guidance by the instructor and acceptance of responsibility by the students. Students have responded in a positive manner in pursuing these types of courses.

Demographics And Education In The Twenty-First Century, Norman Eng

Publications and Research

No abstract provided.

Supervisor Use Of Video As A Tool In Teacher Reflection, Laura H. Baecher, Bede Mccormack, Shiao-Chuan Kung

Publications and Research

Supervisors play a critical role in fostering teacher candidates’ reflective thinking on their practice, yet too often it is the supervisor, rather than the teacher, doing most of the observation work. Video-­‐based supervision offers a promising alternative, as teachers have an opportunity to examine their own lesson and thus engage with the supervisor in a more collaborative conference. In this paper, we explore the ways supervisors approach video in their conferencing with teachers as a vehicle for teacher reflective practice at one TESOL master’s program in the USA. We examine what supervisors find salient in video observations, how they approach …

The Create Strategy For Intensive Analysis Of Primary Literature Can Be Used Effectively By Newly Trained Faculty To Produce Multiple Gains In Diverse Students, Leslie M. Stevens, Sally G. Hoskins

Publications and Research

The CREATE (Consider Read, Elucidate the hypotheses, Analyze and interpret the data, and Think of the next Experiment) strategy aims to demystify scientific research and scientists while building critical thinking, reading/analytical skills, and improved science attitudes through intensive analysis of primary literature. CREATE was developed and piloted at the City College of New York (CCNY), a 4-yr, minority-serving institution, with both upper-level biology majors and first-year students interested in science, technology, engineering, and mathematics. To test the extent to which CREATE strategies are broadly applicable to students at private, public, research-intensive, and/or primarily undergraduate colleges/universities, we trained a cohort of …

An Overview Of Undergraduate Research In The Cuny Community College System, Avrom J. Caplan, Effie S. Maclachlan Phd

Publications and Research

CUNY community colleges occupy a unique niche because they are part of a larger geographically focused university system in which all faculty members are governed by a single set of standards for professional development. Research is clearly a part of the wider institutional culture, and dedicated faculty members who obtained support from state and federal funding agencies have conducted successful student-research programs. Close partnerships between community colleges and their four-year counterparts can contribute to positive student outcomes and to the subsequent transfer of students. The main roadblock to broadening participation is the small number of students who can be supported …

What Difference Does Eportfolio Make? A Field Report From The Connect To Learning Project, Bret Eynon, Laura M. Gambino, Judit Torok

Publications and Research

Connect to Learning (C2L) is a FIPSE-funded project coordinated by LaGuardia Community College (CUNY) that links ePortfolio teams from 24 campuses nationwide into a supportive community of practice. Launched in 2011, C2L focused on exploring and documenting ePortfolio strategies to advance student, faculty, and institutional learning. Working together, the C2L community has developed a rich resource website, Catalyst for Learning: ePortfolio Resources and Research (http://c2l.mcnrc.org), that offers data, strategies, and expertise from C2L campuses. Our work has addressed two overarching questions: (1) “What difference can ePortfolio make?” and (2) “What does it take for ePortfolio to make a difference?” Focused …

Create Cornerstone: Introduction To Scientific Thinking, A New Course For Stem-Interested Freshmen, Demystifies Scientific Thinking Through Analysis Of Scientific Literature, Alan J. Gottesman, Sally G. Hoskins

Publications and Research

The Consider, Read, Elucidate hypotheses, Analyze and interpret data, Think of the next Experiment (CREATE) strategy for teaching and learning uses intensive analysis of primary literature to improve students’ critical-thinking and content integration abilities, as well as their self-rated science attitudes, understanding, and confidence. CREATE also supports maturation of undergraduates’ epistemological beliefs about science. This approach, originally tested with upper-level students, has been adapted in Introduction to Scientific Thinking, a new course for freshmen. Results fromthis course’s initial semesters indicate that freshmen in a one-semester introductory course that uses a narrowly focused set of readings to promote development of analytical …

Three Times Blind: The Wandering, Wondering Path To Asking The Right Question, Bradley W. Bergey

Publications and Research

In this chapter, Bradley Bergey, a 2nd-year doctoral student, tells the tale of his ethnographic journey. He focuses on how he struggled to settle on a question for his project. Bradley had done a good bit of thinking about questions, their nature, and development prior to embarking on this study. In this chapter he explores the relationship between question development, data collection, and crafting an answer to his research question. He de- scribes how his question developed while he developed his own set of “eth- nographic eyes” as a researcher and how he worked to settle on a question that …

The C.R.E.A.T.E. Approach To Primary Literature Shifts Undergraduates’ Self-Assessed Ability To Read And Analyze Journal Articles, Attitudes About Science, And Epistemological Beliefs, Sally G. Hoskins, David Lopatto, Leslie M. Stevens

Publications and Research

The C.R.E.A.T.E. (Consider,Read, Elucidate hypotheses, Analyze and interpret data, Think of the next Experiment)method uses intensive analysis of primary literature in the undergraduate classroom to demystify and humanize science. We have reported previously that the method improves students’ critical thinking and content integration abilities, while at the same time enhancing their self-reported understanding of “who does science, and why.” We report here the results of an assessment that addressed C.R.E.A.T.E. students’ attitudes about the nature of science, beliefs about learning, and confidence in their ability to read, analyze, and explain research articles. Using a Likert-style survey administered pre- and postcourse, …

The Future Of Natural Selection Knowledge Measurement: A Reply To Anderson Et Al. (2010), Ross Nehm, Irvin Sam Schonfeld

Publications and Research

The development of rich, reliable, and robust measures of the composition, structure, and stability of student thinking about core scientific ideas (such as natural selection) remains a complex challenge facing science educators. In their recent article (Nehm & Schonfeld 2008), the authors explored the strengths, weaknesses, and insights provided by a detailed exploration of three commonly used measures of student thinking about natural selection in a large sample of underrepresented minority students. One of their core findings was that all of the tools they studied--including the CINS--have strengths and weaknesses that must be carefully taken into consideration by those …

Using Blackboard To Create Library Research Skills Assessment, Maura A. Smale, Mariana Regalado

Publications and Research

Like other college and university departments, academic libraries are increasingly expected to assess their services and facilities. This article describes an initial step in the development of a comprehensive assessment program for library instruction in the Brooklyn College Library. A pre- and post-quiz were developed based on the curriculum for a required library session in an introductory English composition course. The quizzes were designed to establish a baseline for student knowledge of information literacy as well as measure the effect of library instruction on student learning. We also sought to evaluate the suitability of the Blackboard learning management system for …

Using A Paradigm Shift To Teach Neurobiology And The Nature Of Science—A C.R.E.A.T.E.-Based Approach, Sally G. Hoskins

Publications and Research

Decades ago, classic experiments established the phenomenon of “neural induction” (Spemann and Mangold, 1924; Holtfreter, 1933). It appeared clear that amphibian ectoderm was pre-programmed to form epidermis, and that the neural phenotype was induced by a chemical signal from mesoderm. The “ectoderm makes skin, unless induced to make nervous system” model appeared in many textbooks. This interpretation, however, was not simply incorrect but 180 degrees out of alignment with the actual situation. As subsequently demonstrated, the default state of amphibian ectoderm is neuronal, and the expression of the epidermal phenotype requires cell signaling (Hemmati-Brivanlou and Melton, 1992; 1994; 1997). In …

The Social Construction Of Authorship: An Investigation Of Subjectivity And Rhetorical Authority In The College Writing Classroom, Johannah Rodgers

Dissertations, Theses, and Capstone Projects

Although we use the term author on a daily basis to refer to certain individuals, bodies of work, and systems of ideas, as Michel Foucault and other critics have pointed out, attempting to answer the question “What is an Author?” is by no means a simple proposition. And, starting from the position that there is no single, or definitive answer to this complex question, this dissertation seeks to contribute to the ongoing discussion of the genealogy of authorship by investigating the ways in which conceptions of the author have informed models of the writing subject in the field of rhetoric …

Learning As We G(R)O(W): Strategizing The Lessons Of A Fledgling Rhetoric And Writing Studies Department, Jane Hindman

Publications and Research

Published in one of the first collections to focus on independent writing programs, A Field of Dreams. The volume offers a complex picture of the experience of the stand-alone. Included here are narratives of individual programs from a wide range of institutions, exploring such issues as what institutional issues led to their independence, how independence solved or created administrative problems, how it changed the culture of the writing program and faculty sense of purpose, success, or failure.