Quantitative, Qualitative, Comparative, and Historical Methodologies Commons^™

An Examination Of Two Types Of Identity Achievement, Emily Kuehn, Maggie Schauff, Oscar Baldelomar

Undergraduate Research Symposium 2019

Marcia’s ethnic identity status model (MEIM) emphasizes an independent process of identity formation where adolescents choose a differing identity from influencing authorities, similar to changing religions from what one’s parents believe to another. Phinney & Baldelomar (2011) modified this approach to balance individualistic and collectivistic identity outcomes. This modified approach uses the AMIS (Adaptive Measure of Identity Statuses), which classifies participants into statuses including two types of identity achievements: interdependent/collectivistic and independent/individualistic identity outcomes. The AMIS is a self-guided questionnaire that provides follow-up questions based on past answers. We examined the validity of the AMIS against the MEIM’s scores on …

The Coach’S Journal: Experiences Of Black Female Assistant Coaches In Ncaa Division I Women’S Basketball, Leslie K. Larsen, Leslee Fisher, Lauren Moret

The Qualitative Report

In NCAA Division I women’s basketball, Black female coaches make up only a small percentage of the total number of coaches (i.e., 26%; NCAA, 2016) even though the majority of student-athletes are Black (i.e., 51%). Although these discrepancies have recently been recognized in sport studies literature (Borland & Bruening, 2010; LaVoi & Dutove, 2012), sport psychology researchers have yet to explore the underlying structural and psychological issues that lead to the underrepresentation of Black female coaches in NCAA Division I women’s basketball. To this end, we utilized narrative inquiry (Smith & Sparkes, 2009a) in the current study to explore the …

Exploring The Function Of Member Checking, Amber G. Candela

The Qualitative Report

Member checking is commonly used in qualitative research as a means to maintain validity; however, little has been published about the effects the member checking process may have on participants. In this article, I provide the experiences of two participants in a qualitative case study and argue how member checking should be used as a reflective space for participants.

In Jen’S Shoes – Looking Back To Look Forward: An Autoethnographic Account, Jennifer L. Sze, Jane Southcott

The Qualitative Report

This paper discusses the monumental events in my life that have shaped my two professional identities, teacher and researcher. I used autoethnography as a research methodology to traverse my personal life narratives across two different countries: Vietnam and Australia to seek and to examine my dual cultural identities, and how they shaped me. I am a passionate teacher who believes that teaching can change the world through the causes that I care about such as anti-racism and equity in education for students from all backgrounds. In this case study, data were collected by semi-structured interview and reflection on journals. Data …

Charting Our Course: A Review Of Stephen Andrew’S Searching For An Autoethnographic Ethic, Janie Copple

The Qualitative Report

This review critiques Stephen Andrew’s proposed method for applying ethical guidelines to autoethnographic research. Andrew argues that although extant autoethnographic literature attends to a variety of ethical considerations (i.e., relational ethics, reflexivity in research, tools for ethical writing), explicit analytical guidelines are lacking. Using excerpts from personal autoethnographies, Andrew illustrates his conception for an autoethnographic ethic leaving readers with practical tools and resonant narratives.

Using Scribes In Qualitative Research As An Alternative To Transcription, Kim Eaton, Werner G. K. Stritzke, Jeneva L. Ohan

The Qualitative Report

Transcribing qualitative data is resource-intensive. One less intensive alternative is scribing: the documenting of comprehensive notes, including verbatim quotes by an independent observer during an interview. However, the extent to which a comparable thematic analysis can be derived from scribed interview data relative to verbatim transcriptions of these same interviews has not been investigated. Thus, the purpose of this study is to test the number and content of themes derived from interview data, which had been scribed versus transcribed verbatim and to identify the time and cost differences (if any) between obtaining, processing, and analysing scribed data compared to transcribed …

The Coexistence Plan At A Secondary School: Analysis Based On The Voices Of Students And Teachers, Gustavo González-Calvo, David Hortigüela-Alcalá, Alejandra Hernando-Garijo, Ángel Pérez-Pueyo

The Qualitative Report

The main objective of this research is to analyse the Plan for Coexistence at a Spanish Secondary School and its implementation from the perspective of an inclusive model of school management. Beginning with a theoretical review of different national and international contributions centred on inclusive education and the improvement of school coexistence, we have chosen a qualitative methodology that will enable us to listen and to give a voice to the main members of the school community: students and teachers. We show how the Citizenship Plan follows an inclusive focus, enhancing the participation of the whole community in the different …

Maximizing Nvivo Utilities To Analyze Open-Ended Responses, Xiaoying Feng, Linda Behar-Horenstein

The Qualitative Report

Open-ended responses are widely used to explore and understand participants’ experiences and perspectives in a variety of fields. As one of the most powerful computer-assisted qualitative data analysis software, NVivo allows researchers to analyze open-ended responses to survey and/or interview questions, as well as other text data like reflective writing, image, and videos. The purpose of this paper is to describe and demonstrate how the NVivo word frequency, text search, and matrix coding features can be used to analyze qualitative data from a longitudinal evaluation project. The authors show how the matrix coding feature maximizes NVivo utilities in an analysis …

Spark: Why I Wrote A Novel Designed To Teach The Research Process, Patricia Leavy

The Qualitative Report

I’m a sociologist specializing in research methodology. I’m also a novelist. When my latest novel, Spark, was released, people remarked that it seemed inevitable for me to combine my two passions. I agree. In some ways this is probably always where my work was heading, although it necessarily took a long time to get here. I’d like to share why as a scholar I turned to fiction, the inspiration for Spark, and my hopes for the book.

Painting Intimacy: Art-Based Research Of Intimacy, Michal Lev

Expressive Therapies Dissertations

This art-based research explores whether — and, if so, how — the process of painting, together with witnessing and reflection on the process and imagery, further an understanding of intimacy. The research also examines the conditions that favor intimacy, the obstacles to intimacy, and the particular features of artistic media, processes and reflection, through the editing of video footage, that can further the intimate experience. The participants in the study were five adults (including the researcher) between the ages of thirty and eighty who were familiar with the creation of visual art. Among them were three women and two men …

From Test To Testimony: Resiliency After A Tbi Diagnosis, Quanisha Miffin, Archana V. Hegde, Paige Averett, Natalia Sira

The Qualitative Report

Autoethnographic research is a relatively new means of gathering data on oneself to connect to research and theory while advocating for change within a policy, law, and/ or environment. In this autoethnography I will recount the experience of my traumatic brain injury (TBI) diagnosis following a car accident and present a few implications for the professionals and members of the society at large surrounding the issue of TBI such as the need for awareness and understanding as well as the importance of therapy and other forms of care within different cultures. When I was first diagnosed, many people did not …

An English Learner As A Cultural Broker For Youth Interviews, Cynthia C. Reyes

The Qualitative Report

In the field of student voice, listening is a notion that is made more complex when related to student participation and agency. To listen to who English learners are requires a reframing of these students against the deficit discourse that is often used to describe their linguistic competencies. Discourse analysis is employed to examine the translanguaging experiences of an adolescent English learner who assisted the researcher in interviews with his peers. This empirical piece asks the question of what researchers can learn when employing the use of students as brokers when conducting interviews. Translanguaging is considered an element of cultural …

Investigators Reflections On The Process And Experience Of A Mini-Ethnographic Case Study Research In Nigeria, Ezenwayi C. Amaechi Ph.D., Patricia I. Fusch Ph.D.

The Qualitative Report

The purpose of this paper is to discuss the investigator's reflections, both prospective and retrospective, on the process and experience of conducting a mini-ethnographic case study research in Nigeria. The research titled “Exploring barriers to women entrepreneurs in Enugu State Nigeria” was written to add to the body of knowledge on barriers facing some small-scale women entrepreneurs in the marketplaces in Nigeria. A mini-ethnographic case study design was used for this study, this methodology is a combination of ethnography and case study research that can assist a researcher to gain an in-depth understanding of a phenomenon. The data collection methods …

The Impact Of Longitudinal Action Research On Doctoral Student Retention And Degree Completion, James Olive

The Qualitative Report

The impact of a longitudinal action research (LAR) project on the retention and success of students enrolled in a leadership studies doctoral program was the focus of this study. The purpose was to understand how the experiences obtained through an action research project, conducted over 12-15 months, affected students’ development while they completed the first two years of their doctoral coursework. Ten doctoral students, who were at various stages in their educational journey, were interviewed and asked to reflect upon their experiences while completing their LAR project. Findings indicated that the LAR project provided an opportunity to apply theoretical concepts …

Examining The Impact Of An English In Action Training Program On Secondary-School English Teachers’ Classroom Practice In Bangladesh, Abdul Karim Mr., Abdul Rashid Mohamed Dr.

The Qualitative Report

English teachers in Bangladesh have undergone numerous training programs. Both government-initiated and donor-sponsored training programs have been in operation in Bangladesh. Government initiated institutions to train teachers are Primary Training Institutes (PTIs) and Teacher Training Colleges (TTCs). However, researchers seemed to label training provided by PTIs and TTCs as inadequate. Bridging the gaps intrigued government of Bangladesh to devise donor-aided training programs, including English Language Teaching Improvement Project (ELTIP), English for Teaching, Teaching for English (ETTE), Secondary Education Quality and Access Enhancement Project (SEQAEP), Teaching Quality Improvement in Secondary Education Project (TQI-SEP). Studies reported their potential failure to bring changes …

Transparency And Coherence In A Doctoral Study Case Analysis: Reflecting On The Use Of Nvivo Within A 'Framework' Approach, Marjorie Bonello, Ben Meehan B.M.

The Qualitative Report

This article describes and reflects on the analytical process undertaken on a qualitative case study analysis exploring the concept of interprofessional education (IPE) in Malta. The analysis which employed the ‘Framework’ approach executed by qualitative data analysis (QDAS) software, specifically NVivo, served to produce an audit trail eliciting how the data, findings, interpretations and subsequent conclusions were all tracked and grounded in the raw data. This paper offers a reflective account of my experience in using NVivo highlighting the potential of this software as facilitating a more rigorous and transparent approach to qualitative data analysis.

General Interviewer Techniques: Developing Evidence-Based Practices For Standardized Interviewing, Nora Cate Schaeffer, Jennifer Dykema, Steve M. Coombs, Rob K. Schultz, Lisa Holland, Margaret Hudson

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

The practices of standardized interviewing developed at many research sites over many years. The version of standardization that Fowler and Mangione codified in Standardized Survey Interviewing has provided researchers a core resource to use in training and supervising standardized interviewers. In recent decades, however, the accumulation of recordings and transcripts of interviews makes it possible to re-visit the practices of standardization to describe both how respondents actually answer survey questions and how interviewers actually respond.

To update General Interviewer Training (GIT), we brought observations of interaction during interviews together with research about conversational practices from conversation analysis, psychology, and other …

Antecedents And Consequences Of Interviewer Pace: Assessing Interviewer Speaking Pace At The Question Level, Allyson L. Holbrook, Timothy P. Johnson, Evgenia Kapousouz, Young Ik Cho

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

The pace at which interviewers read survey questions may vary considerably across interviewers (e.g., Cannell, Miller, & Oksenberg, 1981) and as a function of interviewer experience (Olson and Petchev, 2007). The pace at which interviews are conducted can influence respondent perceptions of the importance of interaction (Fowler, 1966). Interviewer training typically includes instructions to read questions slowly and clearly to respondents is based on the assumption that doing so maximizes data quality (e.g., Fowler and Mangione, 1990). In this research, we examine possible causes and consequences of interviewer pace using data from in person surveys conducted with respondents from four …

Race-Of-Virtual-Interviewer Effects, Frederick Conrad, Michael Schober, Daniel Nielsen, Heidi Reichert

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

In developing self-administered interviewing systems that go beyond text, survey designers are faced with choices about how to represent the interviewing agent. In speech-dialog systems like ACASI and IVR, designers must decide if the voice that presents the spoken questions is unambiguously male or female, whether the pronunciation is regionally marked, etc. Any visual representation of an interviewer (e.g., a photograph, a video) requires designers to choose features that visually convey demographic features like race, gender, age, etc. Here we investigate whether the representation of animated virtual interviewers (VIs) affects responses in the same way that analogous attributes of human …

Interviewer Variation In Third Party Presence During Face-To-Face Interviews, Zeina N. Mneimneh, Julie De Jong, Jennifer Kelley

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

The presence of a third person in face-to-face interviews constitutes an important contextual factor that affects the interviewee's responses to culturally sensitive questions (Aquilino, 1997; Casterline and Chidambaram, 1984; Mneimneh et al., 2015; Pollner and Adams, 1994). Interviewers play an essential role in requesting, achieving, and reporting on the private setting of the interview. Our recent work has shown that the rate of interview privacy varies significantly across interviewers; while some interviewers report high rates of privacy among their interviews, others report low rates of privacy for the interviews they administered (Mneimneh et al., 2018). Yet, there is a lack …

The Cannell Legacy, Nancy A. Mathiowetz, Peter V. Miller

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Charles Cannell engineered the study of Interviewer-respondent interaction. He created conceptual frameworks for understanding the interviewing process and its impact on data quality. He invented methods for observing and recording interview interaction. He pioneered the use of randomized experiments in the survey context. He amalgamated insights from clinical and social psychology, sociology, group dynamics, as well as research on verbal and nonverbal communication to inform his work. This interdisciplinary approach has broadly influenced both interviewing research and practice. In this paper, we review Cannell’s many contributions to the field and his enduring legacy.

The Accuracy And Utility Of Using Paradata To Detect Interviewer Question-Reading Deviations, Jennifer Kelley

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Deviations from reading survey questions exactly as worded may change the validity of the questions, thus increasing measurement error. Hence, organizations train their interviewers to read questions verbatim. To ensure interviewers are reading questions verbatim, organizations rely on interview recordings. However, this takes a significant amount of resources. Therefore, some organizations are using paradata generated by the survey software, specifically timestamps, to try to detect when interviewers’ deviate from reading the question verbatim.

To monitor interviewers’ question reading behavior using timestamps, some organizations estimate the expected question administration time to establish a minimum and maximum question administration time thresholds (QATT). …

Interacting With Interviewers In Voice And Text Interviews On Smartphones, Michael Schober, Frederick Conrad, Christopher Antoun, Alison W. Bowers, Andrew L. Hupp, H. Yanna Yan

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

As people increasingly adopt SMS text messaging for communicating in their daily lives, texting becomes a potentially important way to interact with survey respondents, who may expect that they can communicate with survey researchers as they communicate with others. Thus far our evidence from analyses of 642 iPhone interviews suggests that text interviewing can lead to higher quality data (less satisficing, more disclosure) than voice interviews on the same device, whether the questions are asked by an interviewer or an automated system. Respondents also report high satisfaction with text interviews, with many reporting that text is more convenient because they …

Interviewer Falsification In Survey Research: Detection Methods And Impact Of Fraudulent Interviews, Silvia Schwanhäuser, Joseph Sakshaug, Yuliya Kosyakova, Frauke Kreuter

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

The role of the interviewer and sources of interviewer error in the survey data collection process are widely discussed topics in the survey methodology literature. An understudied problem in this context is the falsification of interview data by the interviewer. Research gaps concern, for example, how conclusions drawn from survey data are affected by falsified interviews. So far it is commonly assumed, that the possible effect of falsifications on univariate statistics can only be as high as the overall share of falsified data. Since the share of faked data is usually very low for most surveys, the problem is regarded …

Comparison Of Different Approaches To Evaluate And Explain Interviewer Effects, Geert Loosveldt, Celine Wuyts

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Within survey methodology it is common knowledge that interviewers in face-to-face or telephone interviews can have undesirable effects on the obtained answers. These effects can be created in an active way by, for example, asking suggestive questions or they can be obtained in a passive way as a consequence of certain interviewer characteristics eliciting socially desirable answers. These active and passive effects may differ from interviewer to interviewer. These differences between interviewers in systematic effects create additional variance in the data. The proportion of variance in a (substantive) variable that can be explained by the interviewers is the ‘so called’ …

Designing Studies For Comparing Interviewer Variance Components In Two Groups Of Survey Interviewers, Brady T. West

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Methodological studies of interviewer effects often seek to identify factors that influence the magnitude of interviewer variance for particular survey questions. There is a long history of work in this area, and results from studies like this have informed current interviewing practice. Unfortunately, many studies of this type suffer from one or more of the following limitations in terms of their designs: 1) a failure to randomly assign interviewers to the treatments being compared; 2) a failure to formally test for differences in the variance components between the two groups; and 3) insufficient statistical power for comparison of the variance …

Let’S Talk About Money! How Do Interviewer Expectations Affect Item Nonresponse To Income And Asset Questions?, Sabine Friedel

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Personal income and assets are sensitive topics to discuss and the discussion of money tends to be a taboo. This phenomenon is reflected by high nonresponse rates to items that address income and assets questions in interviewer-mediated surveys. However, such information is important to obtain, as household income and different types of assets are used as core variables in socio-economic models. Such item nonresponse is influenced by interviewers. Although interviewers are trained to conduct standardized interviews, some interviewers obtain a higher number of item nonresponses than others. This study examines interviewer effects on nonresponse to several income and asset questions …

Explaining Interviewer Effects On Survey Unit Nonresponse: A Cross-Survey Analysis, Daniela Ackermann-Piek, Annelies G. Blom, Julie M. Korbmacher, Ulrich Krieger

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

In interviewer-administered surveys, interviewers are involved in nearly all steps of the survey implementation. However, besides many positive aspects of interviewers’ involvement, they are – intentionally or unintentionally – a potential source of survey errors. In recent decades, a large body of literature has accumulated about measuring and explaining interviewer effects on survey unit nonresponse. Recently, West and Blom (2017) have published a research synthesis on factors explaining interviewer effects on various sources of survey error, including survey unit nonresponse. They find that previous research reports great variability across surveys in the significance and even direction of predictors of interviewer …

General Interviewing Techniques: Developing Evidence-Based Practices, Steve Coombs, Margaret Hudson, Lisa Holland, Nora Cate Schaeffer, Jennifer Dykema

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

This poster is a hands-on demonstration of the in-progress General Interviewer Techniques (GIT) materials described by Schaeffer, Dykema, Coombs, Schultz, Holland, and Hudson. Participants will be able to view and listen to the lesson materials, delivered via an online interface, and talk to the GIT developers.

Effects Of Innovative Motivational Strategies And New Staffing Model On Interviewer Attrition: A Data Collection Year In Review, Theresa Camelo, Maureen O’Brien

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Due to high staff attrition and its negative effects on data collection and project cost, a large national study implemented motivational strategies and a new staffing model for the current data collection year. Motivational strategies included retention bonuses, organization gear, and other personalized recognitions. The new staffing model included both a change in weekly hour requirements as well as the number of interviewers staffed in each area. New staff, committed to 20 hours per week, were added to approximately half of the sampling areas with already existing 30 hour per week staff. Two Interviewers were now working a single area, …