Quantitative, Qualitative, Comparative, and Historical Methodologies Commons^™

An English Learner As A Cultural Broker For Youth Interviews, Cynthia C. Reyes

The Qualitative Report

In the field of student voice, listening is a notion that is made more complex when related to student participation and agency. To listen to who English learners are requires a reframing of these students against the deficit discourse that is often used to describe their linguistic competencies. Discourse analysis is employed to examine the translanguaging experiences of an adolescent English learner who assisted the researcher in interviews with his peers. This empirical piece asks the question of what researchers can learn when employing the use of students as brokers when conducting interviews. Translanguaging is considered an element of cultural …

Investigators Reflections On The Process And Experience Of A Mini-Ethnographic Case Study Research In Nigeria, Ezenwayi C. Amaechi Ph.D., Patricia I. Fusch Ph.D.

The Qualitative Report

The purpose of this paper is to discuss the investigator's reflections, both prospective and retrospective, on the process and experience of conducting a mini-ethnographic case study research in Nigeria. The research titled “Exploring barriers to women entrepreneurs in Enugu State Nigeria” was written to add to the body of knowledge on barriers facing some small-scale women entrepreneurs in the marketplaces in Nigeria. A mini-ethnographic case study design was used for this study, this methodology is a combination of ethnography and case study research that can assist a researcher to gain an in-depth understanding of a phenomenon. The data collection methods …

The Impact Of Longitudinal Action Research On Doctoral Student Retention And Degree Completion, James Olive

The Qualitative Report

The impact of a longitudinal action research (LAR) project on the retention and success of students enrolled in a leadership studies doctoral program was the focus of this study. The purpose was to understand how the experiences obtained through an action research project, conducted over 12-15 months, affected students’ development while they completed the first two years of their doctoral coursework. Ten doctoral students, who were at various stages in their educational journey, were interviewed and asked to reflect upon their experiences while completing their LAR project. Findings indicated that the LAR project provided an opportunity to apply theoretical concepts …

Examining The Impact Of An English In Action Training Program On Secondary-School English Teachers’ Classroom Practice In Bangladesh, Abdul Karim Mr., Abdul Rashid Mohamed Dr.

The Qualitative Report

English teachers in Bangladesh have undergone numerous training programs. Both government-initiated and donor-sponsored training programs have been in operation in Bangladesh. Government initiated institutions to train teachers are Primary Training Institutes (PTIs) and Teacher Training Colleges (TTCs). However, researchers seemed to label training provided by PTIs and TTCs as inadequate. Bridging the gaps intrigued government of Bangladesh to devise donor-aided training programs, including English Language Teaching Improvement Project (ELTIP), English for Teaching, Teaching for English (ETTE), Secondary Education Quality and Access Enhancement Project (SEQAEP), Teaching Quality Improvement in Secondary Education Project (TQI-SEP). Studies reported their potential failure to bring changes …

Transparency And Coherence In A Doctoral Study Case Analysis: Reflecting On The Use Of Nvivo Within A 'Framework' Approach, Marjorie Bonello, Ben Meehan B.M.

The Qualitative Report

This article describes and reflects on the analytical process undertaken on a qualitative case study analysis exploring the concept of interprofessional education (IPE) in Malta. The analysis which employed the ‘Framework’ approach executed by qualitative data analysis (QDAS) software, specifically NVivo, served to produce an audit trail eliciting how the data, findings, interpretations and subsequent conclusions were all tracked and grounded in the raw data. This paper offers a reflective account of my experience in using NVivo highlighting the potential of this software as facilitating a more rigorous and transparent approach to qualitative data analysis.

General Interviewer Techniques: Developing Evidence-Based Practices For Standardized Interviewing, Nora Cate Schaeffer, Jennifer Dykema, Steve M. Coombs, Rob K. Schultz, Lisa Holland, Margaret Hudson

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

The practices of standardized interviewing developed at many research sites over many years. The version of standardization that Fowler and Mangione codified in Standardized Survey Interviewing has provided researchers a core resource to use in training and supervising standardized interviewers. In recent decades, however, the accumulation of recordings and transcripts of interviews makes it possible to re-visit the practices of standardization to describe both how respondents actually answer survey questions and how interviewers actually respond.

To update General Interviewer Training (GIT), we brought observations of interaction during interviews together with research about conversational practices from conversation analysis, psychology, and other …

Antecedents And Consequences Of Interviewer Pace: Assessing Interviewer Speaking Pace At The Question Level, Allyson L. Holbrook, Timothy P. Johnson, Evgenia Kapousouz, Young Ik Cho

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

The pace at which interviewers read survey questions may vary considerably across interviewers (e.g., Cannell, Miller, & Oksenberg, 1981) and as a function of interviewer experience (Olson and Petchev, 2007). The pace at which interviews are conducted can influence respondent perceptions of the importance of interaction (Fowler, 1966). Interviewer training typically includes instructions to read questions slowly and clearly to respondents is based on the assumption that doing so maximizes data quality (e.g., Fowler and Mangione, 1990). In this research, we examine possible causes and consequences of interviewer pace using data from in person surveys conducted with respondents from four …

Race-Of-Virtual-Interviewer Effects, Frederick Conrad, Michael Schober, Daniel Nielsen, Heidi Reichert

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

In developing self-administered interviewing systems that go beyond text, survey designers are faced with choices about how to represent the interviewing agent. In speech-dialog systems like ACASI and IVR, designers must decide if the voice that presents the spoken questions is unambiguously male or female, whether the pronunciation is regionally marked, etc. Any visual representation of an interviewer (e.g., a photograph, a video) requires designers to choose features that visually convey demographic features like race, gender, age, etc. Here we investigate whether the representation of animated virtual interviewers (VIs) affects responses in the same way that analogous attributes of human …

Interviewer Variation In Third Party Presence During Face-To-Face Interviews, Zeina N. Mneimneh, Julie De Jong, Jennifer Kelley

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

The presence of a third person in face-to-face interviews constitutes an important contextual factor that affects the interviewee's responses to culturally sensitive questions (Aquilino, 1997; Casterline and Chidambaram, 1984; Mneimneh et al., 2015; Pollner and Adams, 1994). Interviewers play an essential role in requesting, achieving, and reporting on the private setting of the interview. Our recent work has shown that the rate of interview privacy varies significantly across interviewers; while some interviewers report high rates of privacy among their interviews, others report low rates of privacy for the interviews they administered (Mneimneh et al., 2018). Yet, there is a lack …

The Cannell Legacy, Nancy A. Mathiowetz, Peter V. Miller

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Charles Cannell engineered the study of Interviewer-respondent interaction. He created conceptual frameworks for understanding the interviewing process and its impact on data quality. He invented methods for observing and recording interview interaction. He pioneered the use of randomized experiments in the survey context. He amalgamated insights from clinical and social psychology, sociology, group dynamics, as well as research on verbal and nonverbal communication to inform his work. This interdisciplinary approach has broadly influenced both interviewing research and practice. In this paper, we review Cannell’s many contributions to the field and his enduring legacy.

The Accuracy And Utility Of Using Paradata To Detect Interviewer Question-Reading Deviations, Jennifer Kelley

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Deviations from reading survey questions exactly as worded may change the validity of the questions, thus increasing measurement error. Hence, organizations train their interviewers to read questions verbatim. To ensure interviewers are reading questions verbatim, organizations rely on interview recordings. However, this takes a significant amount of resources. Therefore, some organizations are using paradata generated by the survey software, specifically timestamps, to try to detect when interviewers’ deviate from reading the question verbatim.

To monitor interviewers’ question reading behavior using timestamps, some organizations estimate the expected question administration time to establish a minimum and maximum question administration time thresholds (QATT). …

Interacting With Interviewers In Voice And Text Interviews On Smartphones, Michael Schober, Frederick Conrad, Christopher Antoun, Alison W. Bowers, Andrew L. Hupp, H. Yanna Yan

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

As people increasingly adopt SMS text messaging for communicating in their daily lives, texting becomes a potentially important way to interact with survey respondents, who may expect that they can communicate with survey researchers as they communicate with others. Thus far our evidence from analyses of 642 iPhone interviews suggests that text interviewing can lead to higher quality data (less satisficing, more disclosure) than voice interviews on the same device, whether the questions are asked by an interviewer or an automated system. Respondents also report high satisfaction with text interviews, with many reporting that text is more convenient because they …

Interviewer Falsification In Survey Research: Detection Methods And Impact Of Fraudulent Interviews, Silvia Schwanhäuser, Joseph Sakshaug, Yuliya Kosyakova, Frauke Kreuter

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

The role of the interviewer and sources of interviewer error in the survey data collection process are widely discussed topics in the survey methodology literature. An understudied problem in this context is the falsification of interview data by the interviewer. Research gaps concern, for example, how conclusions drawn from survey data are affected by falsified interviews. So far it is commonly assumed, that the possible effect of falsifications on univariate statistics can only be as high as the overall share of falsified data. Since the share of faked data is usually very low for most surveys, the problem is regarded …

Comparison Of Different Approaches To Evaluate And Explain Interviewer Effects, Geert Loosveldt, Celine Wuyts

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Within survey methodology it is common knowledge that interviewers in face-to-face or telephone interviews can have undesirable effects on the obtained answers. These effects can be created in an active way by, for example, asking suggestive questions or they can be obtained in a passive way as a consequence of certain interviewer characteristics eliciting socially desirable answers. These active and passive effects may differ from interviewer to interviewer. These differences between interviewers in systematic effects create additional variance in the data. The proportion of variance in a (substantive) variable that can be explained by the interviewers is the ‘so called’ …

Designing Studies For Comparing Interviewer Variance Components In Two Groups Of Survey Interviewers, Brady T. West

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Methodological studies of interviewer effects often seek to identify factors that influence the magnitude of interviewer variance for particular survey questions. There is a long history of work in this area, and results from studies like this have informed current interviewing practice. Unfortunately, many studies of this type suffer from one or more of the following limitations in terms of their designs: 1) a failure to randomly assign interviewers to the treatments being compared; 2) a failure to formally test for differences in the variance components between the two groups; and 3) insufficient statistical power for comparison of the variance …

Let’S Talk About Money! How Do Interviewer Expectations Affect Item Nonresponse To Income And Asset Questions?, Sabine Friedel

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Personal income and assets are sensitive topics to discuss and the discussion of money tends to be a taboo. This phenomenon is reflected by high nonresponse rates to items that address income and assets questions in interviewer-mediated surveys. However, such information is important to obtain, as household income and different types of assets are used as core variables in socio-economic models. Such item nonresponse is influenced by interviewers. Although interviewers are trained to conduct standardized interviews, some interviewers obtain a higher number of item nonresponses than others. This study examines interviewer effects on nonresponse to several income and asset questions …

Explaining Interviewer Effects On Survey Unit Nonresponse: A Cross-Survey Analysis, Daniela Ackermann-Piek, Annelies G. Blom, Julie M. Korbmacher, Ulrich Krieger

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

In interviewer-administered surveys, interviewers are involved in nearly all steps of the survey implementation. However, besides many positive aspects of interviewers’ involvement, they are – intentionally or unintentionally – a potential source of survey errors. In recent decades, a large body of literature has accumulated about measuring and explaining interviewer effects on survey unit nonresponse. Recently, West and Blom (2017) have published a research synthesis on factors explaining interviewer effects on various sources of survey error, including survey unit nonresponse. They find that previous research reports great variability across surveys in the significance and even direction of predictors of interviewer …

General Interviewing Techniques: Developing Evidence-Based Practices, Steve Coombs, Margaret Hudson, Lisa Holland, Nora Cate Schaeffer, Jennifer Dykema

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

This poster is a hands-on demonstration of the in-progress General Interviewer Techniques (GIT) materials described by Schaeffer, Dykema, Coombs, Schultz, Holland, and Hudson. Participants will be able to view and listen to the lesson materials, delivered via an online interface, and talk to the GIT developers.

Effects Of Innovative Motivational Strategies And New Staffing Model On Interviewer Attrition: A Data Collection Year In Review, Theresa Camelo, Maureen O’Brien

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

Due to high staff attrition and its negative effects on data collection and project cost, a large national study implemented motivational strategies and a new staffing model for the current data collection year. Motivational strategies included retention bonuses, organization gear, and other personalized recognitions. The new staffing model included both a change in weekly hour requirements as well as the number of interviewers staffed in each area. New staff, committed to 20 hours per week, were added to approximately half of the sampling areas with already existing 30 hour per week staff. Two Interviewers were now working a single area, …

Exploring The Mind Of The Interviewer: Findings From Research With Interviewers To Improve The Survey Process, Robin Kaplan, Erica Yu

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

The interviewers’ task in the data collection process is a complex one, with many judgments and decisions being made from moment to moment as they ask questions to get answers from respondents (Japec, 2008). Many survey organizations train their interviewers to use standardized language and read questions verbatim. However, in practice, interviewers may need to use a conversational approach and probe respondents to get the answers needed. This research explores the process by which interviewers make such decisions in real-time by conducting research with interviewers about their experiences collecting data. Using a cognitive interview approach, we asked interviewers about multiple …