Open Access. Powered by Scholars. Published by Universities.®
Social and Behavioral Sciences Commons™
Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 8 of 8
Full-Text Articles in Social and Behavioral Sciences
Your Best Estimate Is Fine. Or Is It?, Jerry Timbrook, Kristen Olson, Jolene D. Smyth
Your Best Estimate Is Fine. Or Is It?, Jerry Timbrook, Kristen Olson, Jolene D. Smyth
Department of Sociology: Faculty Publications
Providing an exact answer to open-ended numeric questions can be a burdensome task for respondents. Researchers often assume that adding an invitation to estimate (e.g., “Your best estimate is fine”) to these questions reduces cognitive burden, and in turn, reduces rates of undesirable response behaviors like item nonresponse, nonsubstantive answers, and answers that must be processed into a final response (e.g., qualified answers like “about 12” and ranges). Yet there is little research investigating this claim. Additionally, explicitly inviting estimation may lead respondents to round their answers, which may affect survey estimates. In this study, we investigate the effect of …
The Effect Of Emphasis In Telephone Survey Questions On Survey Measurement Quality, Kristen M. Olson, Jolene Smyth
The Effect Of Emphasis In Telephone Survey Questions On Survey Measurement Quality, Kristen M. Olson, Jolene Smyth
Department of Sociology: Faculty Publications
Questionnaire design texts commonly recommend emphasizing important words, including capitalization or underlining, to promote their processing by the respondent. In self-administered surveys, respondents can see the emphasis, but in an interviewer-administered survey, emphasis has to be communicated to respondents through audible signals. We report the results of experiments in two US telephone surveys in which telephone survey questions were presented to interviewers either with or without emphasis. We examine whether emphasis changes substantive answers to survey questions, whether interviewers actually engage in verbal emphasis behaviors, and whether emphasis changes the interviewer- respondent interaction. We find surprisingly little effect of the …
Are Self-Description Scales Better Than Agree/Disagree Scales?, Jerry Timbrook, Jolene Smyth, Kristen M. Olson
Are Self-Description Scales Better Than Agree/Disagree Scales?, Jerry Timbrook, Jolene Smyth, Kristen M. Olson
Department of Sociology: Faculty Publications
Questions using agree/disagree (A/D) scales are ubiquitous in survey research because they save time and space on questionnaires through display in grids, but they have also been criticized for being prone to acquiescent reports. Alternatively, questions using self-description (SD) scales (asking respondents how well a statement describes them from Completely to Not at All) can also be presented in grids or with a common question stem, and by omitting the word agree, SD scales may reduce acquiescence. However, no research has examined how response patterns may differ across A/D and SD scales. In this article, we compare survey …
The Effect Of Question Characteristics On Question Reading Behaviors In Telephone Surveys, Kristen M. Olson, Jolene Smyth, Antje Kirchner
The Effect Of Question Characteristics On Question Reading Behaviors In Telephone Surveys, Kristen M. Olson, Jolene Smyth, Antje Kirchner
Department of Sociology: Faculty Publications
Asking questions fluently, exactly as worded, and at a reasonable pace is a fundamental part of a survey interviewer’s role. Doing so allows the question to be asked as intended by the researcher and may decrease the risk of measurement error and contribute to rapport. Despite the central importance placed on reading questions exactly as worded, interviewers commonly misread questions, and it is not always clear why. Thus, understanding the risk of measurement error requires understanding how different interviewers, respondents, and question features may trigger question reading problems. In this article, we evaluate the effects of question features on question …
Comparing Survey Ranking Question Formats In Mail Surveys, Jolene Smyth, Kristen Olson, Allison Burke
Comparing Survey Ranking Question Formats In Mail Surveys, Jolene Smyth, Kristen Olson, Allison Burke
Department of Sociology: Faculty Publications
Although questions that ask respondents to rank-order a list of items can be analytically valuable, responding to ranking questions typically requires a good deal of cognitive effort. This is especially true in mail questionnaires where the advantages of electronic response formats available in web surveys are inaccessible. In this article, we examine two alternative formats for ranking questions in mail surveys. Using a nationally representative mail survey of U.S. adults, this article experimentally compares ranking formats in which respondents write numbers in boxes versus selecting items for the most and second most important issues using a grid layout. Respondents to …
The Effects Of Mismatches Between Survey Question Stems And Response Options On Data Quality And Responses, Jolene Smyth, Kristen Olson
The Effects Of Mismatches Between Survey Question Stems And Response Options On Data Quality And Responses, Jolene Smyth, Kristen Olson
Department of Sociology: Faculty Publications
Several questionnaire design texts emphasize a dual role of question wording: the wording needs to express what is being measured and tell respondents how to answer. Researchers tend to focus heavily on the first of these goals, but sometimes overlook the second, resulting in question wording that does not match the response options provided (i.e., mismatches). Common examples are yes/no questions with ordinal or nominal response options, open-ended questions with closed-ended response options, and check-all-that apply questions with forced-choice response options. A slightly different type of mismatch utilizes a question stem that can be read as asking for two different …
The Effect Of Cati Questions, Respondents, And Interviewers On Response Time, Kristen Olson, Jolene D. Smyth
The Effect Of Cati Questions, Respondents, And Interviewers On Response Time, Kristen Olson, Jolene D. Smyth
Department of Sociology: Faculty Publications
In this paper, we evaluate the joint effects of question, respondent, and interviewer characteristics on response time in a telephone survey. We include question features traditionally examined, such as the length of the question and format of response options, and features that have yet to be examined that are related to the layout and format of interviewer-administered questions. We examine how these question features affect the time to ask and answer survey questions and how different interviewers vary in their administration of these questions. This paper uses paradata from the Work and Leisure Today survey and uses cross-classified random effects …
Effects Of Using Visual Design Principles To Group Response Options In Web Surveys, Jolene D. Smyth, Don A. Dillman, Leah M. Christian, Michael J. Stern
Effects Of Using Visual Design Principles To Group Response Options In Web Surveys, Jolene D. Smyth, Don A. Dillman, Leah M. Christian, Michael J. Stern
Department of Sociology: Faculty Publications
In this paper, we show that in Web questionnaires verbal and visual languages can be used to create groups and subgroups of information, which influence how respondents process Web questionnaires. Following Schwarz (1996; and also Schwarz, Grayson, & Knäuper, 1998) we argue that respondents act as cooperative communicators who use formal features of the questionnaire to help guide them through the survey conversation. Using data from three Web surveys of random samples of Washington State University undergraduates, we found that when response options are placed in close graphical proximity to each other and separated from other options, respondents perceive visual …