Open Access. Powered by Scholars. Published by Universities.®

Family, Life Course, and Society

Department of Sociology: Faculty Publications

Questionnaire design

Publication Year

Articles 1 - 4 of 4

Full-Text Articles in Quantitative, Qualitative, Comparative, and Historical Methodologies

Are Self-Description Scales Better Than Agree/Disagree Scales?, Jerry Timbrook, Jolene Smyth, Kristen M. Olson Jan 2020

Are Self-Description Scales Better Than Agree/Disagree Scales?, Jerry Timbrook, Jolene Smyth, Kristen M. Olson

Department of Sociology: Faculty Publications

Questions using agree/disagree (A/D) scales are ubiquitous in survey research because they save time and space on questionnaires through display in grids, but they have also been criticized for being prone to acquiescent reports. Alternatively, questions using self-description (SD) scales (asking respondents how well a statement describes them from Completely to Not at All) can also be presented in grids or with a common question stem, and by omitting the word agree, SD scales may reduce acquiescence. However, no research has examined how response patterns may differ across A/D and SD scales. In this article, we compare survey …


The Effect Of Question Characteristics On Question Reading Behaviors In Telephone Surveys, Kristen M. Olson, Jolene Smyth, Antje Kirchner Jan 2020

The Effect Of Question Characteristics On Question Reading Behaviors In Telephone Surveys, Kristen M. Olson, Jolene Smyth, Antje Kirchner

Department of Sociology: Faculty Publications

Asking questions fluently, exactly as worded, and at a reasonable pace is a fundamental part of a survey interviewer’s role. Doing so allows the question to be asked as intended by the researcher and may decrease the risk of measurement error and contribute to rapport. Despite the central importance placed on reading questions exactly as worded, interviewers commonly misread questions, and it is not always clear why. Thus, understanding the risk of measurement error requires understanding how different interviewers, respondents, and question features may trigger question reading problems. In this article, we evaluate the effects of question features on question …


Comparing Survey Ranking Question Formats In Mail Surveys, Jolene Smyth, Kristen Olson, Allison Burke Jan 2018

Comparing Survey Ranking Question Formats In Mail Surveys, Jolene Smyth, Kristen Olson, Allison Burke

Department of Sociology: Faculty Publications

Although questions that ask respondents to rank-order a list of items can be analytically valuable, responding to ranking questions typically requires a good deal of cognitive effort. This is especially true in mail questionnaires where the advantages of electronic response formats available in web surveys are inaccessible. In this article, we examine two alternative formats for ranking questions in mail surveys. Using a nationally representative mail survey of U.S. adults, this article experimentally compares ranking formats in which respondents write numbers in boxes versus selecting items for the most and second most important issues using a grid layout. Respondents to …


The Effects Of Mismatches Between Survey Question Stems And Response Options On Data Quality And Responses, Jolene Smyth, Kristen Olson Jan 2018

The Effects Of Mismatches Between Survey Question Stems And Response Options On Data Quality And Responses, Jolene Smyth, Kristen Olson

Department of Sociology: Faculty Publications

Several questionnaire design texts emphasize a dual role of question wording: the wording needs to express what is being measured and tell respondents how to answer. Researchers tend to focus heavily on the first of these goals, but sometimes overlook the second, resulting in question wording that does not match the response options provided (i.e., mismatches). Common examples are yes/no questions with ordinal or nominal response options, open-ended questions with closed-ended response options, and check-all-that apply questions with forced-choice response options. A slightly different type of mismatch utilizes a question stem that can be read as asking for two different …