Quantitative, Qualitative, Comparative, and Historical Methodologies Commons^™

Behavior Change Techniques For Reducing Interviewer Contributions To Total Survey Error, Brad Edwards

Interviewer Workshop, 2019: Interviewers and Their Effects from a Total Survey Error Perspective

In the total survey error paradigm, nonsampling errors can be difficult to quantify, especially errors that occur in the data collection phase of face-to-face surveys. Field interviewers play “… dual roles as recruiters and data collectors…” (West et al, 2018), and are therefore potential contributors to both nonresponse error and measurement error. Recent advances in technology, paradata, and performance dashboards offer an opportunity to observe interviewer effects almost at the source in real time, and to intervene quickly to curtail them. Edwards, Maitland, and Connor (2017) report on an experimental program using rapid feedback of CARI coding results (within 72 …

Nasis: Nebraska Annual Social Indicators Survey -- Current Core Items, Bureau Of Sociological Research

Nebraska Annual Social Indicators Survey (NASIS)

The NASIS survey varies from year to year depending on client needs, but every year a core group of items consisting of common demographics and quality of life measures are included. These include, for example, age, sex, education, community satisfaction, etc (for complete list, see below). These items are asked each year to provide key demographic information to all users of NASIS as well as comparability to other social indicator information.

The core items were reduced in 2018 in an effort to keep NASIS costs as low as possible and reduce respondent burden. You can find the current core items …

2019 Winter Nasis: Nebraska Annual Social Indicators Survey Questionnaire, Bureau Of Sociological Research

Nebraska Annual Social Indicators Survey (NASIS)

75 questions; 12 pages

Nasis 2019: Nebraska Annual Social Indicators Survey Questionnaire, Bureau Of Sociological Research

Nebraska Annual Social Indicators Survey (NASIS)

We need your help to learn about how Nebraskans think, feel, and live. Researchers from the University of Nebraska and across the state are counting on your help to learn about a variety of issues. Your responses will help shape program and policy development in Nebraska now and into the future.

Life In Nebraska 1. Overall, how satisfied or dissatisfied are you with living in Nebraska? ...

196 questions; 12 pages

Drawing On Lgb Identity To Encourage Participation And Disclosure Of Sexual Orientation In Surveys, Mathew Stange, Jolene D. Smyth, Kristen M. Olson

Department of Sociology: Faculty Publications

This paper reports an experiment that tested how three survey cover designs—images of traditional families and individuals displaying themselves in typical gender ways; images of lesbian, gay, and bisexual (LGB) and heterosexual individuals and families; and no cover images—affected LGB people’s participation and disclosure of LGB identity and non-LGB people’s participation. Analyses showed the LGB-inclusive cover led to significantly more LGB respondents than the other designs, without significantly affecting the demographic, political, and religious makeup of the completed sample. We discuss what these findings mean for addressing two challenges: getting LGB people to respond to surveys and to disclose their …

Short Message Service Surveying With Homeless Youth: Findings From A 30-Day Study Of Sleeping Arrangements And Well-Being, Kimberly A. Tyler, Kristen Olson, Colleen M. Ray

Department of Sociology: Faculty Publications

Little is known about the location and consistency of sleeping arrangements among youth experiencing homelessness (YEH) and how this is linked to their well-being. This study addresses this gap using ecological momentary assessment (EMA) via short message service (SMS) surveying with 150 YEH over 30 days, to examine how various sleeping arrangements are associated with depression, marijuana use, support received, and service utilization. Results revealed that the average number of consecutive days youth stayed at any particular location varied considerably. Youth who stayed more frequently with a friend/partner or in a transitional living facility (TLF) reported fewer days of being …

Why Do Cell Phone Interviews Last Longer? A Behavior Coding Perspective, Jerry Timbrook, Kristen Olson, Jolene Smyth

Department of Sociology: Faculty Publications

Why do telephone interviews last longer on cell phones than landline phones? Common explanations for this phenomenon include differential selection into subsets of questions, activities outside the question-answer sequence (such as collecting contact information for cell-minute reimbursement), respondent characteristics, behaviors indicating disruption to respondents’ perception and comprehension, and behaviors indicating interviewer reactions to disruption. We find that the time difference persists even when we focus only on the question-answer portion of the interview and only on shared questions (i.e., eliminating the first two explanations above). To learn why the difference persists, we use behavior codes from the U.S./Japan Newspaper Opinion …

Using Ego Network Data To Inform Agent-Based Models Of Diffusion, Jeffrey A. Smith, Jessica Burow

Department of Sociology: Faculty Publications

Agent-based modeling holds great potential as an analytical tool. Agent-based models (ABMs) are, however, also vulnerable to critique, as they often employ stylized social worlds, with little connection to the actual environment in question. Given these concerns, there has been a recent call to more fully incorporate empirical data into ABMs. This article falls in this tradition, exploring the benefits of using sampled ego network data in ABMs of cultural diffusion. Thus, instead of relying on full network data, which can be difficult and costly to collect, or no empirical network data, which is convenient but not empirically grounded, we …

Essentials Of Structural Equation Modeling, Mustafa Emre Civelek

Zea E-Books Collection

Structural Equation Modeling is a statistical method increasingly used in scientific studies in the fields of Social Sciences. It is currently a preferred analysis method, especially in doctoral dissertations and academic researches. However, since many universities do not include this method in the curriculum of undergraduate and graduate courses, students and scholars try to solve the problems they encounter by using various books and internet resources.

This book aims to guide the researcher who wants to use this method in a way that is free from math expressions. It teaches the steps of a research program using structured equality modeling …

Nasis 2018: Nebraska Annual Social Indicators Survey Questionnaire, Bureau Of Sociological Research

Nebraska Annual Social Indicators Survey (NASIS)

100 questions; 12 pages

Comparing Survey Ranking Question Formats In Mail Surveys, Jolene Smyth, Kristen Olson, Allison Burke

Department of Sociology: Faculty Publications

Although questions that ask respondents to rank-order a list of items can be analytically valuable, responding to ranking questions typically requires a good deal of cognitive effort. This is especially true in mail questionnaires where the advantages of electronic response formats available in web surveys are inaccessible. In this article, we examine two alternative formats for ranking questions in mail surveys. Using a nationally representative mail survey of U.S. adults, this article experimentally compares ranking formats in which respondents write numbers in boxes versus selecting items for the most and second most important issues using a grid layout. Respondents to …

Item Location, The Interviewer–Respondent Interaction, And Responses To Battery Questions In Telephone Surveys, Kristen Olson, Jolene Smyth, Beth Cochran

Department of Sociology: Faculty Publications

Survey researchers often ask a series of attitudinal questions with a common question stem and response options, known as battery questions. Interviewers have substantial latitude in deciding how to administer these items, including whether to reread the common question stem on items after the first one or to probe respondents’ answers. Despite the ubiquity of use of these items, there is virtually no research on whether respondent and interviewer behaviors on battery questions differ over items in a battery or whether interview behaviors are associated with answers to these questions. This article uses a nationally representative telephone survey with audio-recorded …

The Effects Of Respondent And Question Characteristics On Respondent Answering Behaviors In Telephone Interviews, Kristen Olson, Jolene Smyth, Amanda Ganshert

Department of Sociology: Faculty Publications

In a standardized telephone interview, respondents ideally are able to provide an answer that easily fits the response task. Deviations from this ideal question answering behavior are behavioral manifestations of breakdowns in the cognitive response process and partially reveal mechanisms underlying measurement error, but little is known about what question characteristics or types of respondents are associated with what types of deviations. Evaluations of question problems tend to look at one question characteristic at a time; yet questions are comprised of multiple characteristics, some of which are easier to experimentally manipulate (e.g., presence of a definition) than others (e.g., attitude …

The Effects Of Mismatches Between Survey Question Stems And Response Options On Data Quality And Responses, Jolene Smyth, Kristen Olson

Department of Sociology: Faculty Publications

Several questionnaire design texts emphasize a dual role of question wording: the wording needs to express what is being measured and tell respondents how to answer. Researchers tend to focus heavily on the first of these goals, but sometimes overlook the second, resulting in question wording that does not match the response options provided (i.e., mismatches). Common examples are yes/no questions with ordinal or nominal response options, open-ended questions with closed-ended response options, and check-all-that apply questions with forced-choice response options. A slightly different type of mismatch utilizes a question stem that can be read as asking for two different …

Effects Of A Government-Academic Partnership: Has The Nsf-Census Bureau Research Network Helped Improve The U.S. Statistical System?, Daniel H. Weinberg,, John M. Abowd, Robert F. Belli, Noel Cressie, David C. Folch, S. H. Holan, Margaret C. Levenstein, Kristen Olson, Jerome P. Reiter, Matthew D. Shapiro, Jolene Smyth, Leen-Kiat Soh, Bruce D. Spencer, Seth E. Spielman, Lars Vilhuber, Christopher K. Wikle

Department of Sociology: Faculty Publications

The National Science Foundation-Census Bureau Research Network (NCRN) was established in 2011 to create interdisciplinary research nodes on methodological questions of interest and significance to the broader research community and to the Federal Statistical System (FSS), particularly to the Census Bureau. The activities to date have covered both fundamental and applied statistical research and have focused at least in part on the training of current and future generations of researchers in skills of relevance to surveys and alternative measurement of economic units, households, and persons. This article focuses on some of the key research findings of the eight nodes, organized …

Nebraska Annual Social Indicators Survey (Nasis) 2018 Methodology Report, Bureau Of Sociological Research

Nebraska Annual Social Indicators Survey (NASIS)

Introduction 3

Mode Selection 3

Design & Item Selection 3

Sampling Design 4

Experimental Design Treatment 4

Data Collection Process 4

Response Rate 5

Data-Entry Training, Supervision, and Quality Control 5

Processing of Completed Surveys 5

Data Cleaning 5

Representativeness of the Survey 6

NASIS Sample Weights 6

Figures 8

Tables 9

Appendix A: Cover Letter 11

Appendix B: Formatted Mail Survey 13

Appendix C: Future Interest Research Form 45

Appendix D: Reminder Postcard 46

Appendix E: County Codes 47

Appendix F: Variables and Descriptions 48

Nasis: Nebraska Annual Social Indicators Survey -- Previous Core Items, Bureau Of Sociological Research

Nebraska Annual Social Indicators Survey (NASIS)

The NASIS survey varies from year to year depending on client needs, but every year a core group of items consisting of common demographics and quality of life measures are included. These include, for example, age, sex, education, community satisfaction, etc (for complete list, see below). These items are asked each year to provide key demographic information to all users of NASIS as well as comparability to other social indicator information.

The core items were reduced in 2018 in an effort to keep NASIS costs as low as possible and reduce respondent burden. You can find the current core items …

The Diffusion Of Tolerance: Birth Cohort Changes In The Effects Of Education And Income On Political Tolerance, Philip Schwadel, Christopher R. H Garneau

Department of Sociology: Faculty Publications

Political tolerance—the willingness to extend civil liberties to traditionally stigmatized groups—is pivotal to the functioning of democracy and the well-being of members of stigmatized groups. Although political tolerance has traditionally been more common among American elites, we argue that as tolerance has increased, it has also diffused to less educated and less affluent segments of the population. The relative stability of political attitudes over the life course and the socialization of more recent birth cohorts in contexts of increased tolerance suggest that this diffusion of tolerance occurs across birth cohorts rather than time periods. Using age-period-cohort models and more than …

An Examination Of Sms-Related Nonresponse Bias, Matthew Hastings

Survey Research and Methodology Program: Dissertations, Theses, and Student Research

With the proliferation of mobile information and communications technologies, researchers face new opportunities for data collection and challenges to data quality. Short message service (SMS) or “text messaging” is a flexible mobile data service that can be incorporated into survey designs in a variety of ways. Given the many uses of SMS, I provide a framework for the use of SMS in the survey process which outlines the temporal location of three types of SMS-related nonresponse: SMS nonconsent, SMS nondelivery, and SMS noncooperation.

To better understand when SMS-related nonresponse might pose a risk of producing bias in survey estimates, I …

Who Do You Know: Improving And Exploring The Network Scale-Up Method, Patrick Habecker

Department of Sociology: Dissertations, Theses, and Student Research

The purpose of this dissertation was to examine ways to improve and explore the network scale-up method (NSUM). This dissertation improved the NSUM by proposing a new mean of sums (MoS) estimation process, improving recursive back-estimation techniques, exploring how NSUM design changes effected estimates of personal network size, what predicts having larger personal networks, and the cognitive process used by participants taking a NSUM survey. Data was collected from an address-based survey (n=617) of Nebraskans conducted in 2014 and a series of cognitive interviews (n=19) conducted in 2016.

The MoS estimator better predicted the size of a target group than …

Nasis 2017: Nebraska Annual Social Indicators Survey Questionnaire, Bureau Of Sociological Research

Nebraska Annual Social Indicators Survey (NASIS)

We need your help to learn about how Nebraskans think, feel, and live. Researchers from the University of Nebraska and across the state are counting on your help to learn about a variety of issues. Your responses will help shape program and policy development in Nebraska now and into the future.

125 questions; 16 pages

Nebraska Annual Social Indicators Survey (Nasis) 2016-2017 Methodology Report, Bureau Of Sociological Research

Nebraska Annual Social Indicators Survey (NASIS)

2016-2017 NASIS Methodology Report

Contents

Introduction 3

Mode Selection 3

Design and Item Selection 3

Sampling Design 4

Experimental Design Treatment 4

Data Collection Process 4

Response Rate 5

Data-Entry Training, Supervision, and Quality Control 5

Processing of Completed Surveys 5

Data Cleaning 5

NASIS Sample Weights 6

Design Effects 6

Questions 6

Estimate of Sampling Error 9

Appendices 10

Appendix A: Cover Letters 10

First Mailing – Version 1 (Long version with incentive) 10

First Mailing – Version 2 (Short version with incentive) 11

First Mailing – Version 3 (Long version with no incentive) 12

First Mailing – Version …

Social Isolation, Survey Nonresponse, And Nonresponse Bias: An Empirical Evaluation Using Social Network Data Within An Organization, Megumi Watanabe, Kristen Olson, Christina Falci

Department of Sociology: Faculty Publications

Survey researchers have long hypothesized that social isolation negatively affects the probability of survey participation and biases survey estimates. Previous research, however, has relied on proxy measures of isolation, such as being a marginalized group member within a population. We re-examine the relationship between social isolation and survey participation using direct measures of social isolation derived from social network data; specifically, instrumental research and expressive friendship connections among faculty within academic departments. Using a reconceptualization of social isolation, we find that social network isolation is negatively associated with unit response. Among women (a numerical minority group within the organization), we …

Within-Household Selection In Mail Surveys: Explicit Questions Are Better Than Cover Letter Instructions, Kristen Olson, Jolene Smyth

Department of Sociology: Faculty Publications

Randomly selecting a single adult within a household is one of the biggest challenges facing mail surveys. Yet obtaining a probability sample of adults within households is critical to having a probability sample of the US adult population. In this paper, we experimentally test three alternative placements of the within-household selection instructions in the National Health, Wellbeing, and Perspectives study (sample n = 6,000; respondent n = 998): (1) a standard cover letter informing the household to ask the person with the next birthday to complete the survey (control); (2) the control cover letter plus an instruction on the front …

The Republicanization Of Evangelical Protestants In The United States: An Examination Of The Sources Of Political Realignment, Philip Schwadel

Department of Sociology: Faculty Publications

Although the association between evangelical Protestant and Republican affiliations is now a fundamental aspect of American politics, this was not the case as recently as the early 1980s. Following work on secular political realignment and the issue evolution model of partisan change, I use four decades of repeated cross-sectional survey data to examine the dynamic correlates of evangelical Protestant and Republican affiliations, and how these factors promote changes in partisanship. Results show that evangelical Protestants have become relatively more likely to attend religious services and to oppose homosexuality, abortion, and welfare spending. Period-specific mediation models show that opposition to abortion, …

Wellbeing And Data Quality In The American Time Use Survey (Atus) From A Total Survey Error Perspective, Ana Lucía Córdova Cazar

Survey Research and Methodology Program: Dissertations, Theses, and Student Research

In this dissertation, I seek to develop a tool for the enhancement of time-use and wellbeing measures from a total survey error perspective. In particular, I evaluate the quality of the time use data produced in the American Time Use Survey (ATUS), by exploring its indicators and identifying its main predictors, including interview rapport. Results from these analyses are then used to evaluate the extent to which certain variables correlate, as predicted, with expected levels of wellbeing.

The first specific objective was to investigate the data quality of the 2010 ATUS by constructing a data quality index. In my dissertation, …

The Bureau Of Sociological Research At The University Of Nebraska–Lincoln: A Brief History 1964–2014, Michael R. Hill

Zea E-Books Collection

This volume is a provisional account of the origins and subsequent work of the Bureau of Sociological Research (BOSR) at the University of Nebraska–Lincoln (UNL). This study was prepared at the request of Julia McQuillan, Chair of the UNL Department of Sociology and a past BOSR Director, for the 50th anniversary celebration of the Bureau in April 2014.

This study falls within the field known generally as “the sociology of sociology” and this accounts for the devising of a typology of sociologies that delineates the intellectual field of play historically occupied by the Bureau of Sociological Research at the University …

Nebraska Annual Social Indicators Survey (Nasis) 2015-2016 Methodology Report, Bureau Of Sociological Research

Nebraska Annual Social Indicators Survey (NASIS)

Bureau of Sociological Research

2015-2016 NASIS Methodology Report

Contents

Introduction 3

Mode Selection 3

Design and Item Selection 3

Sampling Design 4

Experimental Design Treatment 4

Data Collection Process 4

Response Rate 5

Data-Entry Training, Supervision, and Quality Control 5

Processing of Completed Surveys 5

Data Cleaning 5

NASIS Sample Weights 6

Design Effects 6

Questions 6

Estimate of Sampling Error 9

Appendices 10

Appendix A: Cover Letters 10

First Mailing Cover Letter 10

Second Mailing Cover Letter 11

Appendix B: Survey Instrument 12

Version 1 (printed in black & white only) 12

Version 2 (printed in color) 28

Version …

Nasis 2016: Nebraska Annual Social Indicators Survey Questionnaire, Bureau Of Sociological Research

Nebraska Annual Social Indicators Survey (NASIS)

We need your help to learn about how Nebraskans think, feel, and live. Researchers from the University of Nebraska and across the state are counting on your help to learn about a variety of issues. Your responses will help shape program and policy development in Nebraska now and into the future.

127 questions; 16 pages

Using Data Mining To Predict The Occurrence Of Respondent Retrieval Strategies In Calendar Interviewing: The Quality Of Retrospective Reports, Robert Belli, L. Dee Miller, Tarek Al Baghal, Leen-Kiat Soh

Department of Psychology: Faculty Publications

Determining which verbal behaviors of interviewers and respondents are dependent on one another is a complex problem that can be facilitated via data-mining approaches. Data are derived from the interviews of 153 respondents of the Panel Study of Income Dynamics (PSID) who were interviewed about their life-course histories. Behavioral sequences of interviewer-respondent interactions that were most predictive of respondents spontaneously using parallel, timing, duration, and sequential retrieval strategies in their generation of answers were examined. We also examined which behavioral sequences were predictive of retrospective reporting data quality as shown by correspondence between calendar responses with responses collected in prior …