Relevance & Research Question

Reducing nonresponse bias in the recruitment to probability-based online access panels is essential for any panel striving to achieve accurate inferential statistics. However, certain groups of the population tend to be more difficult to recruit. For example, research have identified that foreign-born individuals and individuals with less educational attainment were more difficult to recruit. Targeted efforts to enhance recruitment and reduce breakoffs in these groups might be especially efficient for reducing potential nonresponse bias. The present study assessed whether simplified invitation letters increased recruitment and reduced breakoffs in a probability-based web panel and whether a simplified language improved those rates even more so among hard-to-recruit subgroups of the population.

Methods & Data

In a probability-based recruitment to the Swedish Citizen Panel (SCP) conducted in fall 2024, the sample was randomly assigned into one of two groups; One group (N = 9,000) were assigned to receive an invitation and reminder letter with the standard language typically used in SCP recruitment. The experimental group (N = 9,000) received a revised version of the letter, written in simpler language that avoided academic jargon and words with many syllables.

Results

Data will be collected in November-December 2024 and will be analyzed and reported in an updated abstract in early January 2025. The effects on recruitment and breakoffs will be analyzed for the full sample, as well as for subgroups based on register information on sex, age, education and immigrant background.

Added Value

The present experiment will demonstrate whether simplified invitation letters increase recruitment rates and decrease breakoffs in a probability-based online access panel, with a particular focus on the impact among hard-to-recruit populations. Simplified invitation letters may offer a cost-effective method to boost recruitment- and breakoff rates as well as reduce demographic skewness, and, in turn, nonresponse bias.

Relevance & Research Question
Diary-based household budget surveys are often burdensome, as respondents must manually log details (e.g., product type, quantity, price) for each purchase over time. A smartphone app that allows participants to upload photos of shopping receipts could reduce this burden and increase survey participation. However, requiring an app that accesses the camera may raise privacy concerns, potentially affecting willingness to participate. This study investigates the influence of highlighting the app's camera feature in the invitation on both response rates and camera usage in the diary.
Methods & Data
In November 2024, a sample of over 7,000 individuals in Germany who’s addresses were drawn from residents’ registration office lists were invited to participate in a smartphone-based household budget survey. Invitation letters included a QR code, URL, and personalized login credentials for the AusgabenAtlas app, compatible with Android and iOS devices. Participants were asked to log their daily spendings in a two-week diary, with the option to use the camera function for receipt uploads or input data manually. Sample members were randomly assigned to one of three invitation treatments that varied in how the camera feature was framed: (1) no mention of the camera feature, (2) mention of the camera feature, and (3) mention of the camera feature with additional emphasis on the effort required.
Results
Data collection will conclude in December 2024, with preliminary findings available in January 2025. We will examine the effect of the invitation treatment on survey response rates and camera feature usage within the app.
Added Value
This research is part of the Smart Survey Implementation (SSI) Project, funded by EUROSTAT, which aims to enhance data collection for official statistics across Europe through digital innovation. This experiment specifically addresses recruitment challenges in app-based surveys and evaluates the potential of mobile technology to streamline participation in official household budget surveys.

GOR 2025 Conference

Ask Me Now or Lose Me Later – The Impact of Immediate Follow-Up on Participation Rates, Retention and Data Quality in Web Panels

Tilda Ekström, Alexandra Garcia Nilsson, and Anders Carlander

Relevance & Research Question: Ensuring high participation rates and respondent retention is essential for sample and data quality in web panels. This study examined whether the time interval between recruitment and invitation to a respondent’s first panel wave affected their likelihood to participate, of unsubscribing from the panel, and the quality of their survey responses. Drawing on Construal Level Theory (CLT), we posit that a longer interval may increase psychological distance and therefore decrease engagement in the web panel. By varying the time between recruitment and the first survey invitation, we aim to present optimal strategies to enhance participation and reduce attrition in web panels.

Methods & Data: This study employed an experimental design using a newly recruited (spring 2024) non-probability sample of panelists (N = 3,140) from the Swedish Citizen Panel. Half of the sample (n = 1,570) were randomly assigned to receive their first panel wave invitation shortly after being recruited, whereas the other half (n = 1,570) were assigned to receive their first invitation six months after being recruited. Both groups responded to the same survey in December 2024.

Results: Data will be collected in December 2024 and will be analyzed and reported in an updated abstract in early January 2025.

Added Value: Understanding the timing of follow-up surveys after recruitment may be essential for deciding whether panelists benefit from an immediate invitation to complete a panel wave shortly after being recruited or if delaying the invitation may be detrimental for engagement. Our findings provide insights for the management of web panels and strategies on newly recruited panelists to reduce dropout rates and improve data quality.