老牛影视

Skip to main content

4 Tips for Making Your Online Surveys Shine

Learn how to build stronger surveys in Qualtrics

A computer against a blue background.

Since she arrived at Duke in January, Shanon Jacobs has leaned on the online survey program, Qualtrics, to help organize virtual events.

Shanon Jacobs, program coordinator for Duke鈥檚 Math Department and the Department of Statistical Science鈥檚 TRIPODS Grant. From soliciting information from potential participants to gathering RSVPs and post-event feedback, the tool helps in many ways.

鈥淚 just created a really simple one the other day for our math awards ceremony,鈥 said Jacobs, program coordinator for Duke鈥檚  and the Department of Statistical Science鈥檚 . 鈥淚 asked what dates everyone could meet. I gave them four options, had them rank them and then we took it from there. It was super simple.鈥

Jacobs knows that Qualtrics, which Duke students, staff and faculty , has a deep well of features and capabilities that make it valuable for researchers who build elaborate surveys. But it works beautifully for relatively straightforward needs, too. 

鈥淚t has a lot of horsepower, but it鈥檚 great for both simple polls and heavy-duty data collection,鈥 she said.

Jacobs among few dozen Duke staff and faculty who attended the recent webinar, 鈥淢ake Informed Decisions with Qualtrics鈥 offered by Duke鈥檚 . 

鈥淟ike so many software systems and tools today, it鈥檚 got a hugely rich set of functions and capabilities,鈥 said Alexandra Cooper, associate director for education and training at the  and associate director of the Duke Initiative on Survey Methodology housed within SSRI.  鈥淪o it can be hard to know which of these are most useful and most important.鈥

Whether you鈥檙e a seasoned user of Qualtrics, or a beginner, here are a few useful tips for making surveys shine.

Save Your Participants Time

Duke Global Health Institute's Erin Gauldin.If your survey is going to the Duke community, you can automatically collect information such as people鈥檚 names and where they work or study by having them authenticate with their NetID.

In addition to no longer needing to ask respondents for identifying data, enabling the NetID login feature 鈥 by following these  鈥 also adds a layer of security to your results by ensuring the survey is only filled out by members of your intended audience.

Erin Gauldin, an academic advisor at the , said that after learning about the time-saving feature, she鈥檒l suggest using it for the many surveys she and her colleagues send to students.

鈥淚 do think it would be a nice thing to take off of people鈥檚 plates,鈥 Gauldin said

Avoid Agreement Bias

A common way to structure a survey question is to put forth a statement and ask respondents if they agree or disagree. 

Survey experts caution against the question structure due to a phenomenon called  or 鈥渁greement bias.鈥 That鈥檚 when survey takers, due to various societal factors, are more likely to choose the agree side of the question even if they don鈥檛 actually agree.

鈥淚nstead we ask questions like 鈥楬ow well does this describe you?鈥欌 Cooper said.

The alternative structure of asking respondents how well a statement describes them, and giving them a range of choices such as 鈥渆xtremely well鈥 or 鈥渘ot well at all,鈥 should yield more accurate data. 

And Qualtrics recognizes the effectiveness of this approach by auto-filling answer choices when you create a question using the 鈥渉ow well does this describe you?鈥 format.

Keep Mobile Devices in Mind

Alexandra CooperWhen building a survey, to keep your questions and answers options as short and concise as possible. That results in questions that are easier for users to understand and makes for an uncluttered look on mobile devices.

You can get a feel for how your survey will look on a mobile device by clicking the 鈥淧review鈥 option before publishing the survey.

鈥淪omething you often want to check when you鈥檙e setting up a survey is what it鈥檚 going to look like on different devices,鈥 Cooper said. 鈥淧articularly, if you鈥檙e creating it on a computer, see what it鈥檚 going to look like for somebody who鈥檚 taking this survey on a phone. And that鈥檚 a reason why keeping questions short, and not too wide, can be really useful.鈥

Make Your Survey Pop

When you create a survey, the default logo at the top may not be that of your part of Duke. If you want a different logo at the top, click on 鈥淟ook and Feel鈥 and go to the 鈥淭heme鈥 option to pick from ready-to-use logos from a wide range of Duke schools, departments and units, including a basic 老牛影视 logo.

Of you can select a blank survey option and build one with no logo at all, which, as Cooper can attest, can be useful in certain situations.

鈥淥ne time I was working with a group that was trying to survey nursing students at both Duke and UNC in March, which of course can be a controversial month between the two schools as the basketball season unfolds,鈥 she said. 鈥淭hey didn鈥檛 want the Duke label on the survey because they didn鈥檛 want the UNC students to refuse to answer, so in that case, you may want to go with something that doesn鈥檛 have a label at all and that鈥檚 another option.鈥

Send story ideas, shout-outs and photographs to Working老牛影视 through  or write working@duke.edu.