Using Qualtrics

From Addiction Research Laboratory
Jump to: navigation, search

General Use:

1. Log into Qualtrics using https://survey.wisc.edu and your Wisc NetID and password.


2. To create a survey, go to My Surveys -- Create Survey, Quick Survey Builder.


3. Name your survey and select or create a folder in your account to file the survey in.


4. You will have the option to create new items (type in or copy and paste from existing docs) OR to import items from other surveys. To make a survey battery for a study, you can import entire questionnaires (e.g. DAST, DBQ, Medical Screening Questionnaire) from the ARL library. You can also select individual questions instead of importing the entire survey (probably helpful for Phone Screens, etc).


Skip Logic

1. Skip Logic is a handy tool for when certain questions do not apply given a particular response on an earlier item. For example, if the question "Are you a smoker?" is on your survey, followed by several questions about smoking behavior, you would probably want to use skip logic.

After the questions are entered into your survey, click on the "Are you a smoker?" item and select Skip Logic from the right hand menu.


2. Within the Skip Logic, you would select If "No" is "Selected" skip to "[next non-smoking related question]" or you could also skip to the end of the survey if that completes the survey.


3. Skip Logic is also convenient for phone screens and in-person screens. You create the skip logic so that if someone responds to a question that would disqualify them from participation, the survey automatically skips to the end (e.g., to some Disqualifying script the RA could read to the participant). This makes screening easier for RAs and ideally, less prone to human error.

There are some caveats, however, such as when an RA is not sure whether a psychological condition or medication would disqualify the participant. In this case, it may be a good idea to have a Skip Logic on an item called "Unsure" that takes the RA to a script to read the participant that indicates further consultation is necessary re: eligibility (see: Hefner2 Phone Screen).


Display Logic

1. Display Logic is like Skip Logic except that you set this if you only want a question displayed based on responses to some earlier question. For example, you might want to only display "You qualify for the study..." and then instructions for the RA to schedule a participant IF the participant has not been disqualified. You may need to create several Display Logics to accomplish this. For example, If "Disqualify" is "Not Selected" AND "Unsure" is "Not Selected," Display "QUALIFIED...." etc.


2. Test it out. With both Skip Logic and Display Logic, it is especially important to "Preview Survey" as you go to make sure that things are showing up the way you want them to. To avoid having to fill in every item while you test, you can click "Skip Validation" while in Preview Survey mode (this saves time).


Branching (from Qualtrics)

Tutorial video on branching


Branching can be useful if you want participants to skip or jump to questions based on the responses they give to a certain question. Branching is like display logic for blocks. Create a branch in your Survey Flow with the condition that if the respondent answers a question a certain way, they will see whatever block you place under the branch.


Question Types and Qualtrics Quirks

1. The default question type is Multiple Choice. You can easily change how many response options there are on the right side of the screen (make sure to have question highlighted).


2. To set number of multiple choice options for multiple questions, the easiest way seems to be to set the first question with the desired number of response options, and then "Copy Question" from the right side menu. Copy as many items as you need for that survey. This is probably easiest before you have typed in the first question to avoid any confusion.


3. To use a different question type, select Change Item Type on the right side menu. You will probably want to go to the bottom of this drop-down menu and click on "Show All Question Types," otherwise only limited types are shown. If you scroll your mouse over the options, each type of question will by displayed in the left portion of the menu.


4. For ALMOST all items, you will want to select "Force Response" on the right side menu. This means that the question must be answered to continue with the survey, and insures that participants (or RAs) do not skip questions, intentionally or unintentionally. You will have to do this for each item so it is best to do it as you go -- Qualtrics does not have a way to apply Force Response to all items in a survey at present.


5. Qualtrics has some funky ways it prefers you to display questions for what they call "Accessibility." For example, in a questionnaire involving Likert responses to several items (e.g., Marijuana Withdrawal Checklist), Qualtrics wants you to put ALL items within 1 Qualtrics "question." This can be problematic if the questionnaire is so long, that once you get to the bottom items, you cannot read the Likert options at the top without scrolling back up on the screen. To ameliorate this problem, you can create a few Qualtrics items with 1/2 or 1/3 of the questionnaire items and break it apart so Likert responses are still visible. Alternatively, you can select "Repeat Headers" but the display isn't quite as nice.


6. Be very careful not to delete questions accidentally (clicking on the red minus sign next to a question). However, if you do accidentally delete a question, they are kept in the trash at the bottom of the screen temporarily, and you can restore them.

Distributing Your Survey for Study Use

1. Once your survey battery is complete, you will want to password protect it before you distribute it so that any random person doesn't fill it out. To do this, click on "Survey Options" and check off "Password Protect." MAKE SURE TO ENTER A PASSWORD -- Qualtrics won't prompt you if you don't.


2. You can also select "Back Button" to allow participants to go back while completing the survey. This may be desirable for Phone Screens and other RA-administered surveys as well.


3. Click "Launch Survey" -- this will give you a unique survey link.


4. Post the link to the wiki page: ARL Wiki Self-Report Measures under a heading for your study and give it a name.

4a. You can also distribute the survey via email: either by emailing the link directly or selecting Survey Options - Survey Protection -- By Invitation Only.


5. Once you distribute your survey, you may want to have others (e.g., RAs) further test it out. Their responses will be stored -- make sure to delete these responses before using the survey in your study to avoid confusion. It is generally a good idea to include "study ID" on each Qualtrics survey and use dummy IDs for testing/practice runs.


6. Once you distribute your survey, you can still make changes. The link will remain the same -- no need to repost it. However, if you make changes to items (as opposed to editing Survey Options), Qualtrics will warn you that the survey has already been distributed, which could be problematic.

Adding a survey to the ARL Libary

1. When you have completed a survey (e.g., a new individual measure such as the Beck Depression Inventory) and want to add it to the ARL Libary, click on "Library" then "Addiction Research Library -- # Surveys"


2. In the top right corner, click on "Copy a survey to this library."


3. Select the source survey, select a folder for it within the ARL library, and name the survey (should be the same as original name in most cases). When selecting a folder, try to keep the organization (an alcohol related measure in the alcohol folder etc.).


4. Surveys within the ARL Library are static. If you edit the survey because it has errors, you will need to delete the old version from the ARL and copy the updated version to the ARL Library. Qualtrics will let you copy multiple surveys with the same name, so deleting the old version from the ARL library first will reduce confusion.


5. Please copy all the surveys you create so that we don't need to reinvent the wheel! ;-)


NOTE: Your surveys will are stored in your "account," not your personal Library, unless you copy them there. Your Library will be static like the ARL Libary is static. **Keep your individual study batteries ONLY in your account, not the ARL Library or account.** This will prevent others from being able to see or unintentionally alter/delete confidential data.

Enter/Return Key for Next question

To use the Enter/Return Key instead of clicking the Next or >> Button to continue to the next page or question first select your question in the Qualtrics editor. Click on he purple button with the gear (Advanced Question Options), and select Add JavaScript. Past this code into the JavaScript window:

var that = this;

 Event.observe(document,'keydown',function(e){
 if (e.keyCode == 13) //'r' was pressed
 {
 that.clickNextButton();
 }

 });

Branching

Tutorial video on branching Branching can be useful if you want participants to skip or jump to questions based on the responses they give to a certain question. Branching is like display logic for blocks. Create a branch in your Survey Flow with the condition that if the respondent answers a question a certain way, they will see whatever block you place under the branch.


FAQ

How can I take my survey multiple times on the same computer?

You can use the anonymous link to your survey on multiple computers at multiple times. As long as you leave the "Save and Continue" and "Prevent Ballot Box Stuffing" options unchecked in your survey options then you can take it over and over.

Is there a way to have one button on every page (eg near the Next/Previous buttons) that allows me to skip to the same specific question every time I click it (ie if the interview ends early)?

There is not a way to put a button on every page that allows you to submit the survey at any time. You can, however, close the browser at any time because the data saves every time the "next" button is pushed. You can then close out all 'partial' responses.


Help

1. Qualtrics has great documentation if you need extra help. This link will get you everything you need.

2. General Qualtrics helpful tips can be found here:

Survey Resources

Best Practices

Survey Help

3. Qualtrics Administration. For changing administrative contacts; adding, deleting, or getting lists of permitted users for our library; etc.: email survey-admins@lists.wisc.edu.