Ranking questions ask respondents to rank items according to the question. They are commonly used to compare and rank preferences on different options. Conjoint.ly allows respondents to rank the options by click-and-drag, clicking the up and down buttons, and direct input.

Respondent view

Respondent view of the ranking question

Ranking question outputs

Ranking questions produce the following outputs:

  • The average position of each option. A lower average means a better position.
  • The ranking diagram which is a histogram that shows the percentage of ranks for each option.
  • The individual response which show the positions that each respondent ranked each option.
  • The number of participants who saw the question.
Ranking question outputs

Setting up a ranking question

Follow these steps to set up a ranking question:

1. Add question

Navigate to the Add questions tab and click on the Add question button at the bottom of the page.

On the Add or import questions pop-out, select the Add a new question tab and click on the Ranking question card to add it to the experiment.

Adding the ranking question

2. Edit question options

Once you add the question, you can adjust the following settings:

  1. Insert the question text in the text box. You can also include formatting and images.
  2. Edit the text boxes next to the bottom and top to change the hints for extremes. To add formatting or images to each hint, click on the settings for that hint. Then check the “Add fancy formatting and pictures to card” checkbox. You can then add formatting or images to the hint.
  3. To change the option text, edit the textbox next to each option. Similar to the hints, click on the settings for each option and check the “Add fancy formatting and pictures to card” checkbox to include formatting or images to the option.
  4. Click on Add option to add additional options.
  5. The order in which options are shown to respondents can be set to be fixed, random, or flip (left-to-right and right-to-left).
Ranking question setup