Can I fix the order of diagnostics in Claims Test or Product Variant Selector?


In this article, we will help you compare the two approaches in setting up diagnostics questions. We will also look into the differences in terms of output. Then, you can decide which method works best for you.

Conjoint.ly will randomize the order of diagnostics questions for your claims in Claims Test or product idea in Product Variant Selector by default to reduce bias as much as possible.

If you need diagnostics questions to show in a certain fixed order across all claims or product ideas, the alternative for this will be to set up the diagnostics section as a Monadic block under Additional questions section. While this allows you greater flexibility in controlling the order of sequence of diagnostic questions, it is important to consider a few key differences in terms of setup and reporting from using a standard Claims Test or Product Variant Selector approach.

Difference in set-up

Standard approach

Monadic block under Additional questions

You might notice that the question id starts with the alphabet D. For example, D1, D2, D3, and so on.


Diagnostics under Diagnostic questions

While the look and feel might look very similar to the standard approach, take note that the question id starts with Q, and more importantly, there will be a difference in the output, explained below.


Diagnostics as Monadic block under Additional questions

Difference in the Output

The main differences in these two different approaches of asking Diagnostic questions would be the way the data will be presented.

Standard approach

Monadic block under Additional questions

1. Standard diagnostic outputs are available on Conjoint.ly dashboard.


Insights - Diagnostics under Diagnostic questions

1. Standard monadic block outputs for each diagnostic are available on Conjoint.ly dashboard. Standard diagnostic outputs are not available.


Insights - Diagnostics as Monadic block under Additional questions

2. In Excel report, data will appear under Diagnostic responses tab. Example:


Data - Diagnostics under Diagnostic questions

2. In Excel report, data will appear under Respondents tab. Example:


Data - Diagnostics as Monadic block under Additional questions


Thank you for reading through this article! Now that you understand the key differences in terms of set-up and output for both approaches, you can decide which option works best for you. We recommend using the standard approach for a more automated data analysis experience.