What is an 'Order Rank' question on OpinionX?
Order Rank is drag-and-drop question format on OpinionX for ranking a list of opinion statements.
When should I use a Order Rank question?
Order Rank questions are great for simple drag-and-drop lists of up to 10 options. For 10+ opinions, we recommend using the Pair Rank method instead, which breaks the list down into head-to-head pair votes and is better suited for long lists
How are the Order Rank scores calculated?
Order Rank on OpinionX is based on a Borda Count format called "The Dowdall Method". When a participant submits their ranked list, each opinion is scored 100/rank. For example, 4th would get 100/4 = 25 points. If a participant excludes an opinion from their ranked list, the opinion gets 0 points. The overall score for each opinion is average(sum of all scores).
Example Order Rank submission table for an individual participant:
Participant1 | Opinion | Formula | Score |
1st | Green | 100/1 | 100 |
2nd | Blue | 100/2 | 50 |
3rd | Red | 100/3 | 33.333... |
4th | Yellow | 100/4 | 25 |
Excluded | Grey | 0 | 0 |
Here's how those scores look on a graph:
Can I set a minimum or maximum number of options that must be ranked by each participant?
Yes! Open the block settings in the bottom-right corner while editing your Order Rank block and enable the "Set Mix/Max Votes". Note: this feature is available to customers on our Analyze tier or higher.
Can participants add a custom answer to the Order Rank list?
Yes! You can allow participants to submit a custom response and then rank it as part of the overall list of options in an Order Rank block:
To add this feature to your survey, go to the Survey Setup Tab, go to your Order Rank block, click the settings icon (⚙️), and enable the Add 'Other' Option checkbox.
On the Overview Tab, your Order Rank results will include a generic "Other" option that combines the scores allocated by all participants. Over on the Participants Tab you can view the custom responses that each individual participant submitted and the ranked position or points they allocated to their own custom response:
How many ranking options can I include in an Order Rank question?
There is no limit to the number of Order Rank options you can include, regardless of which pricing plan you're on. Everyone can add unlimited questions/blocks and unlimited options to each block.
Do Order Rank questions work on mobile devices?
Yes. All OpinionX question-types are designed to be suitable for participants on any web browser, whether that's a desktop monitor, laptop, tablet or smartphone.
Can I use emojis or images in my Order Rank block?
Yes! You can use emojis in any text field on OpinionX. To add images to your Order Rank block, just click the +image icon on the right side of the option text field (check out the screenshot example below!).
The "Hero" image is a single image that appears to participants at the top of their survey screen above the question text. The "Ranking" image is the option that appears in the survey itself for participants to vote on. Here's another screenshot with the difference labelled:
I have a question about Order Rank blocks that wasn't answered :(
Send us a message using our live chat or email [email protected] to get a quick answer from the OpinionX team.