Skip to content
  • There are no suggestions because the search field is empty.

Concept Test Quota Balancing & Distribution

Learn how to set quotas on concepts and balance demographics across concept samples.

At SightX, you can set quotas for concept tests to control how many times each concept is shown. You can also define how often each concept is viewed by specific demographic groups within your survey. Below, we explain how to set this up.

What's in this article:

  1. Define Views per Concept

  2. Balance Demographics Across Concepts

  3. Track Concept Views

  4. Video Tutorial

Tip: Before defining quotas on concept tests, make sure you've input the number of concepts that each respondent should see. For example, you may want each respondent to only evaluate one concept, or you may want respondents to go through the concept test for multiple concepts.

Define Views per Concept with Quotas

By default, SightX will try to achieve equal views of each concept in your concept test. However, you may want to set a specific number of views for each concept, track the views per concept, or set demographic quotas within each concept.  

In that case, you should set up quotas on your concept test:

  1. Navigate to the Distribute section and create a new campaign.
  2. Within your campaign, go to the Quotas page.
  3. Set your overall quota for how many respondents you want to participate in the campaign and click Save in the upper right corner of the screen.
  4. To set views per concept, select your concept test from the dropdown menu of survey questions.
  5. By default, SightX will populate the views per concept evenly for all concepts in the test. If you do not want each concept to be shown an equal number of times, you can edit the views. The total of all concept views must equal: 

    Overall Quota × Number of Concepts Shown per Respondent

  6. When you’re done setting quotas on this page, click the Save button in the upper right corner to apply your configuration.

Note: To achieve your desired views per concept, SightX uses a least-fill algorithm to assign respondents to  concepts based on the concepts that are furthest from reaching their views quotas.

If only one concept is shown to each respondent, the views per concept in the campaign will match the assigned quotas. However if each respondent sees more than one concept, there may be slight variance in the actual views from the requested quotas.

Balance Demographics Across Concepts

In addition to making sure concepts receive the same number of views, you may want the demographics of the respondents who evaluate each concept to be similar across each concept. If concepts are assigned purely based on least-fill, the demographics of the respondents for each may be skewed so that certain demographic groups are over- or underrepresented in some concepts. 

Consider a survey with the following demographic questions:

  • Gender:  Male, Female, Other
  • Age: 18-25, 26-35, 36-45, 46-55, 56+

Suppose your target sample distribution is:

Category

Segment

Quota

 

Gender

Male

30%

Female

50%

Other

20%

 

 

Age

18-25

25%

26-35

25%

36-45

20%

46-55

20%

56+

10%

SightX allows you to set up your quotas so that this distribution is applied within each concept, ensuring that each concept mirrors the intended demographic distribution of the total sample.

  1. Follow steps 1 through 5 above to set quotas on your concept views.
  2. Next, add the demographic questions you want to balance in your concepts, and set the quotas to your desired target sample distribution.
  3. In the concept test quota block, you'll see a section at the bottom for “Quota balancing within concepts”. Here, you can select the quotas that you want to link to the concept test. 
  4. Click Save to apply your configuration.

Track Concept Views

Once your campaign is live, you can monitor progress in the Quotas dashboard, where you’ll see how many times each concept has been viewed by each demographic group.

You can track how many times each concept has been viewed overall:

To see the demographic breakdown within each concept, click the chevron for a detailed breakdown.

You may notice that some quotas within your concept are shown as a range (e.g., 7–8). This indicates that the exact number of responses needed to match your target distribution is not a whole number. As a result, the final count will be rounded to either the lower or higher whole number.

Note on disqualifications: Respondents will be disqualified only if they are shown a single concept and that concept has already met its quota. If a respondent is shown more than one concept, they will not be disqualified.

Video Tutorial