A Complete Guide to Creating and Managing Moderated Interviews in UserTest Pro

This document will guide you through every step of the moderated testing process. From setting up your first live session to scheduling participants, conducting interviews, managing recordings, and analyzing insights, you can confidently gather valuable, real-time feedback from your target users.

Notion.png

Quick Navigation

Section Topic Jump to
1 Pre-requisites Checklist Click here
2 Overview of the UserTest Pro Interface Click here
3 Understanding Moderated Tests Click here
4 Step-by-Step: Creating a New Moderated Test Click here
5 Common FAQs Click here
6 Understanding insights and test recordings Click here
  1. Pre-requisites Checklist Before you begin, please ensure you have the following:

    ✔ You have a client login to UserTest Pro

    ✔ You have a clear goal for your test

    ✔ You've identified your target testers or demographics

    ✔ Assets or prototype links (Prototype, website etc)

    ✔ Sufficient credits in your account or billing method set up

  2. Overview of the UserTest Pro Interface

    Once you log in, you will land on the Client Landing Page, designed for easy access to all essential tools. The interface has four main tabs:

  3. Understanding Moderated Tests

    Moderated tests on UserTest Pro are live, real-time user testing sessions conducted via a built-in video call interface. They allow researchers, designers, product managers, and others to interact directly with participants as they engage with a product or prototype.

    These sessions are ideal for gathering in-depth feedback, observing real-time reactions, and understanding user behavior closely. They are especially valuable for usability testing, early-stage concept validation, and complex user flows. To run a session, you define your goals, prepare tasks, and select participants from the UserTest Pro panel.

    Once scheduled, both participants and moderators receive invites and a link to join the live session, with no additional software needed. During the session, moderators can observe the user's screen, ask follow-up questions, and guide them while recording the session for later analysis.

  4. Step-by-Step: Creating a New Moderated Test

Step 1: Get Started

From the main Dashboard, click the **'Create New Test'** button to begin.

![Notion (1).png](attachment:cd01b9a6-f601-46f6-a703-b84e39ab6e06:8054ffba-4763-4030-9f9e-ef50d85cd2e3.png)

**Step 2: Select Test Type**

You will be asked what type of test you want to create. Select **'Moderated Test'** to proceed.

![Notion (2).png](attachment:14b50d94-6389-475d-9c98-2adb63a9ed02:Notion_(2).png)

**Step 3: Name Your Test**

Enter a clear and concise **'Test title/name'** that defines what is being tested. The name should summarize the objective to help testers understand the purpose at a glance.

<aside>
💡

**Best Practice:** To prevent bias and ensure honest screener responses, avoid including the specific name of your website or product in the test title.

**Bad Practice:** "Test for Instapay web app-Onboarding Flow"

**Good Practice:** "Web App - Onboarding Flow Usability"

</aside>

**Step 4: Describe Your Test**

Provide a **'Test description'** that gives a brief overview of what the test involves and what you expect from the tester. A good description helps set the right expectations and improves the quality of responses.

**Step 5: Provide the URL**

Enter the **URL** for the website or prototype that testers will interact with during the session.

- **Important Guidelines:**
    
    <aside>
    💡
    
    - Ensure the link is live and publicly accessible.
    - Do not use links that are password-protected unless you provide access credentials in the instructions.
    - For prototypes (e.g., Figma), use a shareable, view-only link.
    </aside>
    

**Step 6: Set Session Duration**

Select the session duration that best aligns with your research goals. You can choose between **30 Minutes** and **60 Minutes**.

![Notion (3).png](attachment:f1e129a1-4440-47b1-934d-d46155ac9072:Notion_(3).png)

**Step 7: Define Target Audience**

Customize your tester demographics to find the right participants.

1. **Age Range:** Enter the minimum and maximum age or use the 'Quick Select' options.
2. **Gender:** Choose the gender of participants.
3. **Location:** Select specific states and, optionally, narrow it down to cities.
4. **Responses Required:** Enter the number of participants you need. Note that each 30-minute session costs 5 credits & 60-minute session costs 
5. **Buy Credits:** If you don't have enough credits, you can purchase more.
6. **Save Audience:** You can save your audience settings for future use.
7. Click **'Next: Questions & Screeners'** to proceed.
    
    ![Notion (4).png](attachment:f083a105-4629-4d02-88fa-e142676807c9:Notion_(4).png)
    

**Step 8: Add Screener Questions**

Click **'Add Screener Questions'** to filter for the most relevant testers. This ensures participants meet specific criteria like behaviors or experiences.

- **Question Types:** You can choose between 'Single Select' and 'Multiple Select'.
    - **Single Select:** Best when you want testers to choose only one valid answer from options that rule each other out (e.g., "What is your primary role at work?").
    - **Multiple Select:** Best when you want testers to select all answers that apply from options that can coexist (e.g., "Which of the following tools have you used before?").
- **Answer Validation:** To control who qualifies, you can mark answers as:
    - **Approve:** The tester must choose this option to qualify.
    - **Reject:** Selecting this option will disqualify the tester.
    - **Ignore:** A neutral option that neither qualifies nor disqualifies the tester.

<aside>
💡

**Tips for Better Screening:**

- Avoid simple Yes/No questions.
- Limit your screener to 2-3 questions to avoid limiting your reach.
- Include a 'None of the Above' option to encourage honest responses.
</aside>

**Step 9: Prepare Session Tasks & Questions**

In this step, you will define the tasks for your testers. You have three options for creating them:

1. **Build from Scratch:** Manually write and structure each task for maximum flexibility.
2. **Auto-create with AI:** Let AI generate task suggestions based on your test title and goals, which you can then edit.
3. **Choose a Template:** Select from a library of ready-made templates tailored to common use cases.

![Notion (5).png](attachment:0a7ece2f-9cf4-463d-9756-d8e97f04cece:Notion_(5).png)

**Step 10: Schedule & Publish**

![Notion (6).png](attachment:712e824c-9e20-43f0-a8fc-6e29b3285a61:f25578d4-ae49-4592-ab04-c4d65f0c2f38.png)

This is the final step before your test goes live.

1. **Invite Collaborators:** Add internal team members who can moderate or observe the test.
2. **Set Availability Schedule:** Define the date range, times, and days when participants can book sessions.
3. **Generate Slots:** Click **'Generate Slots'** to create the available time slots based on your schedule.
4. **Publish Test:** Once you are satisfied with the schedule, click **'Publish Test'** to make it live for participants to book.
  1. Common FAQs

Support

If you need assistance or have any questions, please contact us at [email protected]

Our support team will respond within 3 business days.

👉 Visit this page to learn how to analyze test insights, view demographic data and review individual user recordings