Among visitors entering a webinar funnel, our shorter, conversational pre-lander led on later applications, with a historical 99.07% win probability. Over 11 days, initial opt-ins rose from 21.12% to 32.05%, a published 51.77% relative lift. Length, tone and answer effort changed together, so test the complete invitation first and keep later applications as the decision metric. Unlike a qualification form, this form helped people enter the webinar.
What we changed before the webinar
Visitors came from an ad to the pre-lander, watched the webinar, then completed an application to request a consultation. The original form asked three long, serious, problem-focused questions. It was thoughtful, but heavy: like being handed a detailed questionnaire before you have even sat down.
| Dimension | Control | Treatment |
|---|---|---|
| Reading effort | Long questions and answers | Short questions and quick answer choices |
| Tone | Serious and problem-focused | Conversational, emotionally reflective and low pressure |
| Position | Before the webinar | Before the same webinar |
We wanted the answers to be easy to recognize, so completing the form felt like a short conversation. Length, tone, answer effort and emotional framing changed together; a follow-up would need to vary them separately to identify which mattered.
Applications first, opt-ins second
We chose application submission after the webinar as the primary metric, and pre-lander opt-in completion as the secondary metric. Making the first step easier was useful only if visitors continued towards the consultation.
| Metric | Control | Treatment | Historical result |
|---|---|---|---|
| Primary: later application submission | — | 2.31% | 99.07% win probability |
| Secondary: opt-in completion | 21.12% | 32.05% | +10.93 percentage points; +51.77% relative lift |
Without the application control rate and arm counts, we cannot quantify the downstream lift or estimate how many extra applications a similar form would produce.
What does this result justify?
Test a lighter first interaction while keeping the later application as the decision metric.
Test the invitation and follow the visitor
Write questions people can answer quickly and that connect their situation to the webinar’s subject. Keep the webinar, offer and later application stable while you test the pre-lander. If tone is your question, hold question length and answer format constant.
The forms measurement checklist covers assignment and CRM outcomes. For the next stage, our webinar timing tests compare how visitors get from registration to watching, and our webinar funnel guide connects each step to the cost of a sale.
Run the follow-up through the funnel
Choose the primary outcome before launch, then track opt-ins, webinar joins and applications for the same assigned visitors over the same follow-up window. Our PostHog experiment guide walks through the setup; use the system audit to check assignment and event delivery.