Difference-in-Differences (DiD)
A causal method that compares the change in outcome over time between a treated group and a control group.
Last updated
Definition
DiD assumes the parallel-trends assumption: in the absence of treatment, the treated and control groups would have moved in parallel. If true, the difference in their post-treatment movements is the causal effect. Useful for measuring the lift of a new channel launch, a creative refresh, or a price change — anywhere you have a clean before/after on one cohort and an untreated cohort to compare against.
How it applies in India
A festival such as Diwali lifts sales everywhere at once; comparing held-back towns with the rest, each against its own recent weeks, lets a DiD readout cancel that common lift out.
An example
A restaurant chain pauses its ads in two of its ten delivery areas for two weeks. Orders fall 4% in the paused areas and rise 3% in the other eight over the same weeks. The difference-in-differences estimate of what the ads were doing is not the 4% drop on its own but the gap between the two changes, about seven points, because the areas that kept their ads show what would have happened anyway.
How WatEase uses it
WatEase’s quarterly geo-lift test is read as a difference in differences. It compares the held-back towns’ orders before and during the test with the same change in all the other towns, and expresses the result as a ratio of odds with a 95% band (Woolf’s method), working on orders rather than on a regression. Owners see the outcome as “Ads added about N% more orders, ±M%” alongside their other tests and experiments. WatEase does not run a regression-based difference in differences or a separate check of parallel trends.
Frequently asked questions
What does WatEase compare in its difference-in-differences read?
Orders in the towns held back from ads against orders in every other town, before and during a 14-day pause. The ratio of the two changes, with a 95% band, becomes the lift figure owners see.
Related terms
Try WatEase
Run your WhatsApp commerce on the platform built for India — Cloud API, GST invoices, UPI checkout, opt-in tracking, and 0% markup on WhatsApp messages (competitors add 20–25%). Pricing is on request — quoted by the WatEase team.
Get Started Today