Multi-Armed Bandit
A class of algorithms (Thompson, UCB, ε-greedy) that balance exploring uncertain options against exploiting known winners.
Last updated
Definition
The metaphor: a row of slot machines (bandits) with unknown payouts. You want to maximize total reward. Spend too long exploring, you waste time on losers. Switch to exploitation too early, you might miss a winner. The bandit algorithm decides when to explore vs exploit based on confidence in each arm's posterior.
How it applies in India
India’s audiences are multilingual, so a bandit is a quick way to learn whether an English, Hindi or Hinglish version of a message works better, without a long fixed test.
An example
A brand has four new ad creatives and a fixed weekly budget. Splitting spend evenly for a month wastes money on the weakest; picking a winner after two days risks backing a lucky one. A bandit moves impressions towards whichever creative looks best so far while still giving the others enough exposure to prove it wrong.
How WatEase uses it
WatEase ranks ad creatives with Thompson sampling: each creative’s record of conversions and impressions becomes a probability curve, and draws from those curves set the order. When a running creative’s click-through rate falls by 30% or more week on week, with at least 500 impressions in each week, WatEase proposes swapping in the bandit’s top creative; swaps can be applied on Meta, since Google ads cannot be edited in place. The daily budget rebalance in the Marketing add-on uses the same idea over spend-and-revenue curves. Both are part of how WatEase runs agentic marketing.
Frequently asked questions
Does WatEase change my ads on its own?
That depends on the mode you choose. In watch-only mode every change is advice. Otherwise a creative swap is proposed first, budget moves stay within limits (no more than 20% per change and 10% of the total budget a month), and changes suggested by the marketing-mix model wait in an approval queue.
Related terms
Try WatEase
Run your WhatsApp commerce on the platform built for India — Cloud API, GST invoices, UPI checkout, opt-in tracking, and 0% markup on WhatsApp messages (competitors add 20–25%). Pricing is on request — quoted by the WatEase team.
Get Started Today