GlossaryPublished

What is YouTube thumbnail A/B testing?

YouTube’s A/B test shows up to 3 titles or thumbnails at once and keeps the one with the most watch time, not clicks. Who can use it and how to read results.

The short answer

YouTube’s A/B test, run in YouTube Studio, shows different viewers up to three versions of a video’s title, thumbnail or both at the same time, then keeps the version that earned the most watch time. It replaces guessing which thumbnail works with a measured answer from your own audience.

YouTube announced A/B testing for titles at Made on YouTube in September 2025, beside Ask Studio and collaborations. YouTube’s Help Center states the rule: “At the end of the test, the title or combination of title and thumbnail with the highest watch time will be shown to all viewers.” A test should finish within two weeks.

Who and what can be tested

YouTube sets several conditions:

YouTube A/B testing eligibility, from YouTube’s Help Center pages on A/B testing and feature access, checked October 2026
ConditionWhat YouTube says
WhereDesktop only, in YouTube Studio on a computer
AccountAdvanced features must be enabled
VariantsUp to 3 titles, thumbnails, or title and thumbnail pairs
Not testableShorts, scheduled lives and Premieres (a Premiere becomes eligible once it ends)
TestableLong-form videos, including live archives
Excluded contentVideos made for kids, for mature audiences, or private

Watch time, not clicks

The test does not pick the thumbnail with the highest click-through rate. YouTube says it optimises “for overall watch time over other metrics, like click-through-rate,” because a title and thumbnail should also help viewers understand what a video is about, so they do not click the wrong one.

That changes what a good variant is. A thumbnail that wins clicks but disappoints viewers loses to one that brings fewer clicks from people who stay. YouTube also notes that its tests run all variants at the same time, unlike tools that test one after another and often judge by clicks alone, which is why results can differ.

Reading the result

Every finished test ends in one of three results, judged on watch time share:

YouTube A/B test results, from YouTube’s Help Center, checked October 2026
ResultWhat it meansWhat happens
WinnerOne option clearly outperformed the others, with statistical significanceThe winner is shown to all viewers
Performed SameAll options did about the samePick the one you prefer
InconclusiveNo strong statistical differenceThe first option you uploaded stays, unless you change it

Running a useful test

YouTube’s own tips, and what follows from them:

  • Make the variants clearly different. Near-identical thumbnails run longer and rarely produce a Winner.
  • Test older videos first, so a weaker variant costs less of your channel’s views.
  • Use thumbnails of at least 1280 by 720; if any is smaller, YouTube scales all of them down to 854 by 480.
  • Do not edit the title or thumbnail mid-test: a change stops the test, and it has to be restarted.
  • Expect Performed Same often. YouTube says it is normal not to get a Winner, especially on videos with few impressions.

A/B testing and PostEase

PostEase uploads your YouTube video with its title, description and the cover you made as its thumbnail. Start an A/B test in YouTube Studio after the video is up, once the thumbnail is set: changing it during a test stops the test. If your account cannot use custom thumbnails yet, PostEase notes that on the post instead of failing the upload. YouTube, X, LinkedIn (personal profile), Pinterest, Bluesky, and WordPress publishing are live today; Instagram, TikTok, Facebook, and Threads are pending each platform's own API approval.

Questions

How does YouTube pick the winning thumbnail?

By watch time share, not click-through rate. The variant that earned the most watch time is shown to all viewers.

Can I A/B test Shorts thumbnails?

No. YouTube says A/B testing is not available for Shorts, scheduled lives or Premieres until they end.

How long does a YouTube A/B test take?

A few days up to two weeks, depending on impressions and how recently the video was published.

Why did my test not find a winner?

The variants may have been too similar, or the video may not have had enough impressions. Performed Same and Inconclusive are common results.

Sources

  1. YouTube, The next 20: powering the future of entertainment together at Made on YouTube, September 2025.
  2. YouTube, A/B test titles & thumbnails, checked October 2026.
  3. YouTube, Add custom thumbnails on YouTube, checked October 2026.
  4. YouTube, Learn about feature access for YouTube Creators, checked October 2026.

Upload with the cover already set.

Make a cover in the composer and schedule YouTube videos with it as the thumbnail, beside every other platform. Free to start.

Start free