What your smart TV knows about what you watch

Most modern televisions contain a system that identifies what is displayed on the screen and reports it. It is not hidden, exactly — it is disclosed in terms and conditions, and it can usually be turned off — but very few viewers know it exists, and fewer still could find the setting. It has a name: automatic content recognition.

The short version

ACR samples what is on screen and matches it against a reference database to identify the content. Because it works from the display output rather than from an app, it can identify material arriving from sources the television has no other knowledge of — including a games console, a laptop or a streaming stick plugged into an HDMI input. The resulting viewing data feeds advertising systems. It can generally be disabled, but the controls are scattered and rarely labelled in terms a viewer would search for.

How ACR works

The television samples the screen repeatedly — research describes sampling many times per second — and reduces each sample to a compact fingerprint. That fingerprint is compared against a reference database of known content. A match identifies the programme, the film or the advertisement.

The design has one property that matters more than any other. It operates on the display output, not on an app's activity. The television does not need to know which service you are using, or to have any relationship with it. It only needs to see the picture.

Automatic content recognitionalso: ACR

A system that identifies content by fingerprinting what is displayed and matching it against a reference database. Because it works from the screen output, it can identify material from any source, including external devices connected over HDMI.

Why it exists

The commercial logic is straightforward and worth stating plainly, because it explains why the feature is so widespread.

Televisions are sold on thin margins in a fiercely competitive market. Viewing data is valuable to advertisers, who want to know which advertisements were actually seen, on which households, and how that relates to other advertising. A television that reports what it displays turns a one-off hardware sale into an ongoing revenue stream — which in turn subsidises the price of the set.

This is the same economic pattern that made targeted advertising a stated capability of ATSC 3.0, and it is why the feature tends to be enabled by default rather than offered as an opt-in.

What research has established

This is not a speculative concern. It has been examined by regulators and measured by academics.

• Enforcement precedent. A major television manufacturer was found to have sold millions of sets with ACR software installed and enabled by default, tracking viewing from the moment the set was switched on, leading to regulatory action in the United States.
• Network measurement. A 2024 study presented at the ACM Internet Measurement Conference examined ACR traffic on smart televisions directly, characterising what is sent and to whom.
• Opt-out complexity. University research has found that opting out is genuinely difficult — the relevant controls are split across several different settings menus under labels that do not obviously relate to viewing data, requiring many steps to complete.
• Opting out does work. The same measurement research found that when the settings are correctly disabled, network traffic to ACR servers stops. This matters: the controls are hard to find, but they are not decorative.

The last two points together are the practical finding. The problem is discoverability, not the absence of a control.

What else is collected

ACR is the distinctive mechanism, but it is not the only one. A television or streaming platform typically also holds:

Worth separating clearly: your viewing history inside a streaming service is held by that service and is largely unavoidable — it is how the service works. ACR is different in kind, because it is collected by the television about everything it displays, including content from services with no relationship to the manufacturer.

How to find the controls

Menu structures differ by manufacturer and change between software versions, so specific instructions date quickly. What is durable is knowing what to look for.

1. Look under privacy, terms, or viewing information — not under picture or network settings.
2. Search for the concepts rather than the acronym. Manufacturers rarely use the phrase "ACR" in the interface. Look for viewing information services, viewing data, content recognition, or interest-based advertising.
3. Expect more than one switch. Research has repeatedly found the relevant controls split across separate settings, so turning off the first one you find is unlikely to be sufficient.
4. Check the advertising identifier separately. There is usually an option to reset it or to limit ad tracking, listed apart from viewing data.
5. Re-check after a software update. Settings are sometimes reset or newly introduced, and a major update is a sensible prompt to look again.

If you would rather avoid it entirely

Some viewers prefer not to negotiate with the setting at all. The options, with honest limitations:

• Decline during setup. The initial setup wizard is where consent is usually gathered, and declining there is far easier than unpicking it afterwards. It is worth reading those screens rather than accepting through them.
• Do not connect the television to your network. Effective, and costly: no apps, no updates, and no security fixes. This makes the set a display, driven by something else.
• Use an external device for everything. Helps with app-level data, but note the finding above — the television's own ACR may still identify content arriving over HDMI.
• Block the traffic at the router. Possible, fiddly to maintain, and it can break unrelated features. Realistic only if you already run that kind of network.

For most people, working through the settings menus once is the proportionate answer.

Why this belongs in a technology publication

It would be easy to write this as an alarming story, and there are versions of it that do. The more useful framing is that a television is now a networked computer with a commercial relationship to advertising, and that this is a design decision with visible economics behind it — one that partly explains why large sets cost what they do.

That is worth understanding rather than fearing. The gap that deserves criticism is not that the capability exists; it is that the disclosure sits in terms and conditions while the controls sit several menus deep under names no viewer would think to search for.

What a platform can do, as opposed to what it observes, is covered in smart TV and streaming platforms. More app coverage is in the Apps hub.