Attention Aware Player: AI-Powered Attention Detection for Netflix

We built this fun little project to solve a very serious modern crisis: Netflix keeps playing even when your brain has quietly left the room. By leveraging edge computing and computer vision, we created a seamless solution.

You know the scene. You're halfway through an episode, your phone buzzes, and you glance away for "just a second." Somehow, that second becomes five minutes, three plot twists, and one very confused "wait, who is that character?" moment.

So we made Attention Aware Player: a Chrome extension that notices when you are actually watching Netflix. If you look away, it pauses. When you come back, it resumes. If you were gone long enough to miss something important, it rewinds a little too, because honestly, Netflix should not punish you for checking one notification.

The best part? It does all of this on your device using AI-powered face detection. No servers, no creepy tracking, no uploading your face anywhere. Just a small, privacy-first extension trying to save you from the classic "I have no idea what is happening anymore" streaming experience.

The Problem: Distraction is the New Normal

The Viewership Crisis

The average viewer loses focus approximately 6-8 minutes per hour while watching video content. That's not just a Netflix problem — it's a human problem in the digital age. Whether it's phone notifications, work emails, or simply the cognitive load of daily life, our attention spans are fractured.

Real-World Scenarios

• The Busy Professional: Watching Netflix while working from home, constantly split between tabs and screens
• The Multi-Tasker: Scrolling social media while a show plays, half-aware of what's happening
• The Family Viewer: Watching with kids, frequently pausing to handle interruptions, losing the narrative thread
• The Sleep-Deprived: Drifting off during crucial scenes, rewinding repeatedly (or worse — giving up entirely)

Why Manual Pausing Isn't Enough

The problem with manual pause buttons: they rely on conscious action. But distraction is often unconscious. You don't realize you've stopped paying attention until 10 minutes of dialogue has already passed. By then, you've missed the context, the character development, the plot points that matter.

What if the device could detect your attention state before you miss content? What if it could protect your viewing experience automatically?

Meet Attention Aware Player

Attention Aware Player is a Chrome extension designed specifically for Netflix that monitors whether you're actively watching. Using your device's camera and on-device AI, it detects your head position and gaze direction in real-time.

Core Concept

When you look away → Video pauses (~1.5 seconds)
When you return → Video resumes
If you're away too long → Video rewinds a few seconds so you don't miss content

Why It's Different

Most attention-tracking solutions send data to external servers. Not this one. Attention Aware Player runs entirely in your browser using a bundled AI model. Your facial data never leaves your device. Your Netflix viewing history remains private. It's AI without surveillance.

How It Works: The Technical Magic

Face Landmark Detection

At its core, Attention Aware Player uses MediaPipe, Google's framework for real-time perception tasks. Specifically, the Face Landmarker model that detects 468 facial landmarks — key points like eyes, nose, cheeks, and mouth.

But it doesn't store or upload these landmarks. It uses them for one purpose only: to calculate your head pose in real-time.

Head Pose Estimation

The magic happens in the calibration step. When you first use the extension, you click "Calibrate Viewers." This captures your neutral head pose — the natural angle at which you face your screen.

Then, the system calculates two values:

• Yaw: How far left/right your head is turned (±1 = looking completely away)
• Pitch: How far up/down your head is tilted (±1 = looking completely up/down)

By comparing real-time pose to this baseline, the extension determines: Are you looking at the screen or looking away?

Attention States

The system tracks three states:

• ATTENTIVE: Face detected, looking at screen
• NO_FACE: Face not detected or pose too extreme
• INATTENTIVE: Face detected, but looking away persistently

Two-Viewer Mode

If two people are in the camera view and both calibrate, the system tracks them separately. The playback decision is based on group logic: pause only if everyone is inattentive; resume if anyone is watching.

Playback Control Logic

Here's the decision tree:

1. At least one calibrated viewer exists: System is armed
2. All viewers inattentive for 1.5+ seconds: Pause video
3. Any viewer returns attentive: Resume video
4. Viewer returns after 5+ seconds away: Rewind a few seconds, then resume

This design prevents frustrating pauses during natural head movements (looking at notes, etc.) while protecting against genuine distraction.

Technology Stack

Architecture

• Chrome MV3 Extension — Modern, secure extension model with sandboxed content scripts
• TypeScript — Type-safe, maintainable code
• Vite — Lightning-fast build tool optimized for modern browsers
• MediaPipe Vision — On-device AI inference via WebAssembly

Key Components

• Camera Module (camera.ts) — Manages webcam capture and frame processing
• Face Landmarker (faceLandmarker.ts) — Loads and runs the MediaPipe model
• Calibration Engine (calibration.ts) — Calculates head pose from face landmarks
• Attention Engine (attentionEngine.ts) — Evaluates viewer attention state
• Netflix Controller (netflixController.ts) — Bridges extension to Netflix player API
• Side Panel UI — Real-time status display for viewers

Why No Server?

Traditional AI solutions require sending data to a server for processing. Attention Aware Player uses WebAssembly (WASM) to run the MediaPipe model entirely in the browser. The model files (and all processing) stay on your machine. This means:

• Zero latency: Real-time response
• Zero privacy risk: No data transmission
• Works offline: No internet required for detection

Privacy & On-Device Processing

The Privacy Promise

Many tech companies claim privacy but build surveillance into their products. Attention Aware Player is genuinely different:

✓ No server communication — All processing happens in your browser
✓ No biometric storage — Facial data is never saved
✓ No usage tracking — No analytics, no telemetry
✓ No Netflix data access — Extension only controls playback, never reads your watch history
✓ Camera-only when panel is open — Access stops the moment you close the side panel

Permissions Justification

• Camera: Required for face landmark detection (runs locally)
• Netflix host permission: Required to call Netflix's video player API
• Tabs/Active Tab: Required to identify and route commands to the Netflix tab

Each permission serves a specific, necessary function. No permissions requested, no data leaked.

Key Features Breakdown

Intelligent Calibration

Each viewer has a unique head position when they sit normally. The calibration process captures this baseline, making attention detection personalized and accurate. If you wear glasses, sit at an angle, or have any posture variation, calibration adapts to your normal.

Real-Time Status Panel

The side panel displays:

• Live webcam feed with face detection overlay
• Attention state for each viewer (Attentive / Inattentive / No Face)
• Head pose estimation (yaw/pitch)
• Camera permission status
• Netflix tab connection status

Transparency is built in — you always know what the extension is detecting.

Group Viewing Mode

Designed for families, roommates, or anyone watching together. When two people calibrate:

• Both are tracked independently
• Video pauses only if everyone is distracted
• Video resumes if anyone is watching
• The system prevents pausing during legitimate multi-viewer scenarios

Netflix Seamless Integration

The extension doesn't hijack Netflix. It:

• Injects a lightweight bridge script that calls Netflix's native player API
• Respects Netflix's pause/play/seek methods
• Doesn't interfere with manual user controls
• Works with any Netflix account (paid, free trial, or basic)

Use Cases

Busy Professionals

Working from home? Attention Aware Player keeps your show paused while you're focused on work, resuming when you refocus on entertainment. No guilt about missed scenes; the extension has your back.

Multi-Taskers

For those juggling multiple activities — studying, cooking, exercising — the extension prevents the "wait, what just happened?" moment. It ensures you absorb the content you actually watch.

Content Enthusiasts

If you're the type who rewatches scenes you miss, Attention Aware Player eliminates the manual rewinding. It automatically restores context by rewinding when you return.

Families Watching Together

Kids distracted? In group mode, the video pauses only when everyone is genuinely inattentive. Parents regain control over the viewing experience without constant pausing.

Accessibility Use Case

For viewers with attention disorders or disabilities affecting sustained focus, the extension provides external attention support — transforming Netflix into a more accessible platform.

Current State & Roadmap

Available Now: v1.1.0

Attention Aware Player is live on the Chrome Web Store. Install it on any Chromium-based browser and start using it immediately on Netflix.

Current Features:

• Single and dual-viewer mode
• On-device face detection
• Automatic pause/resume/rewind
• Real-time status panel
• Full privacy protection

Future Roadmap (Planned)

• Advanced ML Models — Training custom attention models on diverse populations for better accuracy
• Multi-Browser Support — Firefox, Edge, and other Chromium variants
• YouTube & Streaming Platforms — Expanding beyond Netflix
• Browser Tab Detection — Detecting when the browser tab loses focus (no camera required for this mode)
• Customizable Settings — Adjustable pause delay, rewind duration, attention thresholds
• Analytics Dashboard — Optional view-time insights (fully local, no data sharing)

Call to Action

Try It Today

1. Visit the Chrome Web Store Listing
2. Search for "Attention Aware Player"
3. Click Install
4. Open Netflix and start a video
5. Open the extension side panel and calibrate
6. Watch without the guilt

Note: To enable the camera, click the Puzzle icon (Extensions), select More actions (three dots), go to View web permissions, and set Camera to Allow.

Get Involved

Attention Aware Player is built with transparency in mind:

• Found a bug? Report it via the Chrome Web Store feedback
• Have ideas? Let us know what features would help your viewing experience
• Developer interested? Check out the source code for implementation details

Share Your Feedback

How does Attention Aware Player change your Netflix experience? Tell us in the reviews, or reach out on social media.

Final Thoughts

In a world of constant distraction, your streaming experience shouldn't suffer from your wandering attention. Attention Aware Player proves that AI can enhance privacy and convenience simultaneously — all without sacrificing your personal data.

The future of smart media isn't about servers tracking your every move. It's about devices working for you, with you, while respecting your boundaries.

Your attention is valuable. So is your privacy.

Ready to reclaim your viewing experience? Whether you're looking to build similar privacy-first computer vision extensions or just want to chat about AI, feel free to contact our team for custom implementations.

Get Attention Aware Player on Chrome Web Store

Made by AdaptNXT — Privacy-First AI Solutions

Frequently Asked Questions (FAQ)