Every laptop box now says “AI PC.” Almost none say what the NPU does for you. Buying on the TOPS number alone is the most common mistake, because the neural processing unit (NPU) accelerates a narrow slice of work, and the specs that decide local AI speed are RAM capacity and memory bandwidth. This guide separates marketing from measurable benefit, ranks the 2026 chip platforms, and gives you a framework to decide whether the NPU should drive your purchase.
Quick Takeaways
- The NPU is worth it for battery life, not raw speed. It runs background AI (webcam effects, live captions, noise suppression) at a fraction of CPU or GPU power draw.
- TOPS does not predict chatbot speed. The NPU TOPS number does not predict local-LLM chat speed, since Ollama, llama.cpp, and LM Studio still run on CPU or GPU.
- Buy for RAM first. Get 32 GB if you plan to run local models. 16 GB is the floor for everyone else.
- Platform pick: Snapdragon X2 Elite for battery and portability, AMD Ryzen AI 400 for all-round x86 compatibility, Intel Panther Lake for balanced x86 efficiency.
| Platform | NPU (vendor-quoted) | Architecture | Best For |
|---|---|---|---|
| Snapdragon X2 Elite | ~80 TOPS | ARM | Battery life, thin laptops |
| AMD Ryzen AI 400 | ~60 TOPS | x86 | All-round Windows, full compatibility |
| Intel Core Ultra (Panther Lake) | ~50 TOPS | x86 | Balanced efficiency, x86 apps |
| First-gen Snapdragon X Elite | 45 TOPS | ARM | Value Copilot+ deals |
Current reviewers cite 80 TOPS for Snapdragon X2 Elite, 60 TOPS for Ryzen AI 400, and 50 TOPS for Intel Panther Lake. Some OEM listings quote slightly higher figures. HP lists Snapdragon X2 Elite configurations with a Hexagon NPU rated up to 85 TOPS. Treat these as peak, vendor-measured numbers.
What Is an NPU, and What Makes a PC “Copilot+”?
An NPU is a fixed-function accelerator built for the matrix math inside neural networks. It trades flexibility for efficiency. A CPU handles anything, and a GPU handles parallel math fast. An NPU handles a defined set of low-precision operations (typically INT8 or INT4) at very low power.
TOPS means trillions of operations per second. It is a peak throughput figure at a given precision, usually INT8. It ignores memory bandwidth, software support, and sustained thermals.
Microsoft’s Copilot+ PC label is a certification. It requires an NPU of at least 40 TOPS, which unlocks Windows-native on-device AI features. The same source notes the certification is a platform requirement, not a guarantee that every AI application on the machine uses the NPU.
Copilot+ also expects 16 GB of RAM and 256 GB of storage at minimum. That pairing matters more than the badge.
What the NPU Actually Accelerates
Be precise here. The NPU speeds up a specific list of workloads, and most of them run in the background.
Workloads that use the NPU today
- Windows Studio Effects: background blur, eye contact, auto-framing, voice focus.
- Live Captions and translation: real-time speech-to-text in video calls.
- Local small language models: Windows-integrated features using compact models.
- Image features: upscaling and generative tools in built-in apps like Photos and Paint.
- Vendor and third-party apps: video editors and audio tools with NPU-enabled plugins.
Workloads that mostly do not use the NPU
- Ollama, llama.cpp, and LM Studio chat inference. They default to CPU or GPU backends.
- Gaming and rendering. Those need the GPU.
- Stable Diffusion-style image generation. It generally targets the GPU unless a vendor-specific build exists.
- Compiling, spreadsheets, browsing. CPU territory.
Why Memory Bandwidth Beats TOPS for Local LLMs
Token generation (decode) is memory-bound. Each new token requires reading the model’s weights from memory. A simple ceiling formula:
max tokens/sec ≈ memory bandwidth (GB/s) ÷ model size in memory (GB)
Take an 8B-parameter model at Q4 quantization, roughly 4.7 GB in memory. Laptop LPDDR5X-8533 on a 128-bit bus delivers about 136 GB/s.
136 GB/s ÷ 4.7 GB ≈ 29 tokens/sec (theoretical ceiling)
Real-world numbers land lower because of overhead, but the ratio explains why a faster NPU alone does not make chat faster. The NPU shares that same memory bus.
| Spec | Why It Matters | What to Buy |
|---|---|---|
| RAM capacity | Model must fit in memory | 32 GB for 7B-14B models |
| Memory bandwidth | Sets decode speed ceiling | LPDDR5X, wider bus |
| NPU TOPS | Efficiency for background AI | 40+ is enough; more is headroom |
| GPU (iGPU/dGPU) | Runs most local LLM tools today | Strong iGPU or discrete NVIDIA |
| Battery capacity | NPU’s real benefit shows here | 60+ Wh |
A Copilot+ PC with a discrete NVIDIA GPU is the best pick for local LLM performance, according to one 2026 comparison, and the same source says RAM and GPU matter more than NPU TOPS.
Platform Comparison: Snapdragon vs. AMD vs. Intel
| Factor | Snapdragon X2 Elite | AMD Ryzen AI 400 | Intel Panther Lake |
|---|---|---|---|
| ISA | ARM64 | x86-64 | x86-64 |
| NPU | ~80 TOPS | ~60 TOPS | ~50 TOPS |
| Battery Strength | Best | Good | Good to very good |
| App Compatibility | Emulation for some legacy apps | Native | Native |
| Local LLM Tooling | QNN / DirectML | Ryzen AI / DirectML | OpenVINO / DirectML |
| Gaming | Limited | Strong iGPU | Strong iGPU (Arc) |
| Trade-off | Check niche software first | Higher power draw than ARM | NPU lowest of three |
An AMD Ryzen AI 400 laptop with a 60 TOPS NPU and capable integrated GPU is described as the best all-round integrated option, while Snapdragon X2 Elite is the pick for battery life and portability, with an ARM software-compatibility caveat.
Snapdragon X2 Elite
Pick it if you travel and want a full day or more unplugged. Check your must-have apps (VPN clients, niche engineering tools, anti-cheat games, some drivers) against ARM64 support first. Most mainstream software now runs natively or through Windows emulation.
AMD Ryzen AI 400
Pick it for x86 compatibility with strong integrated graphics. The Ryzen AI 9 HX 475 delivers 60 TOPS and offers full Windows compatibility. It suits developers, creators, and anyone who dislikes compatibility surprises.
Intel Core Ultra Series 3 (Panther Lake)
Pick it for balanced x86 efficiency and a capable Arc integrated GPU. Its NPU rating is the lowest of the three, but it clears the 40 TOPS bar comfortably.
Best AI PCs and Copilot+ Laptops by Use Case
Street prices shift often. Treat the figures below as approximate and verify before buying.
| Laptop | Chip | NPU | Best For | Approx. Price |
|---|---|---|---|---|
| Microsoft Surface Laptop 13.8″ (2026) | Snapdragon X2 Elite | ~80 TOPS | Premium all-rounder | Premium tier |
| HP OmniBook Ultra 14 | Snapdragon X2 Elite | up to 85 TOPS | Windows AI flagship | Premium tier |
| Lenovo Yoga Slim 7x Gen 11 | Snapdragon X2 Elite | ~80 TOPS | Mobile productivity (70 Wh) | Higher than gen-1 ARM |
| ASUS Zenbook A16 | Snapdragon X2 Elite Extreme | ~80 TOPS | Large-screen, under 1.2 kg | Premium tier |
| ASUS Zenbook S16 | Ryzen AI 9 | 50 TOPS | Creators, 3K OLED | ~$1,299 |
| HP OmniBook 5 16 | Ryzen AI 400 | 50 TOPS | AMD value pick | Mid-range |
| ASUS Zenbook A14 | Snapdragon X | 45 TOPS | Travel, long battery | ~$1,099 |
| Acer Aspire 14 AI | Intel Core Ultra 5 226V | 40 TOPS | Budget x86 | ~$629 |
Several of these picks come from review roundups. One lists the HP OmniBook Ultra 14 as the best overall Windows AI laptop, the Zenbook A16 as the best large-screen ultraportable, and the Yoga Slim 7x Gen 11 as the best for mobile productivity with a 70 Wh battery. Another puts the Zenbook S16 at around $1,299 with a 50 TOPS NPU, and the Acer Aspire 14 AI near $629 at the 40 TOPS minimum.
Budget guidance
- Under $700: Accept 40 TOPS, insist on 16 GB RAM, and skip the NPU as a deciding factor.
- $1,000 to $1,500: Choose by battery and display. The NPU tier barely matters here.
- $1,800 and up: Add a discrete GPU or a unified-memory workstation chip if local LLMs are the goal.
Step-by-Step: Verify Whether Your Apps Use the NPU
Do not trust the spec sheet. Check what the hardware does.
Step 1: Watch the NPU in Task Manager
Open Task Manager → Performance → NPU. Run a video call with background blur on. Utilization should rise. If it stays at zero during your normal workflow, you are not using the NPU.
Step 2: List available ONNX Runtime providers
# pip install onnxruntime-directml (or onnxruntime-qnn on Snapdragon)
import onnxruntime as ort
print(ort.get_available_providers())
# Look for: 'QNNExecutionProvider' (Qualcomm NPU),
# 'OpenVINOExecutionProvider' (Intel NPU),
# 'DmlExecutionProvider' (DirectML: GPU/NPU)
Step 3: Run a model on the Qualcomm NPU
import onnxruntime as ort
session = ort.InferenceSession(
"model_int8.onnx", # quantized INT8 model
providers=["QNNExecutionProvider"],
provider_options=[{"backend_path": "QnnHtp.dll"}], # HTP = NPU backend
)
Quantization matters. NPUs favor INT8 or lower. An FP32 model will often fall back to the CPU.
Step 4: Confirm where a local LLM runs
ollama run llama3.1:8b
# In a second terminal:
ollama ps
# The PROCESSOR column shows CPU / GPU split. NPU is not listed:
# standard Ollama builds do not target it.
If chat speed is your priority, test GPU offload and quantization level (Q4_K_M is the usual balance of size and quality) before blaming the NPU.
Real-World Scenarios
Scenario 1: The hybrid worker
You take eight video calls a day on battery. Studio Effects and live captions run on the NPU, and your battery drain falls compared with running the same effects on the CPU. The NPU pays off here, mostly as extra hours unplugged.
Scenario 2: The developer running local models
You prototype with 7B-14B models. You need 32 GB RAM and the fastest memory bandwidth you can afford. A discrete NVIDIA GPU or a high-bandwidth unified-memory chip will beat any NPU for token speed. Use the NPU path only if you are building and testing NPU-targeted ONNX apps.
Scenario 3: The student on a budget
A 40 TOPS Copilot+ laptop under $700 covers captions, translation, and note features. Spend the savings on 16 GB RAM instead of a higher TOPS tier.
Scenario 4: The enterprise IT buyer
Local inference keeps sensitive text on the device. That helps with data-residency rules for summarization and search over internal documents. Test your management stack, VPN, and security agents on ARM64 before a fleet purchase.
Is the NPU Worth It? A Decision Framework
| Your Priority | NPU Worth Paying For? | What to Prioritize Instead |
|---|---|---|
| All-day battery | Yes, indirectly | Efficient chip (ARM or low-power x86) |
| Local LLM chat speed | No | RAM, bandwidth, GPU |
| Windows AI features | Yes (40 TOPS floor) | 16 GB RAM |
| Future-proofing | Partly | 32 GB RAM, upgradeable storage |
| Gaming or rendering | No | Discrete GPU |
Rule of thumb: Treat 40 TOPS as a requirement, not a differentiator. Above that threshold, one 2026 ranking suggests aiming for at least 45 NPU TOPS to stay compatible with 2026-era Windows AI features. Nothing in current software justifies paying a large premium for 80 TOPS over 50. Software support will decide whether the extra headroom ever matters.
Common Buying Mistakes
- Comparing TOPS across vendors as if they were identical. Precision and measurement methods differ.
- Ignoring RAM. Many Copilot+ models ship with 16 GB, which limits local models.
- Skipping the ARM compatibility check. Verify drivers and apps before you commit.
- Trusting affiliate roundups blindly. Many are updated irregularly and mix first-gen and second-gen chips. Check release year and chip generation.
FAQ
Do I need an NPU for AI on a laptop?
No. CPUs and GPUs run most AI software today, including local LLM tools like Ollama and LM Studio. An NPU helps with efficiency for background tasks and unlocks Copilot+ features that require 40+ TOPS.
How many TOPS do I need in an AI laptop?
40 TOPS is the Copilot+ minimum. Aim for 45 or more for headroom. Beyond about 50 TOPS, the extra throughput rarely translates into visible gains because software support and memory bandwidth become the limits.
Is a Copilot+ PC faster at running local LLMs?
Not necessarily. Chat speed depends on memory bandwidth, RAM capacity, and GPU or CPU backend, not NPU TOPS. A laptop with a discrete GPU or fast unified memory will usually beat a Copilot+ ultraportable for LLM inference.
Which is better for AI: Snapdragon, AMD, or Intel?
Snapdragon X2 Elite leads on battery life and quoted NPU TOPS. AMD Ryzen AI 400 offers the best mix of x86 compatibility, integrated graphics, and NPU power. Intel Panther Lake delivers balanced efficiency with native x86 support. Match the platform to your software, not the TOPS badge.




