UK’s trusted IT infrastructure partner since 2003
Servnet
FinanceToolsConfiguratorGet in Touch
AI / GPU

Google TPU 8tx & 8i Max: Confidential AI Compute 2026

London · Servnet News Desk · IT infrastructure analysis4 min read
Share

Google has widened its eighth-generation TPU lineup with TPU 8tx, a confidential computing accelerator, and TPU 8i Max, a dual-chip inference package for long-context work. For UK buyers wary of a single-vendor AI stack, both give a genuine alternative route to NVIDIA DGX systems.

TPU 8i Max Doubles On-Chip Memory
770 MB578 MB385 MB193 MB0 MB384 MBTPU 8i768 MBTPU 8i MaxOn-chip SRAM
View the data behind this chart
TPU 8i Max Doubles On-Chip Memory
TPU 8iTPU 8i Max
On-chip SRAM384 MB768 MB

Four TPU systems in one year — what actually shipped

Google says this is the first year it has introduced four distinct TPU systems, and the latest two are not new silicon but new packaging around existing chips. TPU 8tx reuses TPU 8t silicon with a confidential computing shell built around it, while TPU 8i Max fuses two TPU 8i chips onto a single package. Google credits its modular approach, altering packaging, memory, networking and security around a fixed chip, with letting it ship specialised configurations in months rather than a full silicon cycle.

Google says TPUs now have nearly 100 customers, spanning frontier AI labs, trading firms, retailers and universities. Google says some customers can now deploy TPUs directly in their own data centres; it has not said that TPU 8tx or TPU 8i Max is available for such deployments. Neither TPU 8tx nor TPU 8i Max has a stated Google Cloud availability date or published price, which matters for anyone trying to budget a 2027 deployment today.

TPU 8tx: confidential computing as a built-in feature, not a bolt-on

TPU 8tx pairs TPU 8t's accelerator silicon with 5th Generation AMD EPYC host CPUs and bakes in confidential computing hardware features: PCIe link encryption, cryptographic attestation and secure memory enclaves, so data and model weights stay isolated while in use rather than only at rest or in transit. Google positions TPU 8tx for regulated enterprises and governments running frontier or proprietary models and agents alongside sensitive data.

It also inherits the low-latency Boardfly network built for TPU 8i, which Google says gives TPU 8tx up to 2x lower latency than plain TPU 8t with a near-zero performance penalty. Google says TPU 8tx is intended to support fine-tuning, distillation and reinforcement-learning agent training without moving sensitive data between separate clusters.

TPU 8i Max: memory bandwidth for agents and long context

TPU 8i Max doubles compute, on-chip SRAM and HBM bandwidth over a single TPU 8i by putting two of those chips on one package. Google lists 384MB of SRAM for TPU 8i; doubling that gives 768MB per TPU 8i Max package, within the same rack footprint. TPU 8i has 384MB of SRAM; because 8i Max combines two chips, Google describes the package as having twice the SRAM—768MB by calculation. Google positions this for workloads such as dozens of agents operating across an entire codebase or hours of video, where memory bandwidth, not raw compute, is the bottleneck. Because it fits twice the silicon into an unchanged rack envelope, Google is also selling it on compute density per square foot and per watt, a line item that matters directly for UK data centre operators facing power and space constraints.

Illustration: Google TPU 8tx & 8i Max: Confidential AI Compute 2026

The UK sovereignty and Nvidia-alternative angle

Google maps the four systems to workload roles: TPU 8t for scale-up training, TPU 8i for low-latency reasoning, TPU 8tx for confidential computing, and TPU 8i Max for large context windows and rack density. That gives UK buyers building out UK sovereign AI repatriation strategies a Google-designed alternative to Nvidia-based confidential AI infrastructure, subject to availability and deployment constraints, relevant given that Nvidia has proposed an NVL72 security domain spanning Rubin GPUs, Vera CPUs and interconnects, while Intel is also working to extend TDX toward trusted I/O for accelerator data paths.

Google's decision to run the confidential path through AMD EPYC hosts rather than its usual Arm-based hosts is notable in itself: it hands AMD a seat in the trusted-computing chain of a hyperscale AI system even though Google still designs the accelerator silicon. For procurement teams comparing platforms, that is one more data point that the comparison is becoming multi-vendor, although the competing offerings differ in maturity and availability.

Software underneath: TPU Sync, Pathways, and dynamic slicing

The hardware news arrives alongside several software moves relevant to reliability and operating cost. TPU Sync, now open source, treats chip HBM, host DRAM, shared storage and the data centre network as one memory hierarchy. Google says TPU Sync cuts KV-cache transfer latency by more than 90% and reduces time to first token by an average of 90% on open-weight MoE models with 235B–480B parameters. Google says Cloud Pathways is generally available on GKE and supports sub-minute slice hot-swapping and elastic resharding during hardware disruptions, and GKE dynamic slicing uses optical circuit switching to reshape TPU topologies without rebuilding node pools. Google says GKE dynamic slicing can cut job startup times by up to 5x and speed fault recovery by up to 4.5x. For teams scoping infrastructure for dedicated inference rather than training, these operational claims are arguably as important as the new chip packages themselves.

Google's Four TPU 8-Gen Systems
Primary RoleKey FeatureBest ForTPU 8tScale-up trainingPod to 9,600 chipsLarge-model pretrainingTPU 8iLow-latency reasoningBoardfly networkReal-time inferenceTPU 8txConfidential inferenceAMD EPYC + enclavesRegulateddata workloadsTPU 8i MaxLong-context inference768MB SRAM, dual chipAgent andvideo workloads
View the data behind this chart
Google's Four TPU 8-Gen Systems
Primary RoleKey FeatureBest For
TPU 8tScale-up trainingPod to 9,600 chipsLarge-model pretraining
TPU 8iLow-latency reasoningBoardfly networkReal-time inference
TPU 8txConfidential inferenceAMD EPYC + enclavesRegulated data workloads
TPU 8i MaxLong-context inference768MB SRAM, dual chipAgent and video workloads

What UK buyers should do before committing

Google has not published pricing or a Google Cloud availability date for either system; buyers should confirm availability directly. The immediate action is diligence, not procurement. Buyers should map current workloads against the four-way TPU 8 split, check whether a workload genuinely needs data-in-use protection (TPU 8tx) versus raw context and density (TPU 8i Max), and keep the comparison honest against Nvidia and Intel confidential-computing roadmaps rather than assuming TPU is the default. Running the numbers through tools such as Servnet's AI GPU sizing calculator alongside the AI servers data study will help separate marketing claims from workload reality before any server configuration decisions are locked in for 2027 budgets.

Share
Key takeaways
  • ✓TPU 8tx bakes confidential computing (PCIe encryption, attestation, secure enclaves) into TPU 8t silicon via AMD EPYC hosts, aimed at regulated UK sectors handling sensitive data and proprietary models.
  • ✓TPU 8i Max doubles SRAM to 768MB and HBM bandwidth over TPU 8i by packaging two chips together, targeting long-context and high-agent-count inference within the same rack footprint.
  • ✓Google has not published pricing or a Google Cloud availability date for either new system, so UK budget planning should treat both as pending confirmation.
  • ✓The move strengthens Google's position as a genuine alternative to Nvidia for confidential and sovereign AI inference, alongside separate confidential-computing pushes from Nvidia and Intel.
Frequently asked

FAQs — Google TPU 8tx & 8i Max

What is TPU 8tx used for?

TPU 8tx is Google's confidential computing TPU, built on TPU 8t silicon with AMD EPYC hosts, secure memory enclaves and cryptographic attestation. Google positions it for regulated enterprises and governments doing secure inference and small-scale training on sensitive or proprietary data.

How is TPU 8i Max different from TPU 8i?

TPU 8i Max packages two TPU 8i chips together, doubling compute, on-chip SRAM to 768MB, and HBM bandwidth versus a single TPU 8i chip, while keeping the same rack footprint for higher compute density per watt and square foot.

When can UK buyers get TPU 8tx and TPU 8i Max?

Google has not stated when either system will reach Google Cloud customers, nor published pricing for either, so UK teams should treat both as pre-availability for now.

Is TPU 8tx a real alternative to Nvidia confidential computing?

It is one of several options emerging in parallel: Nvidia is pursuing its own accelerator-level confidential computing with a proposed security domain spanning Rubin GPUs and Vera CPUs, and Intel is extending TDX toward trusted I/O, so buyers evaluating confidential computing hardware now have a genuine multi-vendor comparison to make.

Related

Continue reading

More in AI / GPU →

Turning this into a buying decision?

One conversation with an engineer who's specced this before. No sales script.

Talk to Servnet →

Talk to a UK specialist

Get expert advice or a no-obligation quote — servers, storage, networking, maintenance, finance and cloud. We reply the same working day.

or call 0800 987 4111