Industry

OpenAI and Broadcom Unveil Jalapeño, OpenAI’s First LLM Inference Chip

On June 24, 2026, OpenAI and Broadcom unveiled Jalapeño—OpenAI’s first “Intelligence Processor,” a custom accelerator designed from a blank slate for LLM inference. The chip is the first in a multi-generation compute platform co-developed with Broadcom (silicon/networking) and partners such as Celestica for boards/racks, with initial deployment targeted by the end of 2026 and early testing claimed to beat current state-of-the-art performance per watt.

Tech Insights Reporter Jun 24, 2026 5 min read San Francisco, CA

TLDR

OpenAI and Broadcom on June 24, 2026 unveiled Jalapeño, OpenAI’s first custom Intelligence Processor—an accelerator built specifically for LLM inference, not a general training GPU. It is the first chip in a multi-generation platform the companies are building together, with end-of-2026 initial deployment goals and OpenAI claims of substantially better performance per watt than current state-of-the-art in early testing.

What Jalapeño is

From OpenAI’s primary company announcement:

Name / class: Jalapeño — OpenAI’s first Intelligence Processor.
Workload: Architected around OpenAI’s vision for the future of LLM inference (serving ChatGPT, API, and related production inference).
Partners:
- Broadcom — silicon implementation, networking/connectivity (e.g., interconnect/Tomahawk-class networking in secondary technical coverage).
- Celestica — board, rack, and system expertise for deployable racks (cited in multi-partner platform description).
Roadmap: First step in a multi-generation compute platform; initial deployment by end of 2026, expanding thereafter; Broadcom leadership messaging has referenced gigawatt-scale data-center rollouts with Microsoft and other partners beginning in 2026.
Ceremony note: Hardware delivery to OpenAI CEO Sam Altman and President Greg Brockman by Broadcom CEO Hock Tan and President Charlie Kawwas.
Performance framing: Early testing claims performance per watt substantially better than current SOTA; full public FLOPs/spec sheets remained limited at unveil. Secondary reporting described ~nine-month design-to-silicon cycle and inference-only positioning (training still expected to lean on Nvidia-class GPUs).

Strategic read

Google (TPU), Amazon (Trainium/Inferentia), Microsoft, and Meta already field custom silicon. Jalapeño is OpenAI’s formal entry into first-party inference ASICs—aimed at cost, latency, and supply independence for the token volume of ChatGPT-scale products as the company moves toward public markets.

Why this story matters

Whoever controls inference economics controls how widely frontier models can be sold. A Broadcom-co-developed, OpenAI-designed inference chip is a structural bet that OpenAI will not remain a pure software tenant of Nvidia forever—and that custom silicon is now table stakes for any lab serving billions of tokens a day.

Sources

OpenAI: “OpenAI and Broadcom unveil LLM-optimized inference chip” (openai.com/index/openai-broadcom-jalapeno-inference-chip/, June 24, 2026). Primary announcement.
Reuters / industry coverage of the Jalapeño unveil, inference focus, and partner deployment framing (June 24, 2026).

Featured Image Alt Text

Jalapeño chip package between OpenAI and Broadcom logos with abstract inference dataflow lines.