Last week, OpenAI and Broadcom unveiled OpenAI's first intelligence processor: an accelerator architected around OpenAI's vision for the future of LLM inference and the first AI accelerator in a multi-generation compute platform the companies are building together to make advanced AI faster, more reliable, and more accessible to more people.
It will soon allow users to ask their chatbot to, for example, plan a trip to Chicago for a family wedding, requiring little more than that single request. Based off the user's schedule, which the chatbot will know, it will book flights and hotel accommodations and may even purchase a wedding gift for the couple.
AI expert Bob Maginnis says that is what AI agents are designed to do.
"You create this entity that can execute without overview, without specific guidance on every step," he tells AFN.
The real benefit of Jalapeño, he says, is that "dependence upon international foreign suppliers for our infrastructure" is not an issue; it is homegrown, designed in-house by California-based OpenAI rather than being outsourced to China.
"In a national security angle, we're starting to make chips at the local level; we're increasing compute capacity, which becomes a strategic resource," Maginnis tells AFN. "So, it's reshaping military competition. It's transforming hardware. It's strategically much more than just a new chip."
OpenAI is still measuring final performance, but early testing shows that Jalapeño will deliver performance per watt "substantially better than current state-of-the-art." The architecture reduces data movement and balances compute, memory, and networking resources to achieve realized utilization much closer to theoretical peak performance.
A detailed technical report on performance will be presented in the coming months.
Maginnis adds that Jalapeño is a steppingstone to Artificial General Intelligence, the next big breakthrough for the industry. That is AI that can understand, learn, and apply intelligence across a wide range of tasks at a human level or beyond rather than being limited to a specific function.
Most people will never see most of what Jalapeño can do, but as "it's all about AI competition globally," Maginnis is sure that China will be watching.
