Wow, I posted this and come back a few hours later, and the comments are... a bit depressing honestly.
Do people here know what interaction nets are? They are a fundamentally different programming paradigm, different from the most basic harvard architecture of the 1940s. Whether you think this particular implementation will genuinely support them, and whether that will bring the performance they claim it does, it another question (I'm not sure). But at least can we focus on the topic?
Thanks for sharing, TIL about interaction nets. I found the article linked at the bottom easier to understand[0].
> Another issue with multi-core CPUs is the difficulty of programming them. Debuggability is a major issue, and entirely new classes of issues arise, such as race conditions. However, in interaction nets, all active pairs are independent, and so can actually be executed in any order. This property is known as confluence, and means that no matter the order in which things are executed, the result will be the same. This makes debugging straightforward and eliminates issues like race conditions. This allows Vine to be parallel out of the box; the programmer does not have to do anything special with threads, processes, CUDA kernels, etc. to get parallel execution.
Seems to describe something analogous instruction level parallelism, which traditional CPUs made this millennium have as well via instruction pipelines, branch prediction, and speculative execution. Some of which turned out to not work too well so now we generally run hobbled CPUs with Spectre/Meltdown mitigation enabled.
The reason why we tend to reach for difficult abstractions for core level parallelism is that most automatic/safe approaches tend to stumble pretty hard on Amdahl's law, where most parallel code is consequently almost entirely designed around minimizing critical sections.
I don't fully see how inets would resolve Amdahl's law.
I think you're thinking about this the wrong way. This isnt about surpassing theoretical parallelism limits. Its about gaining parallelism without having to be explicit about it. If you look at the solve function from the page, its doing a brute force search of the 5 queens problem. In the naieve implementation, this is done serially. But with the different approach to compiling the implementation, we can essentially "automatically parallelize" it. Thats the difference between the animation on the left and right. The thing is that in order to handle fine grained parallelism like this you need better/different hardware primitives so that you can split computation at a more fine grain, which is why they needed a new hardware model/isa. This is how they achieved the 4-5x speed up: by automatically parallizing a serially implemented function. If you were to compare a parallelized function to their parallelized function, I would expect to see a smaller speedup. Or at least as I understand it. Correct me if I'm wrong.
I read through the first half, but the graph operations are really confusing me. What's the difference between a principal port and auxiliary ports? A lot of the rewrites are swapping them around so I'm confused what their significance is.
This is the key feature of the architecture. Computation is shown to be localizable and independent in terms of 'active pairs' which are defined as elements connected via their 'principle port'. Since the design permits only one 'principle port' per element, all possible graphs that we can arrive at with this formalism can only have components that 'exclusively' participate in a single 'active pair'.
So there is 'no sharing of state' baked into the computational model by design, enforced by this very simple and elegant design choice.
For me, the edges are still too blurry for me to make out what this actually is. I need someone with more in-depth knowledge to let me know what is actually being proposed here.
On the optimistic side, this looks like a kind of "bigger step" in the direction that GPU/shader programming took, where you change the way you think about and break down a problem to get insanely fast results. Feels like if you target this interaction net structure and give it to this CPU that uses them natively, we could amplify the speed of computations to possibly allow for things that are currently way to slow to do. Realtime physics sims with magnitudes faster steps. That's pretty cool. And all of the downstream effects that would allow for, in product design, scientific modelling, etc. And that's just one train of thought.
On the pessimistic side, though, I have no clue how to "program for an interaction net". Seems like the authors took a "you don't need to, an LLM will do it for you" position, and I can get behind that, but that's a pretty huge step in the direction of "Natural Language Programming" in that I literally can't program it without using an LLM and natural language, because I don't understand the underlying details and probably won't have any structural support to understand it for a while, as the tooling slowly rolls out and gets iterated on, until it can do something we can recognize as "Debugging". I imagine there's some kind of "program it in C, and translate it" thing, too, but it feels like the point here is not to have me be able to debug it, and a detour through C just wastes LLM tokens.
So those are the initial impressions, but then I'm making a TON of assumptions in both sides of that. So I don't even know if my initial impressions are conceptualizing the right paradigms, much less if they are worth discussing with people who are seriously considering this topic. Only speaking for myself here, but at least my own silence is due to not having enough information myself, and not seeing enough in this paper to interest me in research in the topic just yet. Maybe if they've got something I can play with, I could get my head around it more. But, for now, it's just neat.
> Feels like if you target this interaction net structure and give it to this CPU that uses them natively, we could amplify the speed of computations to possibly allow for things that are currently way to slow to do.
I mean, it's basically what out-of-order CPUs already do: read lots of instructions in at the same time, dispatch instructions as their inputs become ready to execute.
Sort of the reality of modern processors is that we have the units available to do the work, we just don't have dispatch logic to keep them fed with work, given how slow memory is. When you have very regular parallelism--dense linear algebra is the canonical example here--SIMD works very efficiently to minimize the dispatch logic needed to keep units fed. When you've got irregular parallelism, dataflow architectures seem to work well at first, until you start trying to make actual chips and you find you've been consistently underestimating how much overhead your dispatch logic is actually chewing up.
Right. Sounds like that to me, too. But, again, I'm completely new to the topic, so what do I know?
If it is true that what is offering is some kind of "super-simd" processor that is built in a way that everything run through it must be similar to simd style code, but because it's hardware, it will run it much faster, then my questions are definitely targeted toward what the speed up is vs a highly-performant SIMD application. I would hope that their "coming next" stuff includes comparisons against the types of SIMD-boosted dense linear algebra you referenced. What is the speed up compared to that. And if it's less than (arbitrarily, say) 10x, how much can be gained by just having an LLM target breaking more stuff down in to multiplex-able instructions? But then, if it's more than that, my questions start turning towards "how much would it take to prototype" and "how much has to be changed from current tooling to produce the chips at scale" and "what is a good showcase target for an initial run? what would be something that could be made actually (in real dollars/hours) cheaper/faster/better by using this chip?"
From what I got, the magic is possible because the software is expressed as interaction networks and the CPU doesn’t need to resolve inter-instruction dependencies because the program makes them explicit.
> If it is true that what is offering is some kind of "super-simd" processor
if it is, that has been tried before and failed (with itanium/etc), because the optimization burden on compilers means that they never end up getting the projected speeds over conventional execution
Interaction nets are a _model of computation_, not a programming paradigm.
I.e. they are on the same level as Turing machines and Lambda Calculus. Arguably they are more elegant than LC as beta-reduction doesn't look like a primitive operation.
E.g. if try to 'run' Turing machine using pencil and paper, a primitive step is to update one step. With IN one step can also be 'local'.
OTOH LC beta-reduction might be impossible to do in-place - you might need a lot of new pages to do just one beta-reduction.
I tried reading that when it was mentioned earlier here on HN, and the fact that the pointy end of the triangle isn't an output, nor can I tell where the outputs are, breaks it all for me, the cognitive impedance mismatch is too damned high.
People had a lot of novel ideas for nomenclature back then in the 1940s, that just don't work 80 years later, it's a shame they still clung on to it in 2026.
I've been thinking of a calculator builder tool for OSRS for a while now, and it seems like I was just trying to use interaction nets! Thanks for the terminology :)
Even if people know they are it doesn't help that a good chunk of the article is dedicated to their AI methods, and there are very little technical explanations of how this actually works.
In the context of this story, I wonder whether interaction nets are more amenable to hardware implementation? I plead ignorance about how the dataflow paradigm maps to hardware.
Exactly my point. But well researched and has compilers from high level languages (Id and some others).
> except they are strongly confluent and have incremental sharing
Data flow is an inverted representation of data demand (lazy evaluation, which is strongly confluent) [1] and I do not see why it cannot (be constrained to) have strong confluence.
In some cases (FFT), TTA's automatic synthesis was able to provide power-per-operation reduction of three orders of magnitude, when compared to specialized ASIC hardware.
I mean, it's not like interaction nets don't come up every now and again. I remember the Bend language making the rounds here several times, v1 of that language was built on their own HVM, which uses interaction nets, it's a niche idea but not a completely forgotten one (Bend 2 appears to have dropped them due to perf reasons). We also get the occasional articles on revolutionary new (old) CPU architectures that will displace everything, last one I saw was pushing VLIW as the silver bullet that would displace the current CPU giants and make x86 obsolete. I don't see much reason to believe that this approach would overcome the main barrier to adoption that those approaches failed on, which is the cost of porting existing software across, unless the creators are willing to front the token costs for that.
Also, the article title is one that heavily emphasizes the AI autoresearch aspects, and doesn't mention interaction nets at all, so it makes sense that people would go into the article primed to think about the autoresearch aspects.
You don't have to make x86 obsolete to be successful. You can just add extra accelerator chips. GPUs did this, NPUs are trying to do this, and there are plenty of exotic accelerators inside modern computers doing specialized DSP tasks.
If this stuff works, it'll surface first as some PCIe extension device that work can be dispatched to when it makes sense. Then maybe it'll get integrated into SoCs and be exposed via new CPU instructions or devices. Perhaps compilers can then start to identify blocks of code that can be reduced to interaction nets, compile the net and then run them on Frostbite style chips opportunistically.
People keep rediscovering the same ideas and renaming it. Interaction nets are another kind of graphical dataflow model. There are lots, but they are all basically the same idea.
//I don't see much reason to believe that this approach would overcome the main barrier to adoption that those approaches failed on, which is the cost of porting existing software across,
> Wow, I posted this and come back a few hours later, and the comments are... a bit depressing honestly.
I think AI sentiment is charged and skews negative amongst culture, but very negatively charged amongst engineers because of the "impending doom" and how our jobs are obviously changing. The craft is arguably gone. Interesting news just becomes another rung in the ladder of job insecurity.
All things being equal, I could see this leading to 1-2 order of magnitude in compute efficiency over von Neumann / Harvard architectures, and may be ideally suited to in-memory compute, in particular.
If you can program it in rustish language with the intermediate representation, that makes everything portable to it without having to figure out the parallelism, potentially.
Very impressive and potentially revolutionary. Micron or Samsung needs to see this, they are having to reinvent compute anyway.
Parallelism can be regular (matrix or tensor operations are examples of that) and irregular (Barnes-Hut as a very simplified example). To extract something like Barnes-Hut from the code with quadratic complexity, one have to make some interesting assumptions. E.g., one has to figure out something.
One may think that regular parallelism is a solved problem, but even nested loops are not always parallelizable without figuring out how to make them to work in parallel.
Then there comes Microsoft Word. Can we make a CPU where Microsoft Word gets executed with maximum IPC achievable? If you do not like MS Word, take a look at Linux Kernel and userland programs as a whole.
This is historic. This kind of thing is what ai self improvement looks like (like it or not...). It might not be this architecture specifically, but this is what the acceleration is going to look like -- show hn posts about ai advancing its tech stack
My question: if these new developments roll out steadily for enough years, what does that mean for nvidia or amd or intel? Do they benefit? Probably? They already have the manufacturing pipelines
Is it real, or is it clickbait nonsense? AIs are really good at producing clickbait nonsense.
Several new kinds of architectures have been tried: the iAPX 432, the Mill, the Reduceron, but things just keep coming back to the out-of-order modified Harvard (a.k.a. fake von Neumann) machine being the most efficient general-purpose computer in our laws of physics.
This is a very interesting project, but unfortunately at this point in time anything with “AI” in the title invites too many hot takes and personal opinions about AI that are unrelated to the story.
On Hacker News (and Reddit and every other social news site) the title drives the comments more than the article content because, frankly, most people don’t even try to read the article. If you had submitted this with a headline that didn’t mention AI and instead said something about interaction nets the tone would probably be very different in the comments.
Please don’t be discouraged, though. This content is very interesting to many of us, but it takes time to read and appreciate it, whereas firing off some “AI bad” hot takes in the comments without reading the article is an easy way to get some upvotes and ignite large comment chains without reading the article. That asymmetry always biases the comments in one direction, but don’t take the comment section bias as a sign that it wasn’t appreciated as a submission. It’s currently the #1 story which is a much better signal of interest than the comments.
Well I mean all of the visuals on the web site are nice and shiny, but all of the existing real and physical architectures are built on years and decades of experience, and years and decades of failure and optimization.
In short, how can we be sure it will work and be stable, and that we're not just watching another AI hallucination?
Does the proof correspond with the chip? Does it prove useful properties? Are the properties it proves desirable? Desirable for what? How did you check?
Good questions, also is the machine code derived from the proof (rocq) or is there just a proof along the code, which allows drift between theory and implementation.
Formally - but by LLM. In theory practice is the same as in theory.
Will be cool to see if Linux can run on a QEMU or FPGA based implementation of this and how the efficiency numbers look then because it's not quite as interesting if it's not general purpose computing ready.
I am interested to have end products with really good UX driven by peak performance and optimizations which blows my mind because it’s so well perfected as humans weren’t part of its process.
As of now, I don’t see any of that being the goals even let alone the result. Instead what I see is that everyone is in a race to have as much product out as possible by the same standards that applied to products made by humans, but even lesser quality.
I the last two decades we have gotten so used to average or less than average product quality that we are willing to pay 2000$ for a device running an operating system like macOS or windows that ‘works most of the time’.
I hope we have products thanks to AI that compete on reliability of software and hardware to the point that the big tech will have to reinvent their processes just to be able to justify prices.
> I the last two decades we have gotten so used to average or less than average product quality that we are willing to pay 2000$ for a device running an operating system like macOS or windows that ‘works most of the time’.
I think that describes the entire lifespan of consumer computing.
I’m old enough to remember Windows 98 running on a Gateway PC. That cost $2000 (without taking inflation into account!) and worked much less of the time than today’s OSes do. Modern OSes are frustrating in various ways but I think it’s easy to take for granted how stable they are compared to the past.
Towards the end of XP's lifetime it was a very stable OS, as was late stage Vista/windows 7. Early vista was obviously a trainwreck, then 10 and onwards have been a gradual slide in terms of stability
A lot of this is simply because of microsoft firing all their QA and pushing it onto customers, which hasn't really worked all that great
I'd love for Apple to stop releasing new OSes every single year in lockstep with iOS.
Snow Leopard was the peak for me. Everything since has been a regression trying to merge iOS with macOS when they have completely different ui/ux paradigms.
Microsoft's strategy was, to my understanding, to create an OS for the next generation of hardware - meaning that, upon release, it couldn't reliably run on the current hardware out in the market.
Partly this was too "encourage" adoption of newer, faster, better machines, partly it was to ensure when that wave of fresh new hardware hit the streets, Windows was ready to take full advantage of it.
I know windows 2000, XP, etc followed this strategy, I think 98 overshot, which required 98SE to do some repair
What does that even mean, other than "faster"? Windows 11 created a mountain of e-waste, consisting of perfectly good hardware.
Why does Windows 11 take several seconds to open the calculator on my 2025 work pc, a 6C/12T machine with 16 GB RAM? Do I need next gen hardware just so Win11 stops wasting my time?
> Why does Windows 11 take several seconds to open the calculator on my 2025 work pc, a 6C/12T machine with 16 GB RAM? Do I need next gen hardware just so Win11 stops wasting my time?
My guess? Its probably some slop-infested Electron app that has to spool 1GB of garbage from disk. And, you know, "copilot" crap.
Should'a been a 100KB application, instant open, and just works.
The answer is almost certainly because it is a "work PC". They are typically loaded up with so much shitty monitoring software with hooks in everything, making everything slower than it should be.
So what you're saying, they deliberately created a system that was so slow and resource-hungry that it couldn't run on anything than much faster, beefier machines?
Why couldn't a more streamlined, simpler, less resource-hungry system run much faster on "newer, faster, better machines"?
> to ensure when that wave of fresh new hardware hit the streets, Windows was ready to take full advantage of it.
wasn't it just the strategy with vista and everything before it? seems that since 7 it's all been designed to run on contemporary hardware (which is why 7 was so rock-solid over its entire lifespan)
> "I am interested to have end products with really good UX driven by peak performance and optimizations [..] Instead what I see is that everyone is in a race to have as much product out as possible by the same standards that applied to products made by humans"
AI is not equipped for this. Humans are part of the experience process, and AI doesn't "understand" individual humans better than other humans do.
UX relies very much on human psychology. That's why, despite all the efforts of scoring it, UX is not an objective metric:
1. AI doesn't know what "good UX" is, as this is judged by the sum of humans using it. --> Structured data of actual usage would be needed for AI to ingest, in a way that it can derive intent from every action and identify friction.
2. A "good UX" is not a transferrable metric. The best UX for a ticket vending machine is not applicable to video-editing software. --> AI would need to understand what to apply when, and at which point it needs to evolve its expectation to the user
3. A "good UX" is not an absolute metric. Photoshop/Premiere/... has a UX which was extended and refined over decades, it is considered good by experienced users but still overwhelmingly confusing for beginners. --> Someone would need to scope the AI for the correct target-group
All this is done today by doing extensive user-testing with actual humans. There are people experienced in this who can create better UX-designs from scratch than others can, and still we keep learning something when we put a group of humans in front of it and watch them use it.
"Intelligence" alone doesn't solve this.
I'm reminded of the story of Stephen Hawking's sister, telling how he invented a "better board game" as a child and always wanted to play it with her, which was apparently the most frustrating and boring game she ever played...
We don't build modern software for humans. We build it for profit extraction. It's why the modern cycle is:
1) First-mover wins: burn VC capital to get a product out free
2) Establish brand and market dominance
3) Integrate advertising to keep the product free and grow the user base
4) Crush competition and capture users due to "mind share" and "network effects"
5) Enshittification until no one is happy with your product and making a replacement is impossible
I basically agree with you, but much less cynically.
At the end of the day, in a well-policed society "profit extraction" == "what you can convince people to willingly spend their money on"
Turns out people are generally willing to spend their money on ads to grow their own businesses, and are generally not willing to spend their money on un-enshittified software replacements for what they're used to.
You might not agree with their choices but that's just how people are. I don't think it would be a better world to force them to choose differently.
Replace people with companies. And realize that company decisions are increasingly AI driven. Today, often with a CEO that asks AI what to do, but eventually, I think the CEO will also get out of that loop.
Can you show me this well-policed society? We've had quite a few decades, almost a century of this new kind of capitalism and afaik in most places it's just become feudalism 2.0.
1. Personally I feel most Western countries have gaps but are well policed enough that I feel comfortable saying at least ~95% of spend represents the revealed preferences of people under their own free will. People could do better with their choices but they aren't coerced or outright defrauded in most cases.
2. I (like most people I feel) am generally very on board with political action to reduce fraud & coercion. I'm not on board with "let's just overthrow capitalism", which just introduces coercion on people's preferences, rather than remove it.
Then again, often when I specifically prompt my agent that "this works like shit, make it better" - it makes it better. There are for sure best practices that agents are well equipped to handle. Often the solution to make UX better is to just make the process simpler (for the user). Agents are also well equipped to do that.
I don't see any reason all the things you mentioned cannot be taught to an LLM using reinforcement learning. The newer models are already much better at this stuff, I see no reason that trajectory will change.
Hence I wrote: "Structured data of actual usage would be needed for AI to ingest, in a way that it can derive intent from every action and identify friction."
The challenge is more about providing actual, objective data to learn this.
The LLM will not be able to decide what is "good UX" and "bad UX", it will have to ingest this information in vast detail from judgement provided by humans, which is also varying alot.
Case in point: Coming from that field, I personally don't have a good user experience using iOS, a majority of end-users will strongly disagree.
An LLM would need to be trained to handle both cases to judge the same human interface, so it would need alot of data to understand both views...
The human UI designer has the benefit of being and to run experiments on themselves, but only n=1. for any problem where that is insufficient or even misleading that benefit disappears. I’d argue that UI is an area where you need n>>1.
That's what UX user studies are for, which is a process of humans observing other humans using the product and taking notes. It's far more common than people seem to believe.
(also: UX is not UI, but I guess this goes without saying...)
Not so. You can time how long it takes, how many clicks to goal, how much of the viewport is shown. There are so many metrics around UX and it can be approached in an objective way. So one UI can be evaluated on another for a given goal. Sick Fable on it and see.
Those are ways of optimizing patterns we already use. New UX patterns from the simple like object rollover states, to the complex like the iPod click wheel, take human innovation.
We respond with delight or disdain based on how they feel.
The only way for AI to know how humans feel about something is to be trained on what we’ve already said about it.
I do so suspect that harebrained ideas like this is how we got “fully optimised, completely garbage” UX experiences that are present in some major corporate services. Google/youtube being a good example of this.
It's not a race to the bottom. It is a statement that AI is already better than an average person or even an "expert" in certain areas. Probably most, at that. You can see it as "AI is advanced" or simply as "humans are pretty stupid, overall".
Judging by the recent global outage of Outlook, which, probably, in some way, affected just about all US commerce, I would say the future for software reliability is still looking grim. The good news is replacing your vendors bespoke solutions is easier than ever. Where I work, we’ve still not internalized that software does not have to be a top-down solution where everyone does the same thing. In substantial management and user education, that goes into getting everyone to do exactly the same thing. The idea that you could just ask Claude to solve your very particular problem, it solves it, and then you move on, maybe not even preserving the code, is not in that mental model
> As of now, I don’t see any of that being the goals even let alone the result. Instead what I see is that everyone is in a race to have as much product out as possible by the same standards that applied to products made by humans, but even lesser quality.
That is, roughly, how all automation works: You build the machine that does the humans job, barely, badly. Then you improve the machine. Producing shitty output on that journey is better than producing no output, if the domain allows for it. You learn more.
That’s not really the case though. Especially in the general case. Just look at the cotton gin. No one was designing little mechanical hands to pick through cotton.
Frequently automation happens only after someone realizes that to automate the process, the process has to be completely reinvented.
I’d say that the majority of successful automation doesn’t follow an iterative path starting from build anything that does exactly what a human does because human physiology isn’t easily replicated with rotational motion.
> That is, roughly, how all automation works: You build the machine that does the humans job, barely, badly. Then you improve the machine
That’s not how automation works. The first thing you build is already taking care of a cumbersome part of the human jobs, even if limited in scope. The improvement part is in reliability and maintenance. Because the core problem is already solved. All that’s left are engineering issues.
So even if the first contraception is horrible, it should be clearly visible which immediate need it intents to solve, even if the full scope of changes is not known yet. But with those, there’s no need behind them, just imagined problems.
Given GP's (accurate) point about the mediocre quality of products whose production has long since been automated, I'm curious at what point you think the output stops being shitty.
I think we are starting to see this in some areas: For example, for years desktop apps were built on top of slow and heavy cross-platform frameworks like Electron, because writing them natively was too burdensome. Now we're seeing rewrites in rust using native APIs and toolkits, resulting in lighter and faster apps.
Software engineering as a discipline is also shifting, and will continue shifting, to a process of continuous automated improvement. In the past, test suites were mostly a way to catch regressions. In future, they will be essential to provide a verified baseline of correct behaviour, and then you will have models looped in the background to continually merge performance and reliability improvements. Similarly you will have error and performance logs fed directly into agents to resolve incidents as soon as they arise.
We are in the baby steps of these changes at the moment, but I think in at most ten years, all non-hobbyist software will be built this way.
> For example, for years desktop apps were built on top of slow and heavy cross-platform frameworks like Electron, because writing them natively was too burdensome
It was not. Just by using QT you were on the fast track to support multiple platforms. And by 2010, most companies were only interested in Windows and MacOS. But today, it’s just laziness. Devs that only know web tech wants to use web tech everywhere, even when it does not fit the job. Hammer and nail style.
> In the past, test suites were mostly a way to catch regressions. In future, they will be essential to provide a verified baseline of correct behaviour?
And who will code these tests? To design good tests, you have to know the product quite well, and to know the product, you have to build it at least once. Because specs are full of knowns unknowns and unknowns unknowns. That’s why the best spec is the code itself.
Even when you know the requirements, you still have to design the test harness, and that depends on the products too. With the same caveat on knowledge.
Yep. iOS app landscape as well. /r/reactnative are pretty much dead now. Everyone write super optimized swift and objective c codes now :D. I'm not complaining. Some of my favorite niche ios apps are all under 10mb each post AI-renaissance.
I think the big issue is what the user sees and interacts with is like 4-5 of the products of the compilation of another 40-50 products that are underneath that spy on you to market, sale, and change the way you think. Without all of that the app would sure be 20-30 megabytes for posts, stories, messaging...or less.
I think you have some serious rose tinted glasses about the reliability of pre 2005 software. Windows almost never randomly crashes anymore but it used to be a common occurrence in the 98 days.
Speak for yourself, but outside of very very poor software, Windows 98, Windows 98SE, even ME were rock solid for me from what I recall. The only time I had really weird issues were very poor drivers. It was the absolute wild west back then.
Are you using "speak for yourself" to mean something wildly different from the commonly understood one?
Windows 98 constantly crashed and froze. It would even freeze during shutdown, and that was the standard experience. People during that period were paranoid about saving every change they made to their documents, and that was for good reason.
Windows 9x didn't even have proper memory protection, the most basic building block of any modern operating system. The fundamentals were as shaky as it could possibly have been.
Win98 and Win98SE would throw BSODs all the time, ME was even worse to the point where I switched to run Win2k on my gaming PC to not experience BSODs in the middle of matches.
This is definitely not true. The blue screen of death was from the Win98 era. How often are we seeing blue screens? I've only seen it once or twice in 10 years but Win98 was very common to see this. You're right, poor drivers in Win98 days would 100% blue screen but poor drivers today don't.
Poor drivers were often the cause of the crashes, so you might be in agreement. Whenever something wasn't working right (all the time), the standard advice was virus scan and update your drivers. Always updating drivers just in case that magically fixed something.
> As of now, I don’t see any of that being the goals even let alone the result. Instead what I see is that everyone is in a race to have as much product out as possible
If you frequent sites like Hacker News or other spaces where projects and announcements are shared, it’s going to look like this.
My friends who don’t follow these spaces have no idea, because those high volume, average quality projects aren’t newsworthy.
The highest quality projects aren’t out here advertising that they were built with AI. Smart teams know that saying something was built with AI is not an attractive quality for consumers. It’s only the teams trying to increase their status and make more content for their resumes who are blasting out announcements about how much AI they’re using.
From here on out, you can assume that any product you use will have had AI used in the development, likely heavily. You’re going to start running into products that blow your mind with their quality, UX, and polish where teams will have quietly employed AI to a high degree. Human input still remains a significant a valuable part of the process, but high performing and attentive teams are actually the ones most able to extract the best results from AI. They’re also the least likely to advertise that fact.
All of the “made entirely by AI” projects you see are going to continue being fun experiments to see what AI can do or little exercises in people trying to advertise their AI skills so employers will hire them or give them raises. When the really great products come along, they’re not going to come with “made by AI” advertisements at all.
> I the last two decades we have gotten so used to average or less than average product quality that we are willing to pay 2000$ for a device running an operating system like macOS or windows that ‘works most of the time’.
Sorry, but the complexity of these devices is much higher than anything that came before it.
What are you comparing this against, and why do you think it would be reasonable to expect higher quality at a similar cost?
With "AI" coding tools the relevant metrics are (again) LOC and token burn. But in the real life the fundamental truth is still the same, code is to be minimized.
AI isn't required. UX doesn't increase bottom line, so it's not targeted. Hiring a UX expert is a cost center, not just for their salary but the cost of changing things to appease them. Combine that with very little competition (to switch between Linux/windows/macos is not like switching from Ford to Toyota), and you have what we have today. People are prisoners and the UX is the food delivered by outsourced, lowest-bid third parties.
My solution is to have an independent ratings agency that gives OS' and individual apps a score. Then software makers could compete by advertising their scores.
My trust in these announcements: the goal seems to be to announce “AI can do this now, btw”. I see no care about delivering something that people want. The powers that be are happy to make the same thing but with some 100% AI attestation.
No human in the product making. No human in the product use.
This is why I am not worried about job prospects in software development.
Neural networks are just another abstraction layer that allows you to produce more functionality by typing fewer characters. A very smart, complicated library, if you will.
And just like all abstractions before it, all productivity gains will be gobbled up by capitalism.
Sure, you can use this productivity boost to do more. Some will, and we will praise them for it. But in a world where primary incentive is acquiring as much centeral bank bills as possible is the main KPI, productivity will be used to deliver the same amount of work (or less!), at lower cost.
Until the world in its entirety undergoes a dramatic moral and systemic shift, I sleep well at night.
> I hope we have products thanks to AI that compete on reliability of software and hardware to the point that the big tech will have to reinvent their processes just to be able to justify prices.
Which part of the entire history of our industry (and other industries) leads you to have a hope like this?
Yep you wouldn't need AI to deliver better quality products.
Software quality (or the lack of it) It's all about the process that produces it. Most companies don't run a quality oriented process. Accelerating the pace of change is only going to make things worse faster.
The title is a bit misleading—humans came up with all the insights and innovations here. What AI has done, which it is exceptionally good at, is take decades of brilliant ideas buried in research literature and synthesize them into a coherently engineered product. It would seem that AI is now doing an end-run around the innovator’s dilemma, or at least part of it, by dramatically lowering the R&D cost of productizing laboratory ideas.
The goal of AI science, AI electronics, AI software, when presented by a lab, is universally not to advance science, engineering, or what not, but sell their product. A product that, if we believe its marketers, is supposed to replace the human with a reduction in quality, not help a human perform to a higher standard. Why would they be contradicting their own narrative by actually crediting the engineers?
Maybe all the 'easy' discoveries have been made and the only new ones are be applying previous discoveries in increasingly complex chains/interactions/workflows.
Something simple becomes complex by increasing the number of relationships. Binary, DNA, Amino Acids, forces, our universe.
“Coherently engineered” is not how I would describe most AI output. If anything it creates a “passable prototype” for any system more complicated than a basic web app.
They're claiming better performance per watt, not better absolute performance, and out-of-order does worse on that metric than the superscalar in-order design they say they beat by 4.59×. That's why, for example, PULPino is in-order.
A third interesting metric is performance per transistor or per area, and generally the best designs there are the long-forgotten MISC designs like the MuP21 and the GA144.
The performance per watt of very slow CPUs is always very good, so that alone is not impressive unless much more data is provided to prove that is really better than what is typical.
On the other hand, the performance per area of the "traditional" CPU that is used for comparison, which I assume that it is some kind of RISC-V, is very poor, so that the performance per area of the new CPU is likely to be also poor, even if much better than that of the strawman.
Their "traditional" CPU has an area that is slightly bigger than that of Cortex-A720 made with a CMOS process almost twice as dense.
So if they were made with the same process, the "traditional" CPU and the new CPU would have an area somewhat bigger than a half of a Cortex-A720.
But Cortex-A720 is an out-of-order 4-wide superscalar core with advanced SIMD and scalable vector extensions, with a good branch predictor and with many other enhancements, for which the area ratio in the same process is expected to be much greater than 2 in comparison with the CPUs evaluated in TFA, while its performance must be several times greater than that of a 2-wide in-order CPU core.
So both the "traditional" CPU and the Frostbite CPU appear to have a much bigger area than expected for their performance.
Moreover, the performance of in-order CPUs is very sensitive to the benchmark selection and to the quality of the compiler optimizations.
So the performance obtained for the benchmarks selected by them, like FFT or LU decomposition, is expected to be much better than for benchmarks that would execute an application not dominated by such regular loops, but having lots of hard to predict branches, e.g. a compiler benchmark.
They say that the ISA will be published. At that time it will be easier to appreciate whether this CPU architecture is really innovative. For now, they have done a lot of work, by fully implementing the CPU core, but the data presented is not sufficiently convincing to demonstrate that it is indeed an architecture that will be able to compete with SOTA CPU cores, e.g. with those from the Arm company.
> The performance per watt of very slow CPUs is always very good
Generally this has not been my experience. Typically both very slow CPUs like the ATMega328 and high-performance CPUs like an Intel i7 are in the neighborhood of 1 nanojoule per instruction. (For operations more than 8 bits wide, the AVR is significantly worse.) Low-power CPUs like the STM32L line are commonly around 0.2nJ/insn. Ambiq's subthreshold logic gets them closer to 0.05nJ/insn.
The ATMega328 is fabbed in a 350 nm process, the STM32L1 is 130nm, while current i7s are 10 nm, so that's not a fair basis to compare the merits of different microarchitectures.
While that's true, I have a vague memory that ≈350nm Pentium IIs also used broadly similar amounts of energy per instruction, maybe an order of magnitude more. But I might be misremembering that. I remember that you have much deeper hardware knowledge than I do; do you know of a better comparison table?
I don't think fair comparisons are really possible across different processes. There's a lot of interaction between silicon process, architecture, and workload.
The fairest comparison is between chips from major vendors in the same year. If you're just doing FP32 matrix multiplies, a 2026 nVidia GPU is ~1 pJ / FLOP, an Apple M4 is ~30 pJ, and a 2026 Intel Xeon is ~50 pJ. The quality of process and optimization is a little different between those 3 companies, but not by as much as 2x. But from those numbers, you can reliably conclude that the GPU architecture is much better for matrix multiplies.
Yes, that is surely true. What about small in-order scalar cores like the PULPino? Maybe the M4 and Xeon are spending a lot of those picojoules on OoO, caches, speculative execution, etc. But supposedly the existing CPU that they're comparing Frostbite with is an in-order superscalar design.
I am of the opinion that even if this novel architecture doesn’t yield dramatic improvements in peak performance across broad classes of workloads, it may still be a welcome improvement in the legibility of software performance down the stack.
By this I mean: currently, transforming a program written in a typical high-level language to optimized ISA code involves what can only be described as black magic inside the compiler. If you don’t know the implementation details of modern superscalar OOO branch-predicting microarchitectures then you may have no clue why two very similar-looking functions could have dramatically different running times. Cue Matt Godbolt tech talk…
What I see as the more promising side of this type of development is a tighter coherence, and thus more transparency in expected runtime performance, between the software above the ISA and the hardware below it. Essentially we now have a linear machine with a linear source language, and with the popularity of Rust nowadays we actually have a critical mass of developers who are already used to applying ownership discipline in program design.
> They're claiming better performance per watt, not better absolute performance
I shouldn't have to read this far into the tea leaves to figure out what performance claims a company is making, but these facts combined sound like they're claiming much better absolute performance, too?
> Each Frostbite quad (a two-by-two grid of tiles) paired with four L3 nodes is 0.792 mm².
> This TCPU [the one they benchmarked against] is 0.895 mm² at the same process.
> Across all the workloads, we average an 8.77x performance-per-area
It got 8.77x performance per area, and was 88% of the area, so that's 7.76x actual performance, right?
Not that "a parallel processor outperformed a single-core processor on parallelizable tasks" is the most earth-shattering relevation in the world, especially when they won't say which single-core processor "for legal reasons".
The second paragraph of the linked page contains their first performance claim. It reads:
> On a set of 25 initially chosen workloads, including 15 held out until the final evaluation, we achieved a 4.59x performance-per-watt multiple when compared to a modern, silicon-proven superscalar (dual-issue, in-order) CPU core.
They do start claiming performance per area in the following paragraph, but that's not an interesting claim for a couple of different reasons:
- As I said above, MISC designs get dramatically better performance per area than any mainstream CPU.
- We're already in the dark-silicon era, where even the relatively low performance-per-area designs used in laptops and cellphones must thermally throttle on a regular basis to avoid burning themselves up, and contain many specialized accelerators used only a small fraction of the time (AES-NI, AVX-512, saturating 8-bit arithmetic, popcount, etc.) instead of additional small general-purpose cores that could run all the time.
Their claims would be a lot more interesting if they provided some kind of absolute numbers to compare against.
I think that 20 years ago creating your own processor as a startup wasn't really feasible, maybe with AI it has become? Some companies will try it out and history will be the judge of that
It's interesting to think that startups could design new processor architectures, but I imagine it'll be years still til a startup could conceivably manufacture them.
They are using _interaction nets_. Interaction nets date back to the 1990s, they are a fundamentally different programming paradigm which is parallelisable by their nature (graph rewriting that can be done locally in any order).
Isn’t this similar to every other alternative architecture that it relies on a “sufficiently smart” compiler to handle the all the dependencies and get increased efficiencies. It isn’t clear to me what exactly is different this time and why it will work better in practice than all the prior attempts.
In the AI/AGI/ASI era, the 4 most valuable things will be:
- Model
- Compute (chips/energy)
- Manufacturers
- Materials
You can already see it beginning at the chip design stage. If AI makes it so that it takes 2 months to design a chip instead of 2 years, then there will way more chips designed to accelerate applications that previously weren't viable economically.
Therefore, it's manufacturers like TSMC that will become more valuable. There will be more chip companies, more designs, more demand.
And in order to make things, you need materials.
In order to design the chip, you need the model and AI hardware.
Why you wouldn't ask the ASI to design a TSMC too? Then the silicon (sand) will become more valuable. Even raw materials may become less important if ASI manages to achieve space elevator or something like that. But my prediction is that the growth of current AI generation is hitting end of the S-curve, and an AI era where AI can design chips in 2 months and fabs in 2 years is not as soon as it seems to be.
I don’t think models will be valuable. It’ll be a shared commodity. The models all seem to converge in performance, and eventually fully open source models with open source training data will become “good enough”. We may end up with a “Linux” of the LLM model world, that just ends up dominating everything else.
It’s similar to how proprietary source code is rapidly losing its value. The most valuable code now is open source, and whoever is best at building processes around open source becomes the winners.
One caveat is that new AI architectures could change the equation, at least temporarily.
We’re converging on intellectual property losing its value in general. What ends up being valuable can be boiled down to culture, human processes and physical materials.
I’d say TSMC becomes less valuable because there will be multiple fabs trying to meet demand. There’s no way for a 10x increase in fab capability to be handled by just the very few companies that exist.
Also most likely these bespoke chips wouldn’t need the latest nanometer processes to work more efficiently, lowering the value of highly advanced EUV machines.
I’d say TSMC becomes less valuable because there will be multiple fabs trying to meet demand. There’s no way for a 10x increase in fab capability to be handled by just the very few companies that exist.
Maybe Rock's law will change now that AI makes technological development less laborious, which is where the money was going. All non-technical overhead also gets reduced; what a 10-person company can do today assuming they can run their agents 24/7 makes the situation from just 10 years ago look medieval. So we'll see more foundries and more production capacity pop up, nibbling at TSMCs feet.
It's just a guess, but given that it takes 20 years to take a chip manufacturing idea to market, ideas are not the bottleneck, but working in the physical world is.
These companies operate under a strict risk modeling framework for their investments, trying to model 10 or so years ahead, because in order to stay profitable they have to shell out 10s of billions at a time. So competition may arise, but very slowly. Heavily simplified.
> there will be multiple fabs trying to meet demand
From what I know, that's easier to say, than to implement. Creating a chip is so complex, that it works for TSMC because of the scale. On lower scale, production won't be profitable.
No, they just revived the idea and the popularity of Rust means that now a critical mass of developers are used to single ownership and linear types. Which was not true in the 1980s.
Genetic algorithms for circuit synthesis aren't a new concept. It found its uses in niche areas like antenna design but wasn't particularly useful for much else. Specifying good utility functions is difficult, and hill climbing them takes impractical resources and time.
The technology may be different but the conclusion is similar.
Not all CPU/GPU architectures have a single global memory space. AMD GCN GPUs have global VRAM, local SRAM for each compute unit(CU), and a global SRAM that all CUs could access. Neither GCC nor LLVM were great at optimizing OpenCL to make effective use of those different memories, so getting the highest performance sometimes required the use of AMD GCN assembler.
Yep. In 1 year from now, imagine what we will be able to do to improve existing computational power per watt/unit of input material.
Oh boy, its going to be a wild ride, hopefully at the end of it we are all merged with the digital Overmind God and not in a 'I have no mouth and must scream' kind of way. But nothing we can do about it now.
It seems like this hardware architecture would need it's own kernel / applications? Porting existing x86 or arm applications to "interaction nets" would be pretty hard to do performantly.
The architecture doesn't even have a program counter or call stack, any application running on it would basically have to be programmed in Vine.
Feels like the visualization is doing a lot of heavy lifting, because the explanation sounds quite mundane (randomly rewriting interactions between two points in a program graph?)
It is also written as if this is a new idea for programming languages, but modelling things as a graph of nodes is like 101 stuff?
I note that the kernels they tested are computation-heavy tasks on essentially fixed- and small-sized working sets, possibly even tasks that are efficiently representable without state that gets used an a priori unknown number of times. (LZ4 decode is a bit of an exception - you don’t know how many times a given position will be copied in the usual streaming decoder, but there may well be a different decoder in which you figure out what future tokens look at an output byte before you emit and discard that byte.)
I wonder how well their design works on the kinds of programs that build large data structures and slowly mutate them, or whether their current design even works at all for such problems.
(Don’t get me wrong: lots of useful problems clearly fit their model. And even if there are problems that don’t, I imagine that much of the compute part of a memory-heavy problem would still work well on something much like their design.)
That is a very nice use of AI. An exploratory project that would take a team many months and would never get funding in such scope is being done much more efficiently.
As to the architecture itself, it is promising, but it is hard to say if it will not suffer from difficulties in writing software for it.
It reminds me of one British computer that had physical hardware nodes, each connected to few adjacent ones. With no time synchronisation, each running independently, communicating through ports to adjacent nodes only, and so on. It died outside of academia, because of the difficulties in programming it and progress on classic architectures.
As we are close to the limit of miniaturisation and at the same time experimenting becomes cheaper I wonder if novel architectures will have their another heyday.
It's similar: they don't want it designing an architecture that overfits to exactly their 25 evaluation workloads, it's supposed to be general purpose.
This is interesting but as far as I can tell there isn't a call stack or program counter. A source level debugger for Vine is a requirement and if it doesn't already exist would represent a substantial engineering project. Also, values can leak if a wire isn't connected properly or a net could get stuck if nodes were waiting on each other in a loop or for a value which never arrives. It's the equivalent of deadlock or a memory leak, and they should reproduce reliably, but they are a new kind of bug class to learn and deal with.
Hmm, interesting. Interaction nets are basically dataflow graphs for pure programs. But AFAICT they do not model stateful computations or control dependence for termination. I don't see how they addressed those problems in the IR, but I only had a few minutes to read the first part and skim the second parts.
How is this different from letting coding agents write SystemVerilog (or Chisel/XLS), cocotb, and sby for verification + some formal verification using Lean or TLA+?
The frostbite tiles and their work-stealing is reminiscent of a 2d-grid of basic blocks from compiler design. Register renaming or something similar to it also seems to help building intuition about this.
Instruction nets sound intriguing, but it looks like execution is based on rewrite rules. Does it need a lot of copying and marshalling to get work done?
You need either the compiler or the programmer to do the parallelization, and in practice the communication costs between cores can be large enough for the parallelization to not be worth it for simple programs.
This ISA seems to be designed to:
1. make the automatic parallelization easy (with workload split between compiler and hardware)
2. make communication costs between tiles very small, so that even very simple workloads can be automatically parallelized.
Also, and I assume they don't have a physical chip. In that regard, when considering performance per watts, the obvious comparison would be against the Mill architecture.
> Moreover, single-core CPU performance has largely stalled since the early 2000s, pushing people towards large multicore CPUs such as Intel Xeon, AMD Zen, and NVIDIA Vera.
Huh? Have you tried the Apple's A + M-series of processors? It has dramatically improved performance and tends to increase single core around 15% per year and it compounds.
The drive towards multi-core architectures is real but it isn't because single core performance has stalled, it is that we want to scale faster than single core performance increases.
These are basic facts that this article is getting wrong. How many more basic errors are in this?
> Does it, or is that because of the large caches and memory bandwidth? Honest question.
The burden to prove your "honest question" claim is on you, not me.
CPUs are incredibly complex and many things contribute to sustained improved performance year over year. To simplify it to just one or two things is showing a lack of understanding of the topic.
I didn't make this claim that he wants me to prove:
> "Does it, or is that because of the large caches and memory bandwidth?"
He made that claim, not me.
The fact that single core performance has been improving consistently in a compounding fashion in the Apple series of M and A chips is a historical fact.
Intel's Lion Cove core is 3.43mm2 without L2 cache and 4.53mm2 with private L2.
M5 S-core is 3.4mm2 including private L2.
But Intel's Lion cove is on N3B while M5 is on N3E which is about 10% less dense. do the math to scale up Lion Cove to N3E and it becomes around 5mm2.
That's 25-35% bigger for worse performance on the same node.
AMD could have gone with 3nm, but went with 5nm (N4P is 5nm++) instead. 3.72mm2 for the core and 4.77mm2 with private L2 cache.
N3E has the same size SRAM as N5/N4. Theoretical logic scaling is around 1.5x (216 MTr/mm² and 143.7 MTr/mm), but high-performance layouts don't get anywhere near that number due to the extra spacing needed for wires and transistors.
If we assume there's zero SRAM anywhere in the core (not true with large register files, L1, uop cache, etc), we get about 2.51mm2 for the core plus another 1.05mm2 (no cache shrink) for L2 giving 3.56mm2 (bigger than M5 S-core). With a more realistic shrink, we could be talking a total area of 3.9-4.2mm2.
TL;DR -- even in the absolute best-case scenario, both Zen5 and Lion Cove are bigger than Apple's M5 S-core.
Is it because the cores are more complex? They have to run x86-64 not arm instructions. I know they all run microcode internally, but maybe the translation layer is simpler on arm.
Honest question again <waves to whoever was ticked off by that>.
I could ask a LLM but HN could use some actual discussion.
I believe the complexity of x86 bleeds throughout the system complicating and bloating everything.
Apple doesn’t need uop cache while x86 designs do which means more power and area.
ARM has looser memory ordering which improves performance. x86 can do this too, but they have to add an entire memory speculator and all the circuitry to handle when the predictions are wrong. Again, that’s extra area and power.
More controversially, x86 decode is still a significant part of the core area. ARM A715 cut decoder area by 75% just by dropping ARMv7 support (and it’s nowhere near as complex as x86). If the decoder is just 5% of the core area (and basically always on), cutting that by 75% means reducing core size and power by a significant amount. I’d also note that a company doesn’t choose complex 2x4 or 3x3 decoder implementations with massive complexity and inferior worst-case performance unless something is forcing them.
The situation isn’t quite as bad is it might otherwise seem though because 512-bit SIMD as it adds to core size (though arguably doesn’t add very much to most workloads over 128-bit aside from some great new instructions). We can calculate this with Strix Point which uses 256-bit “double pumped” SIMD. The core plus L2 area drops to about 4.2mm2 (or about 3.1mm2 for just the core). Using perfect 1.5x scaling for the core and no scaling for the L2 gives around 3.2mm2. Assuming more reasonable 1.3x scaling (which might still be too generous) gives 3.5mm2 which is still bigger for worse performance on hypothetical N3E vs M5 S-cores.
Even in the best scenario, x86 is way behind in total performance, perf/watt, and area. If we assume the engineers at AMD and Intel are good at their job (a good assumption given how long they’ve been beating everyone else on the planet), it only leaves the ISA holding them back complicating things with legacy bloat.
You’ll see a lot of pushback to this idea, but never much of substance to the assertion.
Maybe it did, maybe it didn’t. But you can almost guarantee it will when it iterated and tests and changes and iterates and test and changes and…
How many times has a bold and maybe even exaggerated claim come out and people respond “this is false hype”, or “this is misleading”, or “ehh, only kind of in some technical sense, but don’t worry”. Only for continual iteration and breakthrough to have all of us agreeing one week later that it is indeed doing whatever thing and even that this is old news now.
If the frequency increases, that’s the intelligence explosion…
I don't personally believe that intelligence is one dimensional, to the point of doubting that "general intelligence" exists or is even a valid concept. It's like saying "general locomotion." There is no such thing. There are wings for flying through air, fins and rotors for water, legs and wheels for land, rockets for space. A wheel doesn't work well in the air or space and a rocket is a poor locomotion method in the water.
This implies, BTW, that I don't think humans have general intelligence, because I doubt the existence of such a thing categorically. We get all up in our egos thinking we do because we feel so smart at all the things we're smart about, and of course we can't see the other things because we can't see them. Might not even be able to imagine them.
A chess algorithm is superhuman at playing chess. A human beats AI at writing prose or telling a joke. AI can beat a human at bug-hunting in a giant code base or constructing a large mathematical proof. Humans can beat an AI at dreaming up entirely new directions for mathematics. AI can beat humans at taking those new directions and fleshing them out and relating them to current art.
And so on.
We in fact tend to build machines to be hyper-good at things we are not good at, because that makes them useful to us. So we make AI that is better than us at fast thinking, huge context windows, huge scale associative memory, etc., just like we made classical algorithmic computers that were hyper-good at doing math.
I'm always amazed by this perspective. Despite the fact that a single principle component falls out of all analysis of abstract human tasks across individuals, there is a large contingent of people that still "doubt the existence of such a thing categorically".
There has been an open question in psychology for almost 100 years now: can you design a solvable abstract task for human performance that isn't correlated with this principal component? No one seems to be able to do it, and the AI models have only reinforced this. Making AI models smarter makes them better at almost EVERYTHING. The scaling properties of LLM models, and the scaling properties of neurons in the brain, ensure a general improvement of pattern matching that seems to be task invariant.
Personally, I am convinced by the speed hypothesis here. Since IQ in humans is very correlated with thinking speed, the ability to generate and evaluate more hypotheses per unit of time yields general improvement.
The scepticism among the comments is likely warranted - but i for one really think this area needs more research. x86, ARM and RISC-V are for sure "good enough", but surely those won't be the "final" design of cpu architecture.
We know from brain imaging studies where evolution has had billions of years to perfect design for function, that different brain areas have different wiring types. This suggests that similar pattern for silicon based computation devices where multiple architectures might be optimal for different problems.
Also, this is an early stage technology that might be promising and it should probably be compared against x86, ARM, and RISC-V in their early stages. I feel like we are comparing a young up-start against established legends.
> We believe AI fundamentally changes these economics. In the search for higher performance and lower power, extreme co-design of workloads, ISA, and hardware will continue to be demanded.
yeah this is why the "AI datacenter" debate frustrates me. People take it at face value that the enormous power demands of AI are immutable - they're thinking in a 20th century way where we're powering like, air conditioners or something that aren't changing. It's not at all a given that AI is going to demand power in a year or two the way it does now, these are problems that should be solved, not used as a reason to abandon the whole technology.
I want this to be interesting, but instinct says despite the investment and namedropping on their about page, this is nothing until they show something. The language is vague in the wrong ways. It's either truly great, or they're afraid it sucks, or they need to waffle for some competitive reasons that aren't clear to a reader. It doesn't seem like there's enough fundamental information here to care.
Is it that they don't want to overstate their claims to investors who have to decide whether to actually build these, in case the results they're predicting don't add up?
Either way, we need to be working on EDAI, so if they've got something, hopefully it's something.
Am I the only one who gets really bothered by the use of "by AI" instead of "with AI," in these kinds of statements? Like, the LLM didn't just decide "oh, this looks like a neat thing to work on" all by itself.
Absolutely breathtaking number of claims, and impossible to find the seam between human endeavour and spambot output. Would love a sober overview of this from a suitably competent human, history is littered with promising sounding architectural approaches (anyone remember the Mill?) that went nowhere.
I'm always on the fence and I only believe it when I see such a CPU manufactured and running crysis with better metrics (energy, performance, thermals, stability) than a regular off the shelf cpu as we know it. It needs some sort of proof an average Joe, like me, can see and understand. Until then its just theory to me.
i.e. signal-to-noise ratio has lowered dramatically and news platforms such as this cannot cope, unless they basically turn into clickbait and hype factories.
We used to say ‘show me the code’, we need a bit more proof today. Or just wait it out to see if the authors are still pursuing the same idea 3 months later or have they already moved on.
Before even reading anything the word discovered on the title triggered me. It's was not there waiting for someone to find it - like electrostatic attraction/repulsion. It was either designed or "statistically and agentically arrived at it" if my high level mediocre knowledge about how people use AI to research those things is even a little relevant.
It’s more like it took some really clever insights sprinkled throughout a few decades of hardware/compiler/PL research and did all of the engineering and design work to turn those brilliant (human generated) ideas into a formally specified standard.
They claim to be backed by $24M seed funding [1]. Interestingly, they seem to have copied the entire approach from Tendrils Compute (even using their Vine & Ivy languages), who recently got $30M seed funding [2]. Are the companies related, or did architect labs just steal their idea and dump it into an LLM?
Reading through this it reminds me of all the exciting computer hardware research happening in the 80s, with the rise of VLSI and systematizing chip design. Then Intel ate everyone's lunch, lol.
I think for HPC there's still a lot of untapped potential for chips like these where you're doing primarily "computation" in the sense of crunching numbers. We're seeing that with GPUs, TPUs and with Tenstorrent. For general purpose applications though Amdahl's law strikes again, and the longest serial task is what ends up slowing everything down. It seems modern CPUs are mainly designed around this bottleneck, which is why imo out of order execution will almost always beat in order execution designs for most day-to-day needs.
One other thing I've been wondering about, what would realtime programming look like on Frostbite? Could you make guarantees in execution time? To be fair realtime is quite tricky on out of order cores, but I'd be curious what mental model you'd use for realtime on something like frostbite, or if serial logic still rules.
(dual-issue, in-order) CPU core - this puts you in microcontroller core class and energy is the most important part here. at the end you see the numbers, but synthetic benchmarks have close to zero relevance in that scenario. all around fishy whitepaper-like ai slop corpo blogging to generate buzz
So far this thread is a little breathless about AI.
This looks cool and all.
But, can someone with CPU experience give an opinion? Does this blow your mind? Or is it trash?
Like how the new math solutions when read by a mathematician seem 'ugly', even if technically correct. Does this look like something actually alien and groundbreaking?
I'm not in the industry, just a casual observer (went to school for it though). But it looks similar to the kind of thing that would come out of academia (few profs + grad students), plus a lot of LLM-written hype.
It's not especially hard to get chips that win in some metrics on some inputs, especially when you get to design the ISA.
I don't see any indication that they got their chips fabricated, which is the "last 90%" of the work.
Looks like AI doesn't have to fall for C hubris. Honestly, if you want to make it in this new AI age I recommend you to question every single thing that is considered set in stone, anything that is considered "the natural order of things" in software development. Think hard outside the box.
I don't know why nobody is seeing the problems with C. From my perspective it's not useful to think of C as a portable assembler or a thin layer on "top of the machine", because it makes C machines look eternal and timeless, even though we are deep into the post C machine era of multi core processors with cache coherence.
>Mainstream programming languages, when compiled for general-purpose CPUs, hide the dependencies between the parts of a program. Any piece of code may read or write any variable through a shared, mutable state, and so modern CPU hardware assumes the worst case and rediscovers, at runtime, which instructions actually depend on each other.
To this day I still wonder why people aren't seeing the immediate glaring red flag that the conventional sequential programming model presents. To this day people keep building inherently sequential languages and then wonder why parallelism is so hard. It's hard because you made a fatal assumption: There is only one global memory. How exactly is anyone supposed to reason about such an omnipotent and all powerful concept, where everything can potentially affect anything? If you have two cores, the entire idea of a singular memory screams like a bottleneck. Like, it's crazy to me that anyone would think in 2026 "yup, lets build another sequential language that makes our lives a living hell".
>Moreover, single-core CPU performance has largely stalled since the early 2000s, pushing people towards large multicore CPUs such as Intel Xeon, AMD Zen, and NVIDIA Vera. This forces CPUs to maintain the illusion that every core sees the same memory, and keeping that illusion consistent and performant requires deep cache hierarchies and coherence protocols that cost area and power, and scale poorly.
Correct. Because everything potentially depends on everything, you need to figure out at runtime when things don't depend on each other, which is kind of insane when you think about it.
The assumption of a single global memory is what doomed C. It's the 21th century. Computers don't have global memories anymore, they pretend they do.
You can't fix it. No amount of nostalgia towards C is going to fix this mistake.
Also before someone accuses me of e.g. being a C hater, I'll tell you that Zig's IO Backend parameters are the same type of flaw in Rust that probably will never be fixed. Implicit IO is a different kind of global state that Rust inherited and from the 2026 agentic coding perspective it's a pretty egregious flaw because agents don't care about passing in a parameter, meanwhile from the perspective of PL design, using a parameter instead of a full on effects system has this certain charm / beauty to it, how you don't need to special case everything to get the same results. You just use what is already there.
> keeping that illusion consistent and performant requires deep cache hierarchies and coherence protocols that cost area and power, and scale poorly.
Cache hierarchies also exist because memory latency and capacity tend to be inversely proportional to each other, and directly proportional to cost. The underlying process and physics of chip design works against you on this front.
I'd love to have 1 GB of L1 cache, but that is simply not viable because your cache would be as big as your core, way more expensive, and by the sheer size, it would become a NUMA cache, which defeats the point of a cache and the "illusion" of UMA.
Yes, there’s a notable IEEE article from like 15 years ago that riffs on these same points—the gap between the abstraction presented by the typical ISA and the actual microarchitecture is too great to ignore and we have blindingly complex and opaque layers of compiler optimizations and OOO pipelines that exist solely to maintain the fiction for programmers.
I think the greatest benefit of rethinking CPU architecture at the level of the ISA will be to make performance more transparent to developers without the layers of black magic.
> It's hard because you made a fatal assumption: There is only one global memory. How exactly is anyone supposed to reason about such an omnipotent and all powerful concept, where everything can potentially affect anything?
Because parallelism is not that needed, there’s always contention starting from physical constraint. A user can only have one body, a printer can only output one piece of paper at a time,… There are natural areas for parallelism and it’s been already implemented. Memory as a bottleneck has not been a things for decades.
Breaking down things in terms of tasks is not hard. The hard part is discovering that those parts need to communicate. And sometimes they want access to same limited resources. We already have things like array programming that have a parallel view of computation. But no one is rushing to get things done with them.
I agree, I've always viewed C as a sort of domain specific language for Von Neumann architectures. We only call it a "general purpose language" because the domain was so big, but using C to write multi-core distributed, networked programs to me feels like using CSS to write an operating system.
I'm with you, but I don't see a clear path from "here" (illusion of the same memory) to "there" (each processor has its own memory, I guess). It's really hard to reason about latency, synchronization and communication costs in the abstract.
In a way I see the various cloud computing services as the organically grown (i.e. haphazard and clunky) answer to this problem.
One of the reasons it is so hard is because the discipline of thinking about those things isn’t baked into the language like it should be. You can’t look at a piece of code in a typical high-level language and reason about synchronization overhead because those semantics aren’t expressible in the code. We need languages that support expression of effects and coeffects, which would enable that kind of high-level reasoning about tradeoffs.
If we have enough fabs theres a world where every single problem has a completely custom chip to maximise efficiency of whatever problem needs to be solved. End to end AI - Ask to solve a problem, AI designs the chips, fab delivers it, AI writes the software in a completely custom language. Nobody will understand how anything works other than knowing that it does work
AI so far can't really do anything that humans can't though? (obviously it's infinitely faster) if building extremely customized chips so far has proved to be suboptimal (even if we partially exclude the engineering salaries) why would AI change that?
This approach also implies that optimization and performance will be come highly important? But it's not (outside of a few use cases) and the software that even the SOTA AI labs are building is often an unoptimized mess just like human written software used to be (if not worse)
It is NOT about what human can do or can do better. It is about how fast AI based models can do and for how long they can keep doing without getting tired.
As an evidence, ask anyone of the programmers using LLMs to code. Who gives up first and needs a break to come back next day?
Right now, the cost that limits doing small custom chips is not designing the chip, it's the cost of making the mask sets for the chips and other foundry NRE, which is well above $50M for a single leading edge chip these days.
This money is generally not spent on things that AI can easily make cheaper.
Surely this also potentially unlocks the scenario where “good enough” chip fabrication becomes easier, because not everything needs to rely on the single-most-cutting-edge node-fabrication capabilities, because they can now gain more from architectural customisations in return.
Isn’t there an old episode of Star Trek where they visit a planet with a population that has become utterly dependent on a supercomputer? And as a result everyone has become very stupid? Will have to track that down…
That's the good old recurrent theme of the lotus eaters, I don't think any Star Trek series has missed taking a shot at it. Weirdly, you'd think that the main computer in Star Trek would have made them stupid, but they override it pretty frequently.
> But current "home" lab 3D printing is incapable of producing chips
Current "home lab" 3D printing is fundamentally different from chip manufacturing (additive manufacturing versus lithography), so it's unsurprising that it's incapable of producing chips.
Modern chip fabrication occurs on a microscopic scale. It requires extreme precision and thus must be done in a highly sterile environment. The slightest speck of dust is enough to ruin the output.
Producing such extreme controlled conditions is unlikely to ever be practical at "home" --- certainly not any time soon. Packaging a nuclear reactor for home use would probably be easier.
Wouldn’t AI design a completely programmable base that can become any type of chip instead? It seems limiting that you’d need custom chips for different tasks, a chip could morph on demand, even include different architectures that change during runtime dynamically, or even reinvent itself as required.
If we use the very abstract term “the future” that is.
It's a marvel that you can download a 12Gb file that's basically a neural net smart enough to discuss any age of history, identify photos, etc, on a local chip - all in the space of 3 or 4 high res movie files.
That shouldn't be possible; it means that we've found ways to compress knowledge into spaces smaller than logic would indicate we should able to, and now we have these tiny brains we can take around with us on a laptop that can recite history. When I was a kid there was an electronic encyclopedia you could buy, with condensed articles, and maybe a few megabytes of memory, and that was kind of "magic" ...it made me think of Hari Seldon, or the Hitchhiker's Guide.
I'm not sold on the idea that the compression is working as well as people say it is. But we're compressing on ideas now, not letters or words. Ideas are orthogonal and the damage or loss from compression isn't immediately visible.
Wow, I posted this and come back a few hours later, and the comments are... a bit depressing honestly.
Do people here know what interaction nets are? They are a fundamentally different programming paradigm, different from the most basic harvard architecture of the 1940s. Whether you think this particular implementation will genuinely support them, and whether that will bring the performance they claim it does, it another question (I'm not sure). But at least can we focus on the topic?
https://en.wikipedia.org/wiki/Interaction_nets
Thanks for sharing, TIL about interaction nets. I found the article linked at the bottom easier to understand[0].
> Another issue with multi-core CPUs is the difficulty of programming them. Debuggability is a major issue, and entirely new classes of issues arise, such as race conditions. However, in interaction nets, all active pairs are independent, and so can actually be executed in any order. This property is known as confluence, and means that no matter the order in which things are executed, the result will be the same. This makes debugging straightforward and eliminates issues like race conditions. This allows Vine to be parallel out of the box; the programmer does not have to do anything special with threads, processes, CUDA kernels, etc. to get parallel execution.
[0]: https://tendrils.co/blog/2026-04-26/on-inets
I'd be interested to see how this would pan out.
Seems to describe something analogous instruction level parallelism, which traditional CPUs made this millennium have as well via instruction pipelines, branch prediction, and speculative execution. Some of which turned out to not work too well so now we generally run hobbled CPUs with Spectre/Meltdown mitigation enabled.
The reason why we tend to reach for difficult abstractions for core level parallelism is that most automatic/safe approaches tend to stumble pretty hard on Amdahl's law, where most parallel code is consequently almost entirely designed around minimizing critical sections.
I don't fully see how inets would resolve Amdahl's law.
I think you're thinking about this the wrong way. This isnt about surpassing theoretical parallelism limits. Its about gaining parallelism without having to be explicit about it. If you look at the solve function from the page, its doing a brute force search of the 5 queens problem. In the naieve implementation, this is done serially. But with the different approach to compiling the implementation, we can essentially "automatically parallelize" it. Thats the difference between the animation on the left and right. The thing is that in order to handle fine grained parallelism like this you need better/different hardware primitives so that you can split computation at a more fine grain, which is why they needed a new hardware model/isa. This is how they achieved the 4-5x speed up: by automatically parallizing a serially implemented function. If you were to compare a parallelized function to their parallelized function, I would expect to see a smaller speedup. Or at least as I understand it. Correct me if I'm wrong.
I read through the first half, but the graph operations are really confusing me. What's the difference between a principal port and auxiliary ports? A lot of the rewrites are swapping them around so I'm confused what their significance is.
This is the key feature of the architecture. Computation is shown to be localizable and independent in terms of 'active pairs' which are defined as elements connected via their 'principle port'. Since the design permits only one 'principle port' per element, all possible graphs that we can arrive at with this formalism can only have components that 'exclusively' participate in a single 'active pair'.
So there is 'no sharing of state' baked into the computational model by design, enforced by this very simple and elegant design choice.
I was a bit surprised by Vine's syntax. I expected something a lot more like Lisp.
For me, the edges are still too blurry for me to make out what this actually is. I need someone with more in-depth knowledge to let me know what is actually being proposed here.
On the optimistic side, this looks like a kind of "bigger step" in the direction that GPU/shader programming took, where you change the way you think about and break down a problem to get insanely fast results. Feels like if you target this interaction net structure and give it to this CPU that uses them natively, we could amplify the speed of computations to possibly allow for things that are currently way to slow to do. Realtime physics sims with magnitudes faster steps. That's pretty cool. And all of the downstream effects that would allow for, in product design, scientific modelling, etc. And that's just one train of thought.
On the pessimistic side, though, I have no clue how to "program for an interaction net". Seems like the authors took a "you don't need to, an LLM will do it for you" position, and I can get behind that, but that's a pretty huge step in the direction of "Natural Language Programming" in that I literally can't program it without using an LLM and natural language, because I don't understand the underlying details and probably won't have any structural support to understand it for a while, as the tooling slowly rolls out and gets iterated on, until it can do something we can recognize as "Debugging". I imagine there's some kind of "program it in C, and translate it" thing, too, but it feels like the point here is not to have me be able to debug it, and a detour through C just wastes LLM tokens.
So those are the initial impressions, but then I'm making a TON of assumptions in both sides of that. So I don't even know if my initial impressions are conceptualizing the right paradigms, much less if they are worth discussing with people who are seriously considering this topic. Only speaking for myself here, but at least my own silence is due to not having enough information myself, and not seeing enough in this paper to interest me in research in the topic just yet. Maybe if they've got something I can play with, I could get my head around it more. But, for now, it's just neat.
> Feels like if you target this interaction net structure and give it to this CPU that uses them natively, we could amplify the speed of computations to possibly allow for things that are currently way to slow to do.
I mean, it's basically what out-of-order CPUs already do: read lots of instructions in at the same time, dispatch instructions as their inputs become ready to execute.
Sort of the reality of modern processors is that we have the units available to do the work, we just don't have dispatch logic to keep them fed with work, given how slow memory is. When you have very regular parallelism--dense linear algebra is the canonical example here--SIMD works very efficiently to minimize the dispatch logic needed to keep units fed. When you've got irregular parallelism, dataflow architectures seem to work well at first, until you start trying to make actual chips and you find you've been consistently underestimating how much overhead your dispatch logic is actually chewing up.
Right. Sounds like that to me, too. But, again, I'm completely new to the topic, so what do I know?
If it is true that what is offering is some kind of "super-simd" processor that is built in a way that everything run through it must be similar to simd style code, but because it's hardware, it will run it much faster, then my questions are definitely targeted toward what the speed up is vs a highly-performant SIMD application. I would hope that their "coming next" stuff includes comparisons against the types of SIMD-boosted dense linear algebra you referenced. What is the speed up compared to that. And if it's less than (arbitrarily, say) 10x, how much can be gained by just having an LLM target breaking more stuff down in to multiplex-able instructions? But then, if it's more than that, my questions start turning towards "how much would it take to prototype" and "how much has to be changed from current tooling to produce the chips at scale" and "what is a good showcase target for an initial run? what would be something that could be made actually (in real dollars/hours) cheaper/faster/better by using this chip?"
From what I got, the magic is possible because the software is expressed as interaction networks and the CPU doesn’t need to resolve inter-instruction dependencies because the program makes them explicit.
Isn't this just VLIW / EPIC that failed spectacularly in the early 2000s?
> If it is true that what is offering is some kind of "super-simd" processor
if it is, that has been tried before and failed (with itanium/etc), because the optimization burden on compilers means that they never end up getting the projected speeds over conventional execution
Interaction nets are a _model of computation_, not a programming paradigm.
I.e. they are on the same level as Turing machines and Lambda Calculus. Arguably they are more elegant than LC as beta-reduction doesn't look like a primitive operation.
E.g. if try to 'run' Turing machine using pencil and paper, a primitive step is to update one step. With IN one step can also be 'local'.
OTOH LC beta-reduction might be impossible to do in-place - you might need a lot of new pages to do just one beta-reduction.
I tried reading that when it was mentioned earlier here on HN, and the fact that the pointy end of the triangle isn't an output, nor can I tell where the outputs are, breaks it all for me, the cognitive impedance mismatch is too damned high.
People had a lot of novel ideas for nomenclature back then in the 1940s, that just don't work 80 years later, it's a shame they still clung on to it in 2026.
I've been thinking of a calculator builder tool for OSRS for a while now, and it seems like I was just trying to use interaction nets! Thanks for the terminology :)
> Do people here know what interaction nets are?
Even if people know they are it doesn't help that a good chunk of the article is dedicated to their AI methods, and there are very little technical explanations of how this actually works.
There was also a smaller scale approach called edge/trips that could express code as a dag: https://www.microsoft.com/en-us/research/publication/evaluat...
I think that data flow computing paradigm subsumes interaction nets.
[1] https://en.wikipedia.org/wiki/Dataflow_architecture
Every step there is local, every dependence is explicit and every value has only one owner.
In the context of this story, I wonder whether interaction nets are more amenable to hardware implementation? I plead ignorance about how the dataflow paradigm maps to hardware.
same as interaction nets, no? except they are strongly confluent and have incremental sharing
[1] https://dl.acm.org/doi/pdf/10.1145/93548.93578
Have authors compared interaction nets to the data flow machines? No.
They did not even compared their results to the Transport Triggered Architecture [2] automatic core construction workflow.
[2] https://web.archive.org/web/20051125195128/http://ce.et.tude...
In some cases (FFT), TTA's automatic synthesis was able to provide power-per-operation reduction of three orders of magnitude, when compared to specialized ASIC hardware.
I mean, it's not like interaction nets don't come up every now and again. I remember the Bend language making the rounds here several times, v1 of that language was built on their own HVM, which uses interaction nets, it's a niche idea but not a completely forgotten one (Bend 2 appears to have dropped them due to perf reasons). We also get the occasional articles on revolutionary new (old) CPU architectures that will displace everything, last one I saw was pushing VLIW as the silver bullet that would displace the current CPU giants and make x86 obsolete. I don't see much reason to believe that this approach would overcome the main barrier to adoption that those approaches failed on, which is the cost of porting existing software across, unless the creators are willing to front the token costs for that.
Also, the article title is one that heavily emphasizes the AI autoresearch aspects, and doesn't mention interaction nets at all, so it makes sense that people would go into the article primed to think about the autoresearch aspects.
You don't have to make x86 obsolete to be successful. You can just add extra accelerator chips. GPUs did this, NPUs are trying to do this, and there are plenty of exotic accelerators inside modern computers doing specialized DSP tasks.
If this stuff works, it'll surface first as some PCIe extension device that work can be dispatched to when it makes sense. Then maybe it'll get integrated into SoCs and be exposed via new CPU instructions or devices. Perhaps compilers can then start to identify blocks of code that can be reduced to interaction nets, compile the net and then run them on Frostbite style chips opportunistically.
Did not know Bend dropped them. https://raw.githubusercontent.com/HigherOrderCO/HVM/main/pap... was interesting.
People keep rediscovering the same ideas and renaming it. Interaction nets are another kind of graphical dataflow model. There are lots, but they are all basically the same idea.
//I don't see much reason to believe that this approach would overcome the main barrier to adoption that those approaches failed on, which is the cost of porting existing software across,
Llms are pretty good at porting software.
> Wow, I posted this and come back a few hours later, and the comments are... a bit depressing honestly.
I think AI sentiment is charged and skews negative amongst culture, but very negatively charged amongst engineers because of the "impending doom" and how our jobs are obviously changing. The craft is arguably gone. Interesting news just becomes another rung in the ladder of job insecurity.
Nice to see you on the interwebs Chris-san :)
5 years ago this would have been super cool to me, but now it feels like the gun aimed at us will one day soon use bigger/faster bullets
All things being equal, I could see this leading to 1-2 order of magnitude in compute efficiency over von Neumann / Harvard architectures, and may be ideally suited to in-memory compute, in particular.
If you can program it in rustish language with the intermediate representation, that makes everything portable to it without having to figure out the parallelism, potentially.
Very impressive and potentially revolutionary. Micron or Samsung needs to see this, they are having to reinvent compute anyway.
One may think that regular parallelism is a solved problem, but even nested loops are not always parallelizable without figuring out how to make them to work in parallel.
Then there comes Microsoft Word. Can we make a CPU where Microsoft Word gets executed with maximum IPC achievable? If you do not like MS Word, take a look at Linux Kernel and userland programs as a whole.
This is historic. This kind of thing is what ai self improvement looks like (like it or not...). It might not be this architecture specifically, but this is what the acceleration is going to look like -- show hn posts about ai advancing its tech stack
My question: if these new developments roll out steadily for enough years, what does that mean for nvidia or amd or intel? Do they benefit? Probably? They already have the manufacturing pipelines
Is it real, or is it clickbait nonsense? AIs are really good at producing clickbait nonsense.
Several new kinds of architectures have been tried: the iAPX 432, the Mill, the Reduceron, but things just keep coming back to the out-of-order modified Harvard (a.k.a. fake von Neumann) machine being the most efficient general-purpose computer in our laws of physics.
Any article with a description of a large agentic search process and ... 4 citations ... is begging to be ripped apart.
Really? They let a swarm of AI agents loose and you're sure they didn't draw upon more than 4 references?
Did they just ignore Taelin and HVM?
They aren't. They're just dataflow graphs, and AFAICT they are less powerful than program expression grammars, e-graphs, or the sea of nodes.
> and the comments are... a bit depressing
This is a very interesting project, but unfortunately at this point in time anything with “AI” in the title invites too many hot takes and personal opinions about AI that are unrelated to the story.
On Hacker News (and Reddit and every other social news site) the title drives the comments more than the article content because, frankly, most people don’t even try to read the article. If you had submitted this with a headline that didn’t mention AI and instead said something about interaction nets the tone would probably be very different in the comments.
Please don’t be discouraged, though. This content is very interesting to many of us, but it takes time to read and appreciate it, whereas firing off some “AI bad” hot takes in the comments without reading the article is an easy way to get some upvotes and ignite large comment chains without reading the article. That asymmetry always biases the comments in one direction, but don’t take the comment section bias as a sign that it wasn’t appreciated as a submission. It’s currently the #1 story which is a much better signal of interest than the comments.
Best I can do is upvote your post and reply to it to see if it gets it closer to the top.
dude, CEO of this "startup" done 2 internships. this is obviously investor slop bait
Well I mean all of the visuals on the web site are nice and shiny, but all of the existing real and physical architectures are built on years and decades of experience, and years and decades of failure and optimization.
In short, how can we be sure it will work and be stable, and that we're not just watching another AI hallucination?
Did you not read the article? IIUC the entire chip is formally verified (because, why not)
Does the proof correspond with the chip? Does it prove useful properties? Are the properties it proves desirable? Desirable for what? How did you check?
Good questions, also is the machine code derived from the proof (rocq) or is there just a proof along the code, which allows drift between theory and implementation.
Formally - but by LLM. In theory practice is the same as in theory.
Will be cool to see if Linux can run on a QEMU or FPGA based implementation of this and how the efficiency numbers look then because it's not quite as interesting if it's not general purpose computing ready.
I am interested to have end products with really good UX driven by peak performance and optimizations which blows my mind because it’s so well perfected as humans weren’t part of its process.
As of now, I don’t see any of that being the goals even let alone the result. Instead what I see is that everyone is in a race to have as much product out as possible by the same standards that applied to products made by humans, but even lesser quality.
I the last two decades we have gotten so used to average or less than average product quality that we are willing to pay 2000$ for a device running an operating system like macOS or windows that ‘works most of the time’.
I hope we have products thanks to AI that compete on reliability of software and hardware to the point that the big tech will have to reinvent their processes just to be able to justify prices.
> I the last two decades we have gotten so used to average or less than average product quality that we are willing to pay 2000$ for a device running an operating system like macOS or windows that ‘works most of the time’.
I think that describes the entire lifespan of consumer computing.
I’m old enough to remember Windows 98 running on a Gateway PC. That cost $2000 (without taking inflation into account!) and worked much less of the time than today’s OSes do. Modern OSes are frustrating in various ways but I think it’s easy to take for granted how stable they are compared to the past.
Towards the end of XP's lifetime it was a very stable OS, as was late stage Vista/windows 7. Early vista was obviously a trainwreck, then 10 and onwards have been a gradual slide in terms of stability
A lot of this is simply because of microsoft firing all their QA and pushing it onto customers, which hasn't really worked all that great
QA or not, an OSaaS is never going to be the ideal experience for the end user. That's not it's job.
Clever term haha
I'd love for Apple to stop releasing new OSes every single year in lockstep with iOS.
Snow Leopard was the peak for me. Everything since has been a regression trying to merge iOS with macOS when they have completely different ui/ux paradigms.
Microsoft's strategy was, to my understanding, to create an OS for the next generation of hardware - meaning that, upon release, it couldn't reliably run on the current hardware out in the market.
Partly this was too "encourage" adoption of newer, faster, better machines, partly it was to ensure when that wave of fresh new hardware hit the streets, Windows was ready to take full advantage of it.
I know windows 2000, XP, etc followed this strategy, I think 98 overshot, which required 98SE to do some repair
>next generation of hardware
What does that even mean, other than "faster"? Windows 11 created a mountain of e-waste, consisting of perfectly good hardware.
Why does Windows 11 take several seconds to open the calculator on my 2025 work pc, a 6C/12T machine with 16 GB RAM? Do I need next gen hardware just so Win11 stops wasting my time?
At the time it meant "with hardware accelerated rendering and enough memory for compositing"
This wasn't a given for XP.
> What does that even mean, other than "faster"?
That is, literally, what that means, yes. That was quite obvious from the context.
ESL, but I always imagined next gen to mean something more. For example, electic cars vs petrol cars. Flat screens vs CRT. Smartphones vs dumbphones.
I'm a native English speaker and it wasn't obvious to me that next gen necessarily means faster. Beefier, sure, but not faster.
I'm not sure if you've used any "nextgen" stuff lately but faster is not how I'd automatically characterize them.
> Why does Windows 11 take several seconds to open the calculator on my 2025 work pc, a 6C/12T machine with 16 GB RAM? Do I need next gen hardware just so Win11 stops wasting my time?
My guess? Its probably some slop-infested Electron app that has to spool 1GB of garbage from disk. And, you know, "copilot" crap.
Should'a been a 100KB application, instant open, and just works.
It does open instantly, for me. It's not an Electron app. It's actually open source, too: https://github.com/microsoft/calculator
The answer is almost certainly because it is a "work PC". They are typically loaded up with so much shitty monitoring software with hooks in everything, making everything slower than it should be.
So what you're saying, they deliberately created a system that was so slow and resource-hungry that it couldn't run on anything than much faster, beefier machines?
Why couldn't a more streamlined, simpler, less resource-hungry system run much faster on "newer, faster, better machines"?
> to ensure when that wave of fresh new hardware hit the streets, Windows was ready to take full advantage of it.
So why doesn't Windows take advantage of it?
wasn't it just the strategy with vista and everything before it? seems that since 7 it's all been designed to run on contemporary hardware (which is why 7 was so rock-solid over its entire lifespan)
What do you mean hasn’t really worked all that great, the stock price is way up! /s
> "I am interested to have end products with really good UX driven by peak performance and optimizations [..] Instead what I see is that everyone is in a race to have as much product out as possible by the same standards that applied to products made by humans"
AI is not equipped for this. Humans are part of the experience process, and AI doesn't "understand" individual humans better than other humans do.
UX relies very much on human psychology. That's why, despite all the efforts of scoring it, UX is not an objective metric:
1. AI doesn't know what "good UX" is, as this is judged by the sum of humans using it. --> Structured data of actual usage would be needed for AI to ingest, in a way that it can derive intent from every action and identify friction.
2. A "good UX" is not a transferrable metric. The best UX for a ticket vending machine is not applicable to video-editing software. --> AI would need to understand what to apply when, and at which point it needs to evolve its expectation to the user
3. A "good UX" is not an absolute metric. Photoshop/Premiere/... has a UX which was extended and refined over decades, it is considered good by experienced users but still overwhelmingly confusing for beginners. --> Someone would need to scope the AI for the correct target-group
All this is done today by doing extensive user-testing with actual humans. There are people experienced in this who can create better UX-designs from scratch than others can, and still we keep learning something when we put a group of humans in front of it and watch them use it.
"Intelligence" alone doesn't solve this.
I'm reminded of the story of Stephen Hawking's sister, telling how he invented a "better board game" as a child and always wanted to play it with her, which was apparently the most frustrating and boring game she ever played...
Agreed. It seems everyone has forgotten who we’re building software for in the first place.
The idea of removing humans from the loop entirely feels like some sort of AI apocalypse.
We don't build modern software for humans. We build it for profit extraction. It's why the modern cycle is:
I basically agree with you, but much less cynically.
At the end of the day, in a well-policed society "profit extraction" == "what you can convince people to willingly spend their money on"
Turns out people are generally willing to spend their money on ads to grow their own businesses, and are generally not willing to spend their money on un-enshittified software replacements for what they're used to.
You might not agree with their choices but that's just how people are. I don't think it would be a better world to force them to choose differently.
Replace people with companies. And realize that company decisions are increasingly AI driven. Today, often with a CEO that asks AI what to do, but eventually, I think the CEO will also get out of that loop.
Can you show me this well-policed society? We've had quite a few decades, almost a century of this new kind of capitalism and afaik in most places it's just become feudalism 2.0.
1. Personally I feel most Western countries have gaps but are well policed enough that I feel comfortable saying at least ~95% of spend represents the revealed preferences of people under their own free will. People could do better with their choices but they aren't coerced or outright defrauded in most cases.
2. I (like most people I feel) am generally very on board with political action to reduce fraud & coercion. I'm not on board with "let's just overthrow capitalism", which just introduces coercion on people's preferences, rather than remove it.
Then again, often when I specifically prompt my agent that "this works like shit, make it better" - it makes it better. There are for sure best practices that agents are well equipped to handle. Often the solution to make UX better is to just make the process simpler (for the user). Agents are also well equipped to do that.
so put "make it better" in an infinite loop = profit?
I don't see any reason all the things you mentioned cannot be taught to an LLM using reinforcement learning. The newer models are already much better at this stuff, I see no reason that trajectory will change.
Hence I wrote: "Structured data of actual usage would be needed for AI to ingest, in a way that it can derive intent from every action and identify friction."
The challenge is more about providing actual, objective data to learn this.
The LLM will not be able to decide what is "good UX" and "bad UX", it will have to ingest this information in vast detail from judgement provided by humans, which is also varying alot.
Case in point: Coming from that field, I personally don't have a good user experience using iOS, a majority of end-users will strongly disagree.
An LLM would need to be trained to handle both cases to judge the same human interface, so it would need alot of data to understand both views...
The human UI designer has the benefit of being and to run experiments on themselves, but only n=1. for any problem where that is insufficient or even misleading that benefit disappears. I’d argue that UI is an area where you need n>>1.
That's what UX user studies are for, which is a process of humans observing other humans using the product and taking notes. It's far more common than people seem to believe.
(also: UX is not UI, but I guess this goes without saying...)
Not so. You can time how long it takes, how many clicks to goal, how much of the viewport is shown. There are so many metrics around UX and it can be approached in an objective way. So one UI can be evaluated on another for a given goal. Sick Fable on it and see.
I frankly assumed the example of vending machine vs video editing software illustrated how this is not the answer.
A perfectly scoring vending machine UX applied on Adobe Premiere will tank the UX for Premiere users.
Unrelated but as someone who has used several NLE Adobe Premiere is not what I would pick for good UX.
Those are ways of optimizing patterns we already use. New UX patterns from the simple like object rollover states, to the complex like the iPod click wheel, take human innovation.
We respond with delight or disdain based on how they feel.
The only way for AI to know how humans feel about something is to be trained on what we’ve already said about it.
I do so suspect that harebrained ideas like this is how we got “fully optimised, completely garbage” UX experiences that are present in some major corporate services. Google/youtube being a good example of this.
Of course discretion is needed. It's just another tool at our disposal.
Sometimes, the best way to use a tool like that is by disposal.
> AI doesn't know what "good UX" is
Neither do ~80% (or more) of software developers.
Doesn't make me any keener to use AI. In fact, the opposite.
Of course, because they aren't UX designers.
~80% (or more) of UX designers don't know what "good backend design" is.
Even worse: ~80% (or more) of frontend developers don't know what "good backend design" is.
Not sure what's the point here...
"they aren't UX designers" but they are doing the UX design in 99% of the places I've seen.
Why is it always a race to the bottom?
"AI does X kinda bad" "Well most humans do X even worse so shut up and eat it up"
It's not a race to the bottom. It is a statement that AI is already better than an average person or even an "expert" in certain areas. Probably most, at that. You can see it as "AI is advanced" or simply as "humans are pretty stupid, overall".
Judging by the recent global outage of Outlook, which, probably, in some way, affected just about all US commerce, I would say the future for software reliability is still looking grim. The good news is replacing your vendors bespoke solutions is easier than ever. Where I work, we’ve still not internalized that software does not have to be a top-down solution where everyone does the same thing. In substantial management and user education, that goes into getting everyone to do exactly the same thing. The idea that you could just ask Claude to solve your very particular problem, it solves it, and then you move on, maybe not even preserving the code, is not in that mental model
> As of now, I don’t see any of that being the goals even let alone the result. Instead what I see is that everyone is in a race to have as much product out as possible by the same standards that applied to products made by humans, but even lesser quality.
That is, roughly, how all automation works: You build the machine that does the humans job, barely, badly. Then you improve the machine. Producing shitty output on that journey is better than producing no output, if the domain allows for it. You learn more.
That’s not really the case though. Especially in the general case. Just look at the cotton gin. No one was designing little mechanical hands to pick through cotton.
Frequently automation happens only after someone realizes that to automate the process, the process has to be completely reinvented.
I’d say that the majority of successful automation doesn’t follow an iterative path starting from build anything that does exactly what a human does because human physiology isn’t easily replicated with rotational motion.
paradigm shifts usually reveal the limitations and what needs to be done, ie horeseless carriages needing asphalt was obvious from the start
with current gen frontiers, the limitations seem to be requiring a human in the loop, which is quite ironic
Horsed carriages run much smoother on asphalt too.
yes but cars increased the incentive of the large investment required to pave roads
> That is, roughly, how all automation works: You build the machine that does the humans job, barely, badly. Then you improve the machine
That’s not how automation works. The first thing you build is already taking care of a cumbersome part of the human jobs, even if limited in scope. The improvement part is in reliability and maintenance. Because the core problem is already solved. All that’s left are engineering issues.
So even if the first contraception is horrible, it should be clearly visible which immediate need it intents to solve, even if the full scope of changes is not known yet. But with those, there’s no need behind them, just imagined problems.
Given GP's (accurate) point about the mediocre quality of products whose production has long since been automated, I'm curious at what point you think the output stops being shitty.
I think we are starting to see this in some areas: For example, for years desktop apps were built on top of slow and heavy cross-platform frameworks like Electron, because writing them natively was too burdensome. Now we're seeing rewrites in rust using native APIs and toolkits, resulting in lighter and faster apps.
Software engineering as a discipline is also shifting, and will continue shifting, to a process of continuous automated improvement. In the past, test suites were mostly a way to catch regressions. In future, they will be essential to provide a verified baseline of correct behaviour, and then you will have models looped in the background to continually merge performance and reliability improvements. Similarly you will have error and performance logs fed directly into agents to resolve incidents as soon as they arise.
We are in the baby steps of these changes at the moment, but I think in at most ten years, all non-hobbyist software will be built this way.
> For example, for years desktop apps were built on top of slow and heavy cross-platform frameworks like Electron, because writing them natively was too burdensome
It was not. Just by using QT you were on the fast track to support multiple platforms. And by 2010, most companies were only interested in Windows and MacOS. But today, it’s just laziness. Devs that only know web tech wants to use web tech everywhere, even when it does not fit the job. Hammer and nail style.
> In the past, test suites were mostly a way to catch regressions. In future, they will be essential to provide a verified baseline of correct behaviour?
And who will code these tests? To design good tests, you have to know the product quite well, and to know the product, you have to build it at least once. Because specs are full of knowns unknowns and unknowns unknowns. That’s why the best spec is the code itself.
Even when you know the requirements, you still have to design the test harness, and that depends on the products too. With the same caveat on knowledge.
Yep. iOS app landscape as well. /r/reactnative are pretty much dead now. Everyone write super optimized swift and objective c codes now :D. I'm not complaining. Some of my favorite niche ios apps are all under 10mb each post AI-renaissance.
If only someone would tell meta. WhatsApp, Facebook and Insta all over 400mb. Madness.
I think the big issue is what the user sees and interacts with is like 4-5 of the products of the compilation of another 40-50 products that are underneath that spy on you to market, sale, and change the way you think. Without all of that the app would sure be 20-30 megabytes for posts, stories, messaging...or less.
They don't care.
Not because of react native ¯\_(ツ)_/¯
I think you have some serious rose tinted glasses about the reliability of pre 2005 software. Windows almost never randomly crashes anymore but it used to be a common occurrence in the 98 days.
Speak for yourself, but outside of very very poor software, Windows 98, Windows 98SE, even ME were rock solid for me from what I recall. The only time I had really weird issues were very poor drivers. It was the absolute wild west back then.
Are you using "speak for yourself" to mean something wildly different from the commonly understood one?
Windows 98 constantly crashed and froze. It would even freeze during shutdown, and that was the standard experience. People during that period were paranoid about saving every change they made to their documents, and that was for good reason.
Windows 9x didn't even have proper memory protection, the most basic building block of any modern operating system. The fundamentals were as shaky as it could possibly have been.
Win98 and Win98SE would throw BSODs all the time, ME was even worse to the point where I switched to run Win2k on my gaming PC to not experience BSODs in the middle of matches.
This is definitely not true. The blue screen of death was from the Win98 era. How often are we seeing blue screens? I've only seen it once or twice in 10 years but Win98 was very common to see this. You're right, poor drivers in Win98 days would 100% blue screen but poor drivers today don't.
Poor drivers were often the cause of the crashes, so you might be in agreement. Whenever something wasn't working right (all the time), the standard advice was virus scan and update your drivers. Always updating drivers just in case that magically fixed something.
There were notable songs about how crappy Windows was. South Park joked about it in their first movie
> As of now, I don’t see any of that being the goals even let alone the result. Instead what I see is that everyone is in a race to have as much product out as possible
If you frequent sites like Hacker News or other spaces where projects and announcements are shared, it’s going to look like this.
My friends who don’t follow these spaces have no idea, because those high volume, average quality projects aren’t newsworthy.
The highest quality projects aren’t out here advertising that they were built with AI. Smart teams know that saying something was built with AI is not an attractive quality for consumers. It’s only the teams trying to increase their status and make more content for their resumes who are blasting out announcements about how much AI they’re using.
From here on out, you can assume that any product you use will have had AI used in the development, likely heavily. You’re going to start running into products that blow your mind with their quality, UX, and polish where teams will have quietly employed AI to a high degree. Human input still remains a significant a valuable part of the process, but high performing and attentive teams are actually the ones most able to extract the best results from AI. They’re also the least likely to advertise that fact.
All of the “made entirely by AI” projects you see are going to continue being fun experiments to see what AI can do or little exercises in people trying to advertise their AI skills so employers will hire them or give them raises. When the really great products come along, they’re not going to come with “made by AI” advertisements at all.
Why would you expect to have any other kind of quality than exactly the level people are willing to pay for?
> I hope we have products thanks to AI that compete on reliability of software and hardware
That will only work if most people select for quality and it's very well documented that people don't
Superlogical's Rex is a wonderful (if wonderfully nerdy) version of this. GREAT product. GREAT UX. Heavy use of AI to develop.
Yeah but it’s because its done by a tiny team of experts in their field. Without management etc.
If they sell it to a big corp it will become slop in a matter of weeks.
And even to replicate this - developers of this calibre is 1 in a million.
Corporations exist to break a big task into small manageable chunks.
The traditional corporation consists mostly of information movers, sitting behind relatively few accountability-accepters and action-takers.
The traditional corporation will be replaced by a smaller version consisting purely of high-agency accountability-accepters/action-takers.
These may grow, to be "large companies" - but with a fundamentally different makeup.
> as humans weren’t part of its process
Not even close IMO, a massive number of humans are part of this process... their collective input is what the model is!
> I the last two decades we have gotten so used to average or less than average product quality that we are willing to pay 2000$ for a device running an operating system like macOS or windows that ‘works most of the time’.
Sorry, but the complexity of these devices is much higher than anything that came before it.
What are you comparing this against, and why do you think it would be reasonable to expect higher quality at a similar cost?
The MVPR – Minimum Viable Press Release.
With "AI" coding tools the relevant metrics are (again) LOC and token burn. But in the real life the fundamental truth is still the same, code is to be minimized.
> compete on reliability of software and hardware
Something tells me that a generation of TikTok influencers aren’t going to turn around and demand quality from their computing devices.
The best you can hope for is that the Swiss cheese of OS security is patched up a little more. At least those problems make headlines.
AI isn't required. UX doesn't increase bottom line, so it's not targeted. Hiring a UX expert is a cost center, not just for their salary but the cost of changing things to appease them. Combine that with very little competition (to switch between Linux/windows/macos is not like switching from Ford to Toyota), and you have what we have today. People are prisoners and the UX is the food delivered by outsourced, lowest-bid third parties.
My solution is to have an independent ratings agency that gives OS' and individual apps a score. Then software makers could compete by advertising their scores.
My trust in these announcements: the goal seems to be to announce “AI can do this now, btw”. I see no care about delivering something that people want. The powers that be are happy to make the same thing but with some 100% AI attestation.
No human in the product making. No human in the product use.
This is why I am not worried about job prospects in software development.
Neural networks are just another abstraction layer that allows you to produce more functionality by typing fewer characters. A very smart, complicated library, if you will.
And just like all abstractions before it, all productivity gains will be gobbled up by capitalism.
Sure, you can use this productivity boost to do more. Some will, and we will praise them for it. But in a world where primary incentive is acquiring as much centeral bank bills as possible is the main KPI, productivity will be used to deliver the same amount of work (or less!), at lower cost.
Until the world in its entirety undergoes a dramatic moral and systemic shift, I sleep well at night.
"This is why I am not worried about job prospects in software development."
"main KPI, productivity will be used to deliver the same amount of work (or less!), at lower cost."
Maybe you personally don't need to be worried but I know many who are. Lower costs really mean less headcount right now.
Reliability is the last consideration right now. All that matters is time to market
> everyone is in a race to have as much product out as possible
That explains so much. Everyone (or at least, everyone we hear about) is using AI for faster, which leads to more, but not better.
> applied to products made by humans, but even lesser quality.
I agree. Considering these AI companies promise us everything at perfection, it is shocking how the quality isn't anywhere near perfect.
> I hope we have products thanks to AI that compete on reliability of software and hardware to the point that the big tech will have to reinvent their processes just to be able to justify prices.
Which part of the entire history of our industry (and other industries) leads you to have a hope like this?
Yep you wouldn't need AI to deliver better quality products.
Software quality (or the lack of it) It's all about the process that produces it. Most companies don't run a quality oriented process. Accelerating the pace of change is only going to make things worse faster.
Bro you missed the days of config.sys and autoexec.bat if you think today’s code is mid.
> because it’s so well perfected as humans weren’t part of its process
How does that make any sense? How is really good UX, peak performance and optimization driven by the absence of humans in the process?
This is complete nonsense.
The title is a bit misleading—humans came up with all the insights and innovations here. What AI has done, which it is exceptionally good at, is take decades of brilliant ideas buried in research literature and synthesize them into a coherently engineered product. It would seem that AI is now doing an end-run around the innovator’s dilemma, or at least part of it, by dramatically lowering the R&D cost of productizing laboratory ideas.
The goal of AI science, AI electronics, AI software, when presented by a lab, is universally not to advance science, engineering, or what not, but sell their product. A product that, if we believe its marketers, is supposed to replace the human with a reduction in quality, not help a human perform to a higher standard. Why would they be contradicting their own narrative by actually crediting the engineers?
Maybe all the 'easy' discoveries have been made and the only new ones are be applying previous discoveries in increasingly complex chains/interactions/workflows.
Something simple becomes complex by increasing the number of relationships. Binary, DNA, Amino Acids, forces, our universe.
lol. AI as an "innovation fracking machine". I can appreciate that analogy.
“Coherently engineered” is not how I would describe most AI output. If anything it creates a “passable prototype” for any system more complicated than a basic web app.
I'm quite skeptical; their baseline is a in-order CPU, instead of a modern out-of-order design, and they're testing a small amount of programs.
Also, I'm not an expert in CPUs, but the underlying idea doesn't seem entirely novel - WaveScalar explored dataflow-based architecture 20+ years ago.
They're claiming better performance per watt, not better absolute performance, and out-of-order does worse on that metric than the superscalar in-order design they say they beat by 4.59×. That's why, for example, PULPino is in-order.
A third interesting metric is performance per transistor or per area, and generally the best designs there are the long-forgotten MISC designs like the MuP21 and the GA144.
The performance per watt of very slow CPUs is always very good, so that alone is not impressive unless much more data is provided to prove that is really better than what is typical.
On the other hand, the performance per area of the "traditional" CPU that is used for comparison, which I assume that it is some kind of RISC-V, is very poor, so that the performance per area of the new CPU is likely to be also poor, even if much better than that of the strawman.
Their "traditional" CPU has an area that is slightly bigger than that of Cortex-A720 made with a CMOS process almost twice as dense.
So if they were made with the same process, the "traditional" CPU and the new CPU would have an area somewhat bigger than a half of a Cortex-A720.
But Cortex-A720 is an out-of-order 4-wide superscalar core with advanced SIMD and scalable vector extensions, with a good branch predictor and with many other enhancements, for which the area ratio in the same process is expected to be much greater than 2 in comparison with the CPUs evaluated in TFA, while its performance must be several times greater than that of a 2-wide in-order CPU core.
So both the "traditional" CPU and the Frostbite CPU appear to have a much bigger area than expected for their performance.
Moreover, the performance of in-order CPUs is very sensitive to the benchmark selection and to the quality of the compiler optimizations.
So the performance obtained for the benchmarks selected by them, like FFT or LU decomposition, is expected to be much better than for benchmarks that would execute an application not dominated by such regular loops, but having lots of hard to predict branches, e.g. a compiler benchmark.
They say that the ISA will be published. At that time it will be easier to appreciate whether this CPU architecture is really innovative. For now, they have done a lot of work, by fully implementing the CPU core, but the data presented is not sufficiently convincing to demonstrate that it is indeed an architecture that will be able to compete with SOTA CPU cores, e.g. with those from the Arm company.
> The performance per watt of very slow CPUs is always very good
Generally this has not been my experience. Typically both very slow CPUs like the ATMega328 and high-performance CPUs like an Intel i7 are in the neighborhood of 1 nanojoule per instruction. (For operations more than 8 bits wide, the AVR is significantly worse.) Low-power CPUs like the STM32L line are commonly around 0.2nJ/insn. Ambiq's subthreshold logic gets them closer to 0.05nJ/insn.
I agree with the rest of your comment.
The ATMega328 is fabbed in a 350 nm process, the STM32L1 is 130nm, while current i7s are 10 nm, so that's not a fair basis to compare the merits of different microarchitectures.
While that's true, I have a vague memory that ≈350nm Pentium IIs also used broadly similar amounts of energy per instruction, maybe an order of magnitude more. But I might be misremembering that. I remember that you have much deeper hardware knowledge than I do; do you know of a better comparison table?
I don't think fair comparisons are really possible across different processes. There's a lot of interaction between silicon process, architecture, and workload.
The fairest comparison is between chips from major vendors in the same year. If you're just doing FP32 matrix multiplies, a 2026 nVidia GPU is ~1 pJ / FLOP, an Apple M4 is ~30 pJ, and a 2026 Intel Xeon is ~50 pJ. The quality of process and optimization is a little different between those 3 companies, but not by as much as 2x. But from those numbers, you can reliably conclude that the GPU architecture is much better for matrix multiplies.
Yes, that is surely true. What about small in-order scalar cores like the PULPino? Maybe the M4 and Xeon are spending a lot of those picojoules on OoO, caches, speculative execution, etc. But supposedly the existing CPU that they're comparing Frostbite with is an in-order superscalar design.
I am of the opinion that even if this novel architecture doesn’t yield dramatic improvements in peak performance across broad classes of workloads, it may still be a welcome improvement in the legibility of software performance down the stack.
By this I mean: currently, transforming a program written in a typical high-level language to optimized ISA code involves what can only be described as black magic inside the compiler. If you don’t know the implementation details of modern superscalar OOO branch-predicting microarchitectures then you may have no clue why two very similar-looking functions could have dramatically different running times. Cue Matt Godbolt tech talk…
What I see as the more promising side of this type of development is a tighter coherence, and thus more transparency in expected runtime performance, between the software above the ISA and the hardware below it. Essentially we now have a linear machine with a linear source language, and with the popularity of Rust nowadays we actually have a critical mass of developers who are already used to applying ownership discipline in program design.
> They're claiming better performance per watt, not better absolute performance
I shouldn't have to read this far into the tea leaves to figure out what performance claims a company is making, but these facts combined sound like they're claiming much better absolute performance, too?
> Each Frostbite quad (a two-by-two grid of tiles) paired with four L3 nodes is 0.792 mm².
> This TCPU [the one they benchmarked against] is 0.895 mm² at the same process.
> Across all the workloads, we average an 8.77x performance-per-area
It got 8.77x performance per area, and was 88% of the area, so that's 7.76x actual performance, right?
Not that "a parallel processor outperformed a single-core processor on parallelizable tasks" is the most earth-shattering relevation in the world, especially when they won't say which single-core processor "for legal reasons".
The second paragraph of the linked page contains their first performance claim. It reads:
> On a set of 25 initially chosen workloads, including 15 held out until the final evaluation, we achieved a 4.59x performance-per-watt multiple when compared to a modern, silicon-proven superscalar (dual-issue, in-order) CPU core.
They do start claiming performance per area in the following paragraph, but that's not an interesting claim for a couple of different reasons:
- As I said above, MISC designs get dramatically better performance per area than any mainstream CPU.
- We're already in the dark-silicon era, where even the relatively low performance-per-area designs used in laptops and cellphones must thermally throttle on a regular basis to avoid burning themselves up, and contain many specialized accelerators used only a small fraction of the time (AES-NI, AVX-512, saturating 8-bit arithmetic, popcount, etc.) instead of additional small general-purpose cores that could run all the time.
Their claims would be a lot more interesting if they provided some kind of absolute numbers to compare against.
If you are interested in understanding how CPUs work there are a number of "build your own CPU" style video series on YouTube:
- Ben Eater's series "Building an 8-bit breadboard computer!": https://www.youtube.com/playlist?list=PLowKtXNTBypGqImE405J2...
- Fabian Schuiki's series "Build a Superscalar CPU" (breadboard and custom boards): https://www.youtube.com/playlist?list=PLyR4neQXqQo5nPdEiMbaE...
- Polymath Unlimited's series "The CPU you can build (Tutorial Series)" (logisim): https://www.youtube.com/playlist?list=PLe8IZRJAn3oD3E2tDhNpI...
- mattbatwing's series "Let's Make a Redstone Computer!" (Minecraft): https://www.youtube.com/playlist?list=PL5LiOvrbVo8nPTtdXAdSm...
Odd to see this downvoted. I'd like to see more of these projects.
Yes, their comparisons are weird.
They also compare their architecture simulation language to RTL, instead of comparing it to existing arcitecture sim languages.
> Yes, their comparisons are weird.
Generated by ChatGPT, probably.
It's slop. Token spend that doesn't accomplish anything because the prompter doesn't know what they're doing.
It accomplishes convincing gullible readers. "AI"s primary use case.
I think that 20 years ago creating your own processor as a startup wasn't really feasible, maybe with AI it has become? Some companies will try it out and history will be the judge of that
It's interesting to think that startups could design new processor architectures, but I imagine it'll be years still til a startup could conceivably manufacture them.
Transmeta would like a word:
https://en.wikipedia.org/wiki/Transmeta_Crusoe
They are using _interaction nets_. Interaction nets date back to the 1990s, they are a fundamentally different programming paradigm which is parallelisable by their nature (graph rewriting that can be done locally in any order).
https://en.wikipedia.org/wiki/Interaction_nets
Isn't this more about work-per-joule than about throughput? At least that benchmark graph is in performance-per-watt.
It's a naive direction of AI that helps no one, yes.
Maybe it's Itanium reincarnated
Yeah. Something smells fishy
Isn’t this similar to every other alternative architecture that it relies on a “sufficiently smart” compiler to handle the all the dependencies and get increased efficiencies. It isn’t clear to me what exactly is different this time and why it will work better in practice than all the prior attempts.
My prediction:
In the AI/AGI/ASI era, the 4 most valuable things will be:
- Model
- Compute (chips/energy)
- Manufacturers
- Materials
You can already see it beginning at the chip design stage. If AI makes it so that it takes 2 months to design a chip instead of 2 years, then there will way more chips designed to accelerate applications that previously weren't viable economically.
Therefore, it's manufacturers like TSMC that will become more valuable. There will be more chip companies, more designs, more demand.
And in order to make things, you need materials.
In order to design the chip, you need the model and AI hardware.
Why you wouldn't ask the ASI to design a TSMC too? Then the silicon (sand) will become more valuable. Even raw materials may become less important if ASI manages to achieve space elevator or something like that. But my prediction is that the growth of current AI generation is hitting end of the S-curve, and an AI era where AI can design chips in 2 months and fabs in 2 years is not as soon as it seems to be.
It's possible ASI can design and build a TSMC as well. But instead of that happening within 5 years, maybe that's 10 years down the line?
Instead of focusing on silicon based chips, maybe we need to point these AI's at chips that can be grown like life grows out of a single seed cell.
Put that "seed" in a soup of chemicals, and within few days a chip builds up.
I mean given the state of this conversation you might as well as just spin a wheel.
Yes. But I'm sure that the days of many chip designs and fast are coming. I'm not sure if AI will be able to replace TSMC.
One giant all-encompassing loop.
Agent Centipede? Seems on brand.
I don’t think models will be valuable. It’ll be a shared commodity. The models all seem to converge in performance, and eventually fully open source models with open source training data will become “good enough”. We may end up with a “Linux” of the LLM model world, that just ends up dominating everything else.
It’s similar to how proprietary source code is rapidly losing its value. The most valuable code now is open source, and whoever is best at building processes around open source becomes the winners.
One caveat is that new AI architectures could change the equation, at least temporarily.
We’re converging on intellectual property losing its value in general. What ends up being valuable can be boiled down to culture, human processes and physical materials.
Much like with agentic PCB design, the HDL isn't the hard part.
I’d say TSMC becomes less valuable because there will be multiple fabs trying to meet demand. There’s no way for a 10x increase in fab capability to be handled by just the very few companies that exist.
Also most likely these bespoke chips wouldn’t need the latest nanometer processes to work more efficiently, lowering the value of highly advanced EUV machines.
Right now, it costs $20b - $40b to create one fab. And that's without the R&D time and cost for the actual node process such as N2.
So could AI recreate TSMC? Maybe in a more distant future. But it's a lot harder to recreate TSMC than to design a chip and send the file to TSMC.
I think it's more likely that AI recreates some chip manufacturing breakthrough than to compete against TSMC without one.
Maybe Rock's law will change now that AI makes technological development less laborious, which is where the money was going. All non-technical overhead also gets reduced; what a 10-person company can do today assuming they can run their agents 24/7 makes the situation from just 10 years ago look medieval. So we'll see more foundries and more production capacity pop up, nibbling at TSMCs feet.
It's just a guess, but given that it takes 20 years to take a chip manufacturing idea to market, ideas are not the bottleneck, but working in the physical world is.
If there is a breakthrough in chip manufacturing, IE, a completely new process, then maybe.
We don't really know that.
We do know that AI is already there or close to being able to design a chip, verify it, and send it to TSMC.
These companies operate under a strict risk modeling framework for their investments, trying to model 10 or so years ahead, because in order to stay profitable they have to shell out 10s of billions at a time. So competition may arise, but very slowly. Heavily simplified.
> there will be multiple fabs trying to meet demand
From what I know, that's easier to say, than to implement. Creating a chip is so complex, that it works for TSMC because of the scale. On lower scale, production won't be profitable.
When design time is compressed to this extent, do subsequent steps that used to be insignificant become the new bottleneck?
I would add "simulation/emulation platform" as one of those things.
>Model
I think China is working towards making the models commodities.
The real breakers will be access to cheap raw materials and to cheap energy.
Did they independently rediscover 80's style fine-grained Dynamic Dataflow architectures?
(RIP Arvind)
No, they just revived the idea and the popularity of Rust means that now a critical mass of developers are used to single ownership and linear types. Which was not true in the 1980s.
Genetic algorithms for circuit synthesis aren't a new concept. It found its uses in niche areas like antenna design but wasn't particularly useful for much else. Specifying good utility functions is difficult, and hill climbing them takes impractical resources and time.
The technology may be different but the conclusion is similar.
Not all CPU/GPU architectures have a single global memory space. AMD GCN GPUs have global VRAM, local SRAM for each compute unit(CU), and a global SRAM that all CUs could access. Neither GCC nor LLVM were great at optimizing OpenCL to make effective use of those different memories, so getting the highest performance sometimes required the use of AMD GCN assembler.
https://nerdralph.blogspot.com/2017/02/inside-amd-gcn-code-e...
https://gpuopen.com/learn/amdgcn-assembly/
Yep. In 1 year from now, imagine what we will be able to do to improve existing computational power per watt/unit of input material.
Oh boy, its going to be a wild ride, hopefully at the end of it we are all merged with the digital Overmind God and not in a 'I have no mouth and must scream' kind of way. But nothing we can do about it now.
I would like to know about Mr. Torvalds' ideas about this architecture.
He's been quite critical because hw architects don't talk a lot to software developers.
It seems like this hardware architecture would need it's own kernel / applications? Porting existing x86 or arm applications to "interaction nets" would be pretty hard to do performantly.
The architecture doesn't even have a program counter or call stack, any application running on it would basically have to be programmed in Vine.
Feels like the visualization is doing a lot of heavy lifting, because the explanation sounds quite mundane (randomly rewriting interactions between two points in a program graph?)
It is also written as if this is a new idea for programming languages, but modelling things as a graph of nodes is like 101 stuff?
I note that the kernels they tested are computation-heavy tasks on essentially fixed- and small-sized working sets, possibly even tasks that are efficiently representable without state that gets used an a priori unknown number of times. (LZ4 decode is a bit of an exception - you don’t know how many times a given position will be copied in the usual streaming decoder, but there may well be a different decoder in which you figure out what future tokens look at an output byte before you emit and discard that byte.)
I wonder how well their design works on the kinds of programs that build large data structures and slowly mutate them, or whether their current design even works at all for such problems.
(Don’t get me wrong: lots of useful problems clearly fit their model. And even if there are problems that don’t, I imagine that much of the compute part of a memory-heavy problem would still work well on something much like their design.)
That is a very nice use of AI. An exploratory project that would take a team many months and would never get funding in such scope is being done much more efficiently.
As to the architecture itself, it is promising, but it is hard to say if it will not suffer from difficulties in writing software for it.
It reminds me of one British computer that had physical hardware nodes, each connected to few adjacent ones. With no time synchronisation, each running independently, communicating through ports to adjacent nodes only, and so on. It died outside of academia, because of the difficulties in programming it and progress on classic architectures.
As we are close to the limit of miniaturisation and at the same time experimenting becomes cheaper I wonder if novel architectures will have their another heyday.
The description of interaction nets reminds me of Wolfram's attempts to model physics as "hypergraph rewriting". Is there a link between the two?
Reminds me of CGRAs/dataflow processors which are what most AI inference accelerators are at some simple level.
Why would you hold off evaluation criteria? This isn’t LLM training.
It's similar: they don't want it designing an architecture that overfits to exactly their 25 evaluation workloads, it's supposed to be general purpose.
This is interesting but as far as I can tell there isn't a call stack or program counter. A source level debugger for Vine is a requirement and if it doesn't already exist would represent a substantial engineering project. Also, values can leak if a wire isn't connected properly or a net could get stuck if nodes were waiting on each other in a loop or for a value which never arrives. It's the equivalent of deadlock or a memory leak, and they should reproduce reliably, but they are a new kind of bug class to learn and deal with.
Hmm, interesting. Interaction nets are basically dataflow graphs for pure programs. But AFAICT they do not model stateful computations or control dependence for termination. I don't see how they addressed those problems in the IR, but I only had a few minutes to read the first part and skim the second parts.
Wonder who designed Vine. Is that an AI creation as well?
How is this different from letting coding agents write SystemVerilog (or Chisel/XLS), cocotb, and sby for verification + some formal verification using Lean or TLA+?
The frostbite tiles and their work-stealing is reminiscent of a 2d-grid of basic blocks from compiler design. Register renaming or something similar to it also seems to help building intuition about this.
The whole thing smacks of what is going on in Haskell, wonder what a code generator for this CPU would look like.
Instruction nets sound intriguing, but it looks like execution is based on rewrite rules. Does it need a lot of copying and marshalling to get work done?
Wouldn't a SIMD/SIMT architecture achieve similar speedups? There are many ways to parallelise programs. What am I missing?
You need either the compiler or the programmer to do the parallelization, and in practice the communication costs between cores can be large enough for the parallelization to not be worth it for simple programs.
This ISA seems to be designed to: 1. make the automatic parallelization easy (with workload split between compiler and hardware) 2. make communication costs between tiles very small, so that even very simple workloads can be automatically parallelized.
That sounds a lot like out of order execution at tile scale instead of doing it at instruction/core scale.
the title is a bit misleading. humans built the checker and picked the workloads. the swarm did the grinding.
Also, and I assume they don't have a physical chip. In that regard, when considering performance per watts, the obvious comparison would be against the Mill architecture.
> Moreover, single-core CPU performance has largely stalled since the early 2000s, pushing people towards large multicore CPUs such as Intel Xeon, AMD Zen, and NVIDIA Vera.
Huh? Have you tried the Apple's A + M-series of processors? It has dramatically improved performance and tends to increase single core around 15% per year and it compounds.
The drive towards multi-core architectures is real but it isn't because single core performance has stalled, it is that we want to scale faster than single core performance increases.
These are basic facts that this article is getting wrong. How many more basic errors are in this?
> It has dramatically improved performance and tends to increase single core around 15% per year and it compounds.
Mostly because of SoC designs and dedicated/specialized compute units and versatile instructionsets yadda yadda
> Mostly because of SoC designs and dedicated/specialized compute units and versatile instructionsets yadda yadda
Very true.
> It has dramatically improved performance and tends to increase single core around 15% per year and it compounds.
Does it, or is that because of the large caches and memory bandwidth? Honest question.
> Does it, or is that because of the large caches and memory bandwidth? Honest question.
The burden to prove your "honest question" claim is on you, not me.
CPUs are incredibly complex and many things contribute to sustained improved performance year over year. To simplify it to just one or two things is showing a lack of understanding of the topic.
You made the claim and refuse to back it up.
> You made the claim and refuse to back it up.
I didn't make this claim that he wants me to prove:
> "Does it, or is that because of the large caches and memory bandwidth?"
He made that claim, not me.
The fact that single core performance has been improving consistently in a compounding fashion in the Apple series of M and A chips is a historical fact.
Intel's Lion Cove core is 3.43mm2 without L2 cache and 4.53mm2 with private L2.
M5 S-core is 3.4mm2 including private L2.
But Intel's Lion cove is on N3B while M5 is on N3E which is about 10% less dense. do the math to scale up Lion Cove to N3E and it becomes around 5mm2.
That's 25-35% bigger for worse performance on the same node.
AMD could have gone with 3nm, but went with 5nm (N4P is 5nm++) instead. 3.72mm2 for the core and 4.77mm2 with private L2 cache.
N3E has the same size SRAM as N5/N4. Theoretical logic scaling is around 1.5x (216 MTr/mm² and 143.7 MTr/mm), but high-performance layouts don't get anywhere near that number due to the extra spacing needed for wires and transistors.
If we assume there's zero SRAM anywhere in the core (not true with large register files, L1, uop cache, etc), we get about 2.51mm2 for the core plus another 1.05mm2 (no cache shrink) for L2 giving 3.56mm2 (bigger than M5 S-core). With a more realistic shrink, we could be talking a total area of 3.9-4.2mm2.
TL;DR -- even in the absolute best-case scenario, both Zen5 and Lion Cove are bigger than Apple's M5 S-core.
Is it because the cores are more complex? They have to run x86-64 not arm instructions. I know they all run microcode internally, but maybe the translation layer is simpler on arm.
Honest question again <waves to whoever was ticked off by that>.
I could ask a LLM but HN could use some actual discussion.
I believe the complexity of x86 bleeds throughout the system complicating and bloating everything.
Apple doesn’t need uop cache while x86 designs do which means more power and area.
ARM has looser memory ordering which improves performance. x86 can do this too, but they have to add an entire memory speculator and all the circuitry to handle when the predictions are wrong. Again, that’s extra area and power.
More controversially, x86 decode is still a significant part of the core area. ARM A715 cut decoder area by 75% just by dropping ARMv7 support (and it’s nowhere near as complex as x86). If the decoder is just 5% of the core area (and basically always on), cutting that by 75% means reducing core size and power by a significant amount. I’d also note that a company doesn’t choose complex 2x4 or 3x3 decoder implementations with massive complexity and inferior worst-case performance unless something is forcing them.
The situation isn’t quite as bad is it might otherwise seem though because 512-bit SIMD as it adds to core size (though arguably doesn’t add very much to most workloads over 128-bit aside from some great new instructions). We can calculate this with Strix Point which uses 256-bit “double pumped” SIMD. The core plus L2 area drops to about 4.2mm2 (or about 3.1mm2 for just the core). Using perfect 1.5x scaling for the core and no scaling for the L2 gives around 3.2mm2. Assuming more reasonable 1.3x scaling (which might still be too generous) gives 3.5mm2 which is still bigger for worse performance on hypothetical N3E vs M5 S-cores.
Even in the best scenario, x86 is way behind in total performance, perf/watt, and area. If we assume the engineers at AMD and Intel are good at their job (a good assumption given how long they’ve been beating everyone else on the planet), it only leaves the ISA holding them back complicating things with legacy bloat.
You’ll see a lot of pushback to this idea, but never much of substance to the assertion.
Impressive results. In memory compute?
Is this a legit company? Looks like it was founded by 2 interns...
We are living in the golden age of Computer Science.
Maybe it did, maybe it didn’t. But you can almost guarantee it will when it iterated and tests and changes and iterates and test and changes and…
How many times has a bold and maybe even exaggerated claim come out and people respond “this is false hype”, or “this is misleading”, or “ehh, only kind of in some technical sense, but don’t worry”. Only for continual iteration and breakthrough to have all of us agreeing one week later that it is indeed doing whatever thing and even that this is old news now.
If the frequency increases, that’s the intelligence explosion…
Truly the last invention (for humans)
AI is already superhuman. I have seen this coding.
The big superhuman areas are speed, motivation (infinite), context size, and associative memory.
We are in the “singularity,” which will be a sigmoid, but we don’t know where it will reach its next level.
What does it not seem to have? True volition. Creativity too, maybe, depending on how you define that, which is a can of worms.
It is also subhuman. In things like telling a joke.
A calculator is superhuman. In speed of calculating numbers. Then again, Wikipedia lists calculators as AI, for just that reason.
That's kind of what I mean.
I don't personally believe that intelligence is one dimensional, to the point of doubting that "general intelligence" exists or is even a valid concept. It's like saying "general locomotion." There is no such thing. There are wings for flying through air, fins and rotors for water, legs and wheels for land, rockets for space. A wheel doesn't work well in the air or space and a rocket is a poor locomotion method in the water.
This implies, BTW, that I don't think humans have general intelligence, because I doubt the existence of such a thing categorically. We get all up in our egos thinking we do because we feel so smart at all the things we're smart about, and of course we can't see the other things because we can't see them. Might not even be able to imagine them.
A chess algorithm is superhuman at playing chess. A human beats AI at writing prose or telling a joke. AI can beat a human at bug-hunting in a giant code base or constructing a large mathematical proof. Humans can beat an AI at dreaming up entirely new directions for mathematics. AI can beat humans at taking those new directions and fleshing them out and relating them to current art.
And so on.
We in fact tend to build machines to be hyper-good at things we are not good at, because that makes them useful to us. So we make AI that is better than us at fast thinking, huge context windows, huge scale associative memory, etc., just like we made classical algorithmic computers that were hyper-good at doing math.
I'm always amazed by this perspective. Despite the fact that a single principle component falls out of all analysis of abstract human tasks across individuals, there is a large contingent of people that still "doubt the existence of such a thing categorically".
There has been an open question in psychology for almost 100 years now: can you design a solvable abstract task for human performance that isn't correlated with this principal component? No one seems to be able to do it, and the AI models have only reinforced this. Making AI models smarter makes them better at almost EVERYTHING. The scaling properties of LLM models, and the scaling properties of neurons in the brain, ensure a general improvement of pattern matching that seems to be task invariant.
Personally, I am convinced by the speed hypothesis here. Since IQ in humans is very correlated with thinking speed, the ability to generate and evaluate more hypotheses per unit of time yields general improvement.
Why do you think the singularity would be a sigmoid? Isn’t it by definition increasing rate of change and improvements continuously
There are no true singularities in the real world. Only in math. We colloquialy call a singularity, a spot where things go out of normal very fast.
In my opinion, the benchmarks chosen look small (e.g. json parsing with 4096 chars, mergesort with 1024 elements, fib(20)).
Is the core RISC-V ISA not too alien to this µarchitecture?
The scepticism among the comments is likely warranted - but i for one really think this area needs more research. x86, ARM and RISC-V are for sure "good enough", but surely those won't be the "final" design of cpu architecture.
We know from brain imaging studies where evolution has had billions of years to perfect design for function, that different brain areas have different wiring types. This suggests that similar pattern for silicon based computation devices where multiple architectures might be optimal for different problems.
Also, this is an early stage technology that might be promising and it should probably be compared against x86, ARM, and RISC-V in their early stages. I feel like we are comparing a young up-start against established legends.
> We believe AI fundamentally changes these economics. In the search for higher performance and lower power, extreme co-design of workloads, ISA, and hardware will continue to be demanded.
yeah this is why the "AI datacenter" debate frustrates me. People take it at face value that the enormous power demands of AI are immutable - they're thinking in a 20th century way where we're powering like, air conditioners or something that aren't changing. It's not at all a given that AI is going to demand power in a year or two the way it does now, these are problems that should be solved, not used as a reason to abandon the whole technology.
Jevon's paradox though: any efficiency increase in AI is likely to just result in more AI, not less overall energy use
I want this to be interesting, but instinct says despite the investment and namedropping on their about page, this is nothing until they show something. The language is vague in the wrong ways. It's either truly great, or they're afraid it sucks, or they need to waffle for some competitive reasons that aren't clear to a reader. It doesn't seem like there's enough fundamental information here to care.
Is it that they don't want to overstate their claims to investors who have to decide whether to actually build these, in case the results they're predicting don't add up?
Either way, we need to be working on EDAI, so if they've got something, hopefully it's something.
Yo what the heck. That's kind of funny, the only other guy I know working on this were the HVM guys. They were validated I guess?
Am I the only one who gets really bothered by the use of "by AI" instead of "with AI," in these kinds of statements? Like, the LLM didn't just decide "oh, this looks like a neat thing to work on" all by itself.
Absolutely breathtaking number of claims, and impossible to find the seam between human endeavour and spambot output. Would love a sober overview of this from a suitably competent human, history is littered with promising sounding architectural approaches (anyone remember the Mill?) that went nowhere.
I'm always on the fence and I only believe it when I see such a CPU manufactured and running crysis with better metrics (energy, performance, thermals, stability) than a regular off the shelf cpu as we know it. It needs some sort of proof an average Joe, like me, can see and understand. Until then its just theory to me.
One of the worst things about the llm era is that it's very hard to tell the difference between ai-written breakthroughs and ai-written schizoposts.
i.e. signal-to-noise ratio has lowered dramatically and news platforms such as this cannot cope, unless they basically turn into clickbait and hype factories.
We used to say ‘show me the code’, we need a bit more proof today. Or just wait it out to see if the authors are still pursuing the same idea 3 months later or have they already moved on.
Yeah that makes sense to me honestly. Hard to tell at a glance if a fable oneshot is being dumped out, or if the creator has actual skin in the game
Well that's easy, the vast majority of AI slop is a schizopost basically by definition!
Before even reading anything the word discovered on the title triggered me. It's was not there waiting for someone to find it - like electrostatic attraction/repulsion. It was either designed or "statistically and agentically arrived at it" if my high level mediocre knowledge about how people use AI to research those things is even a little relevant.
It’s more like it took some really clever insights sprinkled throughout a few decades of hardware/compiler/PL research and did all of the engineering and design work to turn those brilliant (human generated) ideas into a formally specified standard.
They claim to be backed by $24M seed funding [1]. Interestingly, they seem to have copied the entire approach from Tendrils Compute (even using their Vine & Ivy languages), who recently got $30M seed funding [2]. Are the companies related, or did architect labs just steal their idea and dump it into an LLM?
[1]: https://architectlabs.com/blog/seed
[2]: https://tendrils.co/blog/2026-11-10/30m-raised
Why does it say "discovered"? What is this, a finding? This is an invention.
Reading through this it reminds me of all the exciting computer hardware research happening in the 80s, with the rise of VLSI and systematizing chip design. Then Intel ate everyone's lunch, lol.
I think for HPC there's still a lot of untapped potential for chips like these where you're doing primarily "computation" in the sense of crunching numbers. We're seeing that with GPUs, TPUs and with Tenstorrent. For general purpose applications though Amdahl's law strikes again, and the longest serial task is what ends up slowing everything down. It seems modern CPUs are mainly designed around this bottleneck, which is why imo out of order execution will almost always beat in order execution designs for most day-to-day needs.
One other thing I've been wondering about, what would realtime programming look like on Frostbite? Could you make guarantees in execution time? To be fair realtime is quite tricky on out of order cores, but I'd be curious what mental model you'd use for realtime on something like frostbite, or if serial logic still rules.
We will continue to invent Transputer-shaped things forever, it seems. Maybe AI actually makes it tractable/ergonomic though.
Sadly, Feynman is dead already so he can't be asked for the buffer size again.
Cool, the first thing on this page should be a link to an emulator and a compiler. I can generate the pretty animated SVGs myself after that.
I'd love to see them run the experiment "Invent a general-purpose computer that exists entirely within a GPU." see if that turns up any potential.
Is it the hardware equivalent to Ginux, the so called not-Linux clone done in 11 days, that's actually not it?
A new architecture discovered, designed, verified, tested, used, enjoyed, glazed, and eventually forgotten solely by their LLM.
When they actually make a CPU and offer it for use, then we'll talk about their magic LLM-designed CPU.
it's pretty obvious their goal is to get aqui-hired by a big lab to work on their chips
Yes. This seemed aimed more at a proof that 'we'd like to be acquired'.
Ideas are plenty, let’s see a product
hardware slopocalypse inc
So... no one at Architect Labs ever played Zachtronics' "TIS-100"? Really?
Oh thank God AI verified it
Babe wake up, CPU-slop has arrived.
Naming is hard I guess.
I read the headline and thought they had built a CPU in EA's game engine
If they did EA would surely can it and sack them all before anyone saw it anyway.
To say nothing of arriving at a "final" computer language via AI.
(dual-issue, in-order) CPU core - this puts you in microcontroller core class and energy is the most important part here. at the end you see the numbers, but synthetic benchmarks have close to zero relevance in that scenario. all around fishy whitepaper-like ai slop corpo blogging to generate buzz
Discovered? I don't think this means what you think it means
It's not like Intel dug x86 from some mine in Oregon
So far this thread is a little breathless about AI.
This looks cool and all.
But, can someone with CPU experience give an opinion? Does this blow your mind? Or is it trash?
Like how the new math solutions when read by a mathematician seem 'ugly', even if technically correct. Does this look like something actually alien and groundbreaking?
I'm not in the industry, just a casual observer (went to school for it though). But it looks similar to the kind of thing that would come out of academia (few profs + grad students), plus a lot of LLM-written hype.
It's not especially hard to get chips that win in some metrics on some inputs, especially when you get to design the ISA.
I don't see any indication that they got their chips fabricated, which is the "last 90%" of the work.
Now they AI can sulk and dwell, wondering why adoption for their new architecture is low, like other, prior, new architectures after arm!
Ok but ...
... WHY ARE THE PRICES SO DAMN HIGH COMPARED TO THREE YEARS AGO?
Once again, you are "not allowed" to invest in the frontier.
Looks like AI doesn't have to fall for C hubris. Honestly, if you want to make it in this new AI age I recommend you to question every single thing that is considered set in stone, anything that is considered "the natural order of things" in software development. Think hard outside the box.
I don't know why nobody is seeing the problems with C. From my perspective it's not useful to think of C as a portable assembler or a thin layer on "top of the machine", because it makes C machines look eternal and timeless, even though we are deep into the post C machine era of multi core processors with cache coherence.
>Mainstream programming languages, when compiled for general-purpose CPUs, hide the dependencies between the parts of a program. Any piece of code may read or write any variable through a shared, mutable state, and so modern CPU hardware assumes the worst case and rediscovers, at runtime, which instructions actually depend on each other.
To this day I still wonder why people aren't seeing the immediate glaring red flag that the conventional sequential programming model presents. To this day people keep building inherently sequential languages and then wonder why parallelism is so hard. It's hard because you made a fatal assumption: There is only one global memory. How exactly is anyone supposed to reason about such an omnipotent and all powerful concept, where everything can potentially affect anything? If you have two cores, the entire idea of a singular memory screams like a bottleneck. Like, it's crazy to me that anyone would think in 2026 "yup, lets build another sequential language that makes our lives a living hell".
>Moreover, single-core CPU performance has largely stalled since the early 2000s, pushing people towards large multicore CPUs such as Intel Xeon, AMD Zen, and NVIDIA Vera. This forces CPUs to maintain the illusion that every core sees the same memory, and keeping that illusion consistent and performant requires deep cache hierarchies and coherence protocols that cost area and power, and scale poorly.
Correct. Because everything potentially depends on everything, you need to figure out at runtime when things don't depend on each other, which is kind of insane when you think about it.
The assumption of a single global memory is what doomed C. It's the 21th century. Computers don't have global memories anymore, they pretend they do. You can't fix it. No amount of nostalgia towards C is going to fix this mistake.
Also before someone accuses me of e.g. being a C hater, I'll tell you that Zig's IO Backend parameters are the same type of flaw in Rust that probably will never be fixed. Implicit IO is a different kind of global state that Rust inherited and from the 2026 agentic coding perspective it's a pretty egregious flaw because agents don't care about passing in a parameter, meanwhile from the perspective of PL design, using a parameter instead of a full on effects system has this certain charm / beauty to it, how you don't need to special case everything to get the same results. You just use what is already there.
> keeping that illusion consistent and performant requires deep cache hierarchies and coherence protocols that cost area and power, and scale poorly.
Cache hierarchies also exist because memory latency and capacity tend to be inversely proportional to each other, and directly proportional to cost. The underlying process and physics of chip design works against you on this front.
I'd love to have 1 GB of L1 cache, but that is simply not viable because your cache would be as big as your core, way more expensive, and by the sheer size, it would become a NUMA cache, which defeats the point of a cache and the "illusion" of UMA.
Yes, there’s a notable IEEE article from like 15 years ago that riffs on these same points—the gap between the abstraction presented by the typical ISA and the actual microarchitecture is too great to ignore and we have blindingly complex and opaque layers of compiler optimizations and OOO pipelines that exist solely to maintain the fiction for programmers.
I think the greatest benefit of rethinking CPU architecture at the level of the ISA will be to make performance more transparent to developers without the layers of black magic.
> Computers don't have global memories anymore, they pretend they do.
Citation needed. After 10 minutes of searching I can't find anything to support this statement.
> It's hard because you made a fatal assumption: There is only one global memory. How exactly is anyone supposed to reason about such an omnipotent and all powerful concept, where everything can potentially affect anything?
Because parallelism is not that needed, there’s always contention starting from physical constraint. A user can only have one body, a printer can only output one piece of paper at a time,… There are natural areas for parallelism and it’s been already implemented. Memory as a bottleneck has not been a things for decades.
Breaking down things in terms of tasks is not hard. The hard part is discovering that those parts need to communicate. And sometimes they want access to same limited resources. We already have things like array programming that have a parallel view of computation. But no one is rushing to get things done with them.
I agree, I've always viewed C as a sort of domain specific language for Von Neumann architectures. We only call it a "general purpose language" because the domain was so big, but using C to write multi-core distributed, networked programs to me feels like using CSS to write an operating system.
I'm with you, but I don't see a clear path from "here" (illusion of the same memory) to "there" (each processor has its own memory, I guess). It's really hard to reason about latency, synchronization and communication costs in the abstract.
In a way I see the various cloud computing services as the organically grown (i.e. haphazard and clunky) answer to this problem.
One of the reasons it is so hard is because the discipline of thinking about those things isn’t baked into the language like it should be. You can’t look at a piece of code in a typical high-level language and reason about synchronization overhead because those semantics aren’t expressible in the code. We need languages that support expression of effects and coeffects, which would enable that kind of high-level reasoning about tradeoffs.
Do you have any ideas on what that would look like? The best I can come up with is something like https://seastar.io/ built in to the language.
But even that feels lacking, even though I'm really impressed with Seastar. I love the "bring operations to data" thinking.
The future is going to be fascinating
If we have enough fabs theres a world where every single problem has a completely custom chip to maximise efficiency of whatever problem needs to be solved. End to end AI - Ask to solve a problem, AI designs the chips, fab delivers it, AI writes the software in a completely custom language. Nobody will understand how anything works other than knowing that it does work
AI so far can't really do anything that humans can't though? (obviously it's infinitely faster) if building extremely customized chips so far has proved to be suboptimal (even if we partially exclude the engineering salaries) why would AI change that?
This approach also implies that optimization and performance will be come highly important? But it's not (outside of a few use cases) and the software that even the SOTA AI labs are building is often an unoptimized mess just like human written software used to be (if not worse)
It is NOT about what human can do or can do better. It is about how fast AI based models can do and for how long they can keep doing without getting tired.
As an evidence, ask anyone of the programmers using LLMs to code. Who gives up first and needs a break to come back next day?
Right now, the cost that limits doing small custom chips is not designing the chip, it's the cost of making the mask sets for the chips and other foundry NRE, which is well above $50M for a single leading edge chip these days.
This money is generally not spent on things that AI can easily make cheaper.
Might allow further growth in chip performance now that simply making smaller transistors is seemingly approaching its limits.
Surely this also potentially unlocks the scenario where “good enough” chip fabrication becomes easier, because not everything needs to rely on the single-most-cutting-edge node-fabrication capabilities, because they can now gain more from architectural customisations in return.
Could be verrry interesting .
Isn’t there an old episode of Star Trek where they visit a planet with a population that has become utterly dependent on a supercomputer? And as a result everyone has become very stupid? Will have to track that down…
"The Return of the Archons".
That's the good old recurrent theme of the lotus eaters, I don't think any Star Trek series has missed taking a shot at it. Weirdly, you'd think that the main computer in Star Trek would have made them stupid, but they override it pretty frequently.
3D printing is the beginnings of this sort of capability. But current "home" lab 3D printing is incapable of producing chips - may be one day it will.
> But current "home" lab 3D printing is incapable of producing chips
Current "home lab" 3D printing is fundamentally different from chip manufacturing (additive manufacturing versus lithography), so it's unsurprising that it's incapable of producing chips.
Modern chip fabrication occurs on a microscopic scale. It requires extreme precision and thus must be done in a highly sterile environment. The slightest speck of dust is enough to ruin the output.
Producing such extreme controlled conditions is unlikely to ever be practical at "home" --- certainly not any time soon. Packaging a nuclear reactor for home use would probably be easier.
That "fab delivers it" does a lot of work, in that concept...
Unless it infringes on big tech patents or other wealth extraction measures, then it'll just be computer says no.
Wouldn’t AI design a completely programmable base that can become any type of chip instead? It seems limiting that you’d need custom chips for different tasks, a chip could morph on demand, even include different architectures that change during runtime dynamically, or even reinvent itself as required.
If we use the very abstract term “the future” that is.
Uh, how will they know it does work?
Which is, effectively, magic. A terrifying and yet exhilarating potential.
It is. In a sense it's very similar to magic.
It's a marvel that you can download a 12Gb file that's basically a neural net smart enough to discuss any age of history, identify photos, etc, on a local chip - all in the space of 3 or 4 high res movie files.
That shouldn't be possible; it means that we've found ways to compress knowledge into spaces smaller than logic would indicate we should able to, and now we have these tiny brains we can take around with us on a laptop that can recite history. When I was a kid there was an electronic encyclopedia you could buy, with condensed articles, and maybe a few megabytes of memory, and that was kind of "magic" ...it made me think of Hari Seldon, or the Hitchhiker's Guide.
I'm not sold on the idea that the compression is working as well as people say it is. But we're compressing on ideas now, not letters or words. Ideas are orthogonal and the damage or loss from compression isn't immediately visible.
Future = AI + Robots