SUMMARYAMD agreed to acquire Toronto-based startup Taalas, which builds inference chips customized for specific AI models rather than general-purpose workloads. The company says its hard-wired silicon can generate outputs for targeted models thousands of times faster than a traditional GPU, and its current chip runs a small version of Meta’s Llama 3.1 model. Taalas has raised $219 million since its 2023 founding and says new models can be turned into custom hardware in about two months.
An anonymous reader quotes a report from CNBC: On Thursday, AMD said it's entered into an agreement to acquire Taalas, a Toronto-based startup that makes chips for inference. Taalas' accelerators are customized, or hard-wired for a single AI model, rather than being general purpose. In exchange for that loss of flexibility, Taalas' technology promises a less-expensive chip that it says can produce output for specific models thousands of times faster than a traditional GPU. An AMD representative declined to provide a purchase price for the transaction. Taalas has raised a total of $219 million in venture funding since its 2023 founding.
Taalas' current chip runs a small version of Meta's Llama 3.1 model, though the company is working on chips for bigger and more advanced models. It's manufactured using an older Taiwan Semiconductor Manufacturing Co. process, and uses speedy SRAM memory on the chip itself. Taalas CEO Ljubisa Bajic says on the startup's website that the company "developed a platform for transforming any AI model into custom silicon." "From the moment a previously unseen model is received, it can be realized in hardware in only two months," Bajic wrote.