Chip startup Etched says its Sohu chip, designed only to run transformer model AIs, is approx 100 times faster and cheaper than Nvidia's next-gen chips.
Chip startup Etched says its Sohu chip, designed only to run transformer model AIs, is approx 100 times faster and cheaper than Nvidia's next-gen chips.
Etched, founded by Harvard dropouts, is building an AI chip that can only run one type of model: transformer-based models.
People, this is fucking awesome.
While it doesn’t take much to be 100x cheaper than Nvidia, the excess compute produced by these transformer geared ASIC’s could lead to an AI boom analogous to the difference between a modern smartphone vs. the “computers” used on the Apollo missions. That will be super cool.
I have some experience using ASIC’s for different purposes and it is just crazy how much efficiency they have over general purpose chips when it comes to both initial cost and power consumption.
If this works out, we could see the currently exponential AI growth get “exponentially exponential” or something.
Whenever I hear 100x better than anything I know its overhype and will immediately not get invested until its actually proven in real world applications