Graphics processing units (GPUs) perform matrix multiplication tasks due to their ability to handle many calculations simultaneously. They break large matrix problems into smaller segments and solve ...

The light is then fanned out to six channels and fed into a layer of six neurons that perform linear matrix multiplication using an array of devices called Mach-Zehnder interferometers.

In getting rid of matrix multiplication and running their algorithm on custom hardware, the researchers found that they could power a billion-parameter-scale language model on just 13 watts, about ...