Blog
-
How many tokens/$ can you get?We're rebuilding the inference stack for throughput per dollar, starting with underused Amazon Inferentia chips.
We're rebuilding the inference stack for throughput per dollar, starting with underused Amazon Inferentia chips.