PyCon
Join us at PyCon US 2026 in Long Beach - we have new AI and security tracks this year
PyCon US 2026 debuts a standalone AI track on May 16 in Long Beach, co-chaired by an Anthropic engineer.
Apr 183 min readopcnew Editorialsimonwillison.net
Back to home
LLM-inference
2 articles tagged with this topic
AWS-Trainium2
Speculative Decoding on AWS Trainium2 Cuts LLM Lat ency Up to 3x
AWS benchmarks show speculative decoding with vLLM on Trainium2 reduces inter -token latency up to 3x for decode-heavy workloads.
Apr 154 min readopcnew Editorialaws.amazon.com