Stories tagged “Ai Inference.”
4 stories
Railway, a cloud platform, warns users to rotate secrets and credentials after detecting suspicious activity on its systems storing customer environment variables.
OpenAI's Jalapeño chip outperforms Nvidia's superchips in AI inference benchmarks, delivering 1.5 to 1.9 times more AI work per watt and 1.7 to 3.6 times lower end-to-end latency.
Kog, a French startup, is working on software optimization to unlock the full potential of conventional GPUs for AI inference. They aim to deliver 30x faster LLM inference using existing hardware.
AI inference company Baseten is reportedly finalizing a $1.5 billion funding round at a $13 billion valuation, just five months after its last $300 million Series E.