#api-performance
#api-performance

[ follow ]

OpenAI Introduces Websocket-Based Execution Mode to Reduce Latency in Agentic Workflows

OpenAI has introduced a WebSocket-based execution mode for its responses API to improve the performance of agentic workflows used in coding agents and real-time AI systems. The change replaces the traditional HTTP request-response pattern with a persistent, bidirectional connection between client and server, targeting latency and coordination overhead in multi-step reasoning workflows.

Artificial intelligence

fromTheregister

2 weeks ago

Anthropic admits it dumbed down Claude with 'upgrades'

Claude users experienced lower-quality responses due to unintentional changes made by Anthropic in March and April.

Web frameworks

fromInfoQ

3 weeks ago

Building Production-Ready tRPC APIs: The TypeScript Alternative to Apollo Federation

tRPC provides end-to-end type safety, significantly reducing API bugs and improving performance compared to GraphQL Federation.

Node JS

fromInfoQ

4 weeks ago

Using AWS Lambda Extensions to Run Post-Response Telemetry Flush

Lambda extensions enable post-response work, improving API response times by managing telemetry flushing without impacting request handling.

DevOps

fromHackernoon

2 years ago

When It's 3AM and Your App is on Fire: How Distributed Tracing Saves the Day | HackerNoon

Distributed tracing is essential for efficiently diagnosing bottlenecks in complex microservices architectures.