RestWs

Scaling Python AI & Long-Running Tasks with Rust

>> Sync Simplicity, Async Power:
REST-Call in, WebSocket-Stream out <<

Are you struggling with REST API timeouts during heavy AI inference or complex data processing? Traditional task queues add significant infrastructure overhead, while standard async Python can still hit bottlenecks.

I’m excited to share my newest project: RestWs, a high-performance web server engine built in Rust (and Python) designed specifically to decouple heavy workloads from the HTTP lifecycle.

❓ The Problem:
Modern APIs face scalability challenges when handling long-running tasks. These workloads block the request-response cycle, leading to client timeouts and resource exhaustion.

💡 The Solution:
RestWs implements the ASGI standard to bridge the gap between low-level systems performance and high-level Python logic. It allows you to write synchronous Python while the Rust engine manages the heavy lifting through a unique "Process Split."

🔑 Key Features:
The Split: Trigger a background task that automatically pipes stdout/logs directly to a persistent WebSocket while the initial HTTP request resolves.

Zero-Downtime Hot-Reload: Deploy new Python code without dropping active WebSocket connections.

Compatibility: Works seamlessly with FastAPI and other ASGI compatible frameworks.

⚡ RestWs is currently in the experimental phase and is perfect for developers looking to simplify their stack while maintaining massive throughput for streaming data and AI applications.

Source code: https://github.com/asderix/RestWs
Demo application: https://github.com/asderix/RestWsDemo