Core Engine: Async Socket Event Loop v1.4.0-stable MIT License

High-Throughput Asynchronous Load Balancer & Reverse Proxy

Distribute mission-critical API traffic, LLM token streams, and microservice workloads with sub-millisecond overhead, active health probing, and automated circuit breaking.

240,000 Req / Sec Throughput
< 0.38 ms p99 Routing Latency
65,535 Max Concurrent Conns
18 MB Core RSS Footprint
version: '3.8'
services:
  openbalancer:
    image: ghcr.io/incontrolplus/openbalancer:latest
    container_name: openbalancer-core
    ports:
      - "8080:8080"
    volumes:
      - ./config.json:/app/config.json:ro
    environment:
      - ROUTING_ALGORITHM=weighted_round_robin
      - HEALTH_PROBE_INTERVAL=3
      - CIRCUIT_BREAKER_THRESHOLD=5
    restart: unless-stopped

Engineered for High-Concurrency Protocols

Built from the ground up on non-blocking asynchronous sockets with zero external dependencies in the hot path.

Protocol Agnostic Routing

Full support for HTTP/1.1, HTTP/2 multiplexing, long-lived WebSockets, Server-Sent Events (SSE), and gRPC streaming.

Active Circuit Breaking

Detects consecutive 5xx errors or socket timeouts in milliseconds, instantly tripping degraded upstream backends out of the pool.

Multi-Algorithm Balancing

Select between Weighted Round-Robin, Smooth Least Connections, and Consistent IP Hash Rings for session sticky routing.

Live Traffic & Failover Visualizer

Observe how OpenBalancer dynamically distributes socket requests and reroutes traffic when an upstream node fails.

Processed Requests 142,850
Observed Latency 12 ms
Dispatched Node srv-us-east-1
INGRESS

Client Ingestion

TCP Sockets & Webhooks

ASYNC ROUTER

OpenBalancer Core

Weighted Round-Robin
srv-us-east-1
AI Model Cluster A (Weight: 2)
HEALTHY
srv-eu-west-1
API Primary Node (Weight: 1)
HEALTHY
srv-ap-southeast-1
Failover Redundancy Pool
HEALTHY

Production Infrastructure & SLA Management

OpenBalancer is backed and operated by INCONTROL PLUS ЕООД. We provide formal B2B Master Services Agreements (MSA), guaranteed 99.9% uptime SLAs, and sub-15 minute emergency incident response for corporate engineering teams.

99.9% Uptime Guarantee

Contractual SLA with automated service credits for downtime under 99.9%.

Sub-15 Min Critical Incident SLA

24/7 direct escalation hotline to senior infrastructure architects.

Net-14 Corporate Invoicing

EU VAT compliant invoicing processed securely via Stripe Invoicing.

Transparent Licensing & B2B Support Tiers

Deploy OpenBalancer for free under the MIT license, or partner with INCONTROL PLUS for guaranteed B2B SLAs.

Community Open-Source

For developers and self-hosted environments.

€0 / forever
  • Full Core Routing Engine (MIT)
  • Round-robin & Weighted Algorithms
  • Active Health Probing & Metrics
  • Docker Swarm & K8s Support
Download Community Core

Custom Enterprise SLA

For multi-region and high-throughput systems.

Custom / retainer
  • Custom Master Services Agreement (MSA)
  • Custom AI LLM Dispatcher Plugins
  • Dedicated Senior DevOps Lead
  • Net-30 Corporate Terms
Secured B2B Invoicing & Retainers Encrypted 256-bit TLS payments processed via Stripe with Net-14 corporate invoicing terms.
VISA MASTERCARD AMEX SEPA STRIPE VERIFIED