You can now configure how HTTP(s) endpoints route requests in Aptible via the UI, CLI, and Terraform.

For request routing, we’ve traditionally defaulted to the Round Robin, a straightforward solution that routes requests evenly between containers in a sequential manner. However, for services that had requests of varying complexity, this may not always be the best option as requests can stack up.

With this update, we’re exposing two new options: Least Outstanding Requests and Weighted Random. Least Outstanding Requests routes traffic to containers with the least in progress requests and is great for varied workloads. On the other hand, Weighted Random routes requests evenly between all containers like Round Robin, but in a random order.

You can configure the Load Balancing Algorithm in the UI through a dropdown when you create or edit HTTP(s) endpoints, in v0.24.8 of the CLI using the --load-balancing-algorithm-type flag in the endpoints:https:create and endpoints:https:modify commands, and through the load_balancing_algorithm_type attribute in Terraform. Valid options are round_robin (default), least_outstanding_requests, and weighted_random.

Reach out to Aptible Support if you have any questions.