First, calculate your custom server utilization target, which is the point where your server is under increasing load and triggers a new server to provision with enough time so that the original server does not reach 100% utilization and drop requests. Consider this formula:
Target Utilization
Let's demonstrate how the formula works with a concrete example:
- Load test your instances to find out user capacity per instance: Load test results: 3,846 users/second
Requests/sec and users/sec are not equivalents, since a user makes multiple requests to complete an action and may execute multiple requests/sec. ...
