15 January 2008 - 2.0.1 |
The actual execution of a LoadTest is configured in two dimensions:
The LoadTest Limit is specified on the top right of the LoadTest Editor and consists of two settings:
Please note that the "Total Runs" Limit Type does not mean per thread but in total; if for example setting the Limit to 1000 and configuring 5 threads, each thread will run approximately 200 requests (depending on execution times..).
Setting the Limit to 0 with either Limit Types will run the LoadTest indefinitely. A progress-bar to the right of the settings will show the current LoadTest progress.
A LoadTest can in soapUI be run using a number of strategies for how TestCases are executed. All strategies have a thread-count allowing the specification of how many TestCases that should be run in parallel. The current strategy is selected using the available Strategy combo, which will show that strategies settings to its right. Some strategies allow interactive changing of the thread-count while executing the LoadTest, others don't.
The following LoadTest Strategies are currently available:
Since multiple LoadTests with different strategies can be created one could for example create one LoadTest with a simple "base" load using the Simple strategy and another LoadTest using the Burst strategy to monitor how base performance is affected when running both LoadTests simultaneously within soapUI or from the command-line.
The Simple Strategy has the following settings:
Use this for simple load testing. For example setting the delay/random to 1000/0.5 will delay each threads TestCase execution by 500 to 1000 ms. Setting the delay to 0 will ignore the random setting and run without any delays.
If setting a delay be aware that the TPS statistic will give misleading results unless the "Calculate TPS on actual time passed" option is selected in the LoadTest Options dialog
The variance strategy has the following settings:
Use this strategy for simulating a linearly varying number of threads over time. The strategy will start at the currently configured thread-count, increase to current + (current*variance), decrease to current - (current*variance) and increase back to the current thread-count.
For example setting the thread-count to 20, duration to 480 and variance to 0.5, the strategy will increase from 20 to 30 threads in the first 2 minutes, decrease to 10 threads of the next 4 minutes and then increase back to the original 20 in the last 2 minutes.
The Burst strategy has the following settings:
Use this strategy to simulate a "burst" load and for example monitor system behaviour during the "recovery" periods
For example setting the limit type to seconds, and limit to 600, the thread-count to 30, burst delay to 50, and burst duration to 10 will pause all 30 threads for 50 seconds and run them for 10 seconds repeatedly under 10 minutes.
The Threads Strategy has the following settings:
Use this strategy to vary the number of threads from a start to end value linearly during the entire LoadTest. This can for example be useful to find the thread-count at which the best TPS is achieved.
For example setting the limit type to seconds, and limit to 600, the start threads to 1, and end threads to 30 will increase the number of threads from 1 to 30 over 10 minutes.