Run Tests with Stresstest CLI

The stresstest tool can be used to run performance tests. There are currently test suites available for running stress tests for time-stamping, document signing, and document validation.

Tests can be run with a varying number of concurrent threads to simulate multiple concurrent incoming connections.

Run stresstest from SIGNSERVER_HOME using the following command:

BASH

bin/stresstest

Usage

CODE

stresstest <options>
Performance testing tool
 -continueonfailure     When this option is specified the test will
                        continue running if a request fails. Failed
                        requests will not be considered for the
                        calculation of the total number of requests and
                        response times. The total number of failed
                        requests will presented in the statistics.

 -data <arg>            Input data to be used with the
                        DocumentSigner/Validator1 testsuites using an
                        XMLSigner.
 -hashalgorithm <arg>   Optional. For setting the hash algorithm in 
						timestamp stuites.Default for TimeStamp1 = SHA1 and
      					TimeStamp2 = SHA256.     
 -infile <arg>          Input file used for DocumentSigner/Validator1
                        testsuites.
 -maxwaittime <arg>     Maximum number of milliseconds for a thread to
                        wait until issuing the next time stamp.
                        Default=100
 -processurl <arg>      URL to process servlet (for the
                        DocumentSigner/Validator1 test suites).
 -requestcertificate	Optional. For request certificate from the TSA 
						in the timestamp testsuite.
 -statoutputdir <arg>   Optional. Directory to output statistics to. If
                        set, each thread creates a file in this directory
                        to output its response times to. The directory
                        must exist.
 -testsuite <arg>       Test suite to run. Any of [TimeStamp1, TimeStamp2,
                        DocumentSigner1, DocumentValidator1].
 -threads <arg>         Number of threads requesting time stamps.
 -timelimit <arg>       Optional. Only run for the specified time (in
                        milliseconds).
 -tsaurl <arg>          URL to timestamp worker to use.
 -userprefix <arg>      Prefix for usernames.
 -usersuffixmax <arg>   Highest suffix for usernames in form of an integer
                        value (inclusive).
 -usersuffixmin <arg>   Lowest suffix for usernames in form of an integer
                        value (inclusive).
 -warmuptime <arg>      Don't count number of signings and response times
                        until after this time (in milliseconds). Default=0
                        (no warmup time).
 -worker <arg>          Worker name or ID to use (with the
                        DocumentSigner/Validator1 test suites).
 -workerurl <arg>       URL to worker servlet (for the
                        DocumentSigner/Validator1 test suites).

Sample Usages

CODE

a) stresstest -testsuite TimeStamp2 -threads 4 -tsaurl http://localhost:8080/signserver/tsa?workerId=1 -hashalgorithm SHA384

b) stresstest -testsuite TimeStamp1 -threads 4 -maxwaittime 100 -statoutputdir ./statistics/ -tsaurl http://localhost:8080/signserver/tsa?workerId=1

c) stresstest -testsuite DocumentSigner1 -threads 4 -processurl http://localhost:8080/signserver/process -worker PDFSigner -infile test.pdf

d) stresstest -testsuite DocumentSigner1 -threads 4 -processurl http://localhost:8080/signserver/process -worker XMLSigner -data "<root/>"

e) stresstest -testsuite DocumentSigner1 -threads 4 -processurl http://localhost:8080/signserver/process -worker XMLSigner -data "<root/>" -userprefix user -usersuffixmin 1 -usersuffixmax 50

f) stresstest -testsuite DocumentValidator1 -threads 4 -processurl http://localhost:8080/signserver/process -worker DemoXMLValidator -infile signed.xml

When finished, that is once the time limit expires or you stop the process by pressing Ctrl+C, a statistic overview is printed containing the number of signings, and statistics (average, minimum, and maximum) for the response times.

Test Suites

There following test suites are available for running stress tests for time-stamping, document signing, and document validation:

TimeStamp1	Sends time-stamp requests using a dummy hash. The default is SHA-1 hash.
TimeStmap2	Sends time-stamp requests using a dummy hash. The default is SHA-256 hash.
DocumentSigner1	Sends document signing requests.
DocumentValidator1	Sends document validation requests.