-
Notifications
You must be signed in to change notification settings - Fork 4
Performance Metrics
Olaf Hartig edited this page Aug 16, 2019
·
5 revisions
The performance metrics are defined based on the following three notions:
- Query execution time (QET) is the amount of time (typically given in milliseconds, but may also be specified otherwise) that passes from the begin of sending a given query to a GraphQL server under test until the complete query result has been received in return.
- Query response time (QRT) is the amount of time (typically given in milliseconds, but may also be specified otherwise) that passes from the begin of sending a given query to a GraphQL server under test until the begin of receiving the query result in return.
- Throughput (TP) is the number of a given set of queries that are processed completely by a GraphQL-based client-server system within a specified time interval, where a query is considered to be processed completely after its complete result has been received by the client that requested the execution of the query. By default, the time intervals considered have a duration of 1 sec (one second); however, the interval duration may also be specified differently for a specific experiment.
- Average query execution time (aQETq) is the average of the QETs measured when executing an individual query multiple times with the GraphQL server under test.
- Average query response time (aQRTq) is the average of the QRTs measured when executing an individual query multiple times with the GraphQL server under test.
- Average query execution time per query template (aQETt) is the average of the QETs measured when executing multiple instances of a specific query template by the GraphQL server under test.
- Overall query execution time per query template (oQETt) is the overall amount of time that passes when executing multiple instances of a specific query template by the GraphQL server under test; i.e., if all the query instances are executed sequentially, then oQETt is the sum of the individual QETs (assuming no delay between the queries).
- Average query response time per query template (aQRTt) is the average of the QRTs measured when executing multiple instances of a specific query template by the GraphQL server under test.
- Throughput per query template (TPt) is the TP regarding (only) the instances of a specific query template.