Remove the microtime() in output data and use wrk latency results

[joanhey]

Actually some frameworks include the lib/output_data.php in the middle of the response, so the microtime() for the execution time is not realistic to compare with others. Also we only check 1 output data, not the average or maximum.
Now the execution time is taken from only 1 check (request), and is not representative from the real execution time.

We can use the data from wrk to create the data and graphs.
Example:

Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.09ms  50.47ms   96.36%
    Req/Sec     7.69k     1.42k   12.35k    86.44%
  Latency Distribution
     50%    1.08ms
     75%    1.30ms
     90%    1.73ms
     99%    2.96ms
  6467305 requests in 15.10s, 1.90GB read
  Non-2xx or 3xx responses: 6467305
Requests/sec: 428286.83
Transfer/sec:    128.66MB

The important data is here: req/s, latency and errors.
We can remove the microtime() in the output_data.php and use the Avg Latency, that's the important time. Also it'll be useful another graph with the Max Latency.

Another important data is if exist errors Non-2xx or 3xx responses as that is a big problem that we are not measuring.

[myaaghubi]

For the past tests (since I still have the results), there is Socket errors with mostly a small number ~1% of timeout for each fw. Plz make sure to check your fw and your environment, since your test shows 100% of rates failed.

For memory and execution time, it is the average of 5 runs by curl check out base/_functions.sh. Consider that it is avg/max latency for a thread.

For lib/output_data.php inside the controller, it is because of the fastcgi-finish to finish it on php-fpm (in case of cakephp, and laravel). So in terms of rps, it is not running from the middle of the response, and either theoretically and by my own test on both, the rps is the same!
There is a bit diff on memory, so I changed them back to fix the issue for php-fpm. It is possible now to run this benchmark on all the frameworks through php-fpm, plz check out disable-fastcgi.sh.

[joanhey]

Why do you close the offtopics !!

[joanhey]

Change your bench !!!

I try my best to help you !!
Bye !!!!