NetworkingTestPlan

Test results doc: https://docs.google.com/spreadsheets/d/1_8CsACPEXqrMIbxBKxPAds091tNAwnwdWkMKr3994QY/edit

1.1. samples/net/sockets/big_http_download with qemu_x86

Setup per http://docs.zephyrproject.org/subsystems/networking/qemu_setup.html (including http://docs.zephyrproject.org/subsystems/networking/qemu_setup.html#setting-up-zephyr-and-nat-masquerading-on-qemu-host-to-access-internet). Make sure that the entire file is downloaded. Then make sure it's downloaded 3 times (total xfer: ~20MB). Ideally, larger total xfer should be tested, but as it is slow, that takes a lot of time.

1.2. samples/net/sockets/big_http_download with frdm_k64f/Ethernet

The frdm_k64f board connected with an Ethernet cable directly to the development host. The testing is per above. (Keep in mind that loop-slip-tap.sh and friends should be stopped, but NAT/DNS setup is still required.

1.3. samples/net/sockets/big_http_download with frdm_k64f/Ethernet to router

The frdm_k64f board connected with an Ethernet cable to a router with DHCPv4 server. At least https://github.com/zephyrproject-rtos/zephyr/commit/0b76b12837deb995077bf026de01a6e9a9e50dfe required. The testing is per above.

2.1. samples/net/sockets/dumb_http_server with qemu_x86

Setup per 1.1. Test on the host with ab -n1000 http://192.0.2.1:8080/. All 1000 requests should be served, without extraordinary delays. Sample reference output:

$ ab -n1000 http://192.0.2.2:8080/
This is ApacheBench, Version 2.3 <$Revision: 1706008 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 192.0.2.2 (be patient)
apr_socket_recv: Connection refused (111)
pfalcon@x230:~$ ab -n1000 http://192.0.2.1:8080/
This is ApacheBench, Version 2.3 <$Revision: 1706008 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 192.0.2.1 (be patient)
Completed 100 requests
Completed 200 requests
Completed 300 requests
Completed 400 requests
Completed 500 requests
Completed 600 requests
Completed 700 requests
Completed 800 requests
Completed 900 requests
Completed 1000 requests
Finished 1000 requests


Server Software:        
Server Hostname:        192.0.2.1
Server Port:            8080

Document Path:          /
Document Length:        2122 bytes

Concurrency Level:      1
Time taken for tests:   19.901 seconds
Complete requests:      1000
Failed requests:        0
Total transferred:      2181000 bytes
HTML transferred:       2122000 bytes
Requests per second:    50.25 [#/sec] (mean)
Time per request:       19.901 [ms] (mean)
Time per request:       19.901 [ms] (mean, across all concurrent requests)
Transfer rate:          107.02 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        2    4   3.3      3      46
Processing:    10   16   4.9     14      72
Waiting:        5   10   3.7      9      38
Total:         12   20   6.3     18      76

Percentage of the requests served within a certain time (ms)
  50%     18
  66%     20
  75%     22
  80%     23
  90%     27
  95%     31
  98%     40
  99%     44
 100%     76 (longest request)

2.2. samples/net/sockets/dumb_http_server with frdm_k64f.

Setup per 1.2. Test per 2.1.