[Improvement] Use client IP addresses instead of proxy servers IPs on the logs

[nvazquez]

Description

Improvement request

Setup:

• Use multiple CloudStack management servers using HAProxy in front of them
• Adjust the global settings accordingly:
  • proxy.header.verify = true
  • proxy.header.names = 'X-Forwarded-For'
  • proxy.cidr = list of CIDRs

The following observations have been made:

• Requests logged to access.log do not use the client IP address but the proxy IP address.
• Requests logged on the management-server.log file are only showing the client IP addresses for requests to <MGMT>:8080/client/api but not <MGMT>:8080/client (as the UI would do)

Expected behavior:

• Having client IP addresses on the logs would be useful (access.log, apilog.log, management-server.log files)

[DaanHoogland]

@nvazquez I would like to create child issues for this one to separate out more and less feasible parts of the issue.

• having jetty log forwarded-for addresses seems quite doable issue: add forwarded-for header to jetty config #11387 pr: get forward header for proxies and apply it in Jetty #11386
• having the UI forward client addresses to the server seems less trivial
• any functional improvement to be made to the apilog.log (apart from renaming it) is to be investigated and defined yet
  agree?
  cc @NuxRo

[DaanHoogland]

curl -H "X-Forwarded-For: 1.2.3.4" http://127.0.0.1:8080/client/api/ for reference

[DaanHoogland]

ok, after huddling, we decided that with #11387 we are basically done. closing this one.
/client is only serving static content and has no logging other than the access log (see #11386)
management-server.log (and apilog) remain unchanged.