gzip content

[vilinski]

@ronaldschlenker Is it possible to send a gzipped content? tried to send one to an influxdb using binary. But what I have understood from the outputs, the ContentEncoding header is lost

This is the code I have used

let gzip (s: string) =
    let bytes = Encoding.UTF8.GetBytes s
    use msi = new MemoryStream (bytes)
    use mso = new MemoryStream ()
    ( use gzo = new GZipStream(mso, CompressionLevel.Optimal)
      msi.CopyTo(gzo)
      gzo.Flush())
    mso.ToArray()
    
let msg = httpLazy {
    POST cfg.url
    AcceptEncoding "gzip"
    ContentEncoding "gzip"
    AuthorizationUserPw cfg.user cfg.password
    body
    binary ("483de6e5-ea9e-4d3f-9192-e3e8b76f0d5b,tag=tag0 field=0.5177723544266878 1625842701503" |> gzip)
    exp
}

it evaluates to this, containing all defined headers:

> msg;;
val it : LazyHttpBuilder<BodyContext> =
  FsHttp.DslCE+Builder+LazyHttpBuilder`1[FsHttp.Domain+BodyContext]
    {Context = { header =
                  { url =
                     "http://moneo-perftest.fuerth.ifm-datalink.net:8086/write?db=perftest"
                    method = POST
                    headers =
                     [("Accept-Encoding", "gzip");
                      ("Content-Encoding", "gzip");
                      ("Authorization",
                       "Basic bW9uZW86YWlyN2tvb1plaTNyb2gxaQ==")]
                    cookies = [] }
                 content =
                  { contentData =
                     ByteArrayContent
                       [|31uy; 139uy; 8uy; 0uy; 0uy; 0uy; 0uy; 0uy; 0uy; 3uy|]
                    contentType = Some "application/octet-stream" }
                 config =
                  { timeout = 00:00:10
                    printHint =
                     { isEnabled = true
                       requestPrintHint = { printHeader = true
                                            printBody = true }
                       responsePrintHint =
                        { printHeader = true
                          printContent = { isEnabled = true
                                           format = true
                                           maxLength = 2147483647 } } }
                    printDebugMessages = false
                    httpMessageTransformer = None
                    httpClientHandlerTransformer = None
                    httpClientTransformer = None
                    httpCompletionOption = ResponseHeadersRead
                    proxy = None
                    certErrorStrategy = Default
                    httpClientFactory = None } };}

But after it sent I've got this, without ContentEncoding? :

> msg
- |> Request.send;;
val it : Response =
  
REQUEST
--------
POST http://localhost:8086/write?db=test HTTP/1.1
Accept-Encoding   : gzip
Authorization     : Basic BlaBla86YWlyN2tvb1plaTNyb2gxaQ==
Cookie            : 
Content-Type      : application/octet-stream
Content-Length    : 10
===content===
::ByteArray (length = 10)

RESPONSE
---------
HTTP/1.1 400 BadRequest
Request-Id           : 9746d725-e0c6-11eb-b670-244bfe8c4492
X-Influxdb-Build     : OSS
X-Influxdb-Error     : unable to parse ': missing fields
X-Influxdb-Version   : 1.8.6
X-Request-ID         : 9746d725-e0c6-11eb-b670-244bfe8c4492
Date                 : Fri, 09 Jul 2021 15:01:51 GMT
Content-Type         : application/json
Content-Length       : 107
===content===
{
  "error": "unable to parse '\u001f�\b\u0000\u0000\u0000\u0000\u0000\u0000\u0003': missing fields"
}


> 

After all, is there a way how to send a custom HttpContent instead?

[SchlenkR]

@vilinski I think this is a bug, due to not setting the content headers correctly.

[SchlenkR]

Also, I think about moving all the content/body based headers into the "body" section of the builder for the next major release. Do you have any thoughts on this?

[vilinski]

I'm ok with it. Maybe also create some custom operators for common compressions like gzip and brotli?
You can also create a discussion to gain some more thoughts