curl perform failed for url /putMedia with result Transferred a partial

[gustavofuhr]

I developed an emmbeded app in camera Axis to send frames to KVS, based on this PR:
#1240

It's working fine, but I get a lot of warnings regarding the curl failure bellow:

** Logging **

2025-07-17T17:01:28.148-05:00 axis-camera  [WARN ] [KVS] curlCompleteSync(): [B8A44F9C9902__train_rails] curl perform failed for url https://s-5ac677c0.kinesisvideo.eu-west-1.amazonaws.com/putMedia with result Transferred a partial [file: transfe](file: transf "‌")r closed with outstanding read data remaining
2025-07-17T17:01:28.150-05:00 axis-camera :     Authorization: ...
2025-07-17T17:01:28.150-05:00 axis-camera : Request Headers: ...
2025-07-17T17:01:28.150-05:00 axis-camera : Request URL: https://s-5ac677c0.kinesisvideo.eu-west-1.amazonaws.com/putMedia

2025-07-17T17:01:28.150-05:00 axis-camera [WARN ] [KVS] curlCompleteSync(): [B8A44F9C9902__train_rails] HTTP Error 0 : Response: (null)

2025-07-17T17:01:28.155-05:00 axis-camera : [WARN ] [KVS] putStreamCurlHandler(): [B8A44F9C9902__train_rails] Stream with streamHandle 547944010384 uploadHandle 133 has exited without triggering end-of-stream. Service call result: 10006

2025-07-17T17:01:28.166-05:00 axis-camera: [WARN ] [KVS] notifyDataAvailable(): [B8A44F9C9902__train_rails] Failed to un-pause curl with error: 43. Curl object 0x7f94227440

What's might be happening? these errors are quite common. Different from the PR that I based my acap on, I start streaming always in a Key frame but the streaming might end in a P frame. At the end of the streaming I send this:

Frame eofr = EOFR_FRAME_INITIALIZER; 
kinesis_video_stream->putFrame(eofr);

[stefankiesz]

Hi, can you please share at what point in your app you are seeing these warnings? Is it during the closing of the stream, cleanup of resources, or is it randomly happening throughout?

If you are not setting the following clientInfo member, please see if the warnings persist after having set it to AUTOMATIC_STREAMING_INTERMITTENT_PRODUCER.

pClientInfo->automaticStreamingFlags = AUTOMATIC_STREAMING_INTERMITTENT_PRODUCER;

[gustavofuhr]

Will check and get back asap.

[gustavofuhr]

Hello, so I tried to add the flag here:

class SampleDeviceInfoProvider : public DefaultDeviceInfoProvider {

    public:
        device_info_t getDeviceInfo() override {
            auto device_info = DefaultDeviceInfoProvider::getDeviceInfo();
            // Set the storage size to 128mb
            device_info.storageInfo.storageSize = 128 * 1024 * 1024;
            device_info.clientInfo.automaticStreamingFlags = AUTOMATIC_STREAMING_INTERMITTENT_PRODUCER;
            return device_info;
        }
};

It did not solve my problem, I"m seeing the warning after I finish an event is streamed.
The error repeats itself each 30 seconds:

2025-08-06T15:48:26.275-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [INFO ] MOTION EVENT DETECTED! State: start, Timestamp: 2025-08-06T18:48:25.734305Z
2025-08-06T15:48:26.276-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [INFO ] HERE WE GO! Send signal to send frames...

2025-08-06T15:48:26.286-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [INFO ] Sending the buffer as fast as possible...
2025-08-06T15:48:26.297-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] notifyDataAvailable(): [B8A44FA0DC7A__axis-local] Failed to un-pause curl with error: 43. Curl object 0x55ac6c23b0
2025-08-06T15:48:26.339-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [INFO ] Buffer sent - Elapsed time: 0.0528247 seconds.
2025-08-06T15:48:26.340-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [INFO ] Will begin live streaming, will stop at: 2025-08-06_15:48:41

2025-08-06T15:48:41.625-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [INFO ] Stream stopped. Will wait for new events

2025-08-06T15:49:11.987-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] curlCompleteSync(): [B8A44FA0DC7A__axis-local] curl perform failed for url https://s-5ac677c0.kinesisvideo.eu-west-1.amazonaws.com/putMedia with result Transferred a partial file: transfer closed with outstanding read data remaining
2025-08-06T15:49:11.988-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] curlCompleteSync(): [B8A44FA0DC7A__axis-local] HTTP Error 0 : Response: (null)
2025-08-06T15:49:11.988-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: Request URL: https://s-5ac677c0.kinesisvideo.eu-west-1.amazonaws.com/putMedia
2025-08-06T15:49:11.988-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: Request Headers:
2025-08-06T15:49:11.988-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]:     Authorization: ...
2025-08-06T15:49:11.993-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] putStreamCurlHandler(): [B8A44FA0DC7A__axis-local] Stream with streamHandle 367964302096 uploadHandle 0 has exited without triggering end-of-stream. Service call result: 10006
2025-08-06T15:49:12.004-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] notifyDataAvailable(): [B8A44FA0DC7A__axis-local] Failed to un-pause curl with error: 43. Curl object 0x7f9c11b3e0

2025-08-06T15:49:42.813-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] curlCompleteSync(): [B8A44FA0DC7A__axis-local] curl perform failed for url https://s-5ac677c0.kinesisvideo.eu-west-1.amazonaws.com/putMedia with result Transferred a partial file: transfer closed with outstanding read data remaining
2025-08-06T15:49:42.815-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] curlCompleteSync(): [B8A44FA0DC7A__axis-local] HTTP Error 0 : Response: (null)
2025-08-06T15:49:42.815-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: Request URL: https://s-5ac677c0.kinesisvideo.eu-west-1.amazonaws.com/putMedia
2025-08-06T15:49:42.815-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: Request Headers:
2025-08-06T15:49:42.815-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]:     Authorization: ...
2025-08-06T15:49:42.822-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] putStreamCurlHandler(): [B8A44FA0DC7A__axis-local] Stream with streamHandle 367964302096 uploadHandle 1 has exited without triggering end-of-stream. Service call result: 10006
2025-08-06T15:49:42.833-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] notifyDataAvailable(): [B8A44FA0DC7A__axis-local] Failed to un-pause curl with error: 43. Curl object 0x55ac685650

2025-08-06T15:50:13.678-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] curlCompleteSync(): [B8A44FA0DC7A__axis-local] curl perform failed for url https://s-5ac677c0.kinesisvideo.eu-west-1.amazonaws.com/putMedia with result Transferred a partial file: transfer closed with outstanding read data remaining
2025-08-06T15:50:13.679-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] curlCompleteSync(): [B8A44FA0DC7A__axis-local] HTTP Error 0 : Response: (null)
2025-08-06T15:50:13.679-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: Request URL: https://s-5ac677c0.kinesisvideo.eu-west-1.amazonaws.com/putMedia
2025-08-06T15:50:13.679-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: Request Headers:
2025-08-06T15:50:13.679-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]:     Authorization: ...
2025-08-06T15:50:13.686-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] putStreamCurlHandler(): [B8A44FA0DC7A__axis-local] Stream with streamHandle 367964302096 uploadHandle 2 has exited without triggering end-of-stream. Service call result: 10006
2025-08-06T15:50:13.697-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] notifyDataAvailable(): [B8A44FA0DC7A__axis-local] Failed to un-pause curl with error: 43. Curl object 0x7f9c0e8730

2025-08-06T15:50:44.522-03:00 axis-b8a44fa0dc7a [ INFO    ] iamotionstreamer[25102]: [WARN ] [KVS] curlCompleteSync(): [B8A44FA0DC7A__axis-local] curl perform failed for url https://s-5ac677c0.kinesisvideo.eu-west-1.amazonaws.com/putMedia with result Transferred a partial file: transfer closed with outstanding read data remaining
...

Here's my StreamDefinition:

std::unique_ptr<StreamDefinition> stream_definition(new StreamDefinition(
        kvs_opts.aws_iot_thing_name,
        hours(kvs_opts.kvs_retentation_period_hours),
        nullptr,
        "",
        STREAMING_TYPE_REALTIME,
        "video/h264", // should be defined by the vdo stream
        duration_cast<milliseconds> (seconds(DEFAULT_MAX_LATENCY_SECONDS)),
        milliseconds(DEFAULT_FRAGMENT_DURATION_MILLISECONDS),
        milliseconds(DEFAULT_TIMECODE_SCALE_MILLISECONDS),
        DEFAULT_KEY_FRAME_FRAGMENTATION,
        DEFAULT_FRAME_TIMECODES,
        use_absolute_fragment_times,
        DEFAULT_FRAGMENT_ACKS,
        DEFAULT_RESTART_ON_ERROR,
        DEFAULT_RECALCULATE_METRICS,
        true,
        40, // THIS IS VERY IMPORTANT FOR VDO STREAMS
        25, // frame rate, should be define by the vdo stream
        DEFAULT_AVG_BANDWIDTH_BPS,
        seconds(DEFAULT_BUFFER_DURATION_SECONDS),
        seconds(DEFAULT_REPLAY_DURATION_SECONDS),
        seconds(DEFAULT_CONNECTION_STALENESS_SECONDS),
        DEFAULT_CODEC_ID,
        DEFAULT_TRACKNAME,
        nullptr,
        0));

[gustavofuhr]

Btw, I'm using version v3.4.2 compiled for aarch64. I tried EOFR_FRAME_INITIALIZER and also stopping only when there's a KEY frame, but neither solve it.

[gustavofuhr]

@stefankiesz any other test that I can make it? I read that it is suppose to work for intermittent producers without any flags and that the warning at each 30 seconds should not be happening at least after v3.1: https://github.com/yuma-m/amazon-kinesis-video-streams-producer-sdk-cpp/blob/b7ab03a563e368a95f6fd454dca15942efbb9bf0/docs/intermittent_producer.md