Audio input gain changes not being applied to ax_audio_stream on ARTPEC-8

[cheval1201]

Hello,

I've been developing an ACAP application which uses audio input streams to capture real-time audio. I had it running without any problems, but recently encountered an issue: the audio input gain settings are not being applied to the ax_audio_stream on ARTPEC-8 devices (specifically, Q1656 and Q9307-LV). This problem doesn't seem to occur on other architectures (tested with CV25 & ARTPEC-7), where the audio input gain changes are applied to the ax_audio_stream correctly. I verified this behavior by logging the audio energy levels of the incoming audio frames while changing the audio input gain values.

I used the AxAudio API to create streams:
https://axiscommunications.github.io/acap-documentation/3.5/api/axaudio/html/axaudio_8h.html#a9f401a9ff9cbb03a9916cbf86ade1d33:~:text=%E2%97%86-,ax_audio_open_pcm_16_stream(),-AXAudioStream*%20ax_audio_open_pcm_16_stream

and used the VAPIX Audio API to change the input gain of the AudioSource:
https://www.axis.com/vapix-library/subjects/t10100065/section/t10036015/display

I couldn't find any release notes or documentation addressing this issue, so I'm wondering if this might be a known problem or if there's something I might be overlooking.

[github-actions[bot]]

This automatically generated reply acts as a friendly reminder.

Answers to your questions will most often come from the community, from developers like yourself. You will, from time to time, find that Axis employees answers some of the questions, but this is not a guarantee. Think of the discussion forum as a complement to other support channels, not a replacement to any of them.

If your question remains unanswered for a period of time, please revisit it to see whether it can be improved by following the guidelines listed in Axis support guidelines.

[vivekatoffice]

Hi @cheval1201 ,
In my understanding, Audio API is only supported in ACAP SDK version 3.

For ACAP version 4: The new APIs are still not available and this may be the root cause of why it is not working with ARTPEC-8 devices (specifically, Q1656 and Q9307-LV)

Reference

If it is possible for you to modify this example to reproduce the issue you mentioned in a sample ACAP for ARTPEC-8(aarch64).

As per one of our expert engineers the following changes were made in Axis OS 11.8:
https://help.axis.com/en-us/axis-os-release-notes-archive#axis-os-11-8

[cheval1201]

Hello,

Regarding this issue, I confirmed again that the audio functionalities (changing audio input gains) work well with our ACAP application with OS 10 (10.11.262), but fails with OS 11 (11.8.61). With OS 11, the input decibel level changes accordingly when I change the audio input gain values in the audio device settings page, but the changed gain value is not applied to our ACAP applications.

I couldn't find any further notes regarding audio in later releases, so I was wondering if the Audio API is to be supported soon.

[SeunghyunOh-Cochl]

Hi @vivekatoffice, I am co-worker with @cheval1201 and using ACAP SDK 3.5 to get microphone stream. Thank you for your explanation. we still have a trouble in getting mic data the gain applied. As we mentions, I used ax_audio_stream on ARTPEC-8 devices (Q1656 and Q9307-LV) and there are no issues in ARTPEC 7, CV25 and NXP i.MX devices(e.g. M4308, M5075, C1410 MK II, C1310-E MK II, C1511, M1075-L). The status are as below,

1. We are currently using ACAP 3.5.

2. The microphone gain is confirmed by the input level to be properly entered, and in the Axis web page video recording for camera, the microphone gain is being applied well (referring below image)

3. We are using ax_audio_open_output_pcm_16 whose way is same as your example. I wonder when using this API, the stream is coming in with the microphone gain applied? If not, please provide an example to receive audio using in the main page.

Can you check this issue or is there any update for this?

[vivekatoffice]

Hi @cheval1201 / @SeunghyunOh-Cochl ,
As I can understand, you are from Cochl and are also listed on Axis Technology partner finder

I suggest you try to ask the Integration helpdesk about this directly.

Note: Axis Technology Integration Partner Program membership needed.

I will try to find more on this from my side and let you know if I can find something useful 🤞 . I still don't see any Audio related APIs in ACAP Native SDK 12.3.0:

Reference

Regarding "Please provide an example to receive audio using in the main page.":

The Axis device webpage (AXIS Q1715 Block Camera: AXIS OS version 12.3.56) using the VAPIX APIs: RTSP over HTTP. I will request the Axis ACAP SDK team if they can add an example here: vapix example

http://<IP Address>/axis-cgi/media.cgi?camera=1&videoframeskipmode=empty&videozprofile=classic&resolution=1920x1080&fps=30&audiodeviceid=0&audioinputid=0&audiocodec=aac&audiosamplerate=16000&audiobitrate=32000&timestamp=1&videocodec=h264&container=mp4

[vivekatoffice]

Hi @SeunghyunOh-Cochl / @cheval1201 ,

Just to update two new examples are released:

A pipewire stream-based ACAP application on an edge device : audio-capture and audio-playback is released

Do try it once the ACAP SDK documentation get updated and let us know your feedback 😄

[SeunghyunOh-Cochl]

Thank you for example. While I am checking the example, there a question.

Is there any effect depending on pipewire version? I checked pipewire library version in each cases.

• The pipewire in docker container SDK: libpipewire-0.3.so.0.1383.0
• The device(Q9307, C1511 with axis os 11): libpipewire-0.3.so.0.1181.0
• The version pipewire release gave us is libpipewire-0.3.so.0.371.0.

I wonder whether there are difference between the pipewire library version or there is a minimum version to use pipewire in axis device.

[SeunghyunOh-Cochl]

I have one more question. I'm testing a pipewire example and I'm confused about which ACAP SDK version to use. There are three options (ACAP 3.5, 4, and 12.5), so which version do I need? I'm currently using ACAP 3.5, and I can find 12.5, but I can't find version 4. Can you guide me on this?

[rocky-ji]

Try to use the latest SDK, version 4 and version 12 are both native SDK, to make it easy understanding, Starting with version 12.0, the ACAP release version and the ACAP Native SDK version align with the major and minor of the AXIS OS versioning to provide clearer compatibility mapping and simpler version tracking.

ACAP version 12.0 contains acap-native-sdk 12.0.0 and maps to AXIS OS 12.0.
ACAP applications built with ACAP 12.0 will be forward compatible with all 12.x releases where the last one in the series is the long-term support (LTS) release. After the LTS release, planned breaking changes will be implemented which is indicated with the step in major. The ACAP version major shows the LTS scope.

https://developer.axis.com/acap/introduction/acap-version-comparison/

The pipewire version depends on the camera OS, there may be version difference depending on the camera OS, but remember to use the latest camera OS.

[vivekatoffice]

Feel free to re-open it OR share the solution/alternative/comment if already resolved👁️‍🗨️