install coroot-ce on ipv4 only k8s cluster -clickhouse failure

[poblin-orange]

Getting the following stacktrace. Looks like its something that can be configured at clickhouse config.xml level ( eg <enable_ipv6>false</enable_ipv6> ) , but unclear how from Coroot CR ?

clickhouse-keeper Processing configuration file '/config/config.xml'.                                                                                                                                                                                                                                                        
clickhouse-keeper 2025.12.16 21:47:33.035760 [ 1 ] {} <Warning> KeeperLogStore: Removing all changelogs                                                                                                                                                                                                                      
clickhouse-keeper 2025.12.16 21:47:33.035811 [ 1 ] {} <Warning> KeeperLogStore: Moving broken logs to detached/20251216T214733                                                                                                                                                                                               
clickhouse-keeper 2025.12.16 21:47:33.035866 [ 1 ] {} <Warning> KeeperLogStore: Removing changelog changelog_1_100000.bin                                                                                                                                                                                                    
clickhouse-keeper 2025.12.16 21:47:33.042002 [ 1 ] {} <Error> RaftInstance: got exception: open: Address family not supported by protocol [system:97] on port 9234                                                                                                                                                           
clickhouse-keeper 2025.12.16 21:47:33.042329 [ 1 ] {} <Error> void DB::KeeperDispatcher::initialize(const Poco::Util::AbstractConfiguration &, bool, bool, const MultiVersion<Macros>::Version &): Code: 568. DB::Exception: Cannot create interserver listener on port 9234. (RAFT_ERROR), Stack trace (when copying this me
clickhouse-keeper                                                                                                                                                                                                                                                                                                            
clickhouse-keeper 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000dd0fe7b                                                                                                                                                                                                                
clickhouse-keeper 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x0000000008bad62c                                                                                                                                                                                                                               
clickhouse-keeper 2. DB::Exception::Exception<int>(int, FormatStringHelperImpl<std::type_identity<int>::type>, int&&) @ 0x000000000e68dc6b                                                                                                                                                                                   
clickhouse-keeper 3. DB::KeeperServer::launchRaftServer(Poco::Util::AbstractConfiguration const&, bool) @ 0x000000001457cfd5                                                                                                                                                                                                 
clickhouse-keeper 4. DB::KeeperServer::startup(Poco::Util::AbstractConfiguration const&, bool) @ 0x000000001457fe89                                                                                                                                                                                                          
clickhouse-keeper 5. DB::KeeperDispatcher::initialize(Poco::Util::AbstractConfiguration const&, bool, bool, std::shared_ptr<DB::Macros const> const&) @ 0x000000001455e49d                                                                                                                                                   
clickhouse-keeper 6. DB::Context::initializeKeeperDispatcher(bool) const @ 0x00000000120f0492                                                                                                                                                                                                                                
clickhouse-keeper 7. DB::Keeper::main(std::vector<String, std::allocator<String>> const&) @ 0x000000000ddd3113                                                                                                                                                                                                               
clickhouse-keeper 8. Poco::Util::Application::run() @ 0x0000000017479466                                                                                                                                                                                                                                                     
clickhouse-keeper 9. DB::Keeper::run() @ 0x000000000ddd0290                                                                                                                                                                                                                                                                  
clickhouse-keeper 10. mainEntryClickHouseKeeper(int, char**) @ 0x000000000ddcf242                                                                                                                                                                                                                                            
clickhouse-keeper 11. main @ 0x0000000008ba98e1                                                                                                                                                                                                                                                                              
clickhouse-keeper 12. ? @ 0x00007fddb42eb5d0                                                                                                                                                                                                                                                                                 
clickhouse-keeper 13. ? @ 0x00007fddb42eb680                                                                                                                                                                                                                                                                                 
clickhouse-keeper 14. _start @ 0x000000000677602e                                                                                                                                                                                                                                                                            
clickhouse-keeper  (version 25.1.3.23 (official build))                                                                                                                                                                                                                                                                      
clickhouse-keeper 2025.12.16 21:47:33.051240 [ 1 ] {} <Error> Application: Code: 568. DB::Exception: Cannot create interserver listener on port 9234. (RAFT_ERROR), Stack trace (when copying this message, always include the lines below):                                                                                 
clickhouse-keeper                                                                                                                                                                                                                                                                                                            
clickhouse-keeper 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000dd0fe7b                                                                                                                                                                                                                
clickhouse-keeper 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x0000000008bad62c                                                                                                                                                                                                                               
clickhouse-keeper 2. DB::Exception::Exception<int>(int, FormatStringHelperImpl<std::type_identity<int>::type>, int&&) @ 0x000000000e68dc6b                                                                                                                                                                                   
clickhouse-keeper 3. DB::KeeperServer::launchRaftServer(Poco::Util::AbstractConfiguration const&, bool) @ 0x000000001457cfd5                                                                                                                                                                                                 
clickhouse-keeper 4. DB::KeeperServer::startup(Poco::Util::AbstractConfiguration const&, bool) @ 0x000000001457fe89                                                                                                                                                                                                          
clickhouse-keeper 5. DB::KeeperDispatcher::initialize(Poco::Util::AbstractConfiguration const&, bool, bool, std::shared_ptr<DB::Macros const> const&) @ 0x000000001455e49d                                                                                                                                                   
clickhouse-keeper 6. DB::Context::initializeKeeperDispatcher(bool) const @ 0x00000000120f0492                                                                                                                                                                                                                                
clickhouse-keeper 7. DB::Keeper::main(std::vector<String, std::allocator<String>> const&) @ 0x000000000ddd3113                                                                                                                                                                                                               
clickhouse-keeper 8. Poco::Util::Application::run() @ 0x0000000017479466                                                                                                                                                                                                                                                     
clickhouse-keeper 9. DB::Keeper::run() @ 0x000000000ddd0290                                                                                                                                                                                                                                                                  
clickhouse-keeper 10. mainEntryClickHouseKeeper(int, char**) @ 0x000000000ddcf242                                                                                                                                                                                                                                            
clickhouse-keeper 11. main @ 0x0000000008ba98e1                                                                                                                                                                                                                                                                              
clickhouse-keeper 12. ? @ 0x00007fddb42eb5d0                                                                                                                                                                                                                                                                                 
clickhouse-keeper 13. ? @ 0x00007fddb42eb680                                                                                                                                                                                                                                                                                 
clickhouse-keeper 14. _start @ 0x000000000677602e                                                                                                                                                                                                                                                                            
clickhouse-keeper  (version 25.1.3.23 (official build))                                                                                                                                                                                                                                                                      
stream closed: EOF for 04-coroot/coroot-clickhouse-keeper-0 (clickhouse-keeper)                                                                                                                                                                                                                                              
stream closed: EOF for 04-coroot/coroot-clickhouse-keeper-0 (config)                                                                                                                                                                                                                                                         

[def]

Which version of the Coroot operator are you using? I just checked the latest ClickHouse Keeper configuration on an IPv4-only node, and everything works fine.

[poblin-orange]

chart coroot-operator 0.4.9, app version 1.4.9. using builtin clickhouse

the following config change solved my issue

              <!-- patch for ipv4 only -->
              <!-- listen_host>::</listen_host -->
             
              <listen_host>0.0.0.0</listen_host>
              <listen_try>1</listen_try>
    
              <keeper_server>
                  <enable_ipv6>false</enable_ipv6>

[def]

@poblin-orange, could you please share how to reproduce your cluster setup? I tested Coroot on k3s running on an Ubuntu node with IPv6 completely disabled at the grub level.

[poblin-orange]

@def here is my context (ubuntu 22.04, bosh vm)

server/11aa3763-7a95-47ad-8089-7399a97a2d0d:~# uname -a
Linux 4e95d6cd-1fcc-423d-af6f-1339c865abd1 5.15.0-161-generic #171-Ubuntu SMP Sat Oct 11 08:17:01 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

server/11aa3763-7a95-47ad-8089-7399a97a2d0d:~# cat /etc/default/grub
GRUB_CMDLINE_LINUX="vconsole.keymap=us net.ifnames=0 biosdevname=0 crashkernel=auto selinux=0 plymouth.enable=0 console=ttyS0,115200n8 earlyprintk=ttyS0 rootdelay=300 ipv6.disable=1 audit=1 cgroup_enable=memory swapaccount=1 apparmor=1 security=apparmor systemd.unified_cgroup_hierarchy=false"
GRUB_RECORDFAIL_TIMEOUT=5

https://techdocs.broadcom.com/us/en/vmware-tanzu/platform/tanzu-operations-manager/3-0/tanzu-ops-manager/security-pcf-infrastructure-stemcell-hardening.html

server/11aa3763-7a95-47ad-8089-7399a97a2d0d:~# /var/vcap/packages/k3s/k3s --version
k3s version v1.33.6+k3s1 (b5847677)
go version go1.24.9

[def]

Thanks, I've reproduced this issue

[def]

This was fixed in clickhouse-keeper , so we just need to update ClickHouse to the latest version

[poblin-orange]

thks @def
btw fantastic job on coroot.

[def]

@poblin-orange this is fixed in the latest version of coroot-operator (1.5.0)