All API requests return HTTP 400 after deploying Netmaker (v1.4.0)

[suyanhj]

Hi,

After deploying Netmaker, all requests to the API service return HTTP 400, including basic endpoints accessed via curl.
This happens consistently and is not limited to browser-based UI requests.

I would appreciate any help or guidance on what might be misconfigured or missing.

---

Environment

• Netmaker version: v1.4.0
• Deployment method: Docker Compose
• Database: SQLite
• Reverse proxy: Nginx (not using Caddy)
• OS: Linux (Alibaba Cloud ECS)
• API exposed via HTTPS

---

Problem Description

After the Netmaker service starts successfully, every API request responds with HTTP 400, regardless of the endpoint.

This includes:

• Requests from the Netmaker UI
• Direct requests using curl

Example behavior:

• OPTIONS requests return 204
• Actual API requests return 400

---

API Logs

[root@iZwz90m5kvzd8cuadjfjr9Z ~]# docker logs netmaker -f
2026/01/08 08:38:48 maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
              
 __   __     ______     ______   __    __     ______     __  __     ______     ______    
/\ "-.\ \   /\  ___\   /\__  _\ /\ "-./  \   /\  __ \   /\ \/ /    /\  ___\   /\  == \   
\ \ \-.  \  \ \  __\   \/_/\ \/ \ \ \-./\ \  \ \  __ \  \ \  _"-.  \ \  __\   \ \  __<   
 \ \_\\"\_\  \ \_____\    \ \_\  \ \_\ \ \_\  \ \_\ \_\  \ \_\ \_\  \ \_____\  \ \_\ \_\ 
  \/_/ \/_/   \/_____/     \/_/   \/_/  \/_/   \/_/\/_/   \/_/\/_/   \/_____/   \/_/ /_/ 
                                                                                                                                                                                                                        

[netmaker] 2026-01-08 08:38:48 database successfully connected 
[netmaker] 2026-01-08 08:38:48 connecting to sqlite 
[netmaker] 2026-01-08 08:38:48 start setting up allocated ip map 
[netmaker] 2026-01-08 08:38:49 [controller.go-92] HandleRESTRequests(): REST Server successfully started on port  8081  (REST) 
[netmaker] 2026-01-08 08:38:49 [main.go-174] startControllers(): connecting to mq broker at ws://mq:1883 
[netmaker] 2026-01-08 08:38:50 [mq.go-74] SetupMQTT(): Mq Client Connecting with Random ID:  LM5LMDG6L2BXT3SLWWSG3AQ 
[netmaker] 2026-01-08 08:38:50 [main.go-177] startControllers(): connected to MQ Broker 
[netmaker] 2026-01-08 08:38:50 [zombie.go-78] ManageZombies(): Zombie management started 
{"time":"2026-01-08T08:38:50.469166857Z","level":"DEBUG","source":"peers.go 196}","msg":"peer update for host","hostId":"c90ee8e4-73f0-4559-8efe-6e1376a7f72a"}

{"time":"2026-01-08T08:48:50.178123622Z","level":"ERROR","source":"timer.go 238}","msg":"error running hook","hook_id":"network-hook","error":"could not find any records"}

(error responses with HTTP 400 for all API requests)

---

docker compose

version: "3.4"
services:
  netmaker:
    container_name: netmaker
    image: gravitl/netmaker:$SERVER_IMAGE_TAG
    env_file: ./netmaker.env
    restart: always
    volumes:
      - dnsconfig:/root/config/dnsconfig
      - sqldata:/root/data
    environment:
      # config-dependant vars
      - STUN_SERVERS=stun1.l.google.com:19302,stun2.l.google.com:19302,stun3.l.google.com:19302,stun4.l.google.com:19302
      # The domain/host IP indicating the mq broker address
      - BROKER_ENDPOINT=wss://broker.${NM_DOMAIN} # For EMQX broker use `BROKER_ENDPOINT=wss://broker.${NM_DOMAIN}/mqtt`
      # For EMQX broker (uncomment the two lines below)
      # - BROKER_TYPE=emqx
      # - EMQX_REST_ENDPOINT=http://mq:18083
      # The base domain of netmaker
      - SERVER_NAME=${NM_DOMAIN}
      - SERVER_API_CONN_STRING=api.${NM_DOMAIN}:443
      # Address of the CoreDNS server. Defaults to SERVER_HOST
      # - COREDNS_ADDR=${SERVER_HOST}
      - COREDNS_ADDR=172.16.22.5
      # Overrides SERVER_HOST if set. Useful for making HTTP available via different interfaces/networks.
      - SERVER_HTTP_HOST=api.${NM_DOMAIN}
    ports:
      #api
      - "8081:8081"
      - "50051:50051"

  netmaker-ui:
    container_name: netmaker-ui
    image: gravitl/netmaker-ui:$UI_IMAGE_TAG
    env_file: ./netmaker.env
    environment:
      # config-dependant vars
      # URL where UI will send API requests. Change based on SERVER_HOST, SERVER_HTTP_HOST, and API_PORT
      BACKEND_URL: "https://api.${NM_DOMAIN}"
    depends_on:
      - netmaker
    links:
      - "netmaker:api"
    restart: always
    ports:
      - "90:80"

#  caddy:
#    image: caddy:2.8.4
#    container_name: caddy
#    env_file: ./netmaker.env
#    restart: unless-stopped
#    extra_hosts:
#      - "host.docker.internal:host-gateway"
#    volumes:
#      - ./Caddyfile:/etc/caddy/Caddyfile
#      - caddy_data:/data
#      - caddy_conf:/config
#    ports:
#      - "80:80/tcp"
#      - "443:443/tcp"
#      - "50051:50051"

  coredns:
    network_mode: host
    container_name: coredns
    image: coredns/coredns:1.10.1
    command: -conf /root/dnsconfig/Corefile
    env_file: ./netmaker.env
    restart: always
    depends_on:
      - netmaker
    volumes:
      - dnsconfig:/root/dnsconfig
#    ports:
#      - "53:53/udp"
  mq:
    container_name: mq
    image: eclipse-mosquitto:2.0.15-openssl
    env_file: ./netmaker.env
    depends_on:
      - netmaker
    restart: unless-stopped
    command: [ "/mosquitto/config/wait.sh" ]
    volumes:
      - ./mosquitto.conf:/mosquitto/config/mosquitto.conf
      - ./wait.sh:/mosquitto/config/wait.sh
      - mosquitto_logs:/mosquitto/log
      - mosquitto_data:/mosquitto/data
    ports:
      - "8883:8883"
      - "1883:1883"
    
volumes:
  caddy_data: { } # runtime data for caddy
  caddy_conf: { } # configuration file for Caddy
  sqldata: { }
  dnsconfig: { } # storage for coredns
  mosquitto_logs: { } # storage for mqtt logs
  mosquitto_data: { } # storage for mqtt data

[suyanhj]

My ngx configuration has added duplicate cross-domain request headers.