Need some help

[Marko-98]

Hi! 👋

Let me start that I'm total beginner in this and I hope you could help me.

I created my own repository and used your auto_update_github_action.yml to install the script. Installation went normally and I added HaGeZi Pro++ as my only blocklist.

Now... I didn't add any allowlist because HaGeZi barely has any wrongly blocked domains and they are promptly fixed by HaGeZi himself. Every time script runs, it downloads predefined recommended allowlists despite me not creating ALLOWLIST_URLS variable. How do I stop this so script only downloads blocklists defined in BLOCKLIST_URLS? Or at least, is it possible to make script not download anything if variable ALLOWLIST_URLS is empty?

Another question I have is, HaGeZi Pro++ (wildcard domains) blocklist has 189.615 domains on the list at the moment. When GitHub Action starts, script uploads 189.526 domains to Cloudflare. It's always 80 to 90 domains missing from the list. Why this happens and what happened to those domains?

Thanks!

[mrrfv]

Hello Marko. Merry Christmas!

Unfortunately, the way the script is currently coded expects the use of some kind of allowlist. Not creating the ALLOWLIST_URLS variable or leaving it empty will always result in the defaults being used.

You can work around this by deleting the Download allowlists step from the YAML file and creating a new one, like in the example below:

<       - name: Download allowlists
<         run: npm run download:allowlist
<         env:
<           ALLOWLIST_URLS: ${{ vars.ALLOWLIST_URLS }}
---
>       - name: Create empty allowlist
>         run: echo '' > allowlist.txt

That way, no allowlists will be downloaded, and the required allowlist.txt file will be empty.

It's always 80 to 90 domains missing from the list. Why this happens and what happened to those domains?

This can happen for many reasons. The script cleans up all lists before uploading to Cloudflare (otherwise they wouldn't be accepted), which includes removing duplicates and unnecessary subdomains. Also, the missing domains could be included in one of the default allowlists :)

I hope this is helpful. Please don't hesitate to reach out if you need any clarification.

[Marko-98]

Hi!

Thanks! I wish you the same and a happy, and successful New Year!

You can work around this by deleting the Download allowlists step from the YAML file and creating a new one, like in the example below:
That way, no allowlists will be downloaded, and the required allowlist.txt file will be empty.

Just tested this and it works perfectly.

This can happen for many reasons. The script cleans up all lists before uploading to Cloudflare (otherwise they wouldn't be accepted), which includes removing duplicates and unnecessary subdomains. Also, the missing domains could be included in one of the default allowlists :)

Is it possible to see which domains were excluded from the list? I went through full HaGeZi list and I haven't found any duplicates so missing domains couldn't be duplicate entries.

What does the script consider as unnecessary subdomains? If domain is example.com and the list contains example.com and something.example.com; I'm guessing it will just send example.com to Cloudflare and not the subdomain, right?

Also, list contains a few domains that have xn-- punycode, are those imported to Cloudflare too?

This was really helpful. 😉

[mrrfv]

No problem :)

Is it possible to see which domains were excluded from the list?

Yes, you can set the DEBUG environment variable (to any value) to see such information while the lists are being created.

If domain is example.com and the list contains example.com and something.example.com; I'm guessing it will just send example.com to Cloudflare and not the subdomain, right?

Yes, exactly.

Also, list contains a few domains that have xn-- punycode, are those imported to Cloudflare too?

The script doesn't touch those, so they should be imported.

[Marko-98]

Yes, you can set the DEBUG environment variable (to any value) to see such information while the lists are being created.

Would it be too much work for you to write me the code I should put to main.yml? I tried ChatGPT, Gemini and Copilot to help me here and they were useless, just broke the script. 😕

[mrrfv]

      - name: Create or update rules and lists
        run: npm run cloudflare-create
        env:
          BLOCK_PAGE_ENABLED: ${{ vars.BLOCK_PAGE_ENABLED }}
          CLOUDFLARE_API_TOKEN: ${{ secrets.CLOUDFLARE_API_TOKEN }}
          CLOUDFLARE_ACCOUNT_ID: ${{ secrets.CLOUDFLARE_ACCOUNT_ID }}
          CLOUDFLARE_LIST_ITEM_LIMIT: ${{ secrets.CLOUDFLARE_LIST_ITEM_LIMIT }}
          DISCORD_WEBHOOK_URL: ${{ secrets.DISCORD_WEBHOOK_URL }}
>         DEBUG: true

This should work, but I haven't tested myself.