[HOW] Generate paste layers without Do Not Populate (DNP) components

[montirafa]

What do you want to achieve?
Generate paste layers without Do Not Populate (DNP) components. The global remove_solder_paste_for_dnp: true is not enough.

Do you have some PCB/Schematic to use as example?
I can't share the original project, but I also tested it using the project shared in issue 784

test.zip

Do you have some configuration file (.kibot.yaml) that you are using?
Edited file:

kibot:
  version: 1

global:
  remove_solder_paste_for_dnp: true
variants:
  - name: 'Test'
    comment: 'Some useful comment'
    type: kibom
    file_id: '_Test'
    variant: ''

outputs:
  - name: 'gerber_default'
    comment: 'Generate Gerbers (Default)'
    type: 'gerber'
    dir: 'Gerbers'
    layers:
      - F.Paste
      - B.Paste
    options:
      disable_aperture_macros: true
      exclude_pads_from_silkscreen: true
      output: '%f-%r-%v-%i.%x'
      plot_footprint_values: false
      subtract_mask_from_silk: true
      use_aux_axis_as_origin: true
      use_gerber_net_attributes: false
      use_gerber_x2_attributes: false

Environment (please complete the following information):
Where are you running KiBot:

• In a CI/CD workflow? GitHub
• In a GitHub action? Which tag are you using? v3
• Using a docker image? kicad8_auto:1.8.4-2_k8.0.8_d12.7
• Using a desktop system? Which OS, distro and version? -

[set-soft]

Hi @montirafa !
I used the bom example from test.zip where R1 is DNP and the above configuration, which I named test.kibot.yaml I then executed:

$ kibot -c test.kibot.yaml -g variant=Test -d t1
$ gerbview t1/Gerbers/bom-job_Test.gbrjob &

Got:

Here R1 is missing, because this is a DNP component.

I then executed:

$ kibot -c gerber.kibot.yaml -g variant=Test -d t2
$ gerbview t2/Gerbers/bom-job_Test.gbrjob 

Then I put the paste layers in gerber.kibot.yaml and executed:

$ ~/KiBot/kibot/src/kibot -c gerber.kibot.yaml -g variant=Test -d t3
$ gerbview t3/Gerbers/bom-job_Test.gbrjob &

Here is what I get enabling the relevant layers:

Is this what you want to get?

[montirafa]

Hi @set-soft!

Yes, these are the results I was hoping for.

These steps also work with my original PCB. However, when using my original panel, the process was killed after running for ~20 minutes.

With verbose mode (-vvv), the last lines were

DEBUG:Also exporting KICAD6_SYMBOL_DIR="/usr/share/kicad/symbols" (kibot - config.py:487)
DEBUG:Also exporting KICAD7_SYMBOL_DIR="/usr/share/kicad/symbols" (kibot - config.py:487)
DEBUG:Also exporting KICAD6_TEMPLATE_DIR="/usr/share/kicad/template" (kibot - config.py:487)
DEBUG:Also exporting KICAD7_TEMPLATE_DIR="/usr/share/kicad/template" (kibot - config.py:487)
DEBUG:Also exporting KICAD6_FOOTPRINT_DIR="/usr/share/kicad/footprints" (kibot - config.py:487)
DEBUG:Also exporting KICAD7_FOOTPRINT_DIR="/usr/share/kicad/footprints" (kibot - config.py:487)
DEBUG:Also exporting KICAD6_3RD_PARTY="/github/home/.local/share/kicad/8.0/3rdparty" (kibot - config.py:487)
DEBUG:Also exporting KICAD7_3RD_PARTY="/github/home/.local/share/kicad/8.0/3rdparty" (kibot - config.py:487)
DEBUG:No 3D aliases (/github/home/.config/kicad/8.0/3d/3Dresolver.cfg) (kibot - config.py:627)
Killed

Looking at the PCB logs, I realized that the next step would be the application of the DNP filter:

DEBUG:Also exporting KICAD6_SYMBOL_DIR="/usr/share/kicad/symbols" (kibot - config.py:487)
DEBUG:Also exporting KICAD7_SYMBOL_DIR="/usr/share/kicad/symbols" (kibot - config.py:487)
DEBUG:Also exporting KICAD6_TEMPLATE_DIR="/usr/share/kicad/template" (kibot - config.py:487)
DEBUG:Also exporting KICAD7_TEMPLATE_DIR="/usr/share/kicad/template" (kibot - config.py:487)
DEBUG:Also exporting KICAD6_FOOTPRINT_DIR="/usr/share/kicad/footprints" (kibot - config.py:487)
DEBUG:Also exporting KICAD7_FOOTPRINT_DIR="/usr/share/kicad/footprints" (kibot - config.py:487)
DEBUG:Also exporting KICAD6_3RD_PARTY="/github/home/.local/share/kicad/8.0/3rdparty" (kibot - config.py:487)
DEBUG:Also exporting KICAD7_3RD_PARTY="/github/home/.local/share/kicad/8.0/3rdparty" (kibot - config.py:487)
DEBUG:No 3D aliases (/github/home/.config/kicad/8.0/3d/3Dresolver.cfg) (kibot - config.py:627)
DEBUG:Filters reset (kibot - fil_base.py:196)
DEBUG:- C21 is DNP by KiCad (kibot - fil_base.py:206)
DEBUG:- C22 is DNP by KiCad (kibot - fil_base.py:206)
DEBUG:- C23 is DNP by KiCad (kibot - fil_base.py:206)
DEBUG:- C24 is DNP by KiCad (kibot - fil_base.py:206)

Are there any limitations, such as file size, number of components to process, or anything similar? For your information, my PCB and panel files are 4.2 MB and 25.3 MB respectively, with 279 and 1674 components.

Thank you so far!

[set-soft]

Hi @montirafa !
The limitation is the available memory.
I doubt the problem is related to the filter itself.
Is hard to know the problem without a test case