Lint error with GRPC plugin: unable to infer component type

[artemklevtsov]

Hi.

I tried to lint config which uses custom golang plugin.

$ redpanda-connect lint --skip-env-var-check benthos/...
benthos/plugins/myplugin/plugin.yaml(1,1) field name not recognised
benthos/plugins/myplugin/plugin.yaml(2,1) field summary not recognised
benthos/plugins/myplugin/plugin.yaml(3,1) field command not recognised
benthos/plugins/myplugin/plugin.yaml(4,1) field type not recognised
benthos/plugins/myplugin/plugin.yaml(5,1) field fields not recognised
benthos/resources/common.yaml(38,1) unable to infer component type: [label myplugin]

How can I avoid this error?
I can move plugins directory but benthos/resources/common.yaml will still result in an errorr.

[mihaitodor]

Hi @artemklevtsov! Is redpanda-connect a custom binary which includes the plugin you developed? If yes, can you share a barebones setup that I can run to reproduce this issue?

[artemklevtsov]

No. I use standard binary.

Repo structure:

❯ tree benthos/
benthos/
├── config.yaml
├── plugins
│   └── xlsx2json
│       ├── go.mod
│       ├── go.sum
│       ├── main
│       ├── main.go
│       └── plugin.yaml
├── resources
│   ├── api.yaml
│   ├── common.yaml
└── tests

Run with:

redpanda-connect run --resources "benthos/resources/*.yaml" --rpc-plugins "benthos/plugins/*/plugin.yaml" benthos/config.yaml

plugin.yaml

name: xlsx2json
command: ["./main"]
type: processor
fields:
  - name: sheets
    kind: list
    type: string

Run lint with:

redpanda-connect lint --skip-env-var-check benthos/...

in resources/common.yaml:

processor_resources:
  - label: parse_xlsx_file
    xlsx2json: {}

[mihaitodor]

Not sure I get it… If it’s the standard binary that’s release by Redpanda, then it cant lint a config which references your custom plugin. You have to craft a custom binary which includes your plugin if you want the linter to work.