Skip to content

CID-DC-compute-optimizer-Crawler gets error #406

@jesperalmstrom

Description

@jesperalmstrom

There is one crawler that fail: CID-DC-compute-optimizer-Crawler.
Crawler Error:

The number of tables detected by crawler: 2576 is greater than the table threshold value provided: 1. Failing crawler without writing to Data Catalog.

Since we have many tables there should be several crawlers since there are many tables for compute-optimizer-*.

compute_optimizer_auto_scale_lines
compute_optimizer_ebs_volume_lines
compute_optimizer_ec2_instance_lines
compute_optimizer_ecs_service_lines
compute_optimizer_idle_lines
compute_optimizer_lambda_lines
compute_optimizer_license_lines
compute_optimizer_rds_instance_lines

Shouldn't there be one crawler per table? Since these are missing crawlers, the tables lack partition.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions