Allow to export dashboards from Serverless environments #3007

mrodm · 2025-10-20T14:30:40Z

Closes #2949

This PR allows to export dashboards in Serverless environments.

For Serverless environments, a new set of APIs from Elastic Package Manager have been used:

Get the current packages installed: https://www.elastic.co/docs/api/doc/kibana/operation/operation-get-fleet-epm-packages-installed
Get the information about those packages (containing asset IDs): https://www.elastic.co/docs/api/doc/kibana/operation/operation-get-fleet-epm-packages-pkgname-pkgversion
Get the actual description of those assets via https://www.elastic.co/docs/api/doc/kibana/operation/operation-post-fleet-epm-bulk-assets

Author's checklist

Check elastic-package export dashboards in Serverless
Check elastic-package export dashboards in local stacks
Check elastic-package edit dashboards in Serverless
Check elastic-package edit dashboards in local stacks

Both commands require the same changes to list dashboards.

Example of usage

First step all installed packages are shown:

 $ elastic-package -C ../integrations-main/packages/nginx export dashboards 
Export Kibana dashboards
Which packages would you like to export dashboards from? (nginx-2.3.2)
  New dashboard                 
  elastic_package_registry-0.3.1
  fleet_server-1.6.0            
> nginx-2.3.2                   
  synthetics-1.4.2              
                                

enter continue • ctrl+c cancel

If the user selects a package, it will be shown all the dashboards related to that package (e.g. nginx):

 $ elastic-package -C ../integrations-main/packages/nginx export dashboards 
Export Kibana dashboards
? Which packages would you like to export dashboards from?: nginx-2.3.2
Which dashboards would you like to export?
  Use ↑↓ to navigate, space to toggle selection, enter to confirm
> [ ] [Logs Nginx] Access and error logs (ID: nginx-046212a0-a2a1-11e7-928f-5dbe6f6f5519, Type: dashboard)
  [ ] [Logs Nginx] Overview (ID: nginx-55a9e6e0-a29e-11e7-928f-5dbe6f6f5519, Type: dashboard)             
  [ ] [Metrics Nginx] Overview (ID: nginx-023d2930-f1a5-11e7-a9ef-93c69af7b129, Type: dashboard)          

enter continue • ctrl+c cancel

If the user is developing a new dashboard (and therefore not related to any package), they should choose New dashboard option, and all the dashboards available in the Serverless instance will be shown:

 $ elastic-package -C ../integrations-main/packages/nginx export dashboards 
Export Kibana dashboards
Which packages would you like to export dashboards from? (nginx-2.3.2)
> New dashboard                 
  elastic_package_registry-0.3.1
  fleet_server-1.6.0            
  nginx-2.3.2                   
  synthetics-1.4.2              
                                

enter continue • ctrl+c cancel

# After choosing "New dashboard" option

 $ epd -C ../integrations-main/packages/nginx export dashboards 
Export Kibana dashboards
? Which packages would you like to export dashboards from?: New dashboard
Which dashboards would you like to export?
  Use ↑↓ to navigate, space to toggle selection, enter to confirm
> [ ] [EPR Metrics] Overview (ID: elastic_package_registry-313c2700-099b-11ed-91b6-3b1f9c2b2771)
  [ ] [Logs Nginx] Access and error logs (ID: nginx-046212a0-a2a1-11e7-928f-5dbe6f6f5519)       
  [ ] [Logs Nginx] Overview (ID: nginx-55a9e6e0-a29e-11e7-928f-5dbe6f6f5519)                    
  [ ] [Metrics Nginx] Overview (ID: nginx-023d2930-f1a5-11e7-a9ef-93c69af7b129)                 

enter continue • ctrl+c cancel

Extract function to select dashboard IDs

mrodm · 2025-10-20T14:41:34Z

cmd/export_dashboards.go


 Use this command to download selected dashboards and other associated saved objects from Kibana. This command adjusts the downloaded saved objects according to package naming conventions (prefixes, unique IDs) and writes them locally into folders corresponding to saved object types (dashboard, visualization, map, etc.).`

+	newDashboardOption = "New dashboard"


Title for the option to be selected in order to show all the dashboards from the Serverless instance.

This option is shown the first one in the list.
Example:

$ elastic-package -C ../integrations-main/packages/nginx export dashboards Export Kibana dashboards Which packages would you like to export dashboards from? (nginx-2.3.2) > New dashboard elastic_package_registry-0.3.1 fleet_server-1.6.0 nginx-2.3.2 synthetics-1.4.2

mrodm · 2025-10-20T14:42:23Z

cmd/export_dashboards.go

 func promptDashboardIDs(ctx context.Context, kibanaClient *kibana.Client) ([]string, error) {
 	savedDashboards, err := kibanaClient.FindDashboards(ctx)


kibana.FindDashboards has been updated in order to show all dashboards also in Serverless via the export API.

mrodm · 2025-10-20T14:44:02Z

cmd/export_dashboards.go

+	if installedPackage == newDashboardOption {
+		dashboardIDs, err := promptDashboardIDs(cmd.Context(), kibanaClient)
+		if err != nil {
+			return nil, fmt.Errorf("prompt for dashboard selection failed: %w", err)
+		}
+		return dashboardIDs, nil
+	}


Used here the same method as in local instances to show all dashboards in the selector.

This function uses kibana.FindDashboards() that has been updated in order to show all dashboards also in Serverless via the export API.

mrodm · 2025-10-20T14:46:52Z

internal/packages/assets.go

+	// These fields are not expected to be part of responses from APIs
+	DataStream string `json:"-"`
+	SourcePath string `json:"-"`


I could not find any usage of these two fields in APIs.
It looks like that they are used in test asset and they are filled programmatically.

elastic-package/internal/packages/assets.go

Line 139 in fc03bdf

DataStream: dsManifest.Name,

elastic-package/internal/packages/assets.go

Line 171 in fc03bdf

DataStream: dsManifest.Name,

elastic-package/internal/packages/assets.go

Line 207 in fc03bdf

SourcePath: assetPath,

If the json:"-" tag is not added to the fields, queries with this struct fail with the error of those fields being not available/undefined.

mrodm · 2025-10-20T16:46:18Z

internal/kibana/dashboards.go

+func (c *Client) exportAllDashboards(ctx context.Context) ([]common.MapStr, error) {
+	logger.Debug("Export dashboards using the Kibana Saved Objects Export API")
+
+	request := ExportSavedObjectsRequest{
+		ExcludeExportDetails:  true,
+		IncludeReferencesDeep: false,
+		Type:                  "dashboard",
+	}
+
+	return c.ExportSavedObjects(ctx, request)
+}


This method would return all the dashboards available in the Kibana Instance.

According to the documentation, the number of assets that will be exported depend on savedObjects.maxImportExportSize setting (link):

NOTE: The savedObjects.maxImportExportSize configuration setting limits the number of saved objects which may be exported.

By default that setting is 10000 elements (savedObjects.maxImportExportSize setting):

The maximum count of saved objects that can be imported or exported. This setting exists to prevent the Kibana server from running out of memory when handling large numbers of saved objects. It is recommended to only raise this setting if you are confident your server can hold this many objects in memory. Default: 10000

elasticmachine · 2025-10-20T16:48:34Z

💔 Build Failed

Buildkite Build
Commit: 7d6211b

Failed CI Steps

History

💚 Build #6368 succeeded d843e20
💚 Build #6366 succeeded 54be65a

cc @mrodm

mrodm added 4 commits October 17, 2025 19:08

Export dashboards using EPM API endpoints

dc54003

Just execute the new method on Serverless

2fa7ec3

Select package from current directory as default

66a1770

Use same method to find dashboards in Serverless via export API

54be65a

Extract function to select dashboard IDs

mrodm self-assigned this Oct 20, 2025

mrodm commented Oct 20, 2025

View reviewed changes

mrodm added 2 commits October 20, 2025 17:38

Increase number of packages per page

d843e20

Remove Response field in response - not present

7d6211b

mrodm commented Oct 20, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Allow to export dashboards from Serverless environments #3007

Allow to export dashboards from Serverless environments #3007

mrodm commented Oct 20, 2025 •

edited

Loading

Uh oh!

mrodm Oct 20, 2025

Uh oh!

mrodm Oct 20, 2025

Uh oh!

mrodm Oct 20, 2025

Uh oh!

mrodm Oct 20, 2025

Uh oh!

mrodm Oct 20, 2025 •

edited

Loading

Uh oh!

mrodm Oct 20, 2025

Uh oh!

elasticmachine commented Oct 20, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants


		Use this command to download selected dashboards and other associated saved objects from Kibana. This command adjusts the downloaded saved objects according to package naming conventions (prefixes, unique IDs) and writes them locally into folders corresponding to saved object types (dashboard, visualization, map, etc.).`

		newDashboardOption = "New dashboard"

		func promptDashboardIDs(ctx context.Context, kibanaClient *kibana.Client) ([]string, error) {
		savedDashboards, err := kibanaClient.FindDashboards(ctx)

Allow to export dashboards from Serverless environments #3007

Are you sure you want to change the base?

Allow to export dashboards from Serverless environments #3007

Conversation

mrodm commented Oct 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Author's checklist

Example of usage

Uh oh!

mrodm Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

mrodm Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

mrodm Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

mrodm Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

mrodm Oct 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mrodm Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

elasticmachine commented Oct 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

💔 Build Failed

Failed CI Steps

History

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

mrodm commented Oct 20, 2025 •

edited

Loading

mrodm Oct 20, 2025 •

edited

Loading

elasticmachine commented Oct 20, 2025 •

edited

Loading