How to convert a YAML to CSV

[cmonty14]

Hello,
I have generated an yaml ouput of openstack command that looks incorrect:

$ .local/bin/openstack share show -c name -c export_locations -f yaml 3d40f57f-3c02-4c2c-b21a-590f379ee0e3
export_locations: '

  id = b3ae3582-00e2-4451-a6c4-57818a47f363

  path = 10.180.2.54:/share_9b053a55_6ba2_4298_a5af_a8bf082146e4

  preferred = True

  id = b0b914aa-558f-41fe-8571-f827f001e6d5

  path = 10.180.0.19:/share_9b053a55_6ba2_4298_a5af_a8bf082146e4

  preferred = False'

name: backupEW3

I modifed the syntax and now I get an output that looks better:

$ .local/bin/openstack share show -c name -c export_locations -f yaml 3d40f57f-3c02-4c2c-b21a-590f379ee0e3 | tr -d "'" | sed '/^$/d' | sed -e '1n; $n; 2,${/id/!s/^/  /}; s/id/- id/g; s/ =/:/g'
export_locations:
  - id: b3ae3582-00e2-4451-a6c4-57818a47f363
    path: 10.180.2.54:/share_9b053a55_6ba2_4298_a5af_a8bf082146e4
    preferred: True
  - id: b0b914aa-558f-41fe-8571-f827f001e6d5
    path: 10.180.0.19:/share_9b053a55_6ba2_4298_a5af_a8bf082146e4
    preferred: False
name: backupEW3

The next step is to convert this YAML in CSV; this CSV file should look like this:

id,path,preferred,name
b3ae3582-00e2-4451-a6c4-57818a47f363,10.180.2.54:/share_9b053a55_6ba2_4298_a5af_a8bf082146e4,true,backupEW3
93b2dbcb-a0f5-4f28-9d49-4bbbdad42b86,10.180.3.160:/share_9b053a55_6ba2_4298_a5af_a8bf082146e4,false,backupEW3

Can you please advise how to convert the YAML?

[mikefarah]

Sure:

yq  '.export_locations[].name = .name | .export_locations' examples/data1.yaml -oc 

id,path,preferred,name
b3ae3582-00e2-4451-a6c4-57818a47f363,10.180.2.54:/share_9b053a55_6ba2_4298_a5af_a8bf082146e4,True,backupEW3
b0b914aa-558f-41fe-8571-f827f001e6d5,10.180.0.19:/share_9b053a55_6ba2_4298_a5af_a8bf082146e4,False,backupEW3

Explanation:

• First we need to add the name property to each export location entry .export_locations[].name = .name
• Pipe that into .export_locations to drill into that array for export
• -oc is shorthand for --output-format=csv