Lineage Data can be directly output in JSON format？

[melin]

Lineage Data can be directly output in JSON format？ which is convenient to store in the graph database。

[maropu]

Ah, it might be worth doing it, but is there a common JSON format to represent a directed acyclic graph?

[melin]

The format is altas Lineage JSON:
https://atlas.apache.org/api/v2/json_AtlasLineageInfo.html

[maropu]

INFO: I added an interface to define an output format for exporting a generated graph into other systems in abb1f0f:

spark-sql-flow-plugin/src/test/scala/org/apache/spark/sql/SQLFlowSuite.scala

Lines 175 to 190 in abb1f0f

	test("df.debugPrintAsSQLFlow - custom graph format") {
	withTempView("t1", "t2") {
	sql("CREATE OR REPLACE TEMPORARY VIEW t1 AS SELECT k, v v1 FROM VALUES (1, 2) t(k, v)")
	sql("CREATE OR REPLACE TEMPORARY VIEW t2 AS SELECT k, v v2 FROM VALUES (1, 3) t(k, v)")
	import SQLFlow._
	val outputString = getOutputAsString {
	val df = sql("SELECT t1.k, sum(v1 + v2) FROM t1, t2 WHERE t1.k = t2.k GROUP BY t1.k")
	df.debugPrintAsSQLFlow(contracted = true,
	(nodes: Seq[SQLFlowGraphNode], edges: Seq[SQLFlowGraphEdge]) => {
	s"#nodes:${nodes.length} #edges:${edges.length}"
	})
	}
	assert(outputString.contains("#nodes:3 #edges:4"))
	}
	}