Longw/retina networkflow logs (#1372)

* adding fb input plugin and new out oms networkflow.go

* test output to console

* update

* update add subfolder

* update

* add file in base container data

* add json parser

* update tag

* add storage type

* update oms nfl with sample (#1358)

* update oms nfl with sample

* hardcode sample to oms.go and send data to mdsd with new stream

* add log

* fix sample data

* update

* update

* enable mdsd trace

* update stream tag

* oms go code for networkflow

* update

* update output plugin

* update stream tag and add coverter for input data

* add sample data2 from hubble

* add sample data2 from hubble

* update

* update struct with interface

* update

* update

* add data handing logic

* add data handling logic

* add assertion and err check

* add assertion and err check

* trivy

* handel uint64

* update networkflow data hanlding

* update mapping per design doc

* update mapping per design doc

* comment out column with regression support needed

* clean sample data

* refactor oms to use map[String]interface{}

* add dependency

* stream tag fetch

* clean dcr stream tag

* cleanup

* move networkflow codes into a new file

* update define const

* update define const

* update

* refactor use netwofkflowlogs vars

* update

* add env flag control

* update env check

* clean up and add logs for error

* add comment

* add panic handler

* rename file

* remove mdsd trace

* move substitute to the right place

* clean and add throttle plugin

* add QoS Metrics Dashboard for Network Flow logs

* clean trivy

* update

* update path for var/log

* address comments and remove high log scale dependency

* remove prometheus config node file

* Longw/retina networkflow logs configmap telemetry (#1397)

* make throttle support configurable

* Longw/retina networkflow logs configmap telemetry (#1398)

* add telemetry for networkFlowLogsFlushedRateMetric networkFlowLogsRateMetric networkFlowLogsSizeMetric

* add unit test

* add e2e test

* address comment

* sync yaml change

* address comments adding telemetry for throttle

* address comments adding telemetry for throttle

* update api version

* update ARM template

* set default to false

* Update throttle related config (#1404)

* update throttle related config

* Longw/retina networkflow logs check empty (#1408)

* add empty check

* update NodeName and Policies

* update wording

* address comments

* update naming

* update configmap check for throttle

* address comments

* address comments rename parameter; update highlogscale condition; added workload for scale test

---------

Co-authored-by: Steven Nguyen <[email protected]>

Author: wanlonghenry

.trivyignore

@@ -15,5 +15,4 @@ GHSA-7jwh-3vrq-q3m8
 CVE-2024-27289
 CVE-2024-27304
 CVE-2023-45288
-CVE-2024-24786
-
+CVE-2024-24786