[CYB-213] Codestyle fixes + linter added #80
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Conflicts: # flink-cyber/metron-parser-chain/parser-chains-parsers/pom.xml # flink-cyber/pom.xml
* fixed unit test for metron-hbase-common module. * refactoring metron-common module.
* revert local pom.
* CYB-30 CYBER reject scoring rules that don't compile * CYB-30 CYBER reject scoring rules that don't compile * CYB-30 CYBER reject scoring rules that don't compile * Merge branch 'CYB-30' of https://github.infra.cloudera.com/skulish-cl… * CYB-30 CYBER reject scoring rules that don't compile * CYB-30 CYBER reject scoring rules that don't compile * Merge branch 'develop' into CYB-30 * Remove code from previous implementation * CYB-30 CYBER reject scoring rules that don't compile
* CYB-36: add scoring rule upsert command * CYB-36: add scoring rule upsert command - fix readme markdown syntax * CYB-36 create command line tool to upsert scoring rules * refact * refact * refact * Revert "refact" This reverts commit 9cc596bb * CYB-36: add scoring rule upsert command * fixed issue with all process rule operations. * added logging dependency. * refactored Scoring.java class. * CYB-19 enable Metron stellar enrichments to sources * fixed unit test * Revert "CYB-19 enable Metron stellar enrichments to sources" This reverts commit 5625a3ac738fc55d243d1a4ea744cff213e136a5. * CYB-36: add scoring rule upsert command * fixed unit test * CYB-36: add scoring rule upsert command * fixed build. Co-authored-by: cduby <[email protected]> Co-authored-by: Svetlana Kulish <[email protected]> Co-authored-by: vpavlenko-cloudera <[email protected]>
This commit does not contain secrets * fixed PR comments. * remove metron zookeeper related code. * update hbase code to a new version.
* CYB-30 CYBER reject scoring rules that don't compile * CYB-30 CYBER reject scoring rules that don't compile * CYB-30 CYBER reject scoring rules that don't compile * Merge branch 'CYB-30' of https://github.infra.cloudera.com/skulish-cl… * CYB-30 CYBER reject scoring rules that don't compile * CYB-30 CYBER reject scoring rules that don't compile * Merge branch 'develop' into CYB-30 * Remove code from previous implementation * CYB-30 CYBER reject scoring rules that don't compile
* CYB-36: add scoring rule upsert command * CYB-36: add scoring rule upsert command - fix readme markdown syntax * CYB-36 create command line tool to upsert scoring rules * refact * refact * refact * Revert "refact" This reverts commit 9cc596bb * CYB-36: add scoring rule upsert command * fixed issue with all process rule operations. * added logging dependency. * refactored Scoring.java class. * CYB-19 enable Metron stellar enrichments to sources * fixed unit test * Revert "CYB-19 enable Metron stellar enrichments to sources" This reverts commit 5625a3ac738fc55d243d1a4ea744cff213e136a5. * CYB-36: add scoring rule upsert command * fixed unit test * CYB-36: add scoring rule upsert command * fixed build. Co-authored-by: cduby <[email protected]> Co-authored-by: Svetlana Kulish <[email protected]> Co-authored-by: vpavlenko-cloudera <[email protected]>
* remove metron profiler.
* removed an old maven http repository that breaks maven build.
* removed duplicate code.
# Conflicts: # flink-cyber/pom.xml
CYB-19 enable Metron stellar enrichments to sources [original]
* CYB-19: Get metron code into project * fixed unit test for metron-hbase-common module. * refactoring metron-common module. * CYB-19: Get metron code into project * revert local pom. * CYB-19: Get metron code into project * fixed problem with unit tests. * CYB-19: Get metron code into project * removed broken line. * CYB-19 enable Metron stellar enrichments to sources * updated unit test for converted put result for new hbase version. * updated MockHTable to new hbase. * CYB-19 enable Metron stellar enrichments to sources * Added MetronGeoEnrichmentAdapter for work with stellar geocode options. * refactored geocode classes. * Added memorize class for permanent caching data. * CYB-19 enable Metron stellar enrichments to sources * Added MetronGeoEnrichmentAdapter for work with stellar geocode options. * refactored geocode classes. * Added memorize class for permanent caching data. * CYB-19 enable Metron stellar enrichments to sources * fixed flink mapping code. * CYB-19 enable Metron stellar enrichments to sources * added asn get support for stellar Enrichment * refactored stellar enrichment code. * updated enrichment-combine pom file. * refactored unit tests. * CYB-19 enable Metron stellar enrichments to sources * fixed build problem * CYB-19 enable Metron stellar enrichments to sources * fixed build. * CYB-19 enable Metron stellar enrichments to sources * fixed build. * CYB-19: Get metron code into project * fixed pr comments. * CYB-19: Get metron code into project * fixed pom file dependency. * removed duplicate of TestUtils class. * CYB-19: Get metron code into project * fixed comments. * CYB-19: Get metron code into project * fixed pom file.
* CYB-48 Update flink to version csa1.6.1.0 * update flink in pom.xml. * CYB-48 Update flink to version csa1.6.1.0 * merge develop branch.
* CYB-21 write profile measurements to hbase * add test phoenix jdbc implementation * CYB-21 write profile measurements to hbase * fixed code related to phoenix jdbc driver. * added configurable value to the profile job. * CYB-21 write profile measurements to hbase * fixed merge conflicts. * CYB-21 write profile measurements to hbase * fixed unit tests and maven dependency. * CYB-21 write profile measurements to hbase * Added flatMap function for converting profile messages to entities that would be saved in Phoenix database. * Updated unit test for ProfileJob. * Added new sql files for phoenix. * Added an entity to display measurement in the database. * CYB-21 write profile measurements to hbase * fixed resource load. * CYB-21 write profile measurements to hbase * fixed review commit. * CYB-21 write profile measurements to hbase * fixed review commit. * CYB-40 profile measurements table accepts a configurable number of key fields * Added new profile dto entity. * Fixed freemarker code. * Changed string replacing. * CYB-40 profile measurements table accepts a configurable number of key fields * Updated some of database entity. * Updated sql select and updates queries. * Code refactoring. * CYB-40 profile measurements table accepts a configurable number of key fields * Validate keyFields amount in measurement table. * CYB-40 profile measurements table accepts a configurable number of key fields * fixed problem with Serialization. * fixed sql grammar. * CYB-40 profile measurements table accepts a configurable number of key fields * fixed order problems. * CYB-40 profile measurements table accepts a configurable number of key fields * fixed pr comments. * CYB-40 profile measurements table accepts a configurable number of key fields * small fixes. * CYB-40 profile measurements table accepts a configurable number of key fields * small fixes. * CYB-40 profile measurements table accepts a configurable number of key fields * fixes pr comments. * CYB-40 profile measurements table accepts a configurable number of key fields * changed phoenix configuration. * CYB-40 profile measurements table accepts a configurable number of key fields * updated phoenix and hbase version. * CYB-40 profile measurements table accepts a configurable number of key fields * updated code that working with Phoenix using thin client instead of thin client. * added ThinClient class * added new jdbc sink * CYB-40 profile measurements table accepts a configurable number of key fields * fixing dependency. * CYB-40 profile measurements table accepts a configurable number of key fields * update pom. * CYB-21 write profile measurements to hbase * fixed some code after review. * fixed problem with upgrading to new version of flink.
- add class indexer to add stellar classes to flink-enrichment-combined jar
[CYB-55]: enrichment-combined job does not recognize stellar functions
…stellar enrichment (#3) - convert stellar enrichment results map values strings before adding to Message Co-authored-by: cduby <[email protected]>
…functions (#4) Co-authored-by: cduby <[email protected]>
Add all Metron parsers to ease Metron job migration from HCP Co-authored-by: cduby <[email protected]>
…t configuration (#6) Co-authored-by: cduby <[email protected]>
* CYB-43 create streaming enrichment writer * CYB-46: batch enrichment loading Co-authored-by: cduby <[email protected]> Co-authored-by: Svetlana Kulish <[email protected]>
Co-authored-by: cduby <[email protected]>
* CYB-50 Distribute cybersec as a Cloudera Manager Parcel * added parcel project. * added csd project. * added assembly job that contains all jars. * CYB-50 Distribute cybersec as a Cloudera Manager Parcel * added parcel module. * added csd module. * added module for assembly all job into one gzip file. * This commit does not contain secrets
* fixed pom files.
change RELEASE version of testng to latest version built with jdk 8
# Conflicts: # flink-cyber/pom.xml
* OCSF support parser config support * switched from field selection to a text field * Java tests fix * Karma tests fix * parsers base path fix * minor refactoring to address the Observable subscription issues * Hidden objects with unknown types
# Conflicts: # flink-cyber/flink-cyber-api/src/main/java/com/cloudera/cyber/indexing/MappingColumnDto.java # flink-cyber/flink-indexing/flink-indexing-hive/src/main/java/com/cloudera/cyber/indexing/hive/util/AvroSchemaUtil.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/common/ApplicationConstants.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/config/kafka/KafkaConfig.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/controller/ChainController.java # flink-cyber/metron-parser-chain/parser-chains-core/src/main/java/com/cloudera/parserchains/core/DefaultChainBuilder.java # flink-cyber/metron-parser-chain/parser-chains-core/src/main/java/com/cloudera/parserchains/core/ReflectiveParserBuilder.java # flink-cyber/metron-parser-chain/parser-chains-core/src/main/java/com/cloudera/parserchains/core/model/define/ParserChainSchema.java # flink-cyber/metron-parser-chain/parser-chains-core/src/main/java/com/cloudera/parserchains/core/model/define/ParserSchema.java # flink-cyber/metron-parser-chain/parser-chains-parsers/src/main/java/com/cloudera/parserchains/parsers/AvroParser.java # flink-cyber/metron-parser-chain/parser-chains-parsers/src/main/java/com/cloudera/parserchains/parsers/SimpleStellarParser.java # flink-cyber/metron-parser-chain/parser-chains-parsers/src/main/java/com/cloudera/parserchains/parsers/StellarParser.java
# Conflicts: # flink-cyber/cyber-jobs/src/main/assemblies/cloudera.xml # flink-cyber/cyber-services/cyber-service-common/src/main/java/com/cloudera/service/common/request/RequestType.java # flink-cyber/cyber-services/cyber-service-common/src/main/java/com/cloudera/service/common/response/ResponseType.java # flink-cyber/cyber-services/cyber-worker-service/src/main/java/com/cloudera/cyber/restcli/controller/KafkaListenerController.java # flink-cyber/cyber-services/cyber-worker-service/src/main/java/com/cloudera/cyber/restcli/service/JobService.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/StartupComponent.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/config/kafka/KafkaConfig.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/controller/ChainController.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/controller/ClusterController.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/controller/ParserController.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/controller/ParserSampleController.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/service/ClusterService.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/service/KafkaService.java
# Conflicts: # flink-cyber/cyber-services/cyber-service-common/src/main/java/com/cloudera/service/common/config/kafka/ClouderaManagementKafkaProperties.java # flink-cyber/cyber-services/cyber-service-common/src/main/java/com/cloudera/service/common/request/RequestType.java # flink-cyber/cyber-services/cyber-service-common/src/main/java/com/cloudera/service/common/response/Job.java # flink-cyber/cyber-services/cyber-service-common/src/main/java/com/cloudera/service/common/response/ResponseType.java # flink-cyber/cyber-services/cyber-service-common/src/main/java/com/cloudera/service/common/utils/ArchiveUtil.java # flink-cyber/cyber-services/cyber-worker-service/src/main/java/com/cloudera/cyber/restcli/controller/KafkaListenerController.java # flink-cyber/cyber-services/cyber-worker-service/src/main/java/com/cloudera/cyber/restcli/service/FilePipelineService.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/common/utils/Utils.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/config/kafka/KafkaConfig.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/controller/ClusterController.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/service/ClusterService.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/service/MockKafkaService.java
vpavlenko-cv
approved these changes
Dec 20, 2024
* json tableapi support * OCSF Support for Flink Indexing
# Conflicts: # flink-cyber/flink-indexing/flink-indexing-hive/src/main/java/com/cloudera/cyber/indexing/hive/tableapi/TableApiAbstractJob.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/config/AppProperties.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/controller/ChainController.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/model/describe/OcsfIndexMappingDescriptor.java # flink-cyber/metron-parser-chain/parser-chains-config-service/src/main/java/com/cloudera/parserchains/queryservice/service/IndexingService.java
stas-panasiuk
added
ready to merge
mikepresseau
force-pushed
the
codestyle
branch
from
7199a0d to
9064ef8
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.