Skip to content

feature: support mc settings#79

Open
idleyui wants to merge 1 commit intomasterfrom
feature/support_mc_settings
Open

feature: support mc settings#79
idleyui wants to merge 1 commit intomasterfrom
feature/support_mc_settings

Conversation

@idleyui
Copy link
Collaborator

@idleyui idleyui commented Dec 15, 2021

No description provided.

public static final String JOB_MAX_ATTEMPT_TIMES = "mma.job.max.attempt.times";
public static final String JOB_MAX_ATTEMPT_TIMES_DEFAULT_VALUE = "3";
public static final String JOB_EXECUTION_MC_PROJECT = "mma.job.execution.mc.project";
public static final String JOB_EXECUTION_MC_SETTINGS = "mma.job.execution.mc.settings";
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

和hive的对齐比较好:mma.data.source.hive.settings.transmission


private TableMetaModel source;
private TableMetaModel dest;
private Map<String, String> settings;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

放在Task层面解析好一些,后续如果mc -> oss或oss -> mc需要加上数据验证的步骤,这个settings是需要复用的

public class ConfigurationUtils {

public static Map<String, String> getSQLSettings(String config) throws MmaException {
Map<String, String> sqlSettings = new HashMap<>();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

用一个immutable map更好些

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants