Skip to content

Commit cacc432

Browse files
varmax2511rashik-bhasin
authored andcommitted
Support for Oracle distribution of Hadoop with Big Data service
1 parent 47ca9da commit cacc432

9 files changed

+727
-224
lines changed

CHANGELOG.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,8 @@
1+
## 4.35.0 (July 14, 2021)
2+
3+
### Added
4+
- Support for Oracle distribution of Hadoop with Big Data service
5+
16
## 4.34.0 (July 07, 2021)
27

38
### Added

examples/big_data_service/main.tf

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ variable "bds_instance_cluster_public_key" {
2828
}
2929

3030
variable "bds_instance_cluster_version" {
31-
default = "CDH6"
31+
default = "ODH1"
3232
}
3333

3434
variable "bds_instance_defined_tags_value" {

oci/bds_bds_instance_resource.go

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -286,6 +286,10 @@ func BdsBdsInstanceResource() *schema.Resource {
286286
// Optional
287287

288288
// Computed
289+
"ambari_url": {
290+
Type: schema.TypeString,
291+
Computed: true,
292+
},
289293
"bd_cell_version": {
290294
Type: schema.TypeString,
291295
Computed: true,
@@ -1189,6 +1193,10 @@ func CloudSqlDetailsToMap(obj *oci_bds.CloudSqlDetails) map[string]interface{} {
11891193
func ClusterDetailsToMap(obj *oci_bds.ClusterDetails) map[string]interface{} {
11901194
result := map[string]interface{}{}
11911195

1196+
if obj.AmbariUrl != nil {
1197+
result["ambari_url"] = string(*obj.AmbariUrl)
1198+
}
1199+
11921200
if obj.BdCellVersion != nil {
11931201
result["bd_cell_version"] = string(*obj.BdCellVersion)
11941202
}

oci/bds_odh_instance_resource_test.go

Lines changed: 501 additions & 0 deletions
Large diffs are not rendered by default.

website/docs/d/bds_auto_scaling_configuration.html.markdown

Lines changed: 19 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ description: |-
1010
# Data Source: oci_bds_auto_scaling_configuration
1111
This data source provides details about a specific Auto Scaling Configuration resource in Oracle Cloud Infrastructure Big Data Service service.
1212

13-
Gets information about the specified autoscaling configuration.
13+
Returns details of the autoscale configuration identified by the given ID.
1414

1515

1616
## Example Usage
@@ -27,28 +27,28 @@ data "oci_bds_auto_scaling_configuration" "test_auto_scaling_configuration" {
2727

2828
The following arguments are supported:
2929

30-
* `auto_scaling_configuration_id` - (Required) Unique Oracle-assigned identifier of the autoscaling configuration.
31-
* `bds_instance_id` - (Required) The OCID of the BDS instance
30+
* `auto_scaling_configuration_id` - (Required) Unique Oracle-assigned identifier of the autoscale configuration.
31+
* `bds_instance_id` - (Required) The OCID of the cluster.
3232

3333

3434
## Attributes Reference
3535

3636
The following attributes are exported:
3737

38-
* `display_name` - A user-friendly name. Does not have to be unique, and it's changeable. Avoid entering confidential information.
39-
* `id` - The unique identifier for autoscaling configuration.
40-
* `node_type` - A node type that is managed by an autoscaling configuration. The only supported type is WORKER.
41-
* `policy` - Policy definitions for the autoscaling configuration
42-
* `policy_type` - Types of autoscaling policies. SCHEDULE-BASED or THRESHOLD-BASED, current only supported THRESHOLD-BASED.
43-
* `rules` - The list of rules for autoscaling. If an action have multiple rules, last rule in the array will be applied.
44-
* `action` - The valid value are - CHANGE_SHAPE_SCALE_UP or CHANGE_SHAPE_SCALE_DOWN
45-
* `metric` - Metric and threshold details for triggering an autoscaling action
46-
* `metric_type` - Allowed value is CPU_UTILIZATION currently
47-
* `threshold` - An autoscaling action is triggered when a performance metric meets or exceeds a threshold
48-
* `duration_in_minutes` - This value is the minimum period of time metric value meets or exceeds threshold value before action is trigger. The value is in minutes.
49-
* `operator` - The comparison operator to use. Options are greater than (GT), less than (LT).
50-
* `value` - integer non negative value. 0 < value < 100
51-
* `state` - The state of the autoscaling configuration
52-
* `time_created` - The time the BDS instance was created. An RFC3339 formatted datetime string
53-
* `time_updated` - The time the autoscale configuration was updated. An RFC3339 formatted datetime string
38+
* `display_name` - A user-friendly name. The name does not have to be unique, and it may be changed. Avoid entering confidential information.
39+
* `id` - The unique identifier for the autoscale configuration.
40+
* `node_type` - A node type that is managed by an autoscale configuration. The only supported type is WORKER.
41+
* `policy` - Policy definitions for the autoscale configuration.
42+
* `policy_type` - Types of autoscale policies. Options are SCHEDULE-BASED or THRESHOLD-BASED. (Only THRESHOLD-BASED is supported in this release.)
43+
* `rules` - The list of rules for autoscaling. If an action has multiple rules, the last rule in the array will be applied.
44+
* `action` - The valid value are CHANGE_SHAPE_SCALE_UP or CHANGE_SHAPE_SCALE_DOWN.
45+
* `metric` - Metric and threshold details for triggering an autoscale action.
46+
* `metric_type` - Allowed value is CPU_UTILIZATION.
47+
* `threshold` - An autoscale action is triggered when a performance metric meets or exceeds a threshold.
48+
* `duration_in_minutes` - This value is the minimum period of time the metric value meets or exceeds the threshold value before the action is triggered. The value is in minutes.
49+
* `operator` - The comparison operator to use. Options are greater than (GT) or less than (LT).
50+
* `value` - Integer non-negative value. 0 < value < 100
51+
* `state` - The state of the autoscale configuration.
52+
* `time_created` - The time the cluster was created, shown as an RFC 3339 formatted datetime string.
53+
* `time_updated` - The time the autoscale configuration was updated, shown as an RFC 3339 formatted datetime string.
5454

website/docs/d/bds_bds_instance.html.markdown

Lines changed: 48 additions & 47 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ description: |-
1010
# Data Source: oci_bds_bds_instance
1111
This data source provides details about a specific Bds Instance resource in Oracle Cloud Infrastructure Big Data Service service.
1212

13-
Gets a BDS instance by identifier
13+
Returns information about the Big Data Service cluster identified by the given ID.
1414

1515
## Example Usage
1616

@@ -25,7 +25,7 @@ data "oci_bds_bds_instance" "test_bds_instance" {
2525

2626
The following arguments are supported:
2727

28-
* `bds_instance_id` - (Required) The OCID of the BDS instance
28+
* `bds_instance_id` - (Required) The OCID of the cluster.
2929

3030

3131
## Attributes Reference
@@ -34,58 +34,59 @@ The following attributes are exported:
3434

3535
* `cloud_sql_details` - The information about added Cloud SQL capability
3636
* `block_volume_size_in_gbs` - The size of block volume in GB that needs to be attached to a given node. All the necessary details needed for attachment are managed by service itself.
37-
* `ip_address` - IP address of the Cloud SQL node
38-
* `is_kerberos_mapped_to_database_users` - Boolean flag specifying whether or not are Kerberos principals mapped to database users.
39-
* `kerberos_details` - Details about Kerberos principals
37+
* `ip_address` - IP address of the Cloud SQL node.
38+
* `is_kerberos_mapped_to_database_users` - Boolean flag specifying whether or not Kerberos principals are mapped to database users.
39+
* `kerberos_details` - Details about the Kerberos principals.
4040
* `keytab_file` - Location of the keytab file
41-
* `principal_name` - Name of the Kerberos principal
41+
* `principal_name` - Name of the Kerberos principal.
4242
* `shape` - Shape of the node
4343
* `cluster_details` - Specific info about a Hadoop cluster
44-
* `bd_cell_version` - Cloud SQL cell version
44+
* `ambari_url` - The URL of Ambari
45+
* `bd_cell_version` - Cloud SQL cell version.
4546
* `bda_version` - BDA version installed in the cluster
46-
* `bdm_version` - Big Data Manager version installed in the cluster
47-
* `bds_version` - Big Data Service version installed in the cluster
48-
* `big_data_manager_url` - The URL of a Big Data Manager
49-
* `cloudera_manager_url` - The URL of a Cloudera Manager
50-
* `csql_cell_version` - Big Data SQL version
51-
* `db_version` - Query Server Database version
52-
* `hue_server_url` - The URL of a Hue Server
53-
* `os_version` - Oracle Linux version installed in the cluster
54-
* `time_created` - The time the cluster was created. An RFC3339 formatted datetime string
55-
* `time_refreshed` - The time the BDS instance was automatically, or manually refreshed. An RFC3339 formatted datetime string
56-
* `cluster_version` - Version of the Hadoop distribution
57-
* `compartment_id` - The OCID of the compartment
58-
* `created_by` - The user who created the BDS instance.
59-
* `defined_tags` - Defined tags for this resource. Each key is predefined and scoped to a namespace. Example: `{"foo-namespace.bar-key": "value"}`
60-
* `display_name` - Name of the BDS instance
61-
* `freeform_tags` - Simple key-value pair that is applied without any predefined name, type or scope. Exists for cross-compatibility only. Example: `{"bar-key": "value"}`
62-
* `id` - The OCID of the BDS resource
63-
* `is_cloud_sql_configured` - Boolean flag specifying whether we configure Cloud SQL or not
64-
* `is_high_availability` - Boolean flag specifying whether or not the cluster is HA
65-
* `is_secure` - Boolean flag specifying whether or not the cluster should be setup as secure.
66-
* `network_config` - Additional configuration of customer's network.
47+
* `bdm_version` - Big Data Manager version installed in the cluster.
48+
* `bds_version` - Big Data Service version installed in the cluster.
49+
* `big_data_manager_url` - The URL of Big Data Manager.
50+
* `cloudera_manager_url` - The URL of Cloudera Manager
51+
* `csql_cell_version` - Big Data SQL version.
52+
* `db_version` - Cloud SQL query server database version.
53+
* `hue_server_url` - The URL of the Hue server.
54+
* `os_version` - Oracle Linux version installed in the cluster.
55+
* `time_created` - The time the cluster was created, shown as an RFC 3339 formatted datetime string.
56+
* `time_refreshed` - The time the cluster was automatically or manually refreshed, shown as an RFC 3339 formatted datetime string.
57+
* `cluster_version` - Version of the Hadoop distribution.
58+
* `compartment_id` - The OCID of the compartment.
59+
* `created_by` - The user who created the cluster.
60+
* `defined_tags` - Defined tags for this resource. Each key is predefined and scoped to a namespace. For example, `{"foo-namespace": {"bar-key": "value"}}`
61+
* `display_name` - The name of the cluster.
62+
* `freeform_tags` - Simple key-value pair that is applied without any predefined name, type, or scope. Exists for cross-compatibility only. For example, `{"bar-key": "value"}`
63+
* `id` - The OCID of the Big Data Service resource.
64+
* `is_cloud_sql_configured` - Boolean flag specifying whether or not Cloud SQL should be configured.
65+
* `is_high_availability` - Boolean flag specifying whether or not the cluster is highly available (HA)
66+
* `is_secure` - Boolean flag specifying whether or not the cluster should be set up as secure.
67+
* `network_config` - Additional configuration of the user's network.
6768
* `cidr_block` - The CIDR IP address block of the VCN.
6869
* `is_nat_gateway_required` - A boolean flag whether to configure a NAT gateway.
69-
* `nodes` - The list of nodes in the BDS instance
70+
* `nodes` - The list of nodes in the cluster.
7071
* `attached_block_volumes` - The list of block volumes attached to a given node.
7172
* `volume_attachment_id` - The OCID of the volume attachment.
7273
* `volume_size_in_gbs` - The size of the volume in GBs.
73-
* `availability_domain` - The name of the availability domain the node is running in
74-
* `display_name` - The name of the node
75-
* `fault_domain` - The name of the fault domain the node is running in
76-
* `hostname` - The fully-qualified hostname (FQDN) of the node
77-
* `image_id` - The OCID of the image from which the node was created
78-
* `instance_id` - The OCID of the underlying compute instance
79-
* `ip_address` - IP address of the node
80-
* `node_type` - BDS instance node type
81-
* `shape` - Shape of the node
82-
* `ssh_fingerprint` - The fingerprint of the SSH key used for node access
83-
* `state` - The state of the node
84-
* `subnet_id` - The OCID of the subnet in which the node should be created
85-
* `time_created` - The time the node was created. An RFC3339 formatted datetime string
86-
* `time_updated` - The time the BDS instance was updated. An RFC3339 formatted datetime string
87-
* `number_of_nodes` - Number of nodes that forming the cluster
88-
* `state` - The state of the BDS instance
89-
* `time_created` - The time the BDS instance was created. An RFC3339 formatted datetime string
90-
* `time_updated` - The time the BDS instance was updated. An RFC3339 formatted datetime string
74+
* `availability_domain` - The name of the availability domain in which the node is running.
75+
* `display_name` - The name of the node.
76+
* `fault_domain` - The name of the fault domain in which the node is running.
77+
* `hostname` - The fully-qualified hostname (FQDN) of the node.
78+
* `image_id` - The OCID of the image from which the node was created.
79+
* `instance_id` - The OCID of the underlying Oracle Cloud Infrastructure Compute instance.
80+
* `ip_address` - IP address of the node.
81+
* `node_type` - Cluster node type.
82+
* `shape` - Shape of the node.
83+
* `ssh_fingerprint` - The fingerprint of the SSH key used for node access.
84+
* `state` - The state of the node.
85+
* `subnet_id` - The OCID of the subnet in which the node is to be created.
86+
* `time_created` - The time the node was created, shown as an RFC 3339 formatted datetime string.
87+
* `time_updated` - The time the cluster was updated, shown as an RFC 3339 formatted datetime string.
88+
* `number_of_nodes` - The number of nodes that form the cluster.
89+
* `state` - The state of the cluster.
90+
* `time_created` - The time the cluster was created, shown as an RFC 3339 formatted datetime string.
91+
* `time_updated` - The time the cluster was updated, shown as an RFC 3339 formatted datetime string.
9192

0 commit comments

Comments
 (0)