hunfabric/modules/cloud-dataplex

Cloud Dataplex instance with lake, zone & assests

This module manages the creation of Cloud Dataplex instance along with lake, zone & assets in single regions.

Simple example

This example shows how to setup a Cloud Dataplex instance, lake, zone & asset creation in GCP project.

module "dataplex" {
  source     = "./fabric/modules/cloud-dataplex"
  name       = "terraform-lake"
  prefix     = "test"
  project_id = "myproject"
  region     = "europe-west2"
  zones = {
    zone_1 = {
      type      = "RAW"
      discovery = true
      assets = {
        asset_1 = {
          bucket_name            = "asset_1"
          cron_schedule          = "15 15 * * *"
          discovery_spec_enabled = true
          resource_spec_type     = "STORAGE_BUCKET"
        }
      }
    },
    zone_2 = {
      type      = "CURATED"
      discovery = true
      assets = {
        asset_2 = {
          bucket_name            = "asset_2"
          cron_schedule          = "15 15 * * *"
          discovery_spec_enabled = true
          resource_spec_type     = "STORAGE_BUCKET"
        }
      }
    }
  }
}

# tftest modules=1 resources=5

TODO

• Add IAM support
• support different type of assets
• support multi-regions

Variables

name	description	type	required	default
name	Name of Dataplex Lake.	string	✓
prefix	Optional prefix used to generate Dataplex Lake.	string	✓
project_id	The ID of the project where this Dataplex Lake will be created.	string	✓
region	Region of the Dataplax Lake.	string	✓
zones	Dataplex lake zones, such as RAW and CURATED.	map(object({…}))	✓
location_type	The location type of the Dataplax Lake.	string		"SINGLE_REGION"

Outputs

name	description	sensitive
assets	Assets attached to the lake of Dataplex Lake.
lake	The lake name of Dataplex Lake.
zones	The zone name of Dataplex Lake.