Files
hunfabric/modules/project/shared-vpc.tf
Ludovico Magnocavallo 36648b6b63 FAST light implementation (#3255)
* data wip

* wip data

* update org schema, add note on expansion

* all schemas, workload notes

* Update WORKLOG.md

* Update WORKLOG.md

* Update WORKLOG.md

* Update WORKLOG.md

* wip

* data wip

* wip

* wip

* wip

* wip

* org module IAM context (using lookup)

* new-style context expansion in project IAM

* remove spurious file

* project module contexts

* finalize context replacement format for project module

* revert org module changes

* fix tag id interpolation in project

* fix tag id interpolation in project

* organization module context

* organization context test

* context expansion for folder tag bindings

* test context expansion for tag bindings

* service account module context

* simplify context local

* context for iam service account

* nuke blueprints

* remove links to blueprints

* vpc sc context in project module

* Add context to GCS module

* Add inline deps to plan_summary script

* Make context a top-level variable for folder, organization, sa

* Add add context top-level to VPC-SC

* move context out of factories_config variable

* tfdoc

* fix merge

* fix merge

* fix examples

* net-vpc module context

* add parent ids to folder context

* rename folder parent context

* fix folder parent check

* new project factory stub

* wip

* wip

* refactor defaults

* project iam

* bueckts and service accounts

* start adding context replacements

* better test data

* automation resources for folders and projects

* automation

* add support for project id interpolation

* first tested apply

* improve IAM description in gcs module

* add context to billing account module

* add notification channels to billing account module context

* add billing budgets to new pf

* schemas and defaults

* bootstrap wip

* bootstrap wip

* bootstrap wip

* pf outputs

* pf fixes

* fix pf sample data

* bootstrap lite fixes

* add locations to organization module contexts

* bootstrap lite fixes

* org fixes, billing accounts

* fix default project parent

* bootstrap lite wip

* add locations to gcs module context

* add context support to logging bucket module

* add context to pubsub module

* split out iam variables in gcs module

* fix logging bucket context test

* bootstrap log sink destinations

* streamline logging-bucket module variables

* fix logging bucket context test

* align logging bucket module interface in fast bootstrap

* add support for project-level log buckets to project factory

* support full context expansion in organization module log sinks

* log buckets in fast-lite bootstrap

* make og sink type optional in organization module

* log sinks in fast-lite bootstrap

* set tag values in factory context

* bootstrap lite data

* output files schema

* billing account schema

* output files

* output providers

* gcs output files

* boilerplate

* tflint

* check documentation

* check docs

* fix project module parent variable validation

* fix log bucket examples

* allow null parent in project module

* silence folder test errors

* fix billing account sink example

* fix project example

* fix billing account module

* fix folder tests

* fix FAST

* fix fast

* tfvars outputs

* wif

* cicd service accounts

* cicd

* allow defaults in context, minimal org policies

* support gcs managed folders in project factory and bootstrap lite

* support prefix in provider output files

* rename bootstrap stage

* gitignore

* gitignore

* security folder, billing IAM

* wip tfvars

* fix typo

* security IAM

* control tag iam/context via variables in organization module

* split tag creation from tag IAM to avoid circular refs

* port organization module tag changes to project module

* implement new-style context expansion in vpc-sc module

* fix fast vpc-sc tests

* boilerplate

* vpc sc stage

* schemas

* fast-lite compatibility for vpc sc stage

* make log project number optional in vpc-sc stage

* networking

* networking

* networking

* networking

* rename and move new stage under fast

* clone pf tests

* use context replacement for internal notification channels in billing account module

* support service agents in project module iam context replacements

* support service agents in project module iam context replacements

* add support for kms keys to project module context

* experimental pf example test and fixes

* fix schemas

* fix tests

* tfdoc

* tfdoc

* pf config

* experimental pf

* remove redundant dot from gcs managed folder IAM keys

* bootstrap experimental test

* project factory exp stage test

* skip tflint for bootstrap experimental test

* tflint

* fix gcs test

* documentation work

* documentation work

* Update README.md

* tfdoc

* tfdoc

* readme

* tfdoc

* readme

* readme

* readme

* readme

* support universe in pf exp projects

* missing universe service agents

* org policies import, non-admin billing IAM

* todo

* fix test

* custom constraints

* fast classic dataset

* fix test data

* context replacements in billing module log sinks

* fix typo

* add support for billing log sinks

* update docs

* readme

* cicd fix and test

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2025-09-02 08:38:57 +02:00

231 lines
7.5 KiB
HCL

/**
* Copyright 2024 Google LLC
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/
# tfdoc:file:description Shared VPC project-level configuration.
locals {
_svpc = var.shared_vpc_service_config
# read the list of service/roles for API service agents
_svpc_agent_config = yamldecode(file(
"${path.module}/sharedvpc-agent-iam.yaml"
))
# filter the list and keep services for which we need to create IAM bindings
_svpc_agent_config_filtered = [
for v in local._svpc_agent_config : v
if contains(local._svpc.service_iam_grants, "${local.ctx_p}service_agents:${v.service}")
]
# normalize the list of service/role tuples
_svpc_agent_grants = flatten(flatten([
for v in local._svpc_agent_config_filtered : [
for service, roles in v.agents : [
for role in roles : {
role = role
service = (
startswith(service, "${local.ctx_p}service_agents:")
? replace(service, "/\\${local.ctx_p}service_agents:/", "")
: service
)
}
]
]
]))
# normalize the service identity IAM bindings directly defined by the user
_svpc_service_iam = flatten([
for role, services in local._svpc.service_agent_iam : [
for service in services : {
role = role
service = (
startswith(service, "${local.ctx_p}service_agents:")
? replace(service, "/\\${local.ctx_p}service_agents:/", "")
: service
)
}
]
])
svpc_host_config = {
enabled = coalesce(
try(var.shared_vpc_host_config.enabled, null), false
)
service_projects = coalesce(
try(var.shared_vpc_host_config.service_projects, null), []
)
}
# combine the two sets of service/role bindings defined above
svpc_service_iam = {
for b in setunion(local._svpc_service_iam, local._svpc_agent_grants) :
"${b.role}:${b.service}" => b
}
# normalize the service identity subnet IAM bindings
_svpc_service_subnet_iam = flatten([
for subnet, services in local._svpc.service_agent_subnet_iam : [
for service in services : [{
region = split("/", subnet)[0]
subnet = split("/", subnet)[1]
service = service
}]
]
])
svpc_service_subnet_iam = {
for v in local._svpc_service_subnet_iam :
"${v.region}:${v.subnet}:${v.service}" => v
}
# normalize the network user subnet IAM binding
_svpc_network_user_subnet_iam = (
local._svpc.network_subnet_users == null || local._svpc.host_project == null
? []
: flatten([
for subnet, members in local._svpc.network_subnet_users : [
for member in members : {
region = split("/", subnet)[0]
subnet = split("/", subnet)[1]
member = member
}
]
])
)
svpc_network_user_subnet_iam = {
for v in local._svpc_network_user_subnet_iam :
"${v.region}:${v.subnet}:${v.member}" => v
}
}
resource "google_compute_shared_vpc_host_project" "shared_vpc_host" {
provider = google-beta
count = local.svpc_host_config.enabled ? 1 : 0
project = local.project.project_id
depends_on = [google_project_service.project_services]
}
resource "google_compute_shared_vpc_service_project" "service_projects" {
provider = google-beta
for_each = toset(local.svpc_host_config.service_projects)
host_project = lookup(
local.ctx.project_ids,
local.project.project_id,
local.project.project_id
)
service_project = lookup(local.ctx.project_ids, each.value, each.value)
depends_on = [google_compute_shared_vpc_host_project.shared_vpc_host]
}
resource "google_compute_shared_vpc_service_project" "shared_vpc_service" {
provider = google-beta
count = var.shared_vpc_service_config.host_project != null ? 1 : 0
host_project = lookup(
local.ctx.project_ids,
var.shared_vpc_service_config.host_project,
var.shared_vpc_service_config.host_project
)
service_project = local.project.project_id
depends_on = [
google_access_context_manager_service_perimeter_dry_run_resource.default,
google_access_context_manager_service_perimeter_resource.default
]
}
resource "google_project_iam_member" "shared_vpc_host_robots" {
for_each = local.svpc_service_iam
project = lookup(
local.ctx.project_ids,
var.shared_vpc_service_config.host_project,
var.shared_vpc_service_config.host_project
)
role = lookup(local.ctx.custom_roles, each.value.role, each.value.role)
member = try(
local.aliased_service_agents[each.value.service].iam_email,
each.value.service
)
depends_on = [
google_project_service.project_services,
google_project_service_identity.default,
google_project_default_service_accounts.default_service_accounts,
data.google_bigquery_default_service_account.bq_sa,
data.google_storage_project_service_account.gcs_sa,
]
}
resource "google_project_iam_member" "shared_vpc_host_iam" {
for_each = toset(var.shared_vpc_service_config.network_users)
project = lookup(
local.ctx.project_ids,
var.shared_vpc_service_config.host_project,
var.shared_vpc_service_config.host_project
)
role = "roles/compute.networkUser"
member = lookup(local.ctx.iam_principals, each.value, each.value)
}
resource "google_project_iam_member" "shared_vpc_host_iam_additive" {
for_each = try(var.shared_vpc_service_config.iam_bindings_additive, {})
project = lookup(
local.ctx.project_ids,
var.shared_vpc_service_config.host_project,
var.shared_vpc_service_config.host_project
)
role = lookup(
local.ctx.custom_roles, each.value.role, each.value.role
)
member = lookup(
local.ctx.iam_principals, each.value.member, each.value.member
)
dynamic "condition" {
for_each = each.value.condition == null ? [] : [""]
content {
expression = each.value.condition.expression
title = each.value.condition.title
description = each.value.condition.description
}
}
}
resource "google_compute_subnetwork_iam_member" "shared_vpc_host_robots" {
for_each = local.svpc_service_subnet_iam
project = lookup(
local.ctx.project_ids,
var.shared_vpc_service_config.host_project,
var.shared_vpc_service_config.host_project
)
region = each.value.region
subnetwork = each.value.subnet
role = "roles/compute.networkUser"
member = try(
local.aliased_service_agents[each.value.service].iam_email,
each.value.service
)
depends_on = [
google_project_service.project_services,
google_project_service_identity.default,
google_project_default_service_accounts.default_service_accounts,
data.google_bigquery_default_service_account.bq_sa,
data.google_storage_project_service_account.gcs_sa,
]
}
resource "google_compute_subnetwork_iam_member" "shared_vpc_host_subnets_iam" {
for_each = local.svpc_network_user_subnet_iam
project = lookup(
local.ctx.project_ids,
var.shared_vpc_service_config.host_project,
var.shared_vpc_service_config.host_project
)
region = each.value.region
subnetwork = each.value.subnet
role = "roles/compute.networkUser"
member = lookup(
local.ctx.iam_principals, each.value.member, each.value.member
)
}