FAST light implementation (#3255)

* data wip

* wip data

* update org schema, add note on expansion

* all schemas, workload notes

* Update WORKLOG.md

* Update WORKLOG.md

* Update WORKLOG.md

* Update WORKLOG.md

* wip

* data wip

* wip

* wip

* wip

* wip

* org module IAM context (using lookup)

* new-style context expansion in project IAM

* remove spurious file

* project module contexts

* finalize context replacement format for project module

* revert org module changes

* fix tag id interpolation in project

* fix tag id interpolation in project

* organization module context

* organization context test

* context expansion for folder tag bindings

* test context expansion for tag bindings

* service account module context

* simplify context local

* context for iam service account

* nuke blueprints

* remove links to blueprints

* vpc sc context in project module

* Add context to GCS module

* Add inline deps to plan_summary script

* Make context a top-level variable for folder, organization, sa

* Add add context top-level to VPC-SC

* move context out of factories_config variable

* tfdoc

* fix merge

* fix merge

* fix examples

* net-vpc module context

* add parent ids to folder context

* rename folder parent context

* fix folder parent check

* new project factory stub

* wip

* wip

* refactor defaults

* project iam

* bueckts and service accounts

* start adding context replacements

* better test data

* automation resources for folders and projects

* automation

* add support for project id interpolation

* first tested apply

* improve IAM description in gcs module

* add context to billing account module

* add notification channels to billing account module context

* add billing budgets to new pf

* schemas and defaults

* bootstrap wip

* bootstrap wip

* bootstrap wip

* pf outputs

* pf fixes

* fix pf sample data

* bootstrap lite fixes

* add locations to organization module contexts

* bootstrap lite fixes

* org fixes, billing accounts

* fix default project parent

* bootstrap lite wip

* add locations to gcs module context

* add context support to logging bucket module

* add context to pubsub module

* split out iam variables in gcs module

* fix logging bucket context test

* bootstrap log sink destinations

* streamline logging-bucket module variables

* fix logging bucket context test

* align logging bucket module interface in fast bootstrap

* add support for project-level log buckets to project factory

* support full context expansion in organization module log sinks

* log buckets in fast-lite bootstrap

* make og sink type optional in organization module

* log sinks in fast-lite bootstrap

* set tag values in factory context

* bootstrap lite data

* output files schema

* billing account schema

* output files

* output providers

* gcs output files

* boilerplate

* tflint

* check documentation

* check docs

* fix project module parent variable validation

* fix log bucket examples

* allow null parent in project module

* silence folder test errors

* fix billing account sink example

* fix project example

* fix billing account module

* fix folder tests

* fix FAST

* fix fast

* tfvars outputs

* wif

* cicd service accounts

* cicd

* allow defaults in context, minimal org policies

* support gcs managed folders in project factory and bootstrap lite

* support prefix in provider output files

* rename bootstrap stage

* gitignore

* gitignore

* security folder, billing IAM

* wip tfvars

* fix typo

* security IAM

* control tag iam/context via variables in organization module

* split tag creation from tag IAM to avoid circular refs

* port organization module tag changes to project module

* implement new-style context expansion in vpc-sc module

* fix fast vpc-sc tests

* boilerplate

* vpc sc stage

* schemas

* fast-lite compatibility for vpc sc stage

* make log project number optional in vpc-sc stage

* networking

* networking

* networking

* networking

* rename and move new stage under fast

* clone pf tests

* use context replacement for internal notification channels in billing account module

* support service agents in project module iam context replacements

* support service agents in project module iam context replacements

* add support for kms keys to project module context

* experimental pf example test and fixes

* fix schemas

* fix tests

* tfdoc

* tfdoc

* pf config

* experimental pf

* remove redundant dot from gcs managed folder IAM keys

* bootstrap experimental test

* project factory exp stage test

* skip tflint for bootstrap experimental test

* tflint

* fix gcs test

* documentation work

* documentation work

* Update README.md

* tfdoc

* tfdoc

* readme

* tfdoc

* readme

* readme

* readme

* readme

* support universe in pf exp projects

* missing universe service agents

* org policies import, non-admin billing IAM

* todo

* fix test

* custom constraints

* fast classic dataset

* fix test data

* context replacements in billing module log sinks

* fix typo

* add support for billing log sinks

* update docs

* readme

* cicd fix and test

---------

Co-authored-by: Julio Castillo <jccb@google.com>
This commit is contained in:
Ludovico Magnocavallo
2025-09-02 08:38:57 +02:00
committed by GitHub
parent dcd762370c
commit 36648b6b63
1180 changed files with 22259 additions and 87165 deletions

File diff suppressed because one or more lines are too long

View File

@@ -79,13 +79,11 @@ locals {
tag_bindings = {}
service_accounts = {}
vpc_sc = merge({
perimeter_name = null
perimeter_bridges = []
is_dry_run = false
perimeter_name = null
is_dry_run = false
}, try(local._projects_config.data_defaults.vpc_sc, {
perimeter_name = null
perimeter_bridges = []
is_dry_run = false
perimeter_name = null
is_dry_run = false
})
)
logging_data_access = {}
@@ -119,9 +117,8 @@ locals {
vpc_sc = try(
merge(
{
perimeter_name = null
perimeter_bridges = []
is_dry_run = false
perimeter_name = null
is_dry_run = false
},
local._projects_config.data_overrides.vpc_sc
),
@@ -290,9 +287,8 @@ locals {
: (
try(v.vpc_sc, null) != null
? merge({
perimeter_name = null
perimeter_bridges = []
is_dry_run = false
perimeter_name = null
is_dry_run = false
}, v.vpc_sc)
: local.__projects_config.data_defaults.vpc_sc
)

View File

@@ -118,8 +118,7 @@ module "projects" {
each.value.vpc_sc.perimeter_name
)
)
perimeter_bridges = each.value.vpc_sc.perimeter_bridges
is_dry_run = each.value.vpc_sc.is_dry_run
is_dry_run = each.value.vpc_sc.is_dry_run
}
quotas = each.value.quotas
}

View File

@@ -483,12 +483,6 @@
"perimeter_name": {
"type": "string"
},
"perimeter_bridges": {
"type": "array",
"items": {
"type": "string"
}
},
"is_dry_run": {
"type": "boolean"
}
@@ -727,4 +721,4 @@
}
}
}
}
}

View File

@@ -68,6 +68,21 @@
- **expression**: *string*
- **location**: *string*
- **title**: *string*
- **quotas**: *object*
<br>*additional properties: false*
- **`^[a-zA-Z0-9_-]+$`**: *object*
<br>*additional properties: false*
- ⁺**service**: *string*
- ⁺**quota_id**: *string*
- ⁺**preferred_value**: *number*
- **dimensions**: *object*
*additional properties: String*
- **justification**: *string*
- **contact_email**: *string*
- **annotations**: *object*
*additional properties: String*
- **ignore_safety_checks**: *string*
<br>*enum: ['QUOTA_DECREASE_BELOW_USAGE', 'QUOTA_DECREASE_PERCENTAGE_TOO_HIGH', 'QUOTA_SAFETY_CHECK_UNSPECIFIED']*
- **parent**: *string*
- **prefix**: *string*
- **project_reuse**: *object*
@@ -124,8 +139,6 @@
*additional properties: Object*
- **vpc_sc**: *object*
- ⁺**perimeter_name**: *string*
- **perimeter_bridges**: *array*
- items: *string*
- **is_dry_run**: *boolean*
## Definitions
@@ -173,7 +186,7 @@
- **member**: *string*
<br>*pattern: ^(?:domain:|group:|serviceAccount:|user:|principal:|principalSet:|[a-z])*
- **role**: *string*
<br>*pattern: ^[a-zA-Z0-9_/]+$*
<br>*pattern: ^[a-zA-Z0-9_/.]+$*
- **condition**: *object*
<br>*additional properties: false*
- ⁺**expression**: *string*

View File

@@ -68,9 +68,8 @@ variable "data_defaults" {
iam_self_roles = optional(list(string))
})), {})
vpc_sc = optional(object({
perimeter_name = string
perimeter_bridges = optional(list(string), [])
is_dry_run = optional(bool, false)
perimeter_name = string
is_dry_run = optional(bool, false)
}))
logging_data_access = optional(map(object({
ADMIN_READ = optional(object({ exempted_members = optional(list(string)) })),
@@ -129,9 +128,8 @@ variable "data_overrides" {
iam_self_roles = optional(list(string))
})))
vpc_sc = optional(object({
perimeter_name = string
perimeter_bridges = optional(list(string), [])
is_dry_run = optional(bool, false)
perimeter_name = string
is_dry_run = optional(bool, false)
}))
logging_data_access = optional(map(object({
ADMIN_READ = optional(object({ exempted_members = optional(list(string)) })),
@@ -407,9 +405,8 @@ variable "factories_data" {
}))
tag_bindings = optional(map(string), {})
vpc_sc = optional(object({
perimeter_name = string
perimeter_bridges = optional(list(string), [])
is_dry_run = optional(bool, false)
perimeter_name = string
is_dry_run = optional(bool, false)
}))
})), {})
})