Commit Graph

1315 Commits

Author SHA1 Message Date
Ludovico Magnocavallo
63a22cd9a2 Refactor secret manager module (#3315)
* wip

* wip

* wip

* wip

* tested, missing versions

* working

* fix secops stage

* readme

* tests

* tflint
2025-09-10 11:47:35 +00:00
Ludovico Magnocavallo
c93b628979 New security stage leveraging project factory and contexts (#3311)
* wip

* wip

* fix contexts

* cas factory

* add support for context to cas module

* cas module contexts and tests

* cas factory

* rename legacy security stage, add test for new stage

* readmes

* doc

* tfdoc

* doc, outputs

* update inventory
2025-09-08 18:59:16 +02:00
Ludovico Magnocavallo
68955ff809 Improve context support in vpc-sc module and stage / new FAST stages small fixes (#3305)
* improve context support in vpc-sc module and stage

* fix stage env files

* fix stage env files

* fix FAST variables comments

* tfdoc

* fix locations order

* fix tests
2025-09-07 14:59:46 +02:00
Ludovico Magnocavallo
894a0f5975 prep v44.1.0 2025-09-06 09:15:41 +00:00
Ludovico Magnocavallo
d6f0a168f6 pf outputs (#3301) 2025-09-05 22:21:27 +02:00
Ludovico Magnocavallo
58643a8ab4 merge fast-dev and prepare v44.0.0 2025-09-05 09:18:21 +00:00
Ludovico Magnocavallo
711436cb71 Final changes to new org setup stage (#3300)
* add provider id field to wif

* readme

* readme

* tfdoc
2025-09-05 09:39:22 +02:00
Ludovico Magnocavallo
756c02c21a Rename new botstrap stage to org-setup (#3299)
* readme changes

* rename stage 0

* rename stage 0

* complete rename of stage 0

* tfdoc

* tfdoc

* tfdoc
2025-09-04 13:34:16 +02:00
Ludovico Magnocavallo
bc6950e205 Rename FAST stages preparing for eventual deprecation (#3298)
* renames

* links

* readme

* docs

* update pf modules tests for renames

* condition_vars context in modules

* data platform dataset

* fix links in stage 3 docs

* schema changes

* schema docs

* tfdoc

* update duplicates check

* fast legacy tests

* legacy schema

* fix tests
2025-09-04 08:24:11 +02:00
Ludovico Magnocavallo
1f59fd6bc7 Merge remote-tracking branch 'origin/master' into fast-dev 2025-09-03 14:33:52 +02:00
Kósa Márkó
7b8ad07b29 gke-hub.tf update local to use cluster.fleet_config.configmanagement_template instead of the highest level block (#3297) 2025-09-03 11:29:27 +00:00
Ludovico Magnocavallo
36648b6b63 FAST light implementation (#3255)
* data wip

* wip data

* update org schema, add note on expansion

* all schemas, workload notes

* Update WORKLOG.md

* Update WORKLOG.md

* Update WORKLOG.md

* Update WORKLOG.md

* wip

* data wip

* wip

* wip

* wip

* wip

* org module IAM context (using lookup)

* new-style context expansion in project IAM

* remove spurious file

* project module contexts

* finalize context replacement format for project module

* revert org module changes

* fix tag id interpolation in project

* fix tag id interpolation in project

* organization module context

* organization context test

* context expansion for folder tag bindings

* test context expansion for tag bindings

* service account module context

* simplify context local

* context for iam service account

* nuke blueprints

* remove links to blueprints

* vpc sc context in project module

* Add context to GCS module

* Add inline deps to plan_summary script

* Make context a top-level variable for folder, organization, sa

* Add add context top-level to VPC-SC

* move context out of factories_config variable

* tfdoc

* fix merge

* fix merge

* fix examples

* net-vpc module context

* add parent ids to folder context

* rename folder parent context

* fix folder parent check

* new project factory stub

* wip

* wip

* refactor defaults

* project iam

* bueckts and service accounts

* start adding context replacements

* better test data

* automation resources for folders and projects

* automation

* add support for project id interpolation

* first tested apply

* improve IAM description in gcs module

* add context to billing account module

* add notification channels to billing account module context

* add billing budgets to new pf

* schemas and defaults

* bootstrap wip

* bootstrap wip

* bootstrap wip

* pf outputs

* pf fixes

* fix pf sample data

* bootstrap lite fixes

* add locations to organization module contexts

* bootstrap lite fixes

* org fixes, billing accounts

* fix default project parent

* bootstrap lite wip

* add locations to gcs module context

* add context support to logging bucket module

* add context to pubsub module

* split out iam variables in gcs module

* fix logging bucket context test

* bootstrap log sink destinations

* streamline logging-bucket module variables

* fix logging bucket context test

* align logging bucket module interface in fast bootstrap

* add support for project-level log buckets to project factory

* support full context expansion in organization module log sinks

* log buckets in fast-lite bootstrap

* make og sink type optional in organization module

* log sinks in fast-lite bootstrap

* set tag values in factory context

* bootstrap lite data

* output files schema

* billing account schema

* output files

* output providers

* gcs output files

* boilerplate

* tflint

* check documentation

* check docs

* fix project module parent variable validation

* fix log bucket examples

* allow null parent in project module

* silence folder test errors

* fix billing account sink example

* fix project example

* fix billing account module

* fix folder tests

* fix FAST

* fix fast

* tfvars outputs

* wif

* cicd service accounts

* cicd

* allow defaults in context, minimal org policies

* support gcs managed folders in project factory and bootstrap lite

* support prefix in provider output files

* rename bootstrap stage

* gitignore

* gitignore

* security folder, billing IAM

* wip tfvars

* fix typo

* security IAM

* control tag iam/context via variables in organization module

* split tag creation from tag IAM to avoid circular refs

* port organization module tag changes to project module

* implement new-style context expansion in vpc-sc module

* fix fast vpc-sc tests

* boilerplate

* vpc sc stage

* schemas

* fast-lite compatibility for vpc sc stage

* make log project number optional in vpc-sc stage

* networking

* networking

* networking

* networking

* rename and move new stage under fast

* clone pf tests

* use context replacement for internal notification channels in billing account module

* support service agents in project module iam context replacements

* support service agents in project module iam context replacements

* add support for kms keys to project module context

* experimental pf example test and fixes

* fix schemas

* fix tests

* tfdoc

* tfdoc

* pf config

* experimental pf

* remove redundant dot from gcs managed folder IAM keys

* bootstrap experimental test

* project factory exp stage test

* skip tflint for bootstrap experimental test

* tflint

* fix gcs test

* documentation work

* documentation work

* Update README.md

* tfdoc

* tfdoc

* readme

* tfdoc

* readme

* readme

* readme

* readme

* support universe in pf exp projects

* missing universe service agents

* org policies import, non-admin billing IAM

* todo

* fix test

* custom constraints

* fast classic dataset

* fix test data

* context replacements in billing module log sinks

* fix typo

* add support for billing log sinks

* update docs

* readme

* cicd fix and test

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2025-09-02 08:38:57 +02:00
Ludovico Magnocavallo
dcd762370c Merge remote-tracking branch 'origin/master' into fast-dev 2025-09-01 15:41:36 +00:00
Julio Castillo
d3f0dc984e Upgrade provider to version 7.0.1 (#3291)
* Upgrade provider to version 7.0.1

* Update READMEs

* Bring back depends_on for services and jobs
2025-09-01 17:29:20 +02:00
Ludovico Magnocavallo
0b974a3a00 Merge remote-tracking branch 'origin/master' into fast-dev 2025-09-01 15:09:29 +00:00
Ludovico Magnocavallo
9a2337ceb9 prepare v42.1.0 2025-09-01 15:05:09 +00:00
Zsolt Molnar
b3c7699b8c Enable ADMIN_READ audit log for sts.googleapis.com in automation (iac) project (#3290)
* Enable ADMIN_READ audit log for sts.googleapis.com in the automation (iac) project for better workload identity debugging and auditing

* Fix FAST tests

* Test fix #2

* Test fix #3

* Final test fix

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2025-09-01 13:58:28 +00:00
Wiktor Niesiobędzki
f93c6f7aa0 Fix IAM grants for stage 3s in resman 2025-09-01 12:52:52 +02:00
Wiktor Niesiobędzki
71b7c68ca2 fix missing conditions in top-level-folders IAM 2025-09-01 12:52:52 +02:00
Wiktor Niesiobędzki
8468fd4ebc Bump provider to 6.47.0, to allow use of gpu_zonal_redundancy_disabled in modules/cloud-run-v2 2025-08-13 15:21:27 +02:00
Ludovico Magnocavallo
f02aa1f63f v42.0.0 2025-08-08 06:49:11 +00:00
Ludovico Magnocavallo
241b005f68 Merge remote-tracking branch 'origin/master' into fast-dev 2025-08-08 06:46:42 +00:00
Ludovico Magnocavallo
f9c76c8a87 version 41.1.0 2025-08-08 06:43:08 +00:00
Matt
1b4dcd5b07 fix: Multi-tenant parameters from upstream bootstrap (#3265)
* fix: Multi-tenant parameters from upstream bootstrap

* Delint

* fix tests, tfdoc

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-08-08 06:35:32 +00:00
Ludovico Magnocavallo
9ad0d57bd2 Merge remote-tracking branch 'origin/master' into fast-dev 2025-08-07 07:26:44 +00:00
Sacha Guyot
05af963c7e Fixing merge artifact in fast/stages/2-networking-b-nva/README.md 2025-08-06 14:49:48 +02:00
Samuele Perticarari
9829b1498d Migrate VPN alerting rules from MQL to PromQL (#3259) 2025-08-05 17:07:25 +02:00
Ludovico Magnocavallo
915a1288d2 Merge remote-tracking branch 'origin/master' into fast-dev 2025-08-04 07:15:42 +00:00
Liam Nesteroff
fdbe2f34bd fixed schema patter for iam_bindings_additive roles (#3258)
* fixed schema to allow iam_bindings_additive roles with "." (roles/compute.admin)
2025-08-01 16:48:04 +10:00
Ludo
5459280294 Merge remote-tracking branch 'origin/master' into fast-dev 2025-07-25 18:16:09 +02:00
Ali-Aburub
ae6b3ee18d Conditionally creates billing sink if the billing account is of type resource (#3130)
* updated billing.tf file to conditionally creates billing sink if the billing account resides out of org

* replace resources with modules

* replace individual iam resources with billing_iam local passed in the module

* update module name and path and move iam from local to module call

* update README.md

* Add log_bucket option to billing_account variable, and update billing account IAM assignments

* update 0-bootstrap README to reflect changes to billing account module

* Update current bootstrap tests to reflect the change to billing_account variable

* Create test for the case when billing account log bucket is created

* running fmt

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-07-21 15:09:36 +00:00
lcaggio
318da4c0c2 Improve and fix DAG variable retrive method. (#3227)
Improve and fix DAG variable retrive method in Airflow Demo DAG files.
2025-07-10 10:21:11 +02:00
Jay Bana
88051c2d5b Add Data Product Reference Example to FAST Data Platform Stage (#3211)
Add Data Product Reference Example to FAST Data Platform Stage

---------

Co-authored-by: lcaggio <lorenzo.caggioni@gmail.com>
2025-07-09 08:53:49 +00:00
Ludovico Magnocavallo
53f691320e Support IAM tag factory context expansion in organization / project modules and FAST resman stage (#3226)
* tag factory context

* support tag factory contexts in resman

* schemas

* fix schema
2025-07-09 09:04:17 +02:00
Liam Nesteroff
1da9bbcfb2 Allowing multiple on-prem domains (#3219)
* Allowing multiple on-prem domains

* added on_prem domain example for tests

* Made gcp domains (gcp.example.com) optional and not created if null
2025-07-09 16:56:40 +10:00
Ludo
0a2cc6e763 Merge remote-tracking branch 'origin/master' into fast-dev 2025-07-07 10:19:23 +02:00
Julio Castillo
b8efcc5d89 Add IP filtering support to modules/gcs (#3216)
* Add IP filtering to GCS

* Bump provider version
2025-07-04 18:57:32 +00:00
Liam Nesteroff
f07e4f64e9 Standardise reuse variable from project module and implement for net-vpc (#3205)
* exposing the network_id from the net-vpc module for use with tag bindings

* convert vpc_create to vpc_reuse

* Changed the reuse vars to standardised attributes

* fixed readme tests and schemas

* modified apigee blueprint to use vpc_reuse with network_id passthrough

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-07-03 09:12:05 +10:00
Julio Castillo
7e20abc19d Update default FAST org policies (#3207) 2025-07-02 13:53:58 +00:00
Ludo
e46178c241 Merge remote-tracking branch 'origin/master' into fast-dev 2025-06-29 14:19:43 +02:00
Ludo
268c92f92d prep v40.2.0 2025-06-29 14:12:20 +02:00
Ludovico Magnocavallo
ef45aa704a Rename workflows config variable introduced in #3198 (#3199)
* rename workflows_config.tf_var_files in resman stage

* fix test result

* fix cloud deploy module versions file
2025-06-28 08:57:55 +00:00
Ludo
0e052abb59 Merge remote-tracking branch 'origin/master' into fast-dev 2025-06-28 09:40:24 +02:00
Ludovico Magnocavallo
f52dc78c8c Add support for extra tfvar files in CI/CD config (#3198) 2025-06-27 16:58:54 +02:00
Sepehr Javid
562a7cfe17 Add default route action to internal app lb path matcher (#3195)
* add path_matcher.default_route_action

* update readme

* update versions
2025-06-26 14:21:32 +02:00
Julio Castillo
ca35fc3377 Only consider active projects to default VPC SC perimeter (#3193) 2025-06-25 16:01:01 +00:00
Liam Nesteroff
c14e159b3b Added option for tag factory in resman (#3190)
* Added option for tag factory in resman
2025-06-24 07:31:52 +10:00
Ludo
1dde5258fa Merge remote-tracking branch 'origin/master' into fast-dev 2025-06-21 17:37:53 +02:00
Liam Nesteroff
ad0910b7b6 Fixed hard-coded resource management tags (!var.tag_names) (#3180)
* fixed var.tag_names ignores

* added some more missed var.tag_values

* fixed exp intended as ref

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-06-20 09:50:58 +00:00
aumohr
71f969c21f Clean fast 2 security from vpcsc (#3187)
* updated fast security readme

* removed not required data file

* change org policy condition to align with best practice documentation

* aligned test
2025-06-20 13:22:22 +04:00