Commit Graph

1151 Commits

Author SHA1 Message Date
Julio Castillo
271942f2ed Bump Terraform to 1.11 (#3120)
* Bump Terraform version to 1.11

* Update workflows
2025-05-29 11:11:39 +02:00
Ludovico Magnocavallo
b9ea8a6c26 Allow creation of regional templates in compute-vm module (#3114)
* allow creation of regional templates in compute-vm module

* tfdoc

* fix blueprint
2025-05-27 14:18:40 +02:00
Ludovico Magnocavallo
7ce4381ac3 add support for service agent expansion to project factory IAM (#3112) 2025-05-24 12:33:20 +02:00
Julio Castillo
1eeaf21b14 Prep release 40.1.0 2025-05-21 16:20:42 +02:00
Ludovico Magnocavallo
743f771adb Add version tracking files to FAST (#3108)
* Add version tracking files to FAST

* tfdoc

* Update test counts

* inventories

* tfdoc

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2025-05-21 16:14:06 +02:00
Julio Castillo
94cdce4467 Add fast_version.txt to FAST stages (#3107)
* Add fast_versions.txt file

* Fix versions.tf module path

* Fix linter
2025-05-21 15:10:57 +02:00
Ludo
e4f83431bc prep v40.0.0 2025-05-21 10:25:45 +02:00
Jay Bana
0411074a73 Improves fast/data-platform-ng README for clarity (#3074)
* Improves Data Platform README for clarity

* Quick fix to table of contents capitalization

* Fix broken link to stages README.md

* Fix broken link to stages README.md

* Add 2 diagrams.

* Update README.

* Update README.

* Fix section headings in README for consistency

* Clarify implementation details in README regarding Data Mesh principles and FAST stage integration

* Reposition folder structure diagram

* Remove Resource Hierarchy Overview section from README

* Remove diagram_resman.png from data platform development stage

* Update diagrams in README for Data Platform stage

* Refine descriptions of logical components in Data Platform architecture

* Refine README and configuration files for Data Platform stage, enhancing clarity and consistency in descriptions and structure.

* Add section for Provider and Terraform variables in README

* Remove demo files and configurations for Data Platform stage

* Fix file paths in IAM management references in README

* Add IAM principal for dp-platform and update resource counts in test files

* Update README to fix folder structure diagram order and alignment

* Fix capitalization and team naming inconsistencies in README

* Add note on IAM permissions review for production deployment in README

* Refactor IAM roles for dp-platform group in terraform.tfvars.sample

* Fix bucket name in product-0.yaml from 'exposed-ew8' to 'exposed'

---------

Co-authored-by: lcaggio <lorenzo.caggioni@gmail.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-05-21 07:30:25 +00:00
Ludo
4a66fbf680 prep v39.2.0 2025-05-21 09:23:49 +02:00
Julio Castillo
5ab29fc1c5 Disable creation of bridge perimeters (#3098)
* Disable creation of bridge perimeters

* Simplify bootsstrap test manifests
2025-05-20 09:13:27 +02:00
Ludovico Magnocavallo
e50b02d404 Add support for additive perimeter resources to vpc-sc module (#3093)
* add support for additive perimeter resources

* FAST stage variable
2025-05-19 11:05:05 +02:00
Laurent Al Hossri
4a652324ee Add GitLab SaaS support in fast/extras/0-cicd-gitlab (#3088)
* feat: add support to SaaS gitlab instance

* fix: fmt terraform

* Update README.md

* fix: validation && add gitlab url local

* fix: adapt readme.md to include gitlab_config modifications

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Ludovico Magnocavallo <ludo@qix.it>
2025-05-18 08:32:40 +00:00
Laurent Al Hossri
8cef0e8ffd fix: remove file starting by 1 and 2 to avoid copying 1-resman-provid… (#2944)
* fix: remove file starting by 1 and 2 to avoid copying 1-resman-providers.tf, 2-project-factory-providers.tf ...

* feat: add schemas to repository files

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-05-18 07:14:29 +00:00
Ludovico Magnocavallo
bb5426128e relax wif org policy in IaC project (#3090) 2025-05-16 07:31:22 +00:00
Ludovico Magnocavallo
212e587f77 Fix permadiff in FAST bootstrap IAM (#3089)
* Add ability to optionally update Cloud Run job containers outside Terraform.

Co-authored-by: Luca Prete <lucaprete@google.com>

* bug: mark policy_controller as optional (#3086)

* bug: mark policy_controller as optional

* Fix documentation

---------

Co-authored-by: Julio Castillo <jccb@google.com>

* fix bootstrap permadiff

* inventory

* inventory

---------

Co-authored-by: Luca Prete <preteluca@gmail.com>
Co-authored-by: Luca Prete <lucaprete@google.com>
Co-authored-by: Falcon Taylor-Carter <falconertc@gmail.com>
Co-authored-by: Julio Castillo <jccb@google.com>
2025-05-16 09:10:39 +02:00
Julio Castillo
3bda69fd26 Map secops group to security by default (#3080)
* Map secops group to security by default

* Update readmes

* Fix bootstrap inventories
2025-05-12 11:16:45 +00:00
Julio Castillo
7ceb814986 VPC SC module refactor (#3062)
* Remove bridge perimeters

* Update FAST stages

* Allow project ids in perimeter definitions

* Preserve order order for ingress/egress policies

* Use CAI

* Use CAI

* Fix tests
2025-05-09 14:37:03 +02:00
lcaggio
2d7b736657 Fix no VPC composer scenario and roles (#3075)
Fix no VPC composer scenario and roles
2025-05-09 10:49:45 +02:00
Ludovico Magnocavallo
30b390483e JSON schema documentation tool (#3070)
* wip

* wip

* wip

* generate schema docs

* formatting

* typo

* fix details

* fix details

* revert dp change

* tfdoc
2025-05-06 08:17:46 +02:00
Ludo
41b4cdef68 prep v40.0.0-rc1 2025-05-05 14:24:32 +02:00
Ludo
226c2f7ed1 Merge remote-tracking branch 'origin/master' into fast-dev 2025-05-05 14:21:46 +02:00
Ludo
46f4bb9d85 prep v39.1.0 2025-05-05 14:19:45 +02:00
Ludovico Magnocavallo
cb7bed50e3 New FAST data platform (#3066)
* copy from broken dp dev branch

* remove extra excalidraw file

* fix networking yaml

* tfdoc

* tfdoc

* nuke old data platform

* fix tests

* tests

* tflint

* high level diagram

* make location optional in composer schema

* add composer outputs

* docs

* remove schema docs

* tfdoc

* update service agent encryption composer def for composer 3

* encryption keys

* typo

* typo

* fix security IAM

* inventory

* tflint

* Fix roles and diagram.

* Fix tflint

* Fix test DP.

* Fix test

* Diagrams excalidraw gz

---------

Co-authored-by: lcaggio <lorenzo.caggioni@gmail.com>
2025-05-03 21:21:38 +00:00
Ludovico Magnocavallo
623f2b0113 Enable repd tag bindings in compute-vm module (#3063)
* enable repd tag bindings in compute-vm module

* tfdoc
2025-05-03 11:29:07 +02:00
apichick
a39874413d Updated network config variables in GKE node pool (#3052) 2025-04-21 20:44:39 +02:00
Ludovico Magnocavallo
5adba9a018 New Dataplex Aspect Types module (#3050)
* README and tests missing

* default location value

* tested

* READMEs
2025-04-20 11:25:13 +02:00
Ludo
205a43a96f prepare v39.0.0 2025-04-18 17:44:29 +02:00
Ludo
2b0a9db8ed Merge branch 'fast-dev' 2025-04-18 17:34:08 +02:00
Ludo
89e68a8e22 prepare v38.2.0 2025-04-18 17:32:51 +02:00
Ludo
c65a8afa6f streamline vpc-sc moved file 2025-04-18 17:28:25 +02:00
simonebruzzechesse
1e2eea1296 2-secops stage (#3038)
* new 2-secops stage
* new 3-secops-dev stage

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-04-18 15:57:29 +02:00
Simone Ruffilli
c6c4cc71d5 Pathexpand all factory data paths (#3033)
* Pathexpand all factory data paths

* fix net monitoring paths

* fix file paths

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-04-16 13:28:10 +02:00
Ludo
4821ac2c07 Merge remote-tracking branch 'origin/master' into fast-dev 2025-04-16 12:13:35 +02:00
Ludovico Magnocavallo
ade7fb32b0 rename stage_config output/variables to stage_configs (#3042) 2025-04-16 09:34:01 +00:00
Francisco P
41df4e09bc Add managed Kafka (#3035)
* Add managed Kafka project template with configuration and variable definitions

* Refactor managed Kafka configuration to use a single kafka_config object for improved clarity and maintainability

* Add Apache License 2.0 header to managed Kafka template files

* Update README and add project.yaml for Managed Kafka cluster setup

* Update README to skip tftest validation for managed Kafka module
2025-04-15 18:15:46 +00:00
karpok78
639a86e626 PF SA fix for budget alert (#3036)
Allowing PF RO SA to parse budget alerts
2025-04-13 13:14:32 +00:00
Simone Ruffilli
d20fc9333b Update CICD section of 0-bootstrap. (#3032)
Update CICD section of 0-bootstrap.
Fixes #2930
2025-04-12 09:45:58 +02:00
Sepehr Javid
8b9979d93e add tag binding for stage folder config (#3028)
* add tag binding for stage folder config

* update readme

* address comment

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-04-11 15:34:47 +00:00
Ludovico Magnocavallo
4811f72a6c Add FAST to Python linting check (#3026)
* turn on Python linting for fast
* remove secops.py

---------

Co-authored-by: bruzzechesse <bruzzechesse@google.com>
2025-04-11 16:48:17 +02:00
Ludo
594a9695ab Merge remote-tracking branch 'origin/master' into fast-dev 2025-04-11 15:52:37 +02:00
simonebruzzechesse
a747653e88 SecOps Anonymization improvements (#3013)
* update secops anonymization pipeline with new chronicle APIs
2025-04-11 15:14:05 +02:00
Simone Ruffilli
3c91acd181 Replace all instances of stackdriver.googleapis.com with log+mon (#3022)
Replace all instances of stackdriver.googleapis.com with logging.googleapis.com  and monitoring.googleapis.com.
Fixes #2932
2025-04-11 12:04:50 +00:00
Ludovico Magnocavallo
7b993cd2f1 allow configuring dns zone names in FAST networking stages (#3021) 2025-04-09 18:53:20 +02:00
Luca Prete
f7a0958e17 [FAST] Remove object creator permission from storage viewer custom role (#3020) 2025-04-09 16:39:20 +02:00
Julio Castillo
b2e26e50ae Enable storage.restrictAuthTypes org policy (#3017) 2025-04-08 15:43:24 +02:00
Matt
db165721f3 Add OKTA WIF provider definition (#3015)
Co-authored-by: Julio Castillo <jccb@google.com>
2025-04-08 12:48:06 +00:00
Ludovico Magnocavallo
bdc97a54c7 Properly support org policy tags in resman/project factory (#3014)
* allow setting IAM for org policy tags, add org policy tags to pf context

* allow tag id substitution

* tfdoc
2025-04-08 14:24:46 +02:00
Wiktor Niesiobędzki
9c93c6daa4 Add trusted images projects 2025-04-06 12:49:16 +02:00
Ludovico Magnocavallo
7aba2c1b58 allow external config of restricted services base set in vpc-sc stage (#3009) 2025-04-04 12:04:15 +00:00
Ludovico Magnocavallo
69188fa9d9 Implement support for VPC-SC perimeter membership from project factory (#3007)
* support project factory-level vpc-sc perimeter interpolation

* fix ro role

* add support for IAM on service accounts

* fix typo
2025-04-04 11:45:22 +00:00