Commit Graph

959 Commits

Author SHA1 Message Date
Julio Castillo
ca35fc3377 Only consider active projects to default VPC SC perimeter (#3193) 2025-06-25 16:01:01 +00:00
Liam Nesteroff
ad0910b7b6 Fixed hard-coded resource management tags (!var.tag_names) (#3180)
* fixed var.tag_names ignores

* added some more missed var.tag_values

* fixed exp intended as ref

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-06-20 09:50:58 +00:00
aumohr
71f969c21f Clean fast 2 security from vpcsc (#3187)
* updated fast security readme

* removed not required data file

* change org policy condition to align with best practice documentation

* aligned test
2025-06-20 13:22:22 +04:00
Liam Nesteroff
6d8b813e51 fixed option to set descriptions for environment tag values (#3174) 2025-06-19 09:00:17 +02:00
dependabot[bot]
8e0ea57c80 Bump requests (#3146)
Bumps [requests](https://github.com/psf/requests) from 2.32.2 to 2.32.4.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.32.2...v2.32.4)

---
updated-dependencies:
- dependency-name: requests
  dependency-version: 2.32.4
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-06-10 08:51:35 +00:00
Ludovico Magnocavallo
3c38bc643e add KMS keys interpolation to project factory (#3145) 2025-06-10 10:24:25 +02:00
Jacek Jabłoński
e6ec5de733 fix additional pod networks config creation in GKE node pool (#3134)
* fix additional pod networks config creation

* fix doc

* Replicate change in gke stage

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2025-06-05 11:41:51 +00:00
Ludovico Magnocavallo
6b04ce769d Allow multiple types in JSON schema docs tool (#3126)
* allow multiple types in JSON schema docs tool

* support pattern

* support pattern
2025-05-31 11:58:20 +02:00
Julio Castillo
271942f2ed Bump Terraform to 1.11 (#3120)
* Bump Terraform version to 1.11

* Update workflows
2025-05-29 11:11:39 +02:00
Ludovico Magnocavallo
b9ea8a6c26 Allow creation of regional templates in compute-vm module (#3114)
* allow creation of regional templates in compute-vm module

* tfdoc

* fix blueprint
2025-05-27 14:18:40 +02:00
Ludovico Magnocavallo
7ce4381ac3 add support for service agent expansion to project factory IAM (#3112) 2025-05-24 12:33:20 +02:00
Julio Castillo
1eeaf21b14 Prep release 40.1.0 2025-05-21 16:20:42 +02:00
Ludovico Magnocavallo
743f771adb Add version tracking files to FAST (#3108)
* Add version tracking files to FAST

* tfdoc

* Update test counts

* inventories

* tfdoc

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2025-05-21 16:14:06 +02:00
Julio Castillo
94cdce4467 Add fast_version.txt to FAST stages (#3107)
* Add fast_versions.txt file

* Fix versions.tf module path

* Fix linter
2025-05-21 15:10:57 +02:00
Ludo
e4f83431bc prep v40.0.0 2025-05-21 10:25:45 +02:00
Jay Bana
0411074a73 Improves fast/data-platform-ng README for clarity (#3074)
* Improves Data Platform README for clarity

* Quick fix to table of contents capitalization

* Fix broken link to stages README.md

* Fix broken link to stages README.md

* Add 2 diagrams.

* Update README.

* Update README.

* Fix section headings in README for consistency

* Clarify implementation details in README regarding Data Mesh principles and FAST stage integration

* Reposition folder structure diagram

* Remove Resource Hierarchy Overview section from README

* Remove diagram_resman.png from data platform development stage

* Update diagrams in README for Data Platform stage

* Refine descriptions of logical components in Data Platform architecture

* Refine README and configuration files for Data Platform stage, enhancing clarity and consistency in descriptions and structure.

* Add section for Provider and Terraform variables in README

* Remove demo files and configurations for Data Platform stage

* Fix file paths in IAM management references in README

* Add IAM principal for dp-platform and update resource counts in test files

* Update README to fix folder structure diagram order and alignment

* Fix capitalization and team naming inconsistencies in README

* Add note on IAM permissions review for production deployment in README

* Refactor IAM roles for dp-platform group in terraform.tfvars.sample

* Fix bucket name in product-0.yaml from 'exposed-ew8' to 'exposed'

---------

Co-authored-by: lcaggio <lorenzo.caggioni@gmail.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-05-21 07:30:25 +00:00
Ludo
4a66fbf680 prep v39.2.0 2025-05-21 09:23:49 +02:00
Julio Castillo
5ab29fc1c5 Disable creation of bridge perimeters (#3098)
* Disable creation of bridge perimeters

* Simplify bootsstrap test manifests
2025-05-20 09:13:27 +02:00
Ludovico Magnocavallo
e50b02d404 Add support for additive perimeter resources to vpc-sc module (#3093)
* add support for additive perimeter resources

* FAST stage variable
2025-05-19 11:05:05 +02:00
Laurent Al Hossri
4a652324ee Add GitLab SaaS support in fast/extras/0-cicd-gitlab (#3088)
* feat: add support to SaaS gitlab instance

* fix: fmt terraform

* Update README.md

* fix: validation && add gitlab url local

* fix: adapt readme.md to include gitlab_config modifications

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Ludovico Magnocavallo <ludo@qix.it>
2025-05-18 08:32:40 +00:00
Laurent Al Hossri
8cef0e8ffd fix: remove file starting by 1 and 2 to avoid copying 1-resman-provid… (#2944)
* fix: remove file starting by 1 and 2 to avoid copying 1-resman-providers.tf, 2-project-factory-providers.tf ...

* feat: add schemas to repository files

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-05-18 07:14:29 +00:00
Ludovico Magnocavallo
bb5426128e relax wif org policy in IaC project (#3090) 2025-05-16 07:31:22 +00:00
Ludovico Magnocavallo
212e587f77 Fix permadiff in FAST bootstrap IAM (#3089)
* Add ability to optionally update Cloud Run job containers outside Terraform.

Co-authored-by: Luca Prete <lucaprete@google.com>

* bug: mark policy_controller as optional (#3086)

* bug: mark policy_controller as optional

* Fix documentation

---------

Co-authored-by: Julio Castillo <jccb@google.com>

* fix bootstrap permadiff

* inventory

* inventory

---------

Co-authored-by: Luca Prete <preteluca@gmail.com>
Co-authored-by: Luca Prete <lucaprete@google.com>
Co-authored-by: Falcon Taylor-Carter <falconertc@gmail.com>
Co-authored-by: Julio Castillo <jccb@google.com>
2025-05-16 09:10:39 +02:00
Julio Castillo
3bda69fd26 Map secops group to security by default (#3080)
* Map secops group to security by default

* Update readmes

* Fix bootstrap inventories
2025-05-12 11:16:45 +00:00
Julio Castillo
7ceb814986 VPC SC module refactor (#3062)
* Remove bridge perimeters

* Update FAST stages

* Allow project ids in perimeter definitions

* Preserve order order for ingress/egress policies

* Use CAI

* Use CAI

* Fix tests
2025-05-09 14:37:03 +02:00
lcaggio
2d7b736657 Fix no VPC composer scenario and roles (#3075)
Fix no VPC composer scenario and roles
2025-05-09 10:49:45 +02:00
Ludovico Magnocavallo
30b390483e JSON schema documentation tool (#3070)
* wip

* wip

* wip

* generate schema docs

* formatting

* typo

* fix details

* fix details

* revert dp change

* tfdoc
2025-05-06 08:17:46 +02:00
Ludo
41b4cdef68 prep v40.0.0-rc1 2025-05-05 14:24:32 +02:00
Ludo
226c2f7ed1 Merge remote-tracking branch 'origin/master' into fast-dev 2025-05-05 14:21:46 +02:00
Ludo
46f4bb9d85 prep v39.1.0 2025-05-05 14:19:45 +02:00
Ludovico Magnocavallo
cb7bed50e3 New FAST data platform (#3066)
* copy from broken dp dev branch

* remove extra excalidraw file

* fix networking yaml

* tfdoc

* tfdoc

* nuke old data platform

* fix tests

* tests

* tflint

* high level diagram

* make location optional in composer schema

* add composer outputs

* docs

* remove schema docs

* tfdoc

* update service agent encryption composer def for composer 3

* encryption keys

* typo

* typo

* fix security IAM

* inventory

* tflint

* Fix roles and diagram.

* Fix tflint

* Fix test DP.

* Fix test

* Diagrams excalidraw gz

---------

Co-authored-by: lcaggio <lorenzo.caggioni@gmail.com>
2025-05-03 21:21:38 +00:00
Ludovico Magnocavallo
623f2b0113 Enable repd tag bindings in compute-vm module (#3063)
* enable repd tag bindings in compute-vm module

* tfdoc
2025-05-03 11:29:07 +02:00
apichick
a39874413d Updated network config variables in GKE node pool (#3052) 2025-04-21 20:44:39 +02:00
Ludovico Magnocavallo
5adba9a018 New Dataplex Aspect Types module (#3050)
* README and tests missing

* default location value

* tested

* READMEs
2025-04-20 11:25:13 +02:00
Ludo
205a43a96f prepare v39.0.0 2025-04-18 17:44:29 +02:00
Ludo
2b0a9db8ed Merge branch 'fast-dev' 2025-04-18 17:34:08 +02:00
Ludo
89e68a8e22 prepare v38.2.0 2025-04-18 17:32:51 +02:00
Ludo
c65a8afa6f streamline vpc-sc moved file 2025-04-18 17:28:25 +02:00
simonebruzzechesse
1e2eea1296 2-secops stage (#3038)
* new 2-secops stage
* new 3-secops-dev stage

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-04-18 15:57:29 +02:00
Simone Ruffilli
c6c4cc71d5 Pathexpand all factory data paths (#3033)
* Pathexpand all factory data paths

* fix net monitoring paths

* fix file paths

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-04-16 13:28:10 +02:00
Ludo
4821ac2c07 Merge remote-tracking branch 'origin/master' into fast-dev 2025-04-16 12:13:35 +02:00
Ludovico Magnocavallo
ade7fb32b0 rename stage_config output/variables to stage_configs (#3042) 2025-04-16 09:34:01 +00:00
Francisco P
41df4e09bc Add managed Kafka (#3035)
* Add managed Kafka project template with configuration and variable definitions

* Refactor managed Kafka configuration to use a single kafka_config object for improved clarity and maintainability

* Add Apache License 2.0 header to managed Kafka template files

* Update README and add project.yaml for Managed Kafka cluster setup

* Update README to skip tftest validation for managed Kafka module
2025-04-15 18:15:46 +00:00
karpok78
639a86e626 PF SA fix for budget alert (#3036)
Allowing PF RO SA to parse budget alerts
2025-04-13 13:14:32 +00:00
Simone Ruffilli
d20fc9333b Update CICD section of 0-bootstrap. (#3032)
Update CICD section of 0-bootstrap.
Fixes #2930
2025-04-12 09:45:58 +02:00
Sepehr Javid
8b9979d93e add tag binding for stage folder config (#3028)
* add tag binding for stage folder config

* update readme

* address comment

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-04-11 15:34:47 +00:00
Ludovico Magnocavallo
4811f72a6c Add FAST to Python linting check (#3026)
* turn on Python linting for fast
* remove secops.py

---------

Co-authored-by: bruzzechesse <bruzzechesse@google.com>
2025-04-11 16:48:17 +02:00
Ludo
594a9695ab Merge remote-tracking branch 'origin/master' into fast-dev 2025-04-11 15:52:37 +02:00
simonebruzzechesse
a747653e88 SecOps Anonymization improvements (#3013)
* update secops anonymization pipeline with new chronicle APIs
2025-04-11 15:14:05 +02:00
Simone Ruffilli
3c91acd181 Replace all instances of stackdriver.googleapis.com with log+mon (#3022)
Replace all instances of stackdriver.googleapis.com with logging.googleapis.com  and monitoring.googleapis.com.
Fixes #2932
2025-04-11 12:04:50 +00:00