Commit Graph

47 Commits

Author SHA1 Message Date
Ludovico Magnocavallo
c8e4179f2b Add custom routes for directpath to net-vpc module (#2966)
* add custom routes for directpath to net-vpc module

* blueprint tests

* blueprint tests

* blueprint tests

* fast tests

* tfdoc

* module examples
2025-03-19 10:22:47 +00:00
Ludovico Magnocavallo
1a4b298cc9 Project factory additions, project module reuse implementation (#2899)
* add support for buckets

* add project-level interpolation for own SAs

* docs

* project reuse changes

* fix example

* tfdoc

* update check documentation tool

* fast tests

* blueprints

* typo
2025-02-15 20:37:45 +01:00
Julio Castillo
d0c3f04c10 Make service agents work in different universes (#2894)
* Make service agents work in different universes

* Use templatestring and two passes for service agent emails

* Fix tests
2025-02-14 12:16:07 +00:00
Wiktor Niesiobędzki
cbaf6928d6 fix non-empty plan after apply for vertex mlops 2024-12-31 17:27:47 +01:00
Julio Castillo
c73f912d43 Fabric e2e fixes (#2791)
* Try to fix fabric e2e tests. Update service agents

* Fix typo

* Fix syntax

* Delay PSA creation until service agents have roles assigned

* Fix tests
2024-12-31 15:25:36 +01:00
Julio Castillo
b7a4717fc3 Fix tests 2024-11-05 12:10:23 +01:00
Wiktor Niesiobędzki
d8a6f3a895 Fix tests 2024-11-05 11:22:43 +01:00
Wiktor Niesiobędzki
232a7cd853 Fix IAM drift in vertex-mlops 2024-11-05 11:22:43 +01:00
Wiktor Niesiobędzki
4ab9c74e9f Review fixes 2024-11-04 10:34:54 +01:00
Wiktor Niesiobędzki
81cb269e25 fix tests 2024-11-04 10:34:54 +01:00
Wiktor Niesiobędzki
59eade7c48 Workaround overlapping networks 2024-11-04 10:34:54 +01:00
Wiktor Niesiobędzki
28160055af replace deprecated google_notebooks_instance with google_workbench_instance 2024-11-04 10:34:54 +01:00
Wiktor Niesiobędzki
d6f0ee9447 fix Vertex-ML-Ops e2e tests 2024-11-04 10:13:32 +01:00
Julio Castillo
c0bf32e797 Refactor service agent management (#2423)
* Service agents script

* Service agents update

* WIP

* Update script and terraform

* Fix tests

* Fix linter

* Update docs

* Bring back pf example inventory

* Fix tests

* Fix more tests

* Fix tests

* Use dataclasses for build_service_agents.py

* Remove unneeded field() from build_service_agents

* Re-enable CMEK depends_on in project outputs

* Update tools/requirements.txt

* Enable storage in GCS example projects

* Fix tests

* Add CMEK Service Agents dependencies for services

* Fix typos and data platform cmek

* More typos
2024-07-23 22:05:38 +02:00
Julio Castillo
4e8adc9c43 Update modules/artifact-registry with newly-released features. (#2396)
Fixes #2377
2024-06-28 19:52:25 +02:00
Julio Castillo
3af7e257d2 Add tflint to pipelines (#2220)
* Fix terraform_deprecated_index

https://github.com/terraform-linters/tflint-ruleset-terraform/blob/v0.5.0/docs/rules/terraform_deprecated_index.md

* Fix terraform_deprecated_interpolation

Reference: https://github.com/terraform-linters/tflint-ruleset-terraform/blob/v0.5.0/docs/rules/terraform_deprecated_interpolation.md

* Fix more indexing

* Remove unused variable

* Enable TFLint for modules

* Add tflint config file

* Fix chdir

* Lint modules

* TFLint fixes

* TFLint

* Fixes binauthz README

* Fixes DNS response policy tests. Restores MIG outputs.

* Fixes other DNS response policy tests.

* Update tests for fast 2-e

* Moar fixed tests

---------

Co-authored-by: Simone Ruffilli <sruffilli@google.com>
2024-04-17 10:23:48 +02:00
Ludovico Magnocavallo
9414779cc2 Allow multiple PSA service providers in net-vpc module (#2218)
* allowing multiple PSA service providers in net-vpc module

* tfdoc

* tfdoc

* Add tfvars/yaml tests

* fix module and tests

* re-enable inventory

* merge fix

* Add multiple PSA test case

* fix cloudsql example

---------

Co-authored-by: Wiktor Niesiobędzki <wiktorn@google.com>
2024-04-16 15:02:36 +00:00
Julio Castillo
993bef71aa Introduce mandatory OWNERS file for blueprint maintainership (#2131)
* Delete deprecated/broken blueprints

* Adding OWNERS to all blueprints

* Fix links

* Update OWNERS

---------

Co-authored-by: javiergp <javiergp@users.noreply.github.com>
2024-03-08 09:40:46 +01:00
Wiktor Niesiobędzki
b902b1dab9 Fix non-empty plan after apply 2024-02-13 07:40:31 +01:00
Ludovico Magnocavallo
71a64487d5 Extend FAST to support different principal types (#2064)
* add doc draft

* typos

* typo

* typo

* typos

* rewording

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* move iam variables to a separate file

* move billing-account module to iam_principals

* move data-catalog-policy-tag module to iam_principals

* move dataplex-datascan module to iam_principals

* move dataproc module to iam_principals

* move folder module to iam_principals

* copyright

* move organization module to iam_principals

* move project module to iam_principals

* move source-repository module to iam_principals

* update blueprints for iam_principals interface

* FAST bootstrap

* module READMEs fixes

* FAST bootstrap

* FAST networking stages

* FAST security stage

* FAST gke stage

* FAST multitenant bootstrap stage

* FAST multitenant resman stage

* tfdoc

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* fix module test

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Rename iam_principals to iam_by_principals

* Update IAM template to include iam_by_principals

* Update Resman README

* Fix ADR link format

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-02-12 14:35:30 +01:00
Wiktor Niesiobędzki
63f1dfb6de end-to-end tests for Vertex blueprint 2023-11-15 11:04:12 +00:00
luigi-bitonti
d07f8fd33d Added CMEK for Secret auto managed (#1739)
Allow to specify custom KMS keys for Secret Manager secrets
2023-11-10 16:45:47 +01:00
Julio Castillo
dfc5023e0b Make deletion protection consistent across all modules (#1735)
* Expose deletion_protection in GKE modules

* Make deletion protection consistent across all modules

* Add deletion_protection option to blueprints

* Fix blueprints tests

* Fix types

* Update READMEs

* Fix dp readme

* Fix cmek blueprint default deletion_protection

* Fix blueprints tests
2023-10-05 17:31:07 +02:00
javiergp
a2eddd0be0 Fixed Cloud Build default bucket name and vpc/subnet names (#1548) 2023-07-31 12:52:36 +02:00
Ludovico Magnocavallo
5a534edf5c update and refactor artifact registry module (#1536) 2023-07-28 09:54:36 +00:00
Julio Castillo
cecbd2072c Fix modules and blueprints tests 2023-05-26 16:38:41 +02:00
Bharath KKB
47ae6dc7c3 chore: update mlops blueprint metadata (#1382) 2023-05-17 07:41:57 +00:00
Alejandro Leal
31c1c8534a Updates to blueprints/data-solutions/vertex-mlops
Updates to blueprints/data-solutions/vertex-mlops
2023-05-15 19:41:55 -04:00
Julio Castillo
05ed1bf12f Add blueprint metadata validation tool 2023-05-05 16:57:48 +02:00
lcaggio
4d66623de1 Fix Shielded Folder - VertexML interoperability (#1355)
* Fix Shielded Folder - VertexML interoperability

* Fix README outputs

* Adding prefix for keyrings and update output
2023-05-05 07:54:57 +00:00
Bharath KKB
1547a55e1f chore: update metadata schema (#1345) 2023-04-28 17:14:20 -05:00
Julio Castillo
1e0b1da0d2 Add directory to vertex-mlops blueprint metadata 2023-04-27 08:52:24 +02:00
Julio Castillo
bca8a33f1e Fix typo and blueprint module name 2023-04-24 20:36:50 +02:00
lcaggio
8488e866bc Update readme 2023-04-20 16:53:09 +02:00
lcaggio
b896ccb9e5 Update metadata types and defaults. 2023-04-19 15:20:29 +02:00
lcaggio
9fdf80738f Fix linting. 2023-04-19 14:09:40 +02:00
lcaggio
30bef8546f Create metadata yaml file 2023-04-19 12:58:00 +02:00
lcaggio
f4490fcaea Fix comments 2023-04-19 11:22:50 +02:00
lcaggio
1f4fac2f1d fix lint 2023-04-18 17:51:24 +02:00
lcaggio
edf67fc5d0 First commit 2023-04-18 17:32:15 +02:00
Ludovico Magnocavallo
91a1168d1d rename blueprint providers file (#1334) 2023-04-18 11:44:09 +02:00
Julio Castillo
4b2e2d2ef7 Add providers to vertex-mlops blueprint 2023-04-18 09:42:46 +02:00
lcaggio
e213f156ad Fix Jit notebook service account. 2023-03-08 16:06:27 +01:00
Julio Castillo
edce6edd28 Update factories and apigee tests 2023-02-25 19:26:11 +01:00
Julio Castillo
b186365cab Update data solutions tests 2023-02-25 19:26:11 +01:00
Julio Castillo
a5e905cb80 Update remaining org policies 2023-02-21 15:49:16 +01:00
javiergp
ce1f86d20b Vertex Pipelines MLOps framework blueprint (#1038)
* First release of the MLOps blueprint
2023-02-02 19:13:13 +01:00