Commit Graph

721 Commits

Author SHA1 Message Date
Simone Ruffilli
87548f9739 Networking Sandbox Blueprint (#1939)
This blueprint creates a networking playground showing a number of different VPC connectivity options:

Hub and spoke via HA VPN
Hub and spoke via VPC peering
Interconnecting two networks via a network virtual appliance (aka NVA)
On top of that, this blueprint implements Policy Based Routing (aka PBR) to show how to force all traffic within a VPC to be funneled through an internal network passthrough load balancer, to implement an Intrusion Prevention System (IPS). PBR is enabled in the hub VPC, matching all traffic originating from within that VPC.
2023-12-21 17:50:38 +01:00
simonebruzzechesse
717f7ecad1 Blueprints naming convention update (#1942)
* update network-dashboard and quota-monitoring naming convention
2023-12-21 17:02:25 +01:00
Simone Ruffilli
0255c80e90 Move squid to __need_fixing (#1936)
* Moved `modules/cloud-config-container/squid` to __need_fixing
* Moved `blueprints/networking/filtering-proxy{,-psc}` to __need_fixing
2023-12-19 14:27:37 +00:00
Ludovico Magnocavallo
21562eefbe don't fail quota fetch on deleted project (#1931) 2023-12-15 20:20:49 +01:00
simonebruzzechesse
c50b732c79 Allow granting network user role on host project from project module and factory (#1930)
* Update shared vpc config for project factory and project module for more granular Shared VPC configuration

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-12-15 14:39:21 +01:00
maunope
1dc6965694 Update quota monitor blueprint to support project discovery (#1924)
* fist test

* dev complete

* update tf with permissions, enabled APIs and discovery root management

* updated readme

* moved projects discovery to a separate method

* reviewed Mauri's changes

* add missing lines from last change

* - fixed discovery page size to 100
- removed last_asset_page_reached var from discover_projects
- added cast to list for projects var in _main, to make the script work both using CLI and pub/sub

* fixed discovery_root default value to work when no value is passed

* fixed tfdoc

* fixed tftest resources #

---------

Co-authored-by: Ludo <ludomagno@google.com>
2023-12-12 19:17:01 +01:00
Ludovico Magnocavallo
bba814c091 Custom role factories for organization and project modules (#1912)
* backport custom role factories

* backport from fast ci/cd branch

* indent

* tfdoc

* fix module tests
2023-12-11 14:16:39 +00:00
Wiktor Niesiobędzki
886734e1e9 Add trigger configuration for Composer (#1916) 2023-12-11 12:54:49 +01:00
Ludovico Magnocavallo
f548b65b1c Add support for subnet-level service network user grants to project module, improve docs (#1907)
* improve project factory example

* light refactor of project modules shared vpc internals and docs

* add support for subnet-level grants on host project
2023-12-07 09:07:48 +00:00
apichick
66bd9d5160 Added workstation-cluster module 2023-11-30 07:02:28 +01:00
Luca Prete
bb58469292 Fixes to F5 blueprint docs (#1886)
Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-24 19:45:38 +01:00
luigi-bitonti
98accdb3ad Added PSC support to CloudSQL Module (#1874)
* Added Feature

* Added PSC to CloudSQL module

* Added psc to read replica

* Changed variables

* Updated README

* Ran fmt

* Removed old variables

* Fix README

* Fixed blueprints

* Fix README

* Fixed output

* Added more outputs and bug fixes

* Changed variable structure

* Bug fix

* Added PSC example.
2023-11-24 15:47:45 +01:00
Luca Prete
56fcb4f88a F5 deployment blueprint (#1883)
Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-24 14:02:34 +01:00
Luca Prete
525fc91d5c Fixes/improvements to F5 HA blueprint (#1882)
Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-23 16:15:47 +01:00
Luca Prete
642f65b841 F5 blueprint (#1787)
---------

Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-22 19:48:13 +01:00
Wiktor Niesiobędzki
9ff67fdaf0 Add DLP Service Agent role 2023-11-20 15:34:27 +01:00
ddaluka
543ea6e7f3 Fix/dlpagent (#1868)
Create DLP Service Account on service activation.
2023-11-20 14:11:01 +01:00
Aurélien Legrand
1f344b65e6 Net dash cfv2 (#1859)
* Handling SQL IP address issue

* reverting one change

* Improving this fix based on wiktor's feedback

* formatting

* Adding supporting for Cloud Function v2 (60 minutes timeout vs 9 minutes timeout)

* Removing useless comment

* formatting

* updating inputs/outputs documentation

* feedback from Julio

* formatting

* python formatting

* formatting

* formatting

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-11-16 14:45:44 +00:00
Wiktor Niesiobędzki
63f1dfb6de end-to-end tests for Vertex blueprint 2023-11-15 11:04:12 +00:00
Francesco Spinelli
1c2f1c7b0d Sql user features (#1856)
* added user type feature

* fix readme

* fix comment

* fix blueprint cloudsql users value + minor fix

* readme fix

* variables fix

* local var fix

* fix for in local var

* fix on readme

* fix intentations var in readme

* fix blueprint user quote

---------

Co-authored-by: Francesco Spinelli <francesco.spinelli@nttdata.com>
2023-11-13 10:27:14 +01:00
luigi-bitonti
d07f8fd33d Added CMEK for Secret auto managed (#1739)
Allow to specify custom KMS keys for Secret Manager secrets
2023-11-10 16:45:47 +01:00
Francesco Spinelli
82c74e4ab6 Dataproc module bug fix (#1848)
* bug fix

* bug fix

* fix dinamic for_each

---------

Co-authored-by: Francesco Spinelli <francesco.spinelli@nttdata.com>
2023-11-09 15:48:29 +00:00
Ludovico Magnocavallo
03937f2b6e Support multilevel data and allow overriding project id in project factory (#1851) 2023-11-09 08:29:46 +00:00
Wiktor Niesiobędzki
2664161c24 Simplify #1836 fix, Avoid map-related casting errors in project factory 2023-11-02 09:12:38 +00:00
Ludovico Magnocavallo
de0325b3a3 Avoid map-related casting errors in project factory (#1836)
* try to repro pf example error

* repro

* repro

* pf fix

* remove extra file

* FAST stage
2023-11-02 08:24:50 +01:00
lcaggio
a0ae43fc6f [Minimal Data Platform] Fix Landing and curated IAM (#1832)
* Fix IAM on Minimal DP

* fix
2023-11-01 17:53:06 +01:00
Aurélien Legrand
68dea5530a Handling SQL IP address issue (#1825)
* Handling SQL IP address issue

* reverting one change

* Improving this fix based on wiktor's feedback

* formatting
2023-10-30 17:26:06 +01:00
Luca Prete
7c6726e79b [net-address] enable ipv6 (#1821)
---------

Co-authored-by: Luca Prete <lucaprete@google.com>
2023-10-28 15:36:30 +02:00
Ludovico Magnocavallo
30d7126b83 Allow specifying arbitrary project roles for service accounts in project factory (#1814)
* allow specifying arbitrary project roles for service accounts in project factory

* tfdoc
2023-10-26 14:09:03 +00:00
Simone Ruffilli
4decc641bb Stop wrapping yamldecode with try() (#1812) 2023-10-25 16:16:05 +02:00
Aurélien Legrand
e10aabdc22 Updating network dashboard: fixing Cloud SQL problem, fixing 1 metric… (#1806)
* Updating network dashboard: fixing Cloud SQL problem, fixing 1 metric issue in the dashboard, pausing for monitoring quota issues, if monitored folders and projects are empty, every project under the discovery root node will be monitored.

* formatting

* time optimization

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-10-25 10:37:25 +00:00
Ludovico Magnocavallo
1ed48b556f make extended shared vpc attributes optional in pf (#1796) 2023-10-23 13:45:48 +00:00
Simone Ruffilli
6d89b88149 versions.tf maintenance + copyright notice bump (#1782)
* Bump copyright notice to 2023

* Delete versions.tf on blueprints

* Pin provider to major version 5

* Remove comment

* Fix lint

* fix bq-ml blueprint readme

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Julio Castillo <jccb@google.com>
2023-10-20 18:17:47 +02:00
Luca Prete
6c48512f7e [#1764] net-lb-int: add support for dual stack and multiple forwarding rules 2023-10-17 09:30:34 +00:00
dependabot[bot]
ca4d9af2e5 Bump golang.org/x/net (#1748)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.7.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.7.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-12 05:41:40 +00:00
dependabot[bot]
888e930464 Bump golang.org/x/net (#1747)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.7.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.7.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-12 07:21:10 +02:00
Julio Castillo
dfc5023e0b Make deletion protection consistent across all modules (#1735)
* Expose deletion_protection in GKE modules

* Make deletion protection consistent across all modules

* Add deletion_protection option to blueprints

* Fix blueprints tests

* Fix types

* Update READMEs

* Fix dp readme

* Fix cmek blueprint default deletion_protection

* Fix blueprints tests
2023-10-05 17:31:07 +02:00
lcaggio
de883957fe Minimal Data Platform - Fix (#1730)
* Fix

* Fix README

* Fix data platform minimal tests

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-10-04 12:15:51 +02:00
lcaggio
6889f02954 Fix data platform roles (#1725)
* Fix Data Platform roles

* Fix README

* Fix blueprint tests

* Update cleanup dp steps

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-10-04 07:31:40 +02:00
Julio Castillo
4b15605711 Fix dnssec keys lookup (#1728)
* Fix dnssec keys lookup

* Fix DNS examples

* Fix FAST and blueprints resource counts
2023-10-03 21:37:21 +02:00
Ludovico Magnocavallo
789328ff5a Bump provider versions to v5.0.0 (#1724)
* bump provider versions to 5.0.0

* fix cloud run, logging and vpc-sc

* Fix secret manager

* fix gke nodepool

* fix gke multitenant stage and blueprint

* Moving alloydb module to experimental.

* Add project to bare resources in examples

* tfdoc

* fix svpc blueprint test

* Revert "fix svpc blueprint test"

This reverts commit 14f02659098070136e64ead600580dd52c23c339.

* Fix GKE peering project

* Disable tests in alloydb module

* Bring back secret ids in secret manager tests

* Remove duplicate key

* last push

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-10-03 12:15:36 +00:00
Ludovico Magnocavallo
aa5d883deb add support for org policies to project factory (#1722) 2023-10-02 14:13:56 +00:00
Ludovico Magnocavallo
df5daab6cc Allow using no service account in compute-vm (#1692)
* module and tests

* align blueprints

* tfdoc

* remove stale variables

* fix blueprint

* variable description
2023-09-19 16:56:51 +00:00
Julio Castillo
3618c9ebdd Fix blueprints using pubsub 2023-09-17 00:21:57 +02:00
Julio Castillo
ad14a7d415 Update READMEs 2023-09-17 00:21:36 +02:00
Julio Castillo
9c878dc9cf Fix tests for new KMS IAM interface 2023-09-17 00:21:36 +02:00
Julio Castillo
da883bab8c Update kms module key-level IAM 2023-09-17 00:21:36 +02:00
Oliver Frolovs
6eb862a775 GKE cluster modules: add optional kube state metrics (#1682)
* `gke-cluster-standard`: add optional kube state metrics
* `gke-cluster-autopilot`: add optional kube state metrics

* FAST: add kube state metrics support for GKE
* blueprints/gke: add kube state metrics support

* Bump up the provider version to `v4.82.0`
2023-09-15 12:18:45 +01:00
Julio Castillo
f3be29cbc9 Fix tests 2023-09-15 00:27:55 +02:00
Oliver Frolovs
b3dc91b5cd Upgrades to monitoring_config in gke-cluster-*, docs update, and cosmetics fixes to GKE cluster modules (#1680)
* gke-cluster-standard: upgrade `monitoring_config` to use object style. Add tests.
* gke-cluster-standard: update docs

* gke-cluster-autopilot: move gateway_api_config block (cosmetic change)
* gke-cluster-autopilot: update docs and fix typos

* Update blueprints due to `monitoring_config` changes in `gke-cluster-standard`.
* Update FAST due to `monitoring_config` changes in `gke-cluster-standard`.
* Update docs for affected blueprints and FAST stages
2023-09-14 23:25:57 +01:00