Commit Graph

765 Commits

Author SHA1 Message Date
Ludovico Magnocavallo
11d7edac64 Add example to FAST GKE stage, streamline GKE Hub module variables and usage (#1977)
* implement optionals in gke-hub module

* simplify gke hub module call in mc mesh blueprint

* simplify gke hub module call and variables in multitenant blueprint

* gke hub inventory

* provide cluster and fleet examples in stage
2024-01-20 10:06:38 +00:00
lcaggio
208902c8da Fix Data platform foundation (#1992)
* FAST + Minimal DP

* Fix tests

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-01-20 08:49:46 +01:00
Aurélien Legrand
eee6aaff2c Network dashboard - fixing 2 bugs: overriden variable and page token … (#1976)
* Network dashboard - fixing 2 bugs: overriden variable and page token not handled properly

* changing pageToken in the regexp
2024-01-15 14:28:17 +01:00
Julio Diez
e623fa4a66 Merge branch 'master' into jd/serverless-program 2024-01-05 21:49:12 +01:00
Julio Diez
8435ad85f3 Address some style comments 2024-01-05 21:48:02 +01:00
Wiktor Niesiobędzki
6c258e6562 Fix description 2023-12-29 12:09:16 +01:00
Wiktor Niesiobędzki
1eea077460 Add service account email to outputs to manage its permissions 2023-12-29 12:09:16 +01:00
Wiktor Niesiobędzki
724dfda09c Provider doesn't set defaults on config
Can't provide just one size (like `web_server` or `triggerrer`) because
of no defaults are taken:
module.composer.google_composer_environment.env: Modifying... [id=***]
╷
│ Error: googleapi: Error 400: Found 6 problems:
│       1) You have to specify Scheduler CPUs not lower than 0.5.
│       2) You have to specify number of schedulers larger than 0.
│       3) You have to specify Web Server CPUs not lower than 0.5.
│       4) You have to specify Worker CPUs not lower than 0.5.
│       5) You have to specify minimum number of workers larger than 0.
│       6) Triggerer memory must be between 1.00GB and 6.50GB for given vCpu

So provide the defaults as set workloads_config == null
2023-12-29 12:09:16 +01:00
Julio Diez
6bad85d758 Update related serverless READMEs 2023-12-29 11:14:16 +01:00
Julio Diez
3685eb8493 Fix tftest values 2023-12-28 20:30:10 +01:00
Julio Diez
bae9845f4b Update README 2023-12-28 20:06:11 +01:00
Julio Diez
2e500c69a7 Avoid permadiff in launch_stage 2023-12-28 17:57:15 +01:00
Julio Diez
2ca24d320e Use of new module cloud-run-v2 2023-12-28 17:30:41 +01:00
Julio Diez
8889c18690 Merge branch 'master' into jd/serverless-program 2023-12-27 12:31:09 +01:00
Simone Ruffilli
87548f9739 Networking Sandbox Blueprint (#1939)
This blueprint creates a networking playground showing a number of different VPC connectivity options:

Hub and spoke via HA VPN
Hub and spoke via VPC peering
Interconnecting two networks via a network virtual appliance (aka NVA)
On top of that, this blueprint implements Policy Based Routing (aka PBR) to show how to force all traffic within a VPC to be funneled through an internal network passthrough load balancer, to implement an Intrusion Prevention System (IPS). PBR is enabled in the hub VPC, matching all traffic originating from within that VPC.
2023-12-21 17:50:38 +01:00
simonebruzzechesse
717f7ecad1 Blueprints naming convention update (#1942)
* update network-dashboard and quota-monitoring naming convention
2023-12-21 17:02:25 +01:00
Simone Ruffilli
0255c80e90 Move squid to __need_fixing (#1936)
* Moved `modules/cloud-config-container/squid` to __need_fixing
* Moved `blueprints/networking/filtering-proxy{,-psc}` to __need_fixing
2023-12-19 14:27:37 +00:00
Ludovico Magnocavallo
21562eefbe don't fail quota fetch on deleted project (#1931) 2023-12-15 20:20:49 +01:00
simonebruzzechesse
c50b732c79 Allow granting network user role on host project from project module and factory (#1930)
* Update shared vpc config for project factory and project module for more granular Shared VPC configuration

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-12-15 14:39:21 +01:00
maunope
1dc6965694 Update quota monitor blueprint to support project discovery (#1924)
* fist test

* dev complete

* update tf with permissions, enabled APIs and discovery root management

* updated readme

* moved projects discovery to a separate method

* reviewed Mauri's changes

* add missing lines from last change

* - fixed discovery page size to 100
- removed last_asset_page_reached var from discover_projects
- added cast to list for projects var in _main, to make the script work both using CLI and pub/sub

* fixed discovery_root default value to work when no value is passed

* fixed tfdoc

* fixed tftest resources #

---------

Co-authored-by: Ludo <ludomagno@google.com>
2023-12-12 19:17:01 +01:00
Ludovico Magnocavallo
bba814c091 Custom role factories for organization and project modules (#1912)
* backport custom role factories

* backport from fast ci/cd branch

* indent

* tfdoc

* fix module tests
2023-12-11 14:16:39 +00:00
Wiktor Niesiobędzki
886734e1e9 Add trigger configuration for Composer (#1916) 2023-12-11 12:54:49 +01:00
Ludovico Magnocavallo
f548b65b1c Add support for subnet-level service network user grants to project module, improve docs (#1907)
* improve project factory example

* light refactor of project modules shared vpc internals and docs

* add support for subnet-level grants on host project
2023-12-07 09:07:48 +00:00
apichick
66bd9d5160 Added workstation-cluster module 2023-11-30 07:02:28 +01:00
Luca Prete
bb58469292 Fixes to F5 blueprint docs (#1886)
Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-24 19:45:38 +01:00
luigi-bitonti
98accdb3ad Added PSC support to CloudSQL Module (#1874)
* Added Feature

* Added PSC to CloudSQL module

* Added psc to read replica

* Changed variables

* Updated README

* Ran fmt

* Removed old variables

* Fix README

* Fixed blueprints

* Fix README

* Fixed output

* Added more outputs and bug fixes

* Changed variable structure

* Bug fix

* Added PSC example.
2023-11-24 15:47:45 +01:00
Luca Prete
56fcb4f88a F5 deployment blueprint (#1883)
Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-24 14:02:34 +01:00
Luca Prete
525fc91d5c Fixes/improvements to F5 HA blueprint (#1882)
Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-23 16:15:47 +01:00
Luca Prete
642f65b841 F5 blueprint (#1787)
---------

Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-22 19:48:13 +01:00
Wiktor Niesiobędzki
9ff67fdaf0 Add DLP Service Agent role 2023-11-20 15:34:27 +01:00
ddaluka
543ea6e7f3 Fix/dlpagent (#1868)
Create DLP Service Account on service activation.
2023-11-20 14:11:01 +01:00
Aurélien Legrand
1f344b65e6 Net dash cfv2 (#1859)
* Handling SQL IP address issue

* reverting one change

* Improving this fix based on wiktor's feedback

* formatting

* Adding supporting for Cloud Function v2 (60 minutes timeout vs 9 minutes timeout)

* Removing useless comment

* formatting

* updating inputs/outputs documentation

* feedback from Julio

* formatting

* python formatting

* formatting

* formatting

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-11-16 14:45:44 +00:00
Wiktor Niesiobędzki
63f1dfb6de end-to-end tests for Vertex blueprint 2023-11-15 11:04:12 +00:00
Francesco Spinelli
1c2f1c7b0d Sql user features (#1856)
* added user type feature

* fix readme

* fix comment

* fix blueprint cloudsql users value + minor fix

* readme fix

* variables fix

* local var fix

* fix for in local var

* fix on readme

* fix intentations var in readme

* fix blueprint user quote

---------

Co-authored-by: Francesco Spinelli <francesco.spinelli@nttdata.com>
2023-11-13 10:27:14 +01:00
luigi-bitonti
d07f8fd33d Added CMEK for Secret auto managed (#1739)
Allow to specify custom KMS keys for Secret Manager secrets
2023-11-10 16:45:47 +01:00
Francesco Spinelli
82c74e4ab6 Dataproc module bug fix (#1848)
* bug fix

* bug fix

* fix dinamic for_each

---------

Co-authored-by: Francesco Spinelli <francesco.spinelli@nttdata.com>
2023-11-09 15:48:29 +00:00
Ludovico Magnocavallo
03937f2b6e Support multilevel data and allow overriding project id in project factory (#1851) 2023-11-09 08:29:46 +00:00
Julio Diez
521b9c7ef2 Update README.md 2023-11-02 13:40:31 +01:00
Julio Diez
c536e27945 Use CR IAM binding instead of IAM policy 2023-11-02 13:40:31 +01:00
Julio Diez
8e76e5ee05 Group default URLs output 2023-11-02 13:40:31 +01:00
Julio Diez
14cca9d1b5 Rename to ip_configs to follow same naming 2023-11-02 13:40:31 +01:00
Julio Diez
21d997c00a Refactor into image_configs variable 2023-11-02 13:40:31 +01:00
Julio Diez
fd74562a41 Refactor into project_configs variable 2023-11-02 13:40:31 +01:00
Wiktor Niesiobędzki
2664161c24 Simplify #1836 fix, Avoid map-related casting errors in project factory 2023-11-02 09:12:38 +00:00
Ludovico Magnocavallo
de0325b3a3 Avoid map-related casting errors in project factory (#1836)
* try to repro pf example error

* repro

* repro

* pf fix

* remove extra file

* FAST stage
2023-11-02 08:24:50 +01:00
lcaggio
a0ae43fc6f [Minimal Data Platform] Fix Landing and curated IAM (#1832)
* Fix IAM on Minimal DP

* fix
2023-11-01 17:53:06 +01:00
Aurélien Legrand
d9589f56a1 Handling SQL IP address issue (#1825)
* Handling SQL IP address issue

* reverting one change

* Improving this fix based on wiktor's feedback

* formatting
2023-10-31 16:20:28 +01:00
Luca Prete
28e5c4e2da [net-address] enable ipv6 (#1821)
---------

Co-authored-by: Luca Prete <lucaprete@google.com>
2023-10-31 16:20:28 +01:00
Julio Diez
0ac7bc838f Update README tests and tfdoc 2023-10-31 16:20:27 +01:00
Julio Diez
2fb387bd8b Simplify ip_ranges structure 2023-10-31 16:20:27 +01:00