Commit Graph

845 Commits

Author SHA1 Message Date
Julio Castillo
52b56aa84a Add generic URL output to modules/artifiact-registry (#2448) 2024-07-25 10:33:01 +02:00
Julio Castillo
c0bf32e797 Refactor service agent management (#2423)
* Service agents script

* Service agents update

* WIP

* Update script and terraform

* Fix tests

* Fix linter

* Update docs

* Bring back pf example inventory

* Fix tests

* Fix more tests

* Fix tests

* Use dataclasses for build_service_agents.py

* Remove unneeded field() from build_service_agents

* Re-enable CMEK depends_on in project outputs

* Update tools/requirements.txt

* Enable storage in GCS example projects

* Fix tests

* Add CMEK Service Agents dependencies for services

* Fix typos and data platform cmek

* More typos
2024-07-23 22:05:38 +02:00
Ludovico Magnocavallo
485442af03 reintroduce docker image path output in AR module (#2433) 2024-07-20 06:49:59 +00:00
Jay Bana
2a2c4a96ce Add support for sqlAssertion AutoDQ rule type in dataplex-datascan (#2416)
* Add sql_assertion rule type to Dataplex AutoDQ data_quality_spec

* Fix broken link to API reference public doc for DQ spec

* Update README.md after linting

* Add example tests for dataplex-datascan

* Bump provider versions

* Bump provider versions everywhere
2024-07-09 21:29:45 +00:00
Wiktor Niesiobędzki
22684f49e7 Fix tutorial error.
Without versions override it fails with:
 Error: Failed to query available provider packages
│
│ Could not retrieve the list of available versions for provider hashicorp/kubectl: provider registry registry.terraform.io does not have a provider named registry.terraform.io/hashicorp/kubectl
│
│ All modules should specify their required_providers so that external consumers will get the correct providers when using a module. To see which modules are currently depending on hashicorp/kubectl, run the following command:
│     terraform providers
2024-06-29 08:55:33 +02:00
Julio Castillo
4e8adc9c43 Update modules/artifact-registry with newly-released features. (#2396)
Fixes #2377
2024-06-28 19:52:25 +02:00
apichick
1174604efe Added forward_proxy_uri to apigee environments in apigee-x-foundations blueprint (#2392) 2024-06-27 19:48:24 +02:00
Alejandro Leal
99dd335cdf Update tutorial.md 2024-06-27 07:36:19 +02:00
Alejandro Leal
0363e2cb80 Several wording and typos updates
Several wording and typos updates
2024-06-27 07:36:19 +02:00
apichick
3933a747fe Fixes related to Apigee KMS keys (#2382)
* Fixes related to Apigee KMS keys

* tfdoc

---------

Co-authored-by: Ludo <ludomagno@google.com>
2024-06-26 06:12:26 +00:00
apichick
73e286c0ab Added spanner-instance module (#2372) 2024-06-23 17:25:22 +00:00
Ludovico Magnocavallo
fa00deb747 Support GCS objects in cloud function modules bundles (#2361)
* cloud function v2

* cloud function v1

* blueprints
2024-06-14 11:44:01 +00:00
Ludovico Magnocavallo
97d77d263b support pre-made bundle archives in cloud function modules (#2358) 2024-06-13 14:58:23 +02:00
Konrad Schieban
330fe0096b Add GCVE Logging and Monitoring Blueprint (#2347)
---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-06-11 14:36:23 +00:00
Wiktor Niesiobędzki
f0c83c4f91 Add Terraform installation step to meet the versions.tf requirements 2024-06-11 15:40:31 +02:00
dependabot[bot]
e15426111c Bump @grpc/grpc-js (#2355)
Bumps [@grpc/grpc-js](https://github.com/grpc/grpc-node) from 1.10.7 to 1.10.9.
- [Release notes](https://github.com/grpc/grpc-node/releases)
- [Commits](https://github.com/grpc/grpc-node/compare/@grpc/grpc-js@1.10.7...@grpc/grpc-js@1.10.9)

---
updated-dependencies:
- dependency-name: "@grpc/grpc-js"
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-11 07:21:41 +02:00
simonebruzzechesse
1969b02ed8 Alloydb add support for psc (#2341)
* alloydb add support for psc
* add tag binding support

Co-authored-by: Wiktor Niesiobędzki <wiktorn@google.com>
2024-06-05 13:39:03 +02:00
Luca Prete
eb5754e475 [FAST] Rename stage 2-networking-d-separate-envs to 2-netwroking-c-separate-envs (#2328)
Co-authored-by: Luca Prete <lucaprete@google.com>
2024-05-31 09:09:31 +03:00
Wiktor Niesiobędzki
f8f18734f1 Add pre-commit hook configuration (#2326)
* Pre-commit config

Run following linters on commit:
Terraform:
- terraform fmt
- terraform tflint

Python specific:
- yapf

Shell scripts
- shellcheck
- shfmt

YAML files:
- yamllint (disabled as of now)
- check-yaml

Other:
- end-of-file-fixer
- trailing-whitespace fixer

Fabric specific
- tools/tfdoc.py
- tools/check_boilerplate.py

* linting fixes

* Fix boilerplate check
2024-05-30 19:35:09 +02:00
Julio Diez
c205a692a3 Kong Gateway on GKE offloading to Cloud Run (#2299)
* First working version including certificates and HTTPS.

It uses a mix of self-managed certificates and the CA Service.

* One CR service only behind the ILB

* Functional deployment including auto-configuration

A k8s job configures the root certificate, service and route in the admin
api to reach the CR service via Kong proxy.

* Admin API exposed internally only, and some cleanup

* Some name changes

* README

* Remove data source for the vpc and subnet

* Remove data source for Kubernetes services

* Update README

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-05-29 16:26:25 +02:00
fulyagonultas
0d60e39aee resource_labels added to the node_config nodepool (#2317)
* resource_labels added to the node_config nodepool

* labels added to the gke standard module

* labels set to mandatory

* Updating variables names

* Fix nodepool label variables defaults

* Fix tests

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-05-29 14:56:15 +02:00
simonebruzzechesse
f4f891d4f1 Gitlab Runner blueprint (#2106)
* add gitlab runner blueprint

* use secret manager to store auth token
small updates and improvements
2024-05-27 10:34:34 +02:00
Ludovico Magnocavallo
dc686c3a84 Remove default location from gcs module (#2303)
* gcs module

* blueprints/apigee/bigquery-analytics

* tfdoc

* pubsub README md syntax
2024-05-24 07:02:33 +00:00
dependabot[bot]
524390b641 --- (#2296)
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-21 07:20:53 +00:00
Simone Ruffilli
887c7e7926 Unify VPN and Peering FAST stages (#2284)
* Unify VPN and Peering FAST stages
2024-05-16 12:18:32 +03:00
Simone Ruffilli
d3ffcc2b1c Disable reserved_internal_range in net-vpc due to provider bug (#2282) 2024-05-15 05:46:18 +00:00
dependabot[bot]
8a9eb0f493 Bump express (#2278)
Bumps [express](https://github.com/expressjs/express) from 4.18.2 to 4.19.2.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.18.2...4.19.2)

---
updated-dependencies:
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-05-14 21:30:35 +02:00
Simone Ruffilli
9a26fe8635 Add support for reserved_internal_range in net-vpc (#2275)
Adds support for reserved_internal_range to net-vpc
2024-05-14 22:19:45 +03:00
apichick
f41d8059ea Added missing apigee org attributes to apigee x foundations blueprint (#2277) 2024-05-14 18:48:05 +00:00
dependabot[bot]
dfbb2c0bc0 Bump protobufjs, @google-cloud/logging-bunyan and @google-cloud/monitoring (#2279)
Bumps [protobufjs](https://github.com/protobufjs/protobuf.js) to 7.2.6 and updates ancestor dependencies [protobufjs](https://github.com/protobufjs/protobuf.js), [@google-cloud/logging-bunyan](https://github.com/googleapis/nodejs-logging-bunyan) and [@google-cloud/monitoring](https://github.com/googleapis/google-cloud-node/tree/HEAD/packages/google-cloud-monitoring). These dependencies need to be updated together.


Updates `protobufjs` from 7.2.4 to 7.2.6
- [Release notes](https://github.com/protobufjs/protobuf.js/releases)
- [Changelog](https://github.com/protobufjs/protobuf.js/blob/master/CHANGELOG.md)
- [Commits](https://github.com/protobufjs/protobuf.js/compare/protobufjs-v7.2.4...protobufjs-v7.2.6)

Updates `@google-cloud/logging-bunyan` from 5.0.0 to 5.1.0
- [Release notes](https://github.com/googleapis/nodejs-logging-bunyan/releases)
- [Changelog](https://github.com/googleapis/nodejs-logging-bunyan/blob/main/CHANGELOG.md)
- [Commits](https://github.com/googleapis/nodejs-logging-bunyan/compare/v5.0.0...v5.1.0)

Updates `@google-cloud/monitoring` from 3.0.5 to 4.0.0
- [Release notes](https://github.com/googleapis/google-cloud-node/releases)
- [Changelog](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-monitoring/CHANGELOG.md)
- [Commits](https://github.com/googleapis/google-cloud-node/commits/kms-v4.0.0/packages/google-cloud-monitoring)

---
updated-dependencies:
- dependency-name: protobufjs
  dependency-type: indirect
- dependency-name: "@google-cloud/logging-bunyan"
  dependency-type: direct:production
- dependency-name: "@google-cloud/monitoring"
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-14 20:37:16 +02:00
apichick
ff6f6bb32a Added apigee-x-foundations blueprint (#2274) 2024-05-14 14:53:38 +00:00
apichick
ab174274de Added new attributes Apigee organization and bumped up providers version (#2243) 2024-04-28 17:31:42 +02:00
Vince Gonzalez
2446b4dd7c Update README.md (#2239) 2024-04-26 01:14:32 +02:00
Tomislav O
59084fa853 docs: 📝 fix error in phpIPAM terraform config by updating VPC peering settings (#2230) 2024-04-22 10:55:03 +00:00
dependabot[bot]
0454fd681d Bump golang.org/x/net (#2227)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.17.0 to 0.23.0.
- [Commits](https://github.com/golang/net/compare/v0.17.0...v0.23.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-04-19 14:26:14 +02:00
dependabot[bot]
55a345ebac Bump golang.org/x/net (#2228)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.17.0 to 0.23.0.
- [Commits](https://github.com/golang/net/compare/v0.17.0...v0.23.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-19 14:25:51 +02:00
simonebruzzechesse
b6771ae7ad fix cloud sql PSA after module upgrade (#2226)
* fix cloud sql PSA after module upgrade
add proxy subnet for ILB
* fix cloud run service accessible from public url in case the service is privately deployed
* add deletion_policy variable in psa_configs for net-vpc module
fix destroy issue with phpIPAM blueprint
2024-04-19 12:41:02 +02:00
Julio Castillo
3af7e257d2 Add tflint to pipelines (#2220)
* Fix terraform_deprecated_index

https://github.com/terraform-linters/tflint-ruleset-terraform/blob/v0.5.0/docs/rules/terraform_deprecated_index.md

* Fix terraform_deprecated_interpolation

Reference: https://github.com/terraform-linters/tflint-ruleset-terraform/blob/v0.5.0/docs/rules/terraform_deprecated_interpolation.md

* Fix more indexing

* Remove unused variable

* Enable TFLint for modules

* Add tflint config file

* Fix chdir

* Lint modules

* TFLint fixes

* TFLint

* Fixes binauthz README

* Fixes DNS response policy tests. Restores MIG outputs.

* Fixes other DNS response policy tests.

* Update tests for fast 2-e

* Moar fixed tests

---------

Co-authored-by: Simone Ruffilli <sruffilli@google.com>
2024-04-17 10:23:48 +02:00
Ludovico Magnocavallo
9414779cc2 Allow multiple PSA service providers in net-vpc module (#2218)
* allowing multiple PSA service providers in net-vpc module

* tfdoc

* tfdoc

* Add tfvars/yaml tests

* fix module and tests

* re-enable inventory

* merge fix

* Add multiple PSA test case

* fix cloudsql example

---------

Co-authored-by: Wiktor Niesiobędzki <wiktorn@google.com>
2024-04-16 15:02:36 +00:00
Julio Castillo
395903ce6a Update README.md 2024-04-11 06:47:12 +02:00
Ben Swenka
1b44af595c Updated diagram to better reflect PSC terminology (#2208) 2024-04-09 15:18:43 +00:00
Tone
2831af09fa feat(gke-cluster-standard): Add optional CiliumClusterWideNetworkPolicy (#2207)
* feat(gke-cluster-standard): Add optionnal `CiliumClusterWideNetworkPolicy`

Add `CiliumClusterWideNetworkPolicy` option on cluster.

Ref:
 - https://registry.terraform.io/providers/hashicorp/google/latest/docs/resources/container_cluster#enable_cilium_clusterwide_network_policy
 - https://cloud.google.com/kubernetes-engine/docs/how-to/configure-cilium-network-policy

* feat(gke-cluster-standard): Update Google provider to manage new feature

* feat(gke-cluster-standard): Move `cilium_clusterwide_network_policy` to `enable_features` field

* fix(scheduled-asset-inventory-export-bq): Set `dataset_id` with underscores

* fix(bigquery-dataset): Set `dataset_id` with underscores
2024-04-09 17:08:36 +02:00
bluPhy
c420f17636 Updating cloud-run-v2 terraform and some typos (#2201)
* Updating cloud-run-v2 terraform and some typos

Updating modules/cloud-run-v2/main.tf to determine the tcp_socket value

Fixin typos in:
tests/fixtures.py
modules/workstation-cluster/README.md
modules/net-lb-int/README.md
modules/dataplex/README.md
modules/dataform-repository/README.md
modules/__docs/20230816-iam-refactor.md
CONTRIBUTING.md
blueprints/third-party-solutions/f5-bigip/f5-bigip-ha-active/startup-script.tpl
blueprints/third-party-solutions/f5-bigip/f5-bigip-ha-active/README.md

* Update README.md

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Ludovico Magnocavallo <ludo@qix.it>
2024-04-07 09:49:07 +00:00
Elia
b80132a618 FAST GCVE stage (#2191)
* GCVE stage prerequisites

* fix gcve prereq

* gcve stage first deploy

* Updated readme filex

* docs updated

* some fixes after testing

* updated readme files

* elia fix

* gcve net admin custom role

* gcve net admin custom role

* elia fix

* ven peering deploy

* elia fix

* added blueprint and stage tests

* Edits to Readme files

* typo in outputs

* clean-up

* gcve stage tests fix

* readme fix

* fix sorting

* fix copyrights and readme file

* fix test

* fix copyright

* fixed gcve feature flag cond.

* removed validation

* fixed typo

* fixed typo

* fixed gcve tests

* fixed typo

* fixed typo

* fixed sorting

* fixed sorting

---------

Co-authored-by: Konrad Schieban <kschieban@google.com>
2024-04-03 17:25:12 +02:00
dependabot[bot]
4e8f60e8e2 Bump express from 4.17.3 to 4.19.2 in /blueprints/gke/binauthz/image (#2181)
Bumps [express](https://github.com/expressjs/express) from 4.17.3 to 4.19.2.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.17.3...4.19.2)

---
updated-dependencies:
- dependency-name: express
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-28 07:14:50 +01:00
Wiktor Niesiobędzki
f2806f347b Bump provider version to 5.18, so fix non-empty plan for google_notebooks_instance 2024-03-25 19:57:14 +01:00
Ludovico Magnocavallo
a590deb58b Fix subnet configuration in cloud nat module (#2171)
* support optional secondary ranges in net-cloudnat module

* fix subnet configuration

* fix packer blueprint
2024-03-22 15:59:02 +01:00
Ludovico Magnocavallo
5ac86ecae7 Support advanced_datapath_observability in gke cluster standard module (#2168)
* support advanced_datapath_observability in gke cluster standard module

* bump provider to 5.17.0
2024-03-22 08:25:43 +01:00
Ludovico Magnocavallo
e051cf42a1 stub READMEs for the removed hub and spoke blueprints (#2169) 2024-03-22 06:48:46 +00:00
Julio Castillo
93e9909166 Fix typo in kafka pattern 2024-03-13 17:59:07 +03:00