Commit Graph

23 Commits

Author SHA1 Message Date
Simon Roberts
81b70695ac Add parameter to modules/pubsub to support message_storage_policy.enforce_in_transit (#3761)
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2026-02-24 17:58:43 +01:00
Julio Castillo
d46b39b717 Add missing context interpolations (#3659) 2026-01-20 20:21:56 +01:00
Ludovico Magnocavallo
36648b6b63 FAST light implementation (#3255)
* data wip

* wip data

* update org schema, add note on expansion

* all schemas, workload notes

* Update WORKLOG.md

* Update WORKLOG.md

* Update WORKLOG.md

* Update WORKLOG.md

* wip

* data wip

* wip

* wip

* wip

* wip

* org module IAM context (using lookup)

* new-style context expansion in project IAM

* remove spurious file

* project module contexts

* finalize context replacement format for project module

* revert org module changes

* fix tag id interpolation in project

* fix tag id interpolation in project

* organization module context

* organization context test

* context expansion for folder tag bindings

* test context expansion for tag bindings

* service account module context

* simplify context local

* context for iam service account

* nuke blueprints

* remove links to blueprints

* vpc sc context in project module

* Add context to GCS module

* Add inline deps to plan_summary script

* Make context a top-level variable for folder, organization, sa

* Add add context top-level to VPC-SC

* move context out of factories_config variable

* tfdoc

* fix merge

* fix merge

* fix examples

* net-vpc module context

* add parent ids to folder context

* rename folder parent context

* fix folder parent check

* new project factory stub

* wip

* wip

* refactor defaults

* project iam

* bueckts and service accounts

* start adding context replacements

* better test data

* automation resources for folders and projects

* automation

* add support for project id interpolation

* first tested apply

* improve IAM description in gcs module

* add context to billing account module

* add notification channels to billing account module context

* add billing budgets to new pf

* schemas and defaults

* bootstrap wip

* bootstrap wip

* bootstrap wip

* pf outputs

* pf fixes

* fix pf sample data

* bootstrap lite fixes

* add locations to organization module contexts

* bootstrap lite fixes

* org fixes, billing accounts

* fix default project parent

* bootstrap lite wip

* add locations to gcs module context

* add context support to logging bucket module

* add context to pubsub module

* split out iam variables in gcs module

* fix logging bucket context test

* bootstrap log sink destinations

* streamline logging-bucket module variables

* fix logging bucket context test

* align logging bucket module interface in fast bootstrap

* add support for project-level log buckets to project factory

* support full context expansion in organization module log sinks

* log buckets in fast-lite bootstrap

* make og sink type optional in organization module

* log sinks in fast-lite bootstrap

* set tag values in factory context

* bootstrap lite data

* output files schema

* billing account schema

* output files

* output providers

* gcs output files

* boilerplate

* tflint

* check documentation

* check docs

* fix project module parent variable validation

* fix log bucket examples

* allow null parent in project module

* silence folder test errors

* fix billing account sink example

* fix project example

* fix billing account module

* fix folder tests

* fix FAST

* fix fast

* tfvars outputs

* wif

* cicd service accounts

* cicd

* allow defaults in context, minimal org policies

* support gcs managed folders in project factory and bootstrap lite

* support prefix in provider output files

* rename bootstrap stage

* gitignore

* gitignore

* security folder, billing IAM

* wip tfvars

* fix typo

* security IAM

* control tag iam/context via variables in organization module

* split tag creation from tag IAM to avoid circular refs

* port organization module tag changes to project module

* implement new-style context expansion in vpc-sc module

* fix fast vpc-sc tests

* boilerplate

* vpc sc stage

* schemas

* fast-lite compatibility for vpc sc stage

* make log project number optional in vpc-sc stage

* networking

* networking

* networking

* networking

* rename and move new stage under fast

* clone pf tests

* use context replacement for internal notification channels in billing account module

* support service agents in project module iam context replacements

* support service agents in project module iam context replacements

* add support for kms keys to project module context

* experimental pf example test and fixes

* fix schemas

* fix tests

* tfdoc

* tfdoc

* pf config

* experimental pf

* remove redundant dot from gcs managed folder IAM keys

* bootstrap experimental test

* project factory exp stage test

* skip tflint for bootstrap experimental test

* tflint

* fix gcs test

* documentation work

* documentation work

* Update README.md

* tfdoc

* tfdoc

* readme

* tfdoc

* readme

* readme

* readme

* readme

* support universe in pf exp projects

* missing universe service agents

* org policies import, non-admin billing IAM

* todo

* fix test

* custom constraints

* fast classic dataset

* fix test data

* context replacements in billing module log sinks

* fix typo

* add support for billing log sinks

* update docs

* readme

* cicd fix and test

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2025-09-02 08:38:57 +02:00
simonebruzzechesse
62321d3054 hotfix push subscription in pubsub module (#2974) 2025-03-20 20:22:43 +01:00
Ludovico Magnocavallo
2b378f4b3a port and fix changes from #2677 (#2682) 2024-11-14 11:05:36 +00:00
mdaddetta
bbf81752a4 Add use_table_schema parameter for PubSub subscription to BigQuery (#2357) 2024-06-12 22:36:19 +00:00
Ludovico Magnocavallo
dc686c3a84 Remove default location from gcs module (#2303)
* gcs module

* blueprints/apigee/bigquery-analytics

* tfdoc

* pubsub README md syntax
2024-05-24 07:02:33 +00:00
Julio Castillo
9d61c6e26d Update IAM for pubsub topics and subscriptions 2023-09-17 00:21:36 +02:00
Luigi Bitonti
f2fc67d72d Added possibility to use gcs push endpoint on pubsub subscription 2023-09-13 15:13:13 +02:00
Israel Herraiz
e692eac867 Add BigQuery subcriptions to Pubsub module.
Pubsub can now have subscriptions that write directly to BigQuery.
 * https://cloud.google.com/pubsub/docs/bigquery

In the Google Terraform provider, this is configured using an additional block
inside a `google_pubsub_subscription` resource.
 * https://registry.terraform.io/providers/hashicorp/google/latest/docs/resources/pubsub_subscription#nested_bigquery_config

This PR adds a new input variable to the `pubsub` module, to optionally add this
block to some of the subscriptions defined in the module.
2022-11-21 17:43:17 +01:00
Israel Herraiz
3f4fa74729 Address reviewer comments. 2022-11-20 16:32:37 +01:00
Israel Herraiz
54e9738c39 Add schemas to Pubsub topic module.
Pubsub topics can now have
schemas (https://cloud.google.com/pubsub/docs/admin#schemas). This PR adds an
option to set the schema settings and create a new optional resource of type
`google_pubsub_schema` attached to the `google_pubsub_topic`.
2022-11-20 13:26:33 +01:00
Ludovico Magnocavallo
d9ea825ea5 add support for topic message duration (#732) 2022-07-12 09:23:23 +02:00
flaprimo
a1b66c2ba1 Add subscription filter support to PubSub module (#632)
* add subscription filters to pubsub module

* add tfdoc

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-04-30 11:25:50 +02:00
Simone Ruffilli
ee25965c89 Copyright bump (#410) 2022-01-01 15:52:31 +01:00
Julio Castillo
1d13e3e624 Add more validations to linter
- Ensure all variables and outputs are sorted
- Ensure all variables and outputs have a description
- Add data-solutions/data-platform-foundations to linter

Fix all modules to follow these new conventions.
2021-10-08 18:26:04 +02:00
Julio Castillo
c2e23001b7 Fix formatting 2021-08-12 10:07:27 +02:00
Noah Dungey
4f91e3039b Fixed typo in max_delivery_attempts variable name.
Fixed type in max_delivery_attempts variable name.
2021-08-11 15:48:38 -06:00
lcaggio
d1b560c76d Fix message_retention_duration type (#261)
* Fix message_retention_duration type

* Fix Readme and update Changelog

* Update CHANGELOG.md

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2021-06-10 18:46:14 +02:00
Julio Castillo
1e11c670f5 Update copyright to 2021 2021-02-15 09:38:10 +01:00
Ludovico Magnocavallo
3a4938874b rename iam variables in pubsub module 2020-11-05 21:28:34 +01:00
Julio Castillo
82a1fe3c20 Removing iam_roles from multiple modules
This commits removes the iam_roles variables from the modules:
 - artifact-registry
 - bigtable-instance
 - cloud-function
 - container-registry
 - endopoints
 - pubsub
 - source-repository
2020-10-30 18:58:07 +01:00
Ludovico Magnocavallo
bd73e1ade9 New pubsub module (#73)
* pubsub module, untested

* fixed a few errors
2020-05-11 17:51:00 +02:00