Commit Graph

66 Commits

Author SHA1 Message Date
Wiktor Niesiobędzki
6673cba773 Fix provider failure when appling example 2025-10-13 18:58:52 +02:00
Ludovico Magnocavallo
08ccec3922 Make project id optional in GCS module (#3369)
* make project id optional in GCS module

* tfdoc
2025-10-02 16:23:23 +00:00
Ludovico Magnocavallo
bc6950e205 Rename FAST stages preparing for eventual deprecation (#3298)
* renames

* links

* readme

* docs

* update pf modules tests for renames

* condition_vars context in modules

* data platform dataset

* fix links in stage 3 docs

* schema changes

* schema docs

* tfdoc

* update duplicates check

* fast legacy tests

* legacy schema

* fix tests
2025-09-04 08:24:11 +02:00
Ludovico Magnocavallo
36648b6b63 FAST light implementation (#3255)
* data wip

* wip data

* update org schema, add note on expansion

* all schemas, workload notes

* Update WORKLOG.md

* Update WORKLOG.md

* Update WORKLOG.md

* Update WORKLOG.md

* wip

* data wip

* wip

* wip

* wip

* wip

* org module IAM context (using lookup)

* new-style context expansion in project IAM

* remove spurious file

* project module contexts

* finalize context replacement format for project module

* revert org module changes

* fix tag id interpolation in project

* fix tag id interpolation in project

* organization module context

* organization context test

* context expansion for folder tag bindings

* test context expansion for tag bindings

* service account module context

* simplify context local

* context for iam service account

* nuke blueprints

* remove links to blueprints

* vpc sc context in project module

* Add context to GCS module

* Add inline deps to plan_summary script

* Make context a top-level variable for folder, organization, sa

* Add add context top-level to VPC-SC

* move context out of factories_config variable

* tfdoc

* fix merge

* fix merge

* fix examples

* net-vpc module context

* add parent ids to folder context

* rename folder parent context

* fix folder parent check

* new project factory stub

* wip

* wip

* refactor defaults

* project iam

* bueckts and service accounts

* start adding context replacements

* better test data

* automation resources for folders and projects

* automation

* add support for project id interpolation

* first tested apply

* improve IAM description in gcs module

* add context to billing account module

* add notification channels to billing account module context

* add billing budgets to new pf

* schemas and defaults

* bootstrap wip

* bootstrap wip

* bootstrap wip

* pf outputs

* pf fixes

* fix pf sample data

* bootstrap lite fixes

* add locations to organization module contexts

* bootstrap lite fixes

* org fixes, billing accounts

* fix default project parent

* bootstrap lite wip

* add locations to gcs module context

* add context support to logging bucket module

* add context to pubsub module

* split out iam variables in gcs module

* fix logging bucket context test

* bootstrap log sink destinations

* streamline logging-bucket module variables

* fix logging bucket context test

* align logging bucket module interface in fast bootstrap

* add support for project-level log buckets to project factory

* support full context expansion in organization module log sinks

* log buckets in fast-lite bootstrap

* make og sink type optional in organization module

* log sinks in fast-lite bootstrap

* set tag values in factory context

* bootstrap lite data

* output files schema

* billing account schema

* output files

* output providers

* gcs output files

* boilerplate

* tflint

* check documentation

* check docs

* fix project module parent variable validation

* fix log bucket examples

* allow null parent in project module

* silence folder test errors

* fix billing account sink example

* fix project example

* fix billing account module

* fix folder tests

* fix FAST

* fix fast

* tfvars outputs

* wif

* cicd service accounts

* cicd

* allow defaults in context, minimal org policies

* support gcs managed folders in project factory and bootstrap lite

* support prefix in provider output files

* rename bootstrap stage

* gitignore

* gitignore

* security folder, billing IAM

* wip tfvars

* fix typo

* security IAM

* control tag iam/context via variables in organization module

* split tag creation from tag IAM to avoid circular refs

* port organization module tag changes to project module

* implement new-style context expansion in vpc-sc module

* fix fast vpc-sc tests

* boilerplate

* vpc sc stage

* schemas

* fast-lite compatibility for vpc sc stage

* make log project number optional in vpc-sc stage

* networking

* networking

* networking

* networking

* rename and move new stage under fast

* clone pf tests

* use context replacement for internal notification channels in billing account module

* support service agents in project module iam context replacements

* support service agents in project module iam context replacements

* add support for kms keys to project module context

* experimental pf example test and fixes

* fix schemas

* fix tests

* tfdoc

* tfdoc

* pf config

* experimental pf

* remove redundant dot from gcs managed folder IAM keys

* bootstrap experimental test

* project factory exp stage test

* skip tflint for bootstrap experimental test

* tflint

* fix gcs test

* documentation work

* documentation work

* Update README.md

* tfdoc

* tfdoc

* readme

* tfdoc

* readme

* readme

* readme

* readme

* support universe in pf exp projects

* missing universe service agents

* org policies import, non-admin billing IAM

* todo

* fix test

* custom constraints

* fast classic dataset

* fix test data

* context replacements in billing module log sinks

* fix typo

* add support for billing log sinks

* update docs

* readme

* cicd fix and test

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2025-09-02 08:38:57 +02:00
Julio Castillo
d3f0dc984e Upgrade provider to version 7.0.1 (#3291)
* Upgrade provider to version 7.0.1

* Update READMEs

* Bring back depends_on for services and jobs
2025-09-01 17:29:20 +02:00
Ludo
0a2cc6e763 Merge remote-tracking branch 'origin/master' into fast-dev 2025-07-07 10:19:23 +02:00
Julio Castillo
b8efcc5d89 Add IP filtering support to modules/gcs (#3216)
* Add IP filtering to GCS

* Bump provider version
2025-07-04 18:57:32 +00:00
Liam Nesteroff
f07e4f64e9 Standardise reuse variable from project module and implement for net-vpc (#3205)
* exposing the network_id from the net-vpc module for use with tag bindings

* convert vpc_create to vpc_reuse

* Changed the reuse vars to standardised attributes

* fixed readme tests and schemas

* modified apigee blueprint to use vpc_reuse with network_id passthrough

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2025-07-03 09:12:05 +10:00
Wiktor Niesiobędzki
2809570651 Fix E2E tests 2025-02-23 18:19:28 +01:00
Wiktor Niesiobędzki
58f22ce647 Add prefix to KMS ring, to allow easy recreate 2025-02-10 00:56:19 +01:00
Julio Castillo
8a2320311d Add bucket_create to modules/gcs (#2827)
* Add `bucket_create` to `modules/gcs`

* Create local with bucket name

* Update variable description

* Fix bucket output

* Fix tests

* Fix tests

* Bump OpenTofu to 1.9.0 (needed for multi-var validations)
2025-01-21 23:48:36 +01:00
Julio Castillo
c60d152f4a Add hierarchical namespace support to GCS module (#2712)
* Add hierarchical namespace support to GCS module

* remove empty iap block from inventories

* Fix tests

* Add new hns inventory

---------

Co-authored-by: Ludo <ludomagno@google.com>
2024-11-18 11:41:49 +00:00
kejti23
caddfef424 add enable_object_retention argument (#2657)
* add enable_object_retention argument

* add enable_object_retention argument - solve linting error

* add enable_object_retention argument - fix variable ending
2024-11-05 17:27:29 +01:00
Wiktor Niesiobędzki
4cda94c185 Better fix for ffa2602 2024-11-04 10:34:54 +01:00
Ludo
ffa2602e5e add support for cmek in gcs module notification topic 2024-11-04 09:03:24 +01:00
Wiktor Niesiobędzki
44a4268afc Fix E2E tests 2024-09-04 12:16:50 +02:00
Julio Castillo
f57635d044 Add managed folders suports to gcs module (#2530)
* Add RPO, make versioning dynamic

* Add manaed folders

* Change autoclass and cors defaults to null

* Update README

* Add iam_by_principals

* Add managed folders var description

* Remove need for managed folders to end in /

* Add inventory to example

* Update readme

* Fix FAST tests
2024-08-28 07:30:52 +00:00
Julio Castillo
c0bf32e797 Refactor service agent management (#2423)
* Service agents script

* Service agents update

* WIP

* Update script and terraform

* Fix tests

* Fix linter

* Update docs

* Bring back pf example inventory

* Fix tests

* Fix more tests

* Fix tests

* Use dataclasses for build_service_agents.py

* Remove unneeded field() from build_service_agents

* Re-enable CMEK depends_on in project outputs

* Update tools/requirements.txt

* Enable storage in GCS example projects

* Fix tests

* Add CMEK Service Agents dependencies for services

* Fix typos and data platform cmek

* More typos
2024-07-23 22:05:38 +02:00
Ludovico Magnocavallo
99ab796c72 Allow disabling topic creation in GCS module notification (#2436)
* allow disabling topic creation in GCS module notification

* use proper topic name
2024-07-22 10:51:25 +00:00
Ludovico Magnocavallo
c80af8de66 Extend support for tag bindings to more modules (#2307)
* fix kms tag bindings

* bigquery dataset

* fix bigquery

* cloud run

* normalize variable type

* rename gcs heading

* kms example test

* fix bigquery

* fix cloud run

* cloud run v2
2024-05-25 10:42:45 +02:00
Ludovico Magnocavallo
dc686c3a84 Remove default location from gcs module (#2303)
* gcs module

* blueprints/apigee/bigquery-analytics

* tfdoc

* pubsub README md syntax
2024-05-24 07:02:33 +00:00
Ludovico Magnocavallo
3138eb9025 add support for tags to GCS module (#2213) 2024-04-11 13:19:05 +00:00
Simone Ruffilli
7833203d87 Add support for GCS soft-delete retention period (#2212)
* Add support for GCS soft-delete retention period
2024-04-11 07:31:00 +00:00
Wiktor Niesiobędzki
110fd798a7 Fix always succeding test (#1937)
Co-authored-by: Julio Castillo <jccb@google.com>
2023-12-21 11:01:08 +00:00
Wiktor Niesiobędzki
1fbd018f5f E2E tests for GCS 2023-11-15 09:33:03 +00:00
devuonocar
103388bcc9 Update default value 2023-10-31 10:47:28 +01:00
devuonocar
e52af05504 Update README.md 2023-10-30 18:34:55 +01:00
devuonocar
96c1342d55 Add public_access_prevention 2023-10-30 18:23:33 +01:00
jeroenmonteban
f464557525 Add autoclass to GCS (#1757)
* Add autoclass to GCS

* Fix linting

* Make autoclass block dynamic

* Fix syntax

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-10-16 07:45:10 +00:00
devuonocar
4f91523a08 Add missing fields to Cloud Storage bucket (#1745)
* Add new featrures

* Terraform fmt

* Fix README.md

* Delete not allowed validation

* Fix README.md

* Fix README.md

* update var

* update var

* Update var
2023-10-10 22:40:30 +02:00
Miren Esnaola
c10eb72a8f Changes in IAM to GCS module 2023-10-04 08:13:45 +02:00
Erin Horning
4885b8a7f9 objects non-nullable 2023-08-22 09:40:50 -06:00
Erin Horning
9a0f9f607f objects output 2023-08-22 09:35:39 -06:00
Erin Horning
2f3d29395f remove validation 2023-08-22 09:09:37 -06:00
Erin Horning
6f1f6f5085 add additional parameters 2023-08-21 16:35:47 -06:00
Erin Horning
10faf82b8d linting 2023-08-11 11:20:06 -06:00
Erin Horning
df1fded669 add support for object upload to gcs module 2023-08-10 21:43:53 -06:00
Ludovico Magnocavallo
884cb8b4bf Ensure all modules have an id output (#1410)
* net-vpc

* a-d

* complete modules

* fix error
2023-06-02 16:07:22 +02:00
Julio Castillo
a0cb67e1f4 Add inventories to gcs examples 2023-01-19 17:47:14 +01:00
Ludovico Magnocavallo
082c63dfc5 refactor GCS module and tests (#1066) 2022-12-22 12:27:09 +01:00
Julio Castillo
e700a27079 Enforce terraform fmt in examples 2022-12-18 14:00:19 +01:00
Natalia Strelkova
68c3b13d6a prefix variable consistency across modules 2022-11-10 15:05:53 +00:00
Julio Castillo
a866182161 Test documentation examples in the examples/ folder 2022-09-06 17:46:09 +02:00
Julio Castillo
0bf1880431 Fix FAST audit logs when using pubsub as destination
This commit also splits each organization-level logging sink of type
`logging` to a separate logging bucket.
2022-06-10 12:25:26 +02:00
Ludovico Magnocavallo
725f7effce Initial MVP for CI/CD (#608)
* preliminary support for wif in stage 0

* IAM wif role

* IAM wif role TODO

* add support for external SA IAM to SA module

* add name output to SA module

* separate cicd SA

* tfdoc

* GITLAB principal (untested)

* make GCS name output static

* outputs bucket

* fix stage 1 test

* tweak outputs

* tfdoc

* move wif_pool to automation variable

* add support for top-level and repository providers

* add missing boilerplate

* fix branchless principal

* initial workflow

* symlink provider template in stages

* remove service accounts from stage 0 cicd tfvars

* add cicd interface variable to resman stage

* fix cicd variable in resman stage

* better condition on outputs_location

* fix last change

* change outputs_location type

* revert outputs_location change

* split outputs in stage 0

* update ci/cd temporary notes

* rename additive IAM resource in SA module

* split outputs in stage 1

* remove unused locals

* fix stage 1 tests

* tfdoc

* Upload action files to outputs_bucket

* Fix tests and README

* rename template, streamline outputs

* local templates and gcs output for all stage 2

* add workflows to local output files

* Use lowercase WIF providers everywhere

* Bring back suffix for workflow files

* Remove unused files

* Update READMEs

* preliminary CI/CD implementation for stage 1

* fix stage 1

* stage 1 cicd

* tfdoc

* fix tests

* readme and links for cicd and wif

* refactor wif providers

* refactor cicd for stage 1

* fix stage 1

* wif org policies

* split identity provider configuration from cicd

* add type attribute to cicd repositories

* valid cicd repositories have a workflow template

* refactor stage 01

* fix stage 01 tests

* minimal CI/CD documentation

* better check_links error reporting

* fix links

* Added Gitlab specific configurations

Set the default issuer_uri for Gitlab. Added allowed audiences to OIDC configuration.

* Fixed TF formatting in identity providers.

* Changing identity provider audience to null

Changing identity provider audience to default to null.

* add instructions for renaming workflows

* address Julio's comments

Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: alexmeissner <alexmeissner@google.com>
2022-04-12 08:17:27 +02:00
Simone Ruffilli
abb6b50a46 Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
Julio Castillo
cf423998f0 Align tftest syntax with tdoc
This commit changes the token separator for inline examples from a
semicolon to a space
2022-01-28 21:34:15 +01:00
Julio Castillo
31f625f149 Link vars and outputs from README 2022-01-22 14:15:16 +01:00
Ludovico Magnocavallo
2bc5f7d33c update tfdoc (#404) 2021-12-30 10:56:19 +01:00
Ludovico Magnocavallo
1ac3fe4460 New tfdoc version (#396)
* update tfdoc

* rewrite check docs, refactor tfdoc replace, regenerate modules READMEs

* remove dead code from check docs

* do not fail on missing variable files in check docs

* fix typos
2021-12-21 08:51:51 +01:00