Commit Graph

94 Commits

Author SHA1 Message Date
Simone Ruffilli
6d89b88149 versions.tf maintenance + copyright notice bump (#1782)
* Bump copyright notice to 2023

* Delete versions.tf on blueprints

* Pin provider to major version 5

* Remove comment

* Fix lint

* fix bq-ml blueprint readme

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Julio Castillo <jccb@google.com>
2023-10-20 18:17:47 +02:00
Julio Castillo
5bbb7bdd09 Simplify linting output in workflow 2023-08-31 10:15:12 +02:00
Ludovico Magnocavallo
819894d2ba IAM interface refactor (#1595)
* IAM modules refactor proposal

* policy

* subheading

* Update 20230816-iam-refactor.md

* log Julio's +1

* data-catalog-policy-tag

* dataproc

* dataproc

* folder

* folder

* folder

* folder

* project

* better filtering in test examples

* project

* folder

* folder

* organization

* fix variable descriptions

* kms

* net-vpc

* dataplex-datascan

* modules/iam-service-account

* modules/source-repository/

* blueprints/cloud-operations/vm-migration/

* blueprints/third-party-solutions/wordpress

* dataplex-datascan

* blueprints/cloud-operations/workload-identity-federation

* blueprints/data-solutions/cloudsql-multiregion/

* blueprints/data-solutions/composer-2

* Update 20230816-iam-refactor.md

* Update 20230816-iam-refactor.md

* capture discussion in architectural doc

* update variable names and refactor proposal

* project

* blueprints first round

* folder

* organization

* data-catalog-policy-tag

* re-enable folder inventory

* project module style fix

* dataproc

* source-repository

* source-repository tests

* dataplex-datascan

* dataplex-datascan tests

* net-vpc

* net-vpc test examples

* iam-service-account

* iam-service-account test examples

* kms

* boilerplate

* tfdoc

* fix module tests

* more blueprint fixes

* fix typo in data blueprints

* incomplete refactor of data platform foundations

* tfdoc

* data platform foundation

* refactor data platform foundation iam locals

* remove redundant example test

* shielded folder fix

* fix typo

* project factory

* project factory outputs

* tfdoc

* test workflow: less verbose tests, fix tf version

* re-enable -vv, shorter traceback, fix action version

* ignore github extension warning, re-enable action version

* fast bootstrap IAM, untested

* bootstrap stage IAM fixes

* stage 0 tests

* fast stage 1

* tenant stage 1

* minor changes to fast stage 0 and 1

* fast security stage

* fast mt stage 0

* fast mt stage 0

* fast pf
2023-08-20 09:44:20 +02:00
Ludovico Magnocavallo
d9f7cef1e7 allow using a separate resource for boot disk (#1496) 2023-07-07 15:40:13 +00:00
Julio Castillo
72b5944fb3 Simplify return 2023-05-05 17:03:42 +02:00
Julio Castillo
05ed1bf12f Add blueprint metadata validation tool 2023-05-05 16:57:48 +02:00
Julio Castillo
f4b8a61981 Clean workflow files 2023-04-25 15:28:34 +02:00
Julio Castillo
ee4a908b10 Remove last remaining legacy fixture 2023-04-25 15:12:32 +02:00
Julio Castillo
78867b0f99 Merge actions 2023-04-25 15:12:32 +02:00
Julio Castillo
a09959539c Use tftest copy env var 2023-04-25 15:12:32 +02:00
Julio Castillo
cc73c30c08 Pin provider versions in cache 2023-04-25 15:12:32 +02:00
Julio Castillo
3cd3106695 troubleshoot 2023-04-25 15:12:32 +02:00
Julio Castillo
7dd30f104f Reorder cache file 2023-04-25 15:12:11 +02:00
Julio Castillo
89fe36b4f4 print lockfiles 2023-04-25 15:12:11 +02:00
Julio Castillo
1b4e8eb305 Copy default versions to lockfile directory before tf init 2023-04-25 15:12:11 +02:00
Julio Castillo
20ccf7416f Enable parallel tests 2023-04-25 15:12:11 +02:00
Julio Castillo
b097d297ff Extend tests to use lockfile if available
This commints allows the test framework to use a lockfile generated
within the tools/lockfile directory. This allows reusing the provider
cache and also running tests in parallel.
2023-04-25 15:12:11 +02:00
Ludovico Magnocavallo
40cda39093 bump Terraform version (#1307) 2023-04-05 09:15:23 +02:00
Ludovico Magnocavallo
3d41d01efc FAST plugin system (#1266)
* plugin folder, gitignore, serverless connector example

* add support to fast plugin variables and outputs to tfdoc

* rename folder, READMEs

* add variable description

* show diffs

* check documentation, use multiple files

* debug check doc

* try a different glob

* debug tfdoc names

* more debug

* and even more debug

* fix gitignore

* fix links

* support extra files in tests

* fix fixture, switch stage 2 peering to new tests

* tfdoc

* Allow globs in extra files

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-03-24 12:28:32 +00:00
Sebastian Kunze
7afdde08c1 Remove container image workflows (#1242) 2023-03-13 07:39:03 +00:00
Julio Castillo
744863b9a3 Simplify testing workflow 2023-03-09 16:04:01 +01:00
Ludovico Magnocavallo
ef28e208d3 Use composite action for test workflow prerequisite steps (#1216)
* test composite action

* add shell in action steps

* home input

* boilerplate

* static home

* use action in all test steps

* fix step name
2023-03-06 11:44:57 +01:00
Ludovico Magnocavallo
563ef270af Try plugin cache, split examples tests (#1215)
* try plugin cache, split examples tests

* fix mkdir

* use cache
2023-03-06 10:38:39 +01:00
Julio Castillo
59ed5d1915 Bump actions versions 2023-02-25 13:08:30 +01:00
Ludovico Magnocavallo
3cca689792 Check linting for Python dashboard files (#1107)
* enable Python lint check for network dashboard

* fix linting for network dashboard
2023-01-21 17:17:51 +01:00
Ludovico Magnocavallo
cb87f3efa5 Document new testing approach (#1048)
* document new testing approach

* remove unused workflow branches

* remove stale folder

* fix link

* document new testing approach

* remove unused workflow branches

* fix link

* Extend tests details in contributing guide

* Typos

Co-authored-by: Julio Castillo <jccb@google.com>
2022-12-12 19:59:46 +00:00
Sebastian Kunze
1287b7ca0a Replace set-output with env variable and remove single quotes on labels (#1022) 2022-11-29 08:57:43 +00:00
Sebastian Kunze
ceb544833a Add OpenContainers annotations to published container images (#1021) 2022-11-29 08:11:53 +00:00
Sebastian Kunze
948b61fdce Use actions/labeler to automatically label pull requests (#1004) 2022-11-22 15:42:47 +01:00
Sebastian Kunze
ad7a0bb857 Add missing write_package permission (#998) 2022-11-22 08:32:42 +00:00
Sebastian Kunze
6400111ad5 Fix repository name must be lowercase on docker build (#996) 2022-11-21 16:04:56 +00:00
Sebastian Kunze
b6249bc52e Push container images to GitHub instead of Google Container Registry (#995) 2022-11-21 14:53:51 +00:00
Julio Castillo
577db1d50b Extend linting to blueprints 2022-10-28 17:49:44 +02:00
Julio Castillo
15d21eba39 Rename workflow names 2022-10-25 16:58:37 +02:00
Ludovico Magnocavallo
680eb656cb disable parallel execution of tests and plugin cache (#887) 2022-10-14 19:52:38 +02:00
Ludovico Magnocavallo
b39abd2389 Revert "Improve handling of tf plugin cache in tests (#885)" (#886)
This reverts commit af447e34e6.
2022-10-14 19:35:30 +02:00
Ludovico Magnocavallo
af447e34e6 Improve handling of tf plugin cache in tests (#885)
* disable tf cache in CI

* re-enable cache

* try a different approach
2022-10-14 19:14:47 +02:00
Ludovico Magnocavallo
4b798fb34d Run tests in parallel using pytest-xdist (#881)
* test terraform cache

* try pytest-xdist

* revert cache changes

* extend to other jobs

* change dist, bump processes to 4

* revert

* mark tests

* run init to prime providers cache

* prime providers cache

* prime providers cache for all jobs

* add local provider to versions

* remove leftover code
2022-10-14 14:56:16 +02:00
Ludovico Magnocavallo
78d1a09aeb Enable FAST 00-cicd provider test (#865)
* enable fast 00-cicd provider test

* don't overwrite version files in CI

* change provider pinning for all tests in CI file
2022-10-07 13:20:56 +02:00
Ludovico Magnocavallo
a0171b2c49 Bump terraform required version (#864)
* bump terraform required version

* fix test

* debug test

* debug test

* disable test

* fix CI file, bump terraform action version
2022-10-07 12:51:56 +02:00
Ludovico Magnocavallo
e66340c4db Refactor compute-vm for Terraform 1.3 (#860)
* refactor compute-vm for Terraform 1.3

* bump Terraform version in CI tests config

* fix optional null handling (ht jccb)

* tfdoc

* update blueprints

* align fast

* align README examples
2022-10-07 10:53:53 +02:00
Julio Castillo
040c9284e6 Fix tf version in pipelines 2022-09-28 11:50:23 +02:00
Ludovico Magnocavallo
834c5d53c9 point tests to new folders
Co-authored-by: Julio Castillo <juliocc@users.noreply.github.com>
2022-09-09 16:39:01 +02:00
Ludovico Magnocavallo
7a2b769312 Delete merge-pr.yml 2022-09-07 11:14:19 +02:00
Roberto Jung Drebes
4174f2a048 and linting too 2022-08-31 15:31:30 +02:00
Roberto Jung Drebes
e1eea481b4 some more yaml quoting 2022-08-31 15:28:47 +02:00
Roberto Jung Drebes
97fc5517b2 fix yaml quotes for merge-pr workflow 2022-08-31 14:39:17 +02:00
Ludovico Magnocavallo
0a58611792 Changelog generator (#763)
* first test

* test signing

* changelog load/dump

* changelog tool

* changelog generator

* lint
2022-08-02 11:45:05 +02:00
Ludovico Magnocavallo
b5162162ec remove changelog workflow 2022-07-31 14:45:11 +02:00
Ludovico Magnocavallo
6efce68b1d fix merge workflow 2022-07-30 19:37:19 +02:00