Commit Graph

488 Commits

Author SHA1 Message Date
Felix Kunde a686824ab8 move FES to v1 2022-01-24 17:19:07 +01:00
Felix Kunde 7079d0ef80 fix unit test, too 2021-12-15 10:32:50 +01:00
Felix Kunde ff1ac1da4f replace dash with underscroe for slot name 2021-12-14 18:48:32 +01:00
Felix Kunde 74ee530a6c introduce applicationId for separate stream CRDs 2021-12-08 17:11:18 +01:00
Felix Kunde 96a2da1fca use defined fes CRD in unit test 2021-12-07 22:32:35 +01:00
Felix Kunde 90d6016dc8 sync streams only when they are defined in manifest 2021-12-06 16:35:11 +01:00
Felix Kunde 3804bc55c8 resolve conflict 2021-12-03 19:19:43 +01:00
Felix Kunde 8f2f70b4fe set applicationId of FES CRD by taking label from manifest 2021-12-03 19:17:01 +01:00
James McDonald def9e1d688
Support standby replication from GS (GCS) (#1446)
* Add support for manual gs_wal_path in standby
* Remove separate standby version configuration
* Remove setting standby path via cluster/uid/version
Picking up the version doesn't work reliably without making changes to
Spilo. It's clearer to just specify the full S3/GS bucket path.

Co-authored-by: Felix Kunde <felix-kunde@gmx.de>
2021-12-03 11:24:29 +01:00
Felix Kunde bde522ba2a make id and payload columns configurable 2021-12-02 17:31:31 +01:00
Felix Kunde 1ed16fadca
make sure upgrade script runs on the master (#1715)
* make sure upgrade script runs on the master
* show a bit more logs from upgrade script
2021-12-02 14:10:58 +01:00
Felix Kunde bdf87da1fe
Merge branch 'master' into fes-support 2021-11-29 16:53:42 +01:00
Felix Kunde f7858ffb70
Initialize arrays of errors / error messages + minor refactoring (#1701)
* init error arrays correctly
* avoid nilPointer when syncing connectionPooler
* getInfrastructureRoles should return error
* fix unit tests and return type for getInfrastructureRoles
2021-11-29 12:49:12 +01:00
Jan Mussler 3e275d122a
Allow individual teams to do auto upgrade via operator. (#1699)
* Allow whitelisting of teams to do auto upgrade upgrade via operator.

Co-authored-by: Felix Kunde <felix-kunde@gmx.de>
2021-11-29 12:47:18 +01:00
Felix Kunde 06956d172d existing slot must use the same plugin 2021-11-25 16:05:48 +01:00
Felix Kunde 8d52e8d3c6 Merge branch 'master' into fes-support 2021-11-25 15:55:14 +01:00
Rafia Sabih e98439e5b6
Add log messages for usernames (#1692)
* add log messages for usernames
* document behavior better in logs

Co-authored-by: Felix Kunde <felix-kunde@gmx.de>
2021-11-18 09:55:33 +01:00
Felix Kunde fa63803be9 minor changes for comments 2021-10-26 17:13:18 +02:00
Felix Kunde a5acfd3b42 reflect latest change in restart logic 2021-10-26 17:06:06 +02:00
Felix Kunde 1eafd688d0
restart master first in some edge cases (#1655)
* restart master first in some edge cases

* edge case is when desired is lower than effective

* wait after config patch and restart on sync whenever we see pending_restart

* convert options to int to check decrease and add unit test

* minor update to e2e tests

* wait only after restart not every sync

* using spilo 14 e2e images
2021-10-26 16:43:19 +02:00
Felix Kunde db76b8c642 minor fix for restart TTL 2021-10-18 17:36:34 +02:00
Felix Kunde 2f4b554fec resolve conflict with latest config sync 2021-10-18 17:23:46 +02:00
Felix Kunde 2a33bf3313
improve Patroni config sync (#1635)
* improve Patroni config sync
* collect new and updated slots to patch patroni
* refactor httpGet in Patroni and extend unit tests
* GetMemberData should call the patroni endpoint
* add PATCH test
2021-10-13 17:17:26 +02:00
Felix Kunde ab25fb29b7
make Postgres 14 available (#1636)
* make Postgres 14 available
* don't be too hard to 9.5
* bump Spilo image and more docs updates
* update e2e test upgrading to 14
2021-10-12 12:00:59 +02:00
Jan Mussler d0d7a32d52
Clearing up error on resize failure message. (#1641)
* Clearing up error message.
2021-10-08 17:11:21 +02:00
Felix Kunde c8d89f9c65 reflect code review 2021-10-01 18:50:40 +02:00
Felix Kunde 9abd6f7fcc avoid CRD getter in unit test 2021-09-22 16:59:15 +02:00
Felix Kunde c5ea2989ca check if fes CRD exists before syncing 2021-09-22 16:45:06 +02:00
Felix Kunde 223ffa75ef remove streamType field 2021-09-22 11:47:31 +02:00
Felix Kunde a17d63088b remove fields from FES api and fix update 2021-09-21 12:31:05 +02:00
Felix Kunde e4c7e3648f remove sqs and a few bugs 2021-09-16 15:58:11 +02:00
Felix Kunde 79bd69d3ab Merge branch 'master' into fes-support 2021-09-16 13:27:57 +02:00
Felix Kunde d2addd3b17 re-add 3rd type, remove callHome flow 2021-08-27 13:00:38 +02:00
Felix Kunde 62ed7e470f
improve pooler sync (#1593)
* remove role from installLookupFunction and run it on database sync, too
* fix condition to decide on syncing pooler
* trigger lookup from database sync only if pooler is set
* use empty spec everywhere and do not sync if one lookupfunction was passed
* do not sync pooler after being disabled
2021-08-27 12:41:37 +02:00
Aaron Peschel 1dd0cd9691
Add Support for Azure WAL-G Backups (#1537)
This commit adds support for using an Azure storage account as a backup
location.

It uses the existing GCS functionality as a reference for what to do,
and follows the example set by GCS as closely as possible.

The decision to name the cloud provider key "aws_or_gcp" is unfortunate
while adding support for Azure, but I have left it alone to allow for
this changeset to be backwards compatible.
2021-08-26 14:59:03 +02:00
John Rood 2d2ce6197b
Add volume selector (#1385)
* Add volume selector
* Add slightly better documentation and gofmt changes
* Update generated deepcopy
* Add test for PV selector

Co-authored-by: John Rood <j.rood@picturae.com>
2021-08-26 14:57:54 +02:00
Felix Kunde 7a84c0852c remove wal type and distinguish source between nakadi and sqs 2021-08-25 18:15:19 +02:00
Quan Hoang 1b3366e9f4
Support affinity in connection pooler deployments (#1464) 2021-08-24 15:25:03 +02:00
Felix Kunde f0815fc5bd
remove debug log of Spilo env vars (#1591) 2021-08-23 15:44:34 +02:00
Felix Kunde 2726492fd3 add delete case and fix updating streams + update unit test 2021-08-23 15:14:11 +02:00
Felix Kunde 6120ef7da4 name FES like the Postgres cluster 2021-08-20 12:51:40 +02:00
Felix Kunde 282b6d2863
allow secrets of default users in a different namespace (#1581)
* allow secrets of default users in a different namespace
* add warning in case secretNamespace is ignored
2021-08-18 16:00:26 +02:00
Felix Kunde 1f8cfc5c98 small fix for setting bools in Postgres config 2021-08-11 09:15:12 +02:00
Felix Kunde 4862b05c69 fix Postgres config sync 2021-08-10 17:29:59 +02:00
Felix Kunde 14e989ac83 update log messages 2021-08-10 11:56:15 +02:00
Felix Kunde eb7050571d operator updates Postgres config and creates replication user 2021-08-10 11:26:23 +02:00
Felix Kunde 2fadb740fa Merge branch 'master' into fes-support 2021-08-09 16:24:05 +02:00
Felix Kunde 66620d5049
refactor restarting instances (#1535)
* refactor restarting instances and reduce listPods calls
* only add parameters to set if it differs from effective config
* update e2e test for updating Postgres config
* patch config only once
2021-08-09 16:23:41 +02:00
Felix Kunde 70df4515bc intermediate commit 2021-07-30 14:11:12 +02:00
Felix Kunde 11f3715ed1 check manifest settings for logical decoding before creating streams 2021-07-29 14:29:42 +02:00