Commit Graph

507 Commits

Author SHA1 Message Date
Felix Kunde 22d3c72eb3 resolve conflicts 2022-02-25 17:50:51 +01:00
Felix Kunde 8b404fd049
minor fixes to password rotation (#1796)
* minor fixes to password rotation
* rework unit test
2022-02-25 17:46:26 +01:00
Menzorg 06c28da97d
synchronous_node_count support (#1484)
* synchronous_node_count support
* notification about Patroni image version
* default synchronous_node_count to 1

Co-authored-by: Felix Kunde <felix-kunde@gmx.de>
2022-02-25 17:21:42 +01:00
Felix Kunde 46547c4088
do not recreate pods if previous Patroni API calls fail (#1767)
* do not recreate pods if previous Patroni API calls fail
* move retry reads against Patroni API to pod.go
* remove final failover check in node affinity test
* make test_min_resource_limits more robust
2022-02-25 09:33:04 +01:00
Felix Kunde 795cd5d4ec sync publication with debug messages 2022-02-21 17:27:10 +01:00
Felix Kunde 34cad4601d fix warning formatting 2022-02-21 17:08:36 +01:00
Felix Kunde 9007475ed8 reflect code review and additional refactoring 2022-02-21 17:01:58 +01:00
Felix Kunde 47aa7b1c64 Merge branch 'master' into fes-support 2022-02-21 11:29:39 +01:00
Felix Kunde 658923d10d
Password rotation in secrets (#1749)
* password rotation in K8s secrets
* add db connection to syncSecrets
* add user retention
* add e2e test
* cleanup on username mismatch if rotation was switched off
* add unit test for syncSecrets + new updateSecret func
2022-02-18 11:54:47 +01:00
Felix Kunde 66824076e5 cosmetic changes 2022-01-28 14:21:23 +01:00
Felix Kunde a78a619e90
toleration diff and nodeReadinessLabel merge with manifest matchExpressions (#1729)
* include tolerations in statefulset comparison
* provide alternative merge behavior of nodeSelectorTerms for node readiness label
* add config option to change affinity merge behavior
* reworked e2e tests around node affinity
2022-01-27 15:57:24 +01:00
Felix Kunde 3f0ed26828 fix sync of publications 2022-01-26 23:15:28 +01:00
Felix Kunde 2630d8eff3 minor fixes 2022-01-26 14:04:17 +01:00
Felix Kunde 31ec300f87 alter publications if needed 2022-01-26 11:38:19 +01:00
Felix Kunde eb51428a44 quotes for schema and table 2022-01-25 18:57:55 +01:00
Felix Kunde 179fcb1126 switch to pgoutput plugin and let operator create publications 2022-01-25 17:18:49 +01:00
Felix Kunde e499567152 resolve conflict 2022-01-24 17:51:24 +01:00
Felix Kunde a686824ab8 move FES to v1 2022-01-24 17:19:07 +01:00
Felix Kunde 411abbe31e
handle case when Patroni returns that lag is unknown (#1724)
* handle case when Patroni returns that lag is unknown
* remove some prints from e2e test
2021-12-17 12:36:23 +01:00
Felix Kunde 7079d0ef80 fix unit test, too 2021-12-15 10:32:50 +01:00
Felix Kunde ff1ac1da4f replace dash with underscroe for slot name 2021-12-14 18:48:32 +01:00
Felix Kunde 07fd4ec00b
choose switchover candidate based on lag and role (#1700)
* choose switchover candidate based on lowest lag in MB and role (in synchronous mode)
2021-12-14 10:35:21 +01:00
Felix Kunde 74ee530a6c introduce applicationId for separate stream CRDs 2021-12-08 17:11:18 +01:00
Felix Kunde 96a2da1fca use defined fes CRD in unit test 2021-12-07 22:32:35 +01:00
Felix Kunde 90d6016dc8 sync streams only when they are defined in manifest 2021-12-06 16:35:11 +01:00
Felix Kunde 3804bc55c8 resolve conflict 2021-12-03 19:19:43 +01:00
Felix Kunde 8f2f70b4fe set applicationId of FES CRD by taking label from manifest 2021-12-03 19:17:01 +01:00
James McDonald def9e1d688
Support standby replication from GS (GCS) (#1446)
* Add support for manual gs_wal_path in standby
* Remove separate standby version configuration
* Remove setting standby path via cluster/uid/version
Picking up the version doesn't work reliably without making changes to
Spilo. It's clearer to just specify the full S3/GS bucket path.

Co-authored-by: Felix Kunde <felix-kunde@gmx.de>
2021-12-03 11:24:29 +01:00
Felix Kunde bde522ba2a make id and payload columns configurable 2021-12-02 17:31:31 +01:00
Felix Kunde 1ed16fadca
make sure upgrade script runs on the master (#1715)
* make sure upgrade script runs on the master
* show a bit more logs from upgrade script
2021-12-02 14:10:58 +01:00
Felix Kunde bdf87da1fe
Merge branch 'master' into fes-support 2021-11-29 16:53:42 +01:00
Felix Kunde f7858ffb70
Initialize arrays of errors / error messages + minor refactoring (#1701)
* init error arrays correctly
* avoid nilPointer when syncing connectionPooler
* getInfrastructureRoles should return error
* fix unit tests and return type for getInfrastructureRoles
2021-11-29 12:49:12 +01:00
Jan Mussler 3e275d122a
Allow individual teams to do auto upgrade via operator. (#1699)
* Allow whitelisting of teams to do auto upgrade upgrade via operator.

Co-authored-by: Felix Kunde <felix-kunde@gmx.de>
2021-11-29 12:47:18 +01:00
Felix Kunde 06956d172d existing slot must use the same plugin 2021-11-25 16:05:48 +01:00
Felix Kunde 8d52e8d3c6 Merge branch 'master' into fes-support 2021-11-25 15:55:14 +01:00
Rafia Sabih e98439e5b6
Add log messages for usernames (#1692)
* add log messages for usernames
* document behavior better in logs

Co-authored-by: Felix Kunde <felix-kunde@gmx.de>
2021-11-18 09:55:33 +01:00
Felix Kunde fa63803be9 minor changes for comments 2021-10-26 17:13:18 +02:00
Felix Kunde a5acfd3b42 reflect latest change in restart logic 2021-10-26 17:06:06 +02:00
Felix Kunde 1eafd688d0
restart master first in some edge cases (#1655)
* restart master first in some edge cases

* edge case is when desired is lower than effective

* wait after config patch and restart on sync whenever we see pending_restart

* convert options to int to check decrease and add unit test

* minor update to e2e tests

* wait only after restart not every sync

* using spilo 14 e2e images
2021-10-26 16:43:19 +02:00
Felix Kunde db76b8c642 minor fix for restart TTL 2021-10-18 17:36:34 +02:00
Felix Kunde 2f4b554fec resolve conflict with latest config sync 2021-10-18 17:23:46 +02:00
Felix Kunde 2a33bf3313
improve Patroni config sync (#1635)
* improve Patroni config sync
* collect new and updated slots to patch patroni
* refactor httpGet in Patroni and extend unit tests
* GetMemberData should call the patroni endpoint
* add PATCH test
2021-10-13 17:17:26 +02:00
Felix Kunde ab25fb29b7
make Postgres 14 available (#1636)
* make Postgres 14 available
* don't be too hard to 9.5
* bump Spilo image and more docs updates
* update e2e test upgrading to 14
2021-10-12 12:00:59 +02:00
Jan Mussler d0d7a32d52
Clearing up error on resize failure message. (#1641)
* Clearing up error message.
2021-10-08 17:11:21 +02:00
Felix Kunde c8d89f9c65 reflect code review 2021-10-01 18:50:40 +02:00
Felix Kunde 9abd6f7fcc avoid CRD getter in unit test 2021-09-22 16:59:15 +02:00
Felix Kunde c5ea2989ca check if fes CRD exists before syncing 2021-09-22 16:45:06 +02:00
Felix Kunde 223ffa75ef remove streamType field 2021-09-22 11:47:31 +02:00
Felix Kunde a17d63088b remove fields from FES api and fix update 2021-09-21 12:31:05 +02:00
Felix Kunde e4c7e3648f remove sqs and a few bugs 2021-09-16 15:58:11 +02:00