Skip to content

Latest commit

 

History

History
485 lines (397 loc) · 19.3 KB

CHANGELOG.md

File metadata and controls

485 lines (397 loc) · 19.3 KB

pgEdge Changes Log

v24.10.7 (on 2024-11-25) to download - REL24_10

  • CLI
    • PostgreSQL versions 17.2, 16.6, and 15.10
    • pgVector version 0.8.0
  • Spock 4.0.6-1
    • Sub Disable Exception Behaviour

v24.10.2 (on 2024-10-02) to download - REL24_10

  • CLI
    • Continued standardization of input flags.
    • Improvements to guardrails on cluster init and add node commands.
    • Removes hard coded spock version in json-template.
    • Support for PG17 extensions.
  • Spock 4.0.5
    • Fixed support for column filters.
    • Fixes to auto ddl and exception logging.

v24.08.8 (on 2024-08-28) to download - REL24_Q3

  • CLI
    • Ace fixes, including support for multiple databases and data types.
    • Improvements to add node and remove node commands.
    • Added support for setuser and permissions extensions.
    • Updates to RPM packaging.
  • spock 3.3.6-1
    • Improvements to Auto DDL functionality.
  • spock 4.0.1-1
    • Enhanced Auto DDL support, including fixes for prepared statements, partition primary key replication sets, and table creation via EXPLAIN.
    • Addressed limitations related to non-superuser operations.
    • Updates to the upgrade script.
    • Adding the repair mode function and exception table handling.
  • lolor 1.2-1
    • Fixed issues with shared preload libraries.
  • snowflake 2.2-1
    • Resolved issues with the Snowflake conversion function.
    • Added upgrade support.

WIP v24.7.0 to devel - REL24_Q3

  • improvements to etcd & patroni for ultra HA & add-node
  • new extensions:
    • pgml & pgrx
    • permissions & set_user (sudo)
    • multicorn

WIP v24.6.6 (on 2017-06-10) to download - REL24_Q2

  • tweaks to default to '-download' rather than upstream

v24.6.5 (on 2017-06-07) to devel & upstream - REL24_Q2

  • spock40beta1 (runs in pg14 thru pg17)
  • pg17beta1
  • spock33 v3.3.4
  • lolor v1.2 - supports pg_dump
  • bump snowflake to v2.1 for pg14+
  • default spock.conflict_logging_level to DEBUG for
  • more auto_ddl regressions tests
  • setting up disabled --extensions
  • re-introduce prometheus postgres_exporter (prompgexp-0.15.0)
  • support for new cluster commands, add-node, remove-node, list-nodes (PR #152 Ibrar)
  • ACE fixes for tables & columns with spaces &/or mixed case names (Tej & Cady)
  • lots of regression testing improvements (Hayee & team)
  • all supported extensions now use metadata (and can be used in containers) (Denis)
  • support 'um install extension1 extension2 extensionN --enable=False' for disabled extensions (Denis)
  • support 'service enable/disable extension' (Denis)

v24.4.6 on 2024-05-09 to upstream ##### (REL24_Q2)

  • extensions metadata fixes
    • cron, audit, partman, hintplan, wal2json
    • readonly, vector, curl, plprofiler, pldebugger
    • citus, plv8, timescaledb, hypopg, foslots
  • ACE regression testing
  • bump spock 33 to 3.3.3 (more auto ddl Asif R)

v24.3.5 on 2024-04-15 to download ##### (REL24_Q1)

  • bump spock33 to 3.3.2 (cascade truncate & upgrade scripts fixes AsifR)

v24.4.5 on 2024-04-10 to upstream ##### (REL24_Q2)

  • bump spock33 to 3.3.2 (cascade truncate fix AsifR)
  • pgbackrest updated cron jobs for clarity and maintainability (PR #122 Ibrar)
  • bump spock 40 to dev5

v24.4.4 on 2024-04-05 ##### (REL24_Q2)

  • add tests cases for DB (PR #121 Hayee/Susan)
  • fix regression in 'update' command
  • snowflake bumped to 2.0
  • pause replication in ACE during repair transactions (PR #120, Tej)
  • Adding hints to spock node-create and sub-create (PR #119, Moiz)
  • fix ACE spock-diff and schema-diff

v24.4.3 on 2024-04-02 ##### (REL24_Q2)

  • fix regression in setup where not preload spock
  • fix pgXX --rm-data to leave metadata & logs
  • enhance orafce, snowflake & foslots installs w extensions metadata

v24.4.2 on 2024-04-01 ##### (REL24_Q2)

  • enhance postgis install w extensions metadata
  • cli's 'conf' & 'logs' directories moved under data so better for containers
  • backrest 2.51-1 enhancements (PR #111, Ibrar)
  • fix lolor install & bump to 1.0beta1
  • fix harcoding of -U, -P, & -d parms in cli.py & setup.py
  • support running util.config_extension by default when no specific install script

v24.4.1 on 2024-03-28 ##### (REL24_Q2)

  • fix ACE to handle list data type and refactored command names (PR #110 Cady & Tej)
  • bump backrest to 2.51-1
  • bump patroni to 3.2.2.1-1
  • bump vector to 0.6.2-1
  • doc fix for localhost (Cady)
  • fix config.env in tests (Hayee)
  • enhancements to backrest scripts (PR #103, #105-#109 Ibrar)
  • enhancements to patroni and etcd scripts (PR #104 Ibrar)
  • fix to ACE to use first of possibly mulitple db's (PR #102 Tej)
  • add auto-ddl tests (PR #101 Hayee)
  • detect osx-i386 (as unsupported)
  • cruft cleanups
    • no longer generate 'nc', 'nodectl', & 'ctl' symlinks
    • stop generating versions24.sql & zip_bz2
    • spock.set_readonly() --> db.set_readonly()
    • drop support for 'install pgedge' in favor of 'setup'
    • drop --tent & --ent unsupported flags
    • drop --with (-cat, -backrest, & -postgrest) unsupported setup flags

v24.3.4 on 2024-03-26 ##### (REL24_Q1)

  • fix to ACE to use first of possibly mulitple db's (CP #)
  • doc fix for localhost (CP #)

v24.4.0 on 2024-03-21 ##### (REL24_Q2)

  • spock v4.0dev4
    • logical clock
    • unique 16-bit generated node id's
    • repair mode for transactions

v24.3.3 on 2024-03-20 ###### (REL24_Q1)

  • block inappropriate components

v24.3.2 on 2024-03-17 ##### (REL24_Q1)

  • fix 'update' command to work from CLI v24.1.3 & forward
  • Large Object LOgical Replication: lolor v1.0dev1
  • spock v4.0dev3 (evolved from v3.3dev2)
  • default spock 32 --> 33
  • spock v3.3.1 support (evolved from v3.2.8)
  • OSX arm64 experimental support for localhost dev/test
  • more backup/restore/pitr integration via backrest v2.50-3
  • 'localhost' commands split out from 'cluster'
  • improvements to 'cluster' usability (cady)
  • 'db', 'cluster', 'spock' doc cleanups (cady)

v24.3.1 on 2024-03-07

  • update 'spock32' to v3.2.8 on pg14/15/16
    • fix problem with pg14 build
    • do not backup snowflake schema when sync_structure
    • restrict CREATE|ALTER|DROP SUBSCRIPTION command
    • allow CLUSTER command
    • only allow top level statements to replicate
  • update 'readonly' to 1.2 on pg14/15/16
  • update 'postgis' to 3.2.4 on pg15/16
  • update 'vector' to 0.6.1 on pg15/16
  • update 'spock33' to v3.2dev2 on el8/el9/arm9 for pg15/16
  • fix messaging & setup issues

v24.2.5 on 2024-03-01

  • spock v3.3dev1 for pg15 & pg16
  • New '-3' binaries for pg15.6 & pg16.2 for spock33 compatibility
  • configurable extension meta data (1st step toward disabled extensions at setup time)
  • rename cluster 'local-create' command to 'localhost-create'
  • rename cluster 'local-destroy' command to 'localhost-destroy'
  • stop using deprecated './pgedge install pgegde' command, in 'cluster localhost-create', in favor of using './pgedge setup' command
  • experimental developer support for pg15 on OSX

v24.2.4 on 2024-02-23

  • spock v3.2.7 is available as default in pg15 & pg16
  • improve and document regressions tests (susan)
  • fix 'update' command to install/re-install ctlibs

v24.2.3 on 2024-02-21

  • make spock v3.2.7rc1 available for test
  • 'multicloud' CLI support for Akamai-Linode (for test clusters)
  • add test support for wal2json on pg15/16
  • backrest v2.50-2 now support full, incremental and pitr(ibrar)
  • prelim support for pREST as a test component
  • add prelim support for our pgedge patroni v3.2.1
  • 'install patroni' now pulls in 'etcd' as a dependency
  • bump etcd to 3.5.12
  • 'install etcd' now also install golang & haproxy by default
  • remove staz
  • deprecate postgREST

v24.2.2 on 2024-02-14

  • add plv8 support for pg16 on el9 & arm9
  • fix deprecation warnings where still using 'nc' instead of 'pgedge'
  • 'setup pgedge' fully supports using flags syntax & pinning pg &/or spock versions
  • deprecation warning for 'install pgegdge'
  • fix ACE success messages in util.py (Cady)
  • ignore --help description lines starting with ('Type: ' & 'Default: ')

v24.2.1 on 2024-02-12

  • bump spock32 to v3.2.6 with auto-dll fixes and regression fixes
  • bump pg16 to v16.2-2 (now includes patch with new delta apply functionality to be used in spock33)
  • fixes to avoid duplicate logging (Cady)
  • fix db create when spock already on the cluster (multiple db's)
  • fix bug installing specific component versions where metadata updates & config not run
  • getting ready for spock33 private beta (default spock now explicitely 32 now that there is more than one)
  • display deprecation warning when 'nc', 'nodectl' or 'ctl' aliases used for 'pgedge' CLI name
  • passing '--no-tty' to any CLI forces non-interactive mode (most are non-interactive anyway)
  • bump postgrest from 11.2.0 to 12.0.2 (& also remove dependency on deprecated component.py)
  • bump backrest from 2.49 to 2.50
  • bump orafce from 4.5.0 to 4.9.2

v24.1.9 on 2024-02-07

  • build spock-3.2.5rc1 el9 test version for auto_ddl
  • enhance ACE with functionality to handle row offset mismatches ( PR #86 Tej)
  • bump pg minor versions to 16.2, 15.11, .....
  • more refactoring for service commands and logging (PR #85 Cady)
  • fix regression in 'service.py' including 'component' that was removed
  • 3rd pass at 'setup pgedge' as documented way to install pgedge AND be able to pin the spock version

v24.1.8 on 2024-02-06

  • build spock-3.2.5beta2 el9 test version for auto_ddl
    • Add tables with PK to default repset, while removing it from insert_only (if added there)
    • synchronize tables
    • Added INFO/LOG messages.
  • regession fix and more refactoring for um, service and logging (PR #84 Cady)
  • many more regression test improvements (PR #83... QA)
  • start work on new 'setup pgedge' with online help
  • remove unused 'Id' parm from db.create()
  • specifying '-p port' parm for 'install pgedge' is enforced
  • deprecate docker folder in favor of pgedge-docker repo
  • remove unused .py files & use -upstream/install.py by default

v24.1.7 on 2024-01-31

  • build spock-3.2.5beta1 el9 test version for wip_auto_ddl functional testing
  • add util.run_native() for supporting backrest, patroni, ansible and etcd CLI's
  • bump pgvector from 0.5.1 to 0.6.0
  • improve DB doc
  • improve ACE doc
  • cleanout nclibs, ddlx, & multicorn2 from versions.sql (not supported yet)

v24.1.6 on 2024-01-30

  • work on build automation
  • lots of work updating doc
  • a cleaned up, simplified and documented CLI 'devel/setup' process
  • drop the '24' in versions24.sql & install24.py
  • fold in the multicloud POC from multicloud-cli project
  • use newer 'PyYAML', add 'ansible', drop 'supervisor' in 'ctlibs'
  • deprecate 'ctl' for 'pgedge' as CLI name
  • ACE fixes for json config changes (PR #81 Tej)
  • More UM refactoring (PR #79 & #80 Cady)
  • 'ent' modules are now simply marked 'prod'
  • rename 'secure' module to 'cloud'
  • seperate out 'pgbin-build' from 'nodectl' & rename it to 'cli'
  • lots of new doc & unit testings (PR #71, 73, 74 - Hayee)
  • refactor of UM and SERVICE (Cady)
  • eliminate bzip2 requirements in favor of standard gzip and optionally pigz
  • bump pg_curl from 2.1.1 to 2.2.2
  • improve build automation across platforms
  • bump timescaledb from 2.11.2 to 2.13.1
  • add pg16 support for timescaledb
  • bump plv8 from 3.2.0 to 3.2.1
  • bump partman from 4.7.4 to 5.0.1
  • bump postgis from 3.4.0 to 3.4.1
  • bump citus from 12.1.0 to 12.1.1
  • add support for multiple spock db's (PR #70 Cady)
  • add support to ACE for repset-diff (PR #72 Tej)
  • fix two things for SLES & OpenSuse LEAP support
    • remove ruff.toml broken link at runtime from hub/scripts
    • make sure we properly support SLES 15 & not just OpenSuse LEAP 15
  • quite down install ctlibs for ubu22, al2023 & LEAP/sle15
  • start using .tgz files in REPO to elimnate need for BZIP2 to be installed

v24.1.5 on 2024-01-08

  • bump spock32 to v3.2.4 & remove spock31 support
  • bring back el9 version of pg17, snowflake-pg17 & spock32-pg17
  • bring skeleton.sh tests up to snuff for pg14/15/16 & el8 consideration
  • foslots and readonly for pg14/15/16 & el8
  • bump pgadmin4 to 8.x
  • bump etcd to 3.5.11 & include for el8
  • bump backrest to 2.49 & include for el8
  • include el8 builds for pgcat, etcd & backrest
  • devel builds of pg14 thru pg17 all include log_old_values patch
  • verify SELinux not active when trying to --autostart a 'pgedge install'
  • fix error handling on file priv's in cli.py
  • improve pg14 with spock32 patches
  • 1st pass at replacing 'cloud' w/ 'multicloud'

v24.1.4 on 2024-01-02

  • CLUSTER:

    • rework cluster-init json for compat with enterprise cloud
  • CLOUD:

    • leverage apache-libcloud module from pypy
    • rename machine.py --> cloud.py
    • patch libcloud with a fix from equinixmetal (metros) & from us (ram TB)
    • include our patched libcloud 3.8.0 in our lib directory (& remove from requirements.txt)
  • EL8/SLE-15 for AMD64:

    • require python39 be added so we can use it over the default (unsupported) python36
    • support spock & snowflake for EL8 on am64 for pg 14/15/16
    • test on Rocky Linux 8 & Open Suse LEAP 15.5
  • CTL:

    • fix security warning when using tar.extract_all() by using data_filter when available
    • v 23.x is no more. v24.x is always used & install.py is a symlink to install24.py
    • drop support for pg17devel (replace with spock3x & wait for 17beta1)
    • use ruff (rather than flake8 & black)
  • DOCKER:

    • use latest RockyLinux 9 image (rather than 9.2)
    • drop fakectl notes at bottom of README

v24.1.3 on 2023-12-05

  • CTL:
    • fix nc & nodectl regression when called from a different directory

v24.1.2 on 2023-12-04

  • CTL:

    • comment out nc & nodectl deprecation warning (for now)
  • PG14:

    • snowflake now supports pg14
    • 'install pgedge --pg 14' now supported
  • ACE:

    • fixes and improvements to table-repair
  • SPOCK32:

    • v3.2.2 regression fix for missing transactions in corner cases

v24.1.1 on 2023-11-30

  • PGEDGE:

    • 'install pgedge' now defaults to spock32 for pg14, pg15 & pg16
  • ACE:

    • table-repair can now handle missing, divergent and extra rows
  • SPOCK32:

    • support for pg14 on EL9
    • support for limited feature set against core/unpatched pg14+
    • 3.2.1 on pg14, pg15, pg16 & pg17
    • pg14 version is compiled against unpatched postgresql
  • PG14:

    • now available on EL9
    • still on EL8 too
  • BACKREST:

    • support pg14/15/16
    • upgrade to 2.48
  • CTL: 'nc' & 'nodectl' are now aliases for 'ctl'

  • DEV/TEST:

    • test on Fedora Core 39 w Python 3.12
    • test on Ubuntu 23.10 w Python 3.11
    • test on Amazon Linux 2023
    • code cleanups:
      • use 'black' coding style consistently
      • use 'flake8' incrementally
    • exclude use of urlllib3 v1.26.18 (does not work on OSX)

v24.0.10 on 2023-11-17

  • small fixes for Fedora 39 & python 3.12 test support
  • regenerate and cleanup doc
  • document regression tests using cluster local-create, northwind, & ace
  • MACHINE: doc & more improvements

done for 24.0.8 on 2023-11-15

  • SPOCK32: bump to 3.2dev7 for prelim paralell_slots testing on pg17

done for 24.0.7 on 2023-11-13

  • ACE: table re-run only compares delta rows
  • MACHINE: 3rd pass includes:
    • equinixmetal fixes to LibCloud 3.1.8+ for size_list() & node_create()
    • size_list(), node_list(), node_start(), node_stop(), node_reboot(), node_create()
  • CITUS: bump to 12.1 and make avaialble for pg16
  • PLDEBUGGER: bump to 1.6 and make available for pg16
  • ANSIBLE: add native command line support
  • SPOCK32: bump to 3.2dev6 for pg14 support & can compile against unpatched postgres

Fixes and minor changes:

  • fix get/set guc (cady)
  • complex und apps only supported on EL9
  • add error message when './nc list' is empty
  • filter out pre_reqs on './nc list'
  • bump pg12/13/14/15 on el8-amd architecture to latest releases
  • bump pglogical (for test only) to 2.4.4 for pg15 & now also pg16
  • bump cron to 1.6.2 for pg15 & pg16

done for 24.0.6 on 2023-11-07

  • bump pg15 & pg16 to latests from community
  • refactor to be able to run PyCharm IDE/debugger on cli.py
  • rework container strategy to lose dependency on systemctl
  • refactor install pgadmin4 web to support el9, httpd & configuring firewalld
  • another pass at OSX support for dev
  • 1st pass at creating multicloud clusters leveraging new MACHINE & FIREWALL CLI's

done for 24.0.5 on 2023-11-01

New Features:

  • MACHINE: 2nd pass includes support for basic AWS & EQNX functionality
  • FIREWALL: new support for firewalld configuration
  • Support for PyCharm IDE for making development easier

Fixes and minor enhancements:

  • cleanup requirements.txt
  • 1st pass at --ent components
  • refactor --extension, --showduplicates & --test
  • bump readonly to 1.1.1, vector to 1.1.1, & spock31 to 3.1.8
  • 'CREATE EXTENSION snowflake' after install --no-restart (pgedge-2-07)
  • better messaging for unsupported pg binaries on a platform
  • fix './nc update' when in the 24.xxx stream
  • better instrument 'reload pgXX' when running w/ or wo/ systemd

done for 24.0.4 on 2023-10-24

Fixes and minor enhancements:

  • deployment problems caused by cady and ibrar and tej. :-)
  • fixes to se3cure.py (cady)
  • default 'install pgedge' to '--pg 17' (denis)
  • default INSTALL_PY to 'install24.py' if "-upstream" is in REPO (denis)

done for 24.0.3 on 2023-10-23

New Features:

  • MACHINE: 2nd pass includes support for configuring remote firewalls

Fixes and minor enhancements:

  • added the '--pause' option to 'install pgegde'

done for 24.0.2 on 2023-10-21

New Features:

  • SNOWFLAKE: New extension to support snowflake sequences (jan)
  • SPOCK: 3.2dev5 readonly(asifr/affan) & snowflake migration (jan)
  • PG: Hidden Columns patch (korry)
  • STAZ: Spock Three AZ Clustering (ibrar)
  • ACE: new upsert & dryrun functionality (tej)
  • DB: 1st pass @ get & set GUC functions (cady)
  • MACHINE: 1st pass at experimental cli (denis)

Minor fixes and supporting enhancements:

  • refactor pg build process to cleanly apply N patches (denis)
  • support INSTALL_PY env for cluster commands using install24.py
  • bump pg15/16/17 to include HiddenColumns patch (denis)
  • enhance 'install pgedge' for STAZ (denis)
    • add 'replicator' role
    • support optional '--rm-data' parm
  • update pgcat, etcd, & staz from 'test' to 'prod' status (denis)
  • update copyright notices for 2024 (denis)
  • move unused nt.py and repo.py scripts to attic (denis)
  • 1st pass at instructions for settting up virtual env (denis)
  • refactor for easier debugging (denis)

done for 24.0.1 on 2023-10-17

  • begin dev for 2024 Edition
  • bump spock to 3.2dev3 and add support for pg15-pg17
  • add support for snowflake 1.1 to pg15-pg17
  • install snowflake in pgedge2-6