v1.6.0

📝️ What's Changed (Pull Request list)

• Enhance: Add warehouse_id to pg_stat_activity_extended by @lss602726449 in #453
• Modify the orca optimizer's processing of unionall distribution strat… by @Light-City in #399
• Update the location of python-dependencies.txt by @Zhangbaowen-Hashdata in #460
• Add hook for exec_simple_query and support self-defined spilling memory threshold in cost module. by @songdongxiaoa2 in #447
• Fix compile error that pipe is redefined by @gfphoenix78 in #349
• [AQUMV] Use contain_var_clause instead of pull_var_clause. by @avamingli in #451
• directory_table: matchignore & remove meta-command username output by @edespino in #464
• Enhance: Add hook to support different way to create/drop/alter wareh… by @lss602726449 in #462
• Fix: replace gpscp with gpsync in ext fts by @jiaqizho in #470
• Re-used index after ALTER COLUMN TYPE shouldn't change relfilenode by @lss602726449 in #474
• Cherry-pick Resgroup related code from GreenPlum [Mar 2, 2022 - Feb 7, 2023] by @foreyes in #448
• Add weekly build and release process by @Zhangbaowen-Hashdata in #459
• [Answer Query Using Materialized Views] Consider mutable functions and bypass expressions have no Vars for view query target. by @avamingli in #455
• [AQUMV] Expose the function adjust view query and varno fix. by @avamingli in #469
• Modify weekly build release details by @Zhangbaowen-Hashdata in #477
• Call the query_info_collect_hook directly if expection happens by @foreyes in #481
• Fix record password_history when the role is not allowed to use profile. by @wenchaozhang-123 in #480
• Resolve inconsistent result issue in gpdtm_plpgsql test case by @congxuebin in #491
• Fix cbdb ci not running properly by @Zhangbaowen-Hashdata in #497
• cherry-pick: Work around spurious compiler warning in inet operators by @gfphoenix78 in #499
• Add LoongArch(loongarch64) support to s_lock.h by @wangzw in #500
• Implement some feature of directory table. by @wenchaozhang-123 in #484
• Fix copy to replicated table display copy number is incorrect. by @wenchaozhang-123 in #498
• Fix the correct size of memory block in bitmapinsert by @gfphoenix78 in #495
• re-enable the external FTS ICW by @jiaqizho in #483
• Fix ignore of direct table test files. by @avamingli in #502
• Fix gpinitsystem by @fanfuxiaoran in #490
• Fix compile errors detected by gcc 12 by @gfphoenix78 in #503
• Fix bsearch compare function in guc.c by @gfphoenix78 in #507
• [Unstable cases]Fix Some commands forgot to mark meta track. by @avamingli in #505
• Fix compile error in c++20 by @gfphoenix78 in #510
• change AOCO_Compression test case to validate pg_relation_size and get_ao_compression_ratio within ±10% expected range by @congxuebin in #493
• Maintain materialized view data status. by @avamingli in #501
• Define EXT_OID_START to suggest oid range for extensions. by @avamingli in #514
• Ignore pg_upgrade to make CI happy. by @avamingli in #515
• Reduce flakiness in test fts_segment_reset by @jiaqizho in #518
• make gp_dqa test case stable by @congxuebin in #521
• Doc: list more tools for Cloudberry Database by @tuhaihe in #523
• Fix copy to directory table always return 1. by @wenchaozhang-123 in #522
• Reimplement copy from directory table. by @wenchaozhang-123 in #527
• Add materialized view relative triggers case in SingleNode mode. by @avamingli in #517
• [Answer Query Using Materialized Views] Refactor view query target list process. by @avamingli in #525
• Implementation of Tag. by @wenchaozhang-123 in #444
• Fix segfilecount of AO/AOCO when bulk insertion: COPY by @avamingli in #530
• Feature: Update orafce to 4.9 and enhance it by @foreyes in #524
• [AQUMV]Allow to use normal materialized views to answer query. by @avamingli in #528
• Support copy from directory table for entry distribution policy. by @wenchaozhang-123 in #533
• Small README.md improvement. by @reshke in #534
• Use FDW to query multiple servers as shards by @oppenheimer01 in #320
• Add an option in psql to avoid encoding issues on some platforms by @gfphoenix78 in #535
• Refactor cbdb_log to use vfprintf by @ruhuang2001 in #506
• Update aocsam.c: fix safeFSWriteSize arg type by @reshke in #540
• Update the image to Rockylinux8 to ensure the normal operation of CI by @Zhangbaowen-Hashdata in #556
• Remove unsupported AC_FUNC_FSEEKO macro by @gfphoenix78 in #543
• adjust test cases for the cloudberrydb binary swap test by @congxuebin in #537
• CREATE FOREIGN TABLE LIKE. by @avamingli in #554
• Enable SingleQE join with SegmentGeneralWorkers by @avamingli in #327
• Use syscache lookup in ShouldUseReservedSegno by @gongxun0928 in #541
• Implement READ_STRING_FIELD_NULL serializable read function. by @wenchaozhang-123 in #553
• Fix: free tupleDesc on commit or abort transcation. by @yjhjstz in #551
• Update appendonlywriter.c: fix debug message by @reshke in #564
• Fix crash of COPY FROM on AO/AOCO/PAX partition tables. by @avamingli in #549
• Fix: Add ao_unique_index_build test in greenplum_schedule by @lss602726449 in #562
• Fix copy some directory table to problems. by @wenchaozhang-123 in #550
• Fix bug with base relation truncate for IMMV by @reshke in #570
• Suppress compile-time error in SparseData.h by @reshke in #566
• Support lock directory table. by @wenchaozhang-123 in #572
• Doc: update the alter table help command content by @EcaleD in #574
• Cherry-pick Resgroup V2 and toolkit from GPDB by @jiaqizho in #531
• Fix: no need to do the qual-clause twice by @jiaqizho in #396
• [ORCA]: fallback to postgres optimizer when NL inner plan is index scan by @gfphoenix78 in #565
• Add FIXME about redundant param from 'ivm_visible_in_prestate' call. by @reshke in #578
• Support distributed by clause specification when Create MV if not exists by @reshke in #563
• Cherry pick commits related to recent RESGROUP v2 merge. by @reshke in #579
• Change temp table name used to IMMV to some less frequent sequence of… by @reshke in #581
• Rephrase comment for deferred IVM case by @reshke in #576
• Fix pxf_fragment.c compilation failure by @Terry1504 in #590
• Fix pg_upgrade version parsing when upgrading from Greenplum by @reshke i...

v1.5.4-20240730-weekly

What's Changed

• Add materialized view relative triggers case in SingleNode mode. by @avamingli in #517
• [Answer Query Using Materialized Views] Refactor view query target list process. by @avamingli in #525
• Implementation of Tag. by @wenchaozhang-123 in #444
• Fix segfilecount of AO/AOCO when bulk insertion: COPY by @avamingli in #530
• Feature: Update orafce to 4.9 and enhance it by @foreyes in #524
• [AQUMV]Allow to use normal materialized views to answer query. by @avamingli in #528
• Support copy from directory table for entry distribution policy. by @wenchaozhang-123 in #533
• Small README.md improvement. by @reshke in #534
• Use FDW to query multiple servers as shards by @oppenheimer01 in #320
• Add an option in psql to avoid encoding issues on some platforms by @gfphoenix78 in #535
• Refactor cbdb_log to use vfprintf by @ruhuang2001 in #506

New Contributors

• @reshke made their first contribution in #534
• @oppenheimer01 made their first contribution in #320
• @ruhuang2001 made their first contribution in #506

Full Changelog: 1.5.4-20240723-weekly...1.5.4-20240730-weekly

v1.5.4-20240723-weekly

What's Changed

• make gp_dqa test case stable by @congxuebin in #521
• Doc: list more tools for Cloudberry Database by @tuhaihe in #523
• Fix copy to directory table always return 1. by @wenchaozhang-123 in #522
• Reimplement copy from directory table. by @wenchaozhang-123 in #527

Full Changelog: 1.5.4-20240716-weekly...1.5.4-20240723-weekly

v1.5.4-20240716-weekly

What's Changed

• Fix bsearch compare function in guc.c by @gfphoenix78 in #507
• [Unstable cases]Fix Some commands forgot to mark meta track. by @avamingli in #505
• Fix compile error in c++20 by @gfphoenix78 in #510
• change AOCO_Compression test case to validate pg_relation_size and get_ao_compression_ratio within ±10% expected range by @congxuebin in #493
• Maintain materialized view data status. by @avamingli in #501
• Define EXT_OID_START to suggest oid range for extensions. by @avamingli in #514
• Ignore pg_upgrade to make CI happy. by @avamingli in #515
• Reduce flakiness in test fts_segment_reset by @jiaqizho in #518

Full Changelog: 1.5.4-20240709-weekly...1.5.4-20240716-weekly

v1.5.4-20240709-weekly

What's Changed

• Fix record password_history when the role is not allowed to use profile. by @wenchaozhang-123 in #480
• Resolve inconsistent result issue in gpdtm_plpgsql test case by @congxuebin in #491
• Fix cbdb ci not running properly by @Zhangbaowen-Hashdata in #497
• cherry-pick: Work around spurious compiler warning in inet operators by @gfphoenix78 in #499
• Add LoongArch(loongarch64) support to s_lock.h by @wangzw in #500
• Implement some feature of directory table. by @wenchaozhang-123 in #484
• Fix copy to replicated table display copy number is incorrect. by @wenchaozhang-123 in #498
• Fix the correct size of memory block in bitmapinsert by @gfphoenix78 in #495
• re-enable the external FTS ICW by @jiaqizho in #483
• Fix ignore of direct table test files. by @avamingli in #502
• Fix gpinitsystem by @fanfuxiaoran in #490
• Fix compile errors detected by gcc 12 by @gfphoenix78 in #503

New Contributors

• @congxuebin made their first contribution in #491
• @wangzw made their first contribution in #500

Full Changelog: 1.5.4-20240702-weekly...1.5.4-20240709-weekly

v1.5.4

📝️ What's Changed (Pull Request list)

• Add function cbdb_relation_size by @fanfuxiaoran in #428
• Remove cbload relevant codes. by @wenchaozhang-123 in #431
• Cherry pick from GPDB (02/07/2022-02/28/2022) by @avamingli in #432
• Fix motion toast error. by @gfphoenix78 in #436
• Fix checking password file permissions in dbconn.py by @fanfuxiaoran in #438
• [ORCA] Fix flaky "Invalid key is inaccessible" fallback (#15147) by @fanfuxiaoran in #437
• Refactor cbload to gpdirtableload with python. by @wenchaozhang-123 in #435
• Fix explain(locus) issues. by @avamingli in #433
• [AQUMV] Support DISTINCT clause on origin query. by @avamingli in #439
• [Answer Query Using Materialized Views] Support Postgres special grammar DISTINCT ON clause on origin query. by @avamingli in #441
• Expand a new external var tag by @jiaqizho in #443
• PendingDelete: expand the pending deletes interface by @jiaqizho in #442
• CPP keywords should not be used as function/parameter names by @jiaqizho in #449
• [Answer Query Using Materialized Views] Support LIMIT/OFFSET/FETCH clause on origin query. by @avamingli in #446
• checkberry gpcheckperf series updates are used to solve the problem that cbdb 1.5.2 version gpcheckperf does not display disk information by @August-beaulo in #430
• Cleanup the build tools and guide directories by @tuhaihe in #445
• Insert more data to make tuplestore spill in regress/misc_jiras.sql. by @fanfuxiaoran in #452

🙌🏻️ New Contributors

• @fanfuxiaoran made their first contribution in #428

🧑🏻‍💻 Contributors

Thanks to all the contributors to make this release happen:
@higuoxing, @tuhaihe, @August-beaulo, @avamingli, @piyushc01, @red1452, @edespino, @jnihal, @Annu149, @jiaqizho, @wenchaozhang-123, @dgkimura, @fanfuxiaoran, @gfphoenix78, @HelloYJohn, @adam8157, @xiaoxiaoHe-E, @InnerLife0, @wuyuhao28, @l-wang, @lij55, @huansong, @chrishajas, @tglsfdc, @fairyfar, @kainwen, @nmisch, @my-ship-it

Full Changelog: 1.5.3...1.5.4

---

_{🧂🧪 Try out Cloudberry Database via building one Docker-based Sandbox, which is tailored to help you gain a basic understanding of Cloudberry Database's capabilities and features a range of materials, including tutorials, sample code, and crash courses.}

v1.5.4-20240702-weekly

Note

This is a weekly release for you to try out the latest features of Cloudberry Database.

What's Changed

• Enhance: Add warehouse_id to pg_stat_activity_extended by @lss602726449 in #453
• Modify the orca optimizer's processing of unionall distribution strat… by @Light-City in #399
• Update the location of python-dependencies.txt by @Zhangbaowen-Hashdata in #460
• Add hook for exec_simple_query and support self-defined spilling memory threshold in cost module. by @songdongxiaoa2 in #447
• Fix compile error that pipe is redefined by @gfphoenix78 in #349
• [AQUMV] Use contain_var_clause instead of pull_var_clause. by @avamingli in #451
• directory_table: matchignore & remove meta-command username output by @edespino in #464
• Enhance: Add hook to support different way to create/drop/alter wareh… by @lss602726449 in #462
• Fix: replace gpscp with gpsync in ext fts by @jiaqizho in #470
• Re-used index after ALTER COLUMN TYPE shouldn't change relfilenode by @lss602726449 in #474
• Cherry-pick Resgroup related code from GreenPlum [Mar 2, 2022 - Feb 7, 2023] by @foreyes in #448
• Add weekly build and release process by @Zhangbaowen-Hashdata in #459
• [Answer Query Using Materialized Views] Consider mutable functions and bypass expressions have no Vars for view query target. by @avamingli in #455
• [AQUMV] Expose the function adjust view query and varno fix. by @avamingli in #469
• Modify weekly build release details by @Zhangbaowen-Hashdata in #477
• Call the query_info_collect_hook directly if expection happens by @foreyes in #481

New Contributors

• @Light-City made their first contribution in #399
• @songdongxiaoa2 made their first contribution in #447
• @edespino made their first contribution in #464

Full Changelog: 1.5.4...1.5.4-20240702-weekly

v1.5.3

Caution

Before running the ./configure command to build the Cloudberry Database from version 1.5.3 source code files, make sure to execute the following command to install the dependencies. We have refactored the relative module using Python in PR #435. For the latest source code, you can refer to the original guide for building the Cloudberry Database.

yum install -y go
export GOPROXY=https://goproxy.io,direct

📝️ What's Changed

• default build postgres_fdw by @smartyhero in #400
• [cherry-pick] [7X] gpconfig does not escape '$' char by @Ray-Eldath in #403
• feature: Use amflags to support Column-oriented scanning of custom ta… by @gongxun0928 in #407
• Fix: make enough out data buffer when call EVP_DecryptUpdate (#479) by @kongfanshen-0801 in #408
• Add GUC 'gp_random_insert_segments' to control the segments used for random distributed table insertion by @foreyes in #406
• Doc: update the README.md by @tuhaihe in #411
• Doc: update the deploying README.md by @Zhangbaowen-Hashdata in #409
• Fix: pgrx cannot find function after numeric change interface by @jiaqizho in #410
• Implement of Directory table by @wenchaozhang-123 in #390
• Fix directory table ci pipeline problems. by @wenchaozhang-123 in #414
• Disable dump pax tables in pg_dump by @jiaqizho in #412
• Fix copy from directory table. by @wenchaozhang-123 in #416
• Fix visimap consults for unique checks during UPDATEs by @lss602726449 in #423
• Update the googletest module URL by @tuhaihe in #429
• Fix drop directory privilege check. by @wenchaozhang-123 in #425

🙌🏻️ New Contributors

• @kongfanshen-0801 made their first contribution in #408
• @foreyes made their first contribution in #406

🧑🏻‍💻 Contributors

Thanks to all the contributors to make this release happen: @smartyhero, @Annu149, @Ray-Eldath, @gongxun0928, @kongfanshen-0801, @foreyes, @tuhaihe, @Zhangbaowen-Hashdata, @jiaqizho, @wenchaozhang-123, @lss602726449, @soumyadeep2007, @ashwinstar

Full Changelog: 1.5.2...1.5.3

---

_{🧂🧪 Try out Cloudberry Database via building one Docker-based Sandbox, which is tailored to help you gain a basic understanding of Cloudberry Database's capabilities and features a range of materials, including tutorials, sample code, and crash courses.}

v1.5.2

📝️ What's Changed

• [Answer Query Using Materialized Views] Support GROUP BY, GROUPING SETS, ROLLUP, CUBE in origin query. by @avamingli in #342
• Use pg_class instead of gp_segment_configuration to test Entry. by @avamingli in #294
• Feature: Orca optimizor support pax storage table by @gfphoenix78 in #346
• Add macro RelationIsNonblockRelation to expand code path like AO/CO by @gfphoenix78 in #347
• Feature encoding option for custom table AM by @gfphoenix78 in #343
• Turn on enable_shared_postgres_backend by default by @gfphoenix78 in #351
• [Answer Query Using Materialized Views] Correct PlannerInfo fields after rewritten. by @avamingli in #348
• [Answer Query Using Materialized Views] Support HAVING clause in origin query by @avamingli in #354
• [AQUMV] Avoid misbehaviors that are not supported currently. by @avamingli in #357
• [Answer Query Using Materialized Views] Support ORDER BY in origin query by @avamingli in #358
• make shareinput_Xslice_dsm_handle_ptr and shareinput_Xslice_hash non-static by @shmiwy in #361
• Fix AO/AOCS insertDesc memory issue. by @avamingli in #365
• As ci will failed in upterm stage, revert it now. by @wenchaozhang-123 in #371
• Fix CopyCreateStmtFields, lost intoPolicy field. by @yjhjstz in #372
• Fix configue not consistent with configure.ac by @lss602726449 in #373
• gpssh: removing b and \r getting added to command output by @wenchaozhang-123 in #355
• Don't inherit parent's reloptions if child partition's AM differs by @yjhjstz in #375
• Fix: unstable ao vacuum icw test by @jiaqizho in #376
• Fix shell script involves demo cluster by @gfphoenix78 in #377
• Extend a new AM method to do acquire sample rows. by @wenchaozhang-123 in #374
• [AQUMV] Use view's TupleDesc to construct final columns. by @avamingli in #366
• Fix CREATE TYPE in namespace pg_ext_aux by @gfphoenix78 in #380
• Feature: add tests and benchmark in interconnect module by @jiaqizho in #384
• Fix: initialize parallel_workers to zero for CdbPathLocus_HashedOJ by @HuSen8891 in #387
• Add new callback 'scan_flags' for table access method by @HuSen8891 in #391
• Export numeric structure and interface to public by @jiaqizho in #392
• Move preloaded interconnect to the header file by @gfphoenix78 in #388
• Add inline function 'table_scan_flags' for table AM to get the flags. by @HuSen8891 in #395
• Enhancement: Add gpshrink to support elastic scaling by @lss602726449 in #393
• Fix: redefined sm4 in pgcrypto and backend/crypto by @jiaqizho in #394
• Revert #201 partially by @Ray-Eldath in #386
• Offload entry root slice to QE by @Ray-Eldath in #385

🙌🏻️ New Contributors

• @shmiwy made their first contribution in #361

🧑🏻‍💻 Contributors

Thanks to all the contributors to make this release happen: @avamingli, @gfphoenix78, @shmiwy, @wenchaozhang-123, @yjhjstz, @lss602726449, @jiaqizho, @HuSen8891, @Ray-Eldath 👍

Full Changelog: 1.5.1...1.5.2

---

_{🧂🧪 Try out Cloudberry Database 1.5.2 via building one Docker-based Sandbox, which is tailored to help you gain a basic understanding of Cloudberry Database's capabilities and features a range of materials, including tutorials, sample code, and crash courses.}

v1.5.1

📰️What's Changed

• [Answer Query Using Materialized Views] Refactor codes to new file aqumv.c by @avamingli in #321
• Rename GP parallel words to CBDB parallel. by @avamingli in #293
• Doc: update README.md for CloudberryDB by @tuhaihe in #324
• Fix: Illegal PGnotify declaration by @jiaqizho in #325
• Fix: may cause UAF problem in get_size_from_segDBs by @jiaqizho in #326
• Expose some functions to support PAX for partition tables by @gfphoenix78 in #328
• Refactor the table AM: scan_begin_extractcolumns to contain execution context by @gfphoenix78 in #329
• Doc: update the terminal info to CloudberryDB by @tuhaihe in #300
• Fix \d in psql to show correct storage name from pg_am by @gfphoenix78 in #330
• Move struct workfile_set to workfile_mgr.c by @gfphoenix78 in #331
• Add namespace pg_ext_aux for extension by @gfphoenix78 in #333
• Add dml hook for extensions by @gfphoenix78 in #332
• Add custom object class support by @gfphoenix78 in #335
• Add reloption support for custom table access method by @gfphoenix78 in #336
• Add callback in TableAmRoutine to handle swapping relation files by @gfphoenix78 in #338
• Fix issues about namespace pg_ext_aux by @gfphoenix78 in #340
• Check index unique & skip prefetch for non-heap relation by @gfphoenix78 in #337
• [Answer Query Using Materialized Views] Compute Aggregations on Materialized Views. by @avamingli in #322
• Rename postgres.so to libpostgres.so by @gfphoenix78 in #341

Full Changelog: 1.5.0...1.5.1

🫶🏻Contributors

Thanks to all the contributors to make this release happen: @avamingli, @tuhaihe, @jiaqizho, @gfphoenix78 🙌🏻️

---

_{🧂🧪 Try out Cloudberry Database 1.5.1 via building one Docker-based Sandbox, which is tailored to help you gain a basic understanding of Cloudberry Database's capabilities and features a range of materials, including tutorials, sample code, and crash courses.}