feat: merge main to v0.9 #3961

tobegit3hub · 2024-07-18T01:32:39Z

Merge main to v0.9.

Co-authored-by: lijiangnan <[email protected]>

* refactor!: relocate go sdk moving to https://github.com/4paradigm/openmldb-go-sdk * go readme * ci: fix sdk workflow

raw SQL request mode example was wrong because execute_mode should be request

* fix: make clients use auth by default * fix: let skip auth flag only affect verify

* fix: make clients use auth by default * fix: let skip auth flag only affect verify * feat: tablets get user table remotely * fix: use FLAGS_system_table_replica_num for user table

…ient (4paradigm#3910)

* feat: merge AIOS DAG SQL * feat: mergeDAGSQL * add AIOSUtil * feat: add AIOS merge SQL test case * feat: split margeDAGSQL and validateSQLInRequest

* fix: gcformat space * fix: gcformat continuous sign use hash * fix: delete incorrect comments

* Set s3 and aws dependencies ad provided (4paradigm#3897) * feat: execlude zookeeper for curator (4paradigm#3899) * Execlude zookeeper when using curator * Fix local build java

* fix: make clients use auth by default * fix: let skip auth flag only affect verify * feat: tablets get user table remotely * fix: use FLAGS_system_table_replica_num for user table * feat: consistent user cruds * fix: pass instance of tablet and nameserver into auth lambda to allow locking * feat: best effort try to flush user data to all tablets * fix: lock scope * fix: stop user sync thread safely * fix: default values for user table columns

* feat(parser): simple ANSI SQL rewriter * feat(draft): translate request mode query * feat: request query rewriter * test: tpc rewrite cases * feat(rewrite): enable ansi sql rewriter in `ExecuteSQL` You may explicitly set this feature on via `set session ansi_sql_rewriter = 'true'` TODO: this rewriter feature should be off by default

…digm#3948) Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.18 to 1.26.19. - [Release notes](https://github.com/urllib3/urllib3/releases) - [Changelog](https://github.com/urllib3/urllib3/blob/1.26.19/CHANGES.rst) - [Commits](urllib3/urllib3@1.26.18...1.26.19) --- updated-dependencies: - dependency-name: urllib3 dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

)

* feat(udf): array_combine * feat(udf): new functions - array_combine - array_join * feat: casting arrays to array<string> for array_combine WIP, string allocation need fix * fix: array_combine with non-string types * feat(array_combine): handle null inputs * fix(array_combine): behavior tweaks - use empty string if delimiter is null - restrict to array_combine(string, array<T> ...)

* feat: change user table to match mysql * feat: support user authz * fix: cean up created users

…igm#3951) Bumps [requests](https://github.com/psf/requests) from 2.31.0 to 2.32.2. - [Release notes](https://github.com/psf/requests/releases) - [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md) - [Commits](psf/requests@v2.31.0...v2.32.2) --- updated-dependencies: - dependency-name: requests dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps org.apache.derby:derby from 10.14.2.0 to 10.17.1.0. --- updated-dependencies: - dependency-name: org.apache.derby:derby dependency-type: direct:development ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [org.postgresql:postgresql](https://github.com/pgjdbc/pgjdbc) from 42.3.3 to 42.3.9. - [Release notes](https://github.com/pgjdbc/pgjdbc/releases) - [Changelog](https://github.com/pgjdbc/pgjdbc/blob/master/CHANGELOG.md) - [Commits](pgjdbc/pgjdbc@REL42.3.3...REL42.3.9) --- updated-dependencies: - dependency-name: org.postgresql:postgresql dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* feat: iot table * fix * fix * fix delete key entry * fix comment * ut * ut test * fix ut * sleep more for truncate * sleep 16 * tool pytest fix and swig fix * fix * clean * move to base * fix * fix coverage ut * fix --------- Co-authored-by: Huang Wei <[email protected]>

* feat(open-mysql-db): refactor 1. remove unnecessary instance var port 2. fix cause null bug 3. remove unnecessary throws 4. fix ctx.close() sequence bug 5. config sessionTimeout and requestTimeout 6. add docs of SqlEngine * feat(open-mysql-db): refactor * feat(open-mysql-db): revert passsword * feat(open-mysql-db): mock commit and schema table count * feat(open-mysql-db): replace data type text with string * feat(open-mysql-db): remove null --------- Co-authored-by: yangwucheng <[email protected]>

* fix: drop aggr tables in drop table * fix * fix test * fix * fix --------- Co-authored-by: Huang Wei <[email protected]>

* ci(4paradigm#3954): fix checkout action on old glibc OS * ci: include checkout fix in all workflows * ci: fix python-sdk

node-3 is not available, moving to node-2

…radigm#3943)

$SPARK_HOME may be a symbolic link referring to a invalid directory, so we'd try 'rm -f' first

github-actions · 2024-07-18T02:07:44Z

SDK Test Report

100 files - 2 100 suites - 2 2m 6s ⏱️ -6s
318 tests - 39 308 ✅ - 35 10 💤 - 4 0 ❌ ±0
446 runs - 37 436 ✅ - 33 10 💤 - 4 0 ❌ ±0

Results for commit 6b37c8d. ± Comparison against base commit 2bc38dd.

github-actions · 2024-07-18T02:22:50Z

HybridSE Mac Test Report

0 tests 0 ✅ 0s ⏱️
0 suites 0 💤
0 files 0 ❌

Results for commit 6b37c8d.

github-actions · 2024-07-18T02:22:50Z

HybridSE Linux Test Report

20 433 tests 20 431 ✅ 6m 51s ⏱️
262 suites 2 💤
69 files 0 ❌

Results for commit 6b37c8d.

codecov · 2024-07-18T03:21:14Z

Codecov Report

Attention: Patch coverage is 55.35778% with 1254 lines in your changes missing coverage. Please review.

Project coverage is 77.90%. Comparing base (2bc38dd) to head (6b37c8d).

Files	Patch %	Lines
src/storage/index_organized_table.cc	0.00%	404 Missing ⚠️
src/sdk/sql_cluster_router.cc	35.29%	187 Missing ⚠️
src/storage/iot_segment.cc	33.96%	173 Missing ⚠️
src/tablet/tablet_impl.cc	45.74%	134 Missing ⚠️
src/storage/iot_segment.h	11.11%	80 Missing ⚠️
src/base/index_util.cc	0.00%	57 Missing ⚠️
hybridse/src/rewriter/ast_rewriter.cc	85.13%	44 Missing ⚠️
src/client/tablet_client.cc	28.57%	40 Missing ⚠️
hybridse/src/codegen/array_ir_builder.cc	68.42%	18 Missing ⚠️
hybridse/src/codegen/struct_ir_builder.cc	67.85%	18 Missing ⚠️
... and 22 more

Additional details and impacted files

@@              Coverage Diff              @@
##               v0.9    #3961       +/-   ##
=============================================
+ Coverage     41.22%   77.90%   +36.68%     
=============================================
  Files           197      566      +369     
  Lines         11806   125671   +113865     
  Branches       1441        0     -1441     
=============================================
+ Hits           4867    97905    +93038     
- Misses         6635    27766    +21131     
+ Partials        304        0      -304

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

github-actions · 2024-07-18T03:47:52Z

Linux Test Report

60 files + 1 253 suites +1 1h 58m 19s ⏱️ + 6m 41s
13 605 tests + 96 13 598 ✅ + 96 7 💤 ±0 0 ❌ ±0
19 317 runs +136 19 310 ✅ +136 7 💤 ±0 0 ❌ ±0

Results for commit 6b37c8d. ± Comparison against base commit 2bc38dd.

greatljn and others added 30 commits April 28, 2024 12:43

feat: sbin use the generated zk conf (4paradigm#3901)

3d9eb1e

Co-authored-by: lijiangnan <[email protected]>

refactor!: relocate go sdk (4paradigm#3889)

d9bb344

* refactor!: relocate go sdk moving to https://github.com/4paradigm/openmldb-go-sdk * go readme * ci: fix sdk workflow

docs: fix example (4paradigm#3907)

1632b3a

raw SQL request mode example was wrong because execute_mode should be request

fix: make clients use always send auth info (4paradigm#3906)

8ce7d72

* fix: make clients use auth by default * fix: let skip auth flag only affect verify

feat: tablets get user table remotely (4paradigm#3918)

7269141

* fix: make clients use auth by default * fix: let skip auth flag only affect verify * feat: tablets get user table remotely * fix: use FLAGS_system_table_replica_num for user table

fix: recoverdata support load disk table (4paradigm#3888)

c5ecca7

docs: add map desc in create table (4paradigm#3912)

ebc4978

ci(4paradigm#3904): python mac jobs fix (4paradigm#3905)

a92f187

fix(4paradigm#3909): checkout execute_mode in config clause in sql cl…

6569b42

…ient (4paradigm#3910)

feat: merge dag sql (4paradigm#3911)

673ab1d

* feat: merge AIOS DAG SQL * feat: mergeDAGSQL * add AIOSUtil * feat: add AIOS merge SQL test case * feat: split margeDAGSQL and validateSQLInRequest

fix: gcformat space and continuous sign (4paradigm#3921)

63d3a17

* fix: gcformat space * fix: gcformat continuous sign use hash * fix: delete incorrect comments

feat: merge 090 features to main (4paradigm#3929)

ba817e4

* Set s3 and aws dependencies ad provided (4paradigm#3897) * feat: execlude zookeeper for curator (4paradigm#3899) * Execlude zookeeper when using curator * Fix local build java

Run script to update post release version (4paradigm#3931)

5bbf9e3

feat(udf): isin (4paradigm#3939)

818d292

feat(4paradigm#3916): support @@execute_mode = 'request' (4paradigm#3924

6b06e38

)

feat: support batchrequest in ProcessQuery (4paradigm#3938)

e3da2a6

feat: user authz (4paradigm#3941)

2a73952

* feat: change user table to match mysql * feat: support user authz * fix: cean up created users

fix: drop aggr tables in drop table (4paradigm#3908)

c8ae8f8

* fix: drop aggr tables in drop table * fix * fix test * fix * fix --------- Co-authored-by: Huang Wei <[email protected]>

ci(4paradigm#3954): fix checkout action on old glibc OS (4paradigm#3955)

cd905da

* ci(4paradigm#3954): fix checkout action on old glibc OS * ci: include checkout fix in all workflows * ci: fix python-sdk

test: node-2 to node-3 (4paradigm#3957)

b6ffe03

node-3 is not available, moving to node-2

feat: support locate(substr, str[, pos]) function(4paradigm#820) (4pa…

9a81683

…radigm#3943)

aceforeverd and others added 3 commits July 12, 2024 13:25

fix(scripts): deploy spark correctly (4paradigm#3958)

c2a754f

$SPARK_HOME may be a symbolic link referring to a invalid directory, so we'd try 'rm -f' first

Add changelog for 0.9.1 (4paradigm#3959)

60e4fb5

Resolve conflict

6b37c8d

tobegit3hub self-assigned this Jul 18, 2024

yangwucheng approved these changes Jul 18, 2024

View reviewed changes

aceforeverd approved these changes Jul 18, 2024

View reviewed changes

tobegit3hub merged commit ba5e85b into 4paradigm:v0.9 Jul 18, 2024
29 of 35 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: merge main to v0.9 #3961

feat: merge main to v0.9 #3961

tobegit3hub commented Jul 18, 2024

github-actions bot commented Jul 18, 2024

github-actions bot commented Jul 18, 2024

github-actions bot commented Jul 18, 2024

codecov bot commented Jul 18, 2024

github-actions bot commented Jul 18, 2024

feat: merge main to v0.9 #3961

feat: merge main to v0.9 #3961

Conversation

tobegit3hub commented Jul 18, 2024

github-actions bot commented Jul 18, 2024

SDK Test Report

github-actions bot commented Jul 18, 2024

HybridSE Mac Test Report

github-actions bot commented Jul 18, 2024

HybridSE Linux Test Report

codecov bot commented Jul 18, 2024

Codecov Report

github-actions bot commented Jul 18, 2024

Linux Test Report