Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: merge main to v0.9 #3961

Merged
merged 33 commits into from
Jul 18, 2024

Conversation

tobegit3hub
Copy link
Collaborator

  • Merge main to v0.9.

greatljn and others added 30 commits April 28, 2024 12:43
* refactor!: relocate go sdk

moving to https://github.com/4paradigm/openmldb-go-sdk

* go readme

* ci: fix sdk workflow
raw SQL request mode example was wrong because execute_mode should be request
* fix: make clients use auth by default

* fix: let skip auth flag only affect verify
* fix: make clients use auth by default

* fix: let skip auth flag only affect verify

* feat: tablets get user table remotely

* fix: use FLAGS_system_table_replica_num for user table
* feat: merge AIOS DAG SQL

* feat: mergeDAGSQL

* add AIOSUtil

* feat: add AIOS merge SQL test case

* feat: split margeDAGSQL and validateSQLInRequest
* fix: gcformat space

* fix: gcformat continuous sign use hash

* fix: delete incorrect comments
* Set s3 and aws dependencies ad provided (4paradigm#3897)

* feat: execlude zookeeper for curator (4paradigm#3899)

* Execlude zookeeper when using curator

* Fix local build java
* fix: make clients use auth by default

* fix: let skip auth flag only affect verify

* feat: tablets get user table remotely

* fix: use FLAGS_system_table_replica_num for user table

* feat: consistent user cruds

* fix: pass instance of tablet and nameserver into auth lambda to allow locking

* feat: best effort try to flush user data to all tablets

* fix: lock scope

* fix: stop user sync thread safely

* fix: default values for user table columns
* feat(parser): simple ANSI SQL rewriter

* feat(draft): translate request mode query

* feat: request query rewriter

* test: tpc rewrite cases

* feat(rewrite): enable ansi sql rewriter in `ExecuteSQL`

You may explicitly set this feature on via `set session ansi_sql_rewriter
= 'true'`

TODO: this rewriter feature should be off by default
…digm#3948)

Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.18 to 1.26.19.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/1.26.19/CHANGES.rst)
- [Commits](urllib3/urllib3@1.26.18...1.26.19)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* feat(udf): array_combine

* feat(udf): new functions

- array_combine
- array_join

* feat: casting arrays to array<string> for array_combine

WIP, string allocation need fix

* fix: array_combine with non-string types

* feat(array_combine): handle null inputs

* fix(array_combine): behavior tweaks

- use empty string if delimiter is null
- restrict to array_combine(string, array<T> ...)
* feat: change user table to match mysql

* feat: support user authz

* fix: cean up created users
…igm#3951)

Bumps [requests](https://github.com/psf/requests) from 2.31.0 to 2.32.2.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](psf/requests@v2.31.0...v2.32.2)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps org.apache.derby:derby from 10.14.2.0 to 10.17.1.0.

---
updated-dependencies:
- dependency-name: org.apache.derby:derby
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [org.postgresql:postgresql](https://github.com/pgjdbc/pgjdbc) from 42.3.3 to 42.3.9.
- [Release notes](https://github.com/pgjdbc/pgjdbc/releases)
- [Changelog](https://github.com/pgjdbc/pgjdbc/blob/master/CHANGELOG.md)
- [Commits](pgjdbc/pgjdbc@REL42.3.3...REL42.3.9)

---
updated-dependencies:
- dependency-name: org.postgresql:postgresql
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* feat: iot table

* fix

* fix

* fix delete key entry

* fix comment

* ut

* ut test

* fix ut

* sleep more for truncate

* sleep 16

* tool pytest fix and swig fix

* fix

* clean

* move to base

* fix

* fix coverage ut

* fix

---------

Co-authored-by: Huang Wei <[email protected]>
* feat(open-mysql-db): refactor

1. remove unnecessary instance var port
2. fix cause null bug
3. remove unnecessary throws
4. fix ctx.close() sequence bug
5. config sessionTimeout and requestTimeout
6. add docs of SqlEngine

* feat(open-mysql-db): refactor

* feat(open-mysql-db): revert passsword

* feat(open-mysql-db): mock commit and schema table count

* feat(open-mysql-db): replace data type text with string

* feat(open-mysql-db): remove null

---------

Co-authored-by: yangwucheng <[email protected]>
* fix: drop aggr tables in drop table

* fix

* fix test

* fix

* fix

---------

Co-authored-by: Huang Wei <[email protected]>
* ci(4paradigm#3954): fix checkout action on old glibc OS

* ci: include checkout fix in all workflows

* ci: fix python-sdk
node-3 is not available, moving to node-2
aceforeverd and others added 3 commits July 12, 2024 13:25
$SPARK_HOME may be a symbolic link referring to a invalid directory, so
we'd try 'rm -f' first
@tobegit3hub tobegit3hub self-assigned this Jul 18, 2024
@github-actions github-actions bot added documentation Improvements or additions to documentation workflow CICD related build openmldb compiling and installing sdk openmldb java/python sdk execute-engine hybridse sql engine storage-engine openmldb storage engine. nameserver & tablet extensions airflow, kafaka extensions go-sdk labels Jul 18, 2024
Copy link
Contributor

SDK Test Report

100 files   -  2  100 suites   - 2   2m 6s ⏱️ -6s
318 tests  - 39  308 ✅  - 35  10 💤  - 4  0 ❌ ±0 
446 runs   - 37  436 ✅  - 33  10 💤  - 4  0 ❌ ±0 

Results for commit 6b37c8d. ± Comparison against base commit 2bc38dd.

Copy link
Contributor

HybridSE Mac Test Report

0 tests   0 ✅  0s ⏱️
0 suites  0 💤
0 files    0 ❌

Results for commit 6b37c8d.

Copy link
Contributor

HybridSE Linux Test Report

20 433 tests   20 431 ✅  6m 51s ⏱️
   262 suites       2 💤
    69 files         0 ❌

Results for commit 6b37c8d.

Copy link

codecov bot commented Jul 18, 2024

Codecov Report

Attention: Patch coverage is 55.35778% with 1254 lines in your changes missing coverage. Please review.

Project coverage is 77.90%. Comparing base (2bc38dd) to head (6b37c8d).

Files Patch % Lines
src/storage/index_organized_table.cc 0.00% 404 Missing ⚠️
src/sdk/sql_cluster_router.cc 35.29% 187 Missing ⚠️
src/storage/iot_segment.cc 33.96% 173 Missing ⚠️
src/tablet/tablet_impl.cc 45.74% 134 Missing ⚠️
src/storage/iot_segment.h 11.11% 80 Missing ⚠️
src/base/index_util.cc 0.00% 57 Missing ⚠️
hybridse/src/rewriter/ast_rewriter.cc 85.13% 44 Missing ⚠️
src/client/tablet_client.cc 28.57% 40 Missing ⚠️
hybridse/src/codegen/array_ir_builder.cc 68.42% 18 Missing ⚠️
hybridse/src/codegen/struct_ir_builder.cc 67.85% 18 Missing ⚠️
... and 22 more
Additional details and impacted files
@@              Coverage Diff              @@
##               v0.9    #3961       +/-   ##
=============================================
+ Coverage     41.22%   77.90%   +36.68%     
=============================================
  Files           197      566      +369     
  Lines         11806   125671   +113865     
  Branches       1441        0     -1441     
=============================================
+ Hits           4867    97905    +93038     
- Misses         6635    27766    +21131     
+ Partials        304        0      -304     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

Linux Test Report

    60 files  +  1     253 suites  +1   1h 58m 19s ⏱️ + 6m 41s
13 605 tests + 96  13 598 ✅ + 96  7 💤 ±0  0 ❌ ±0 
19 317 runs  +136  19 310 ✅ +136  7 💤 ±0  0 ❌ ±0 

Results for commit 6b37c8d. ± Comparison against base commit 2bc38dd.

@tobegit3hub tobegit3hub merged commit ba5e85b into 4paradigm:v0.9 Jul 18, 2024
29 of 35 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build openmldb compiling and installing documentation Improvements or additions to documentation execute-engine hybridse sql engine extensions airflow, kafaka extensions go-sdk sdk openmldb java/python sdk storage-engine openmldb storage engine. nameserver & tablet workflow CICD related
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants