Commit Graph

22203 Commits

Author SHA1 Message Date
shuming.li d9a9d30e12
[Enhancement] Loose check mv's schema for better compatibilities (#63114)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-16 09:56:42 +08:00
zhangqiang ebb9d9ed10
[UT] Refactor some ut (#63095)
Signed-off-by: sevev <qiangzh95@gmail.com>
2025-09-16 09:54:59 +08:00
Harbor Liu b16b523873
[Doc] Add DN matching mechanism for LDAP Group Provider and update documentation (#63115)
Signed-off-by: 絵空事スピリット <wanglichen@starrocks.com>
Co-authored-by: 絵空事スピリット <wanglichen@starrocks.com>
2025-09-16 09:46:56 +08:00
gengjun-git 1d1530ac5c
[Enhancement] Force drop decommissioned backend if all the tablets in recycle bin (#62781)
## Why I'm doing:
The decommission of backend sometimes blocked by tablet in recycle bin.

## What I'm doing:
We can force drop the backend if the following conditions met:
1. All the tablets are in recycle bin.
2. All the replication number of tablets is bigger than the retained backend number(which means there is no backend to migrate, so decommission is blocked), and at least one healthy replica on retained backend.
3. There are at least 1 available backend.

Signed-off-by: gengjun-git <gengjun@starrocks.com>
2025-09-16 09:38:04 +08:00
meegoo a8587012bb
[BugFix] Fix multi statement stream load due to invalid source type (#63044)
Signed-off-by: meegoo <meegoo.sr@gmail.com>
2025-09-16 09:33:40 +08:00
satanson b956f11544
[Enhancement] Full sort use german string for comparison (#62929)
Signed-off-by: satanson <ranpanf@gmail.com>
2025-09-15 20:23:40 +08:00
kangkaisen 1ed65e2a6d
[BugFix] FE audit log missing Client for submit-task flows (#63027)
Signed-off-by: kangkaisen <kangkaisen@apache.org>
2025-09-15 19:20:18 +08:00
Murphy d0463f981b
[Tool] update default configuration of allin1 docker (#63133)
What I'm doing:
Increase the compaction threads in the allin1 docker setup to accelerate the standard load-query cycle.

Signed-off-by: Murphy <mofei@starrocks.com>
2025-09-15 17:02:54 +08:00
PengFei Li d60c76aa52
[Tool] Add CLEANUP block to SQL-tester for reliable per-case teardown (#63068)
## Why I’m doing
- Tests often enable temporary configs, create transient objects, or invoke external side-effects. When a test fails mid-way, ad-hoc cleanup embedded in the test body may be skipped, leaving residue that causes flakiness and cross-test interference.
- This change provides a first-class, always-run teardown mechanism that executes after each case, regardless of pass/fail, improving test reliability and isolation, and simplifying test authoring.

## What I’m doing
- Introduce a CLEANUP block to SQL-tester that defines statements to run in tearDown for each case.
- Semantics:
  - CLEANUP runs unconditionally in tearDown after each case (pass/fail/timeout).
  - Results in CLEANUP are not validated; failures are logged but do not prevent later cleanup steps.
  - Existing built-in cleanup (e.g., dropping parsed DATABASE/RESOURCE) still runs; CLEANUP is additive.
  - In record mode, the CLEANUP block is preserved in-place in the generated R file.
- Syntax and example:
```sql
-- name: my_case
...
CLEANUP {
  -- SQL must end with ';'
  DROP TABLE IF EXISTS t1;
  DROP DATABASE IF EXISTS db_${uuid0};
  -- shell and function are allowed
  shell: echo "cleanup ${uuid0}"
  function: restore_env("arg1")
} END CLEANUP
```

**Code changes**
- test/README.md
  - Document the CLEANUP grammar, usage, semantics, and example.
- test/lib/__init__.py
  - Add CLEANUP/END CLEANUP flags.
- test/lib/choose_cases.py
  - Parse CLEANUP blocks, collect commands, validate format, include in case model, support variable/uuid replacement, and record block in-place during -r mode.
- test/test_sql_cases.py
  - Execute collected CLEANUP commands in tearDown unconditionally; keep record-mode output aligned; ensure built-in database/resource cleanup still runs.

Signed-off-by: PengFei Li <lpengfei2016@gmail.com>
2025-09-15 14:27:43 +08:00
shuming.li 231a243094
[BugFix] Fix mv repair hive base table bug (#63072)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-15 14:14:24 +08:00
He Zhao 9db7b1797e
[Tool] Add JVM options for JDK-17 (#63120)
Add JVM options to make iceberg metadata and Java UD work properly in JDK 17 environment

Signed-off-by: zhaohehuhu <luoyedeyi@163.com>
2025-09-15 13:43:39 +08:00
絵空事スピリット 45bfb2e725
[Doc] Metrics for Fragment Instance State Report (#63112)
Signed-off-by: 絵空事スピリット <wanglichen@starrocks.com>
2025-09-15 05:02:37 +00:00
xiangguangyxg ec460c2c34
[Enhancement] Enhance cluster snapshot restore to support warehouse (#63023)
Signed-off-by: xiangguangyxg <xiangguangyxg@gmail.com>
2025-09-15 11:18:53 +08:00
Simon Griebel f7b21e6eb8
[Enhancement] Directly create a small_permutation in the chunks_sorter_full_sort (#62400)
Signed-off-by: Simon Griebel <s.griebel@celonis.com>
2025-09-15 11:11:03 +08:00
Kevin Cai eef8913640
[UT] add log to help identifying who is the chaos monkey (#62958)
Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
2025-09-15 11:09:33 +08:00
Kevin Cai 742ea6ed37
[Tool] add healthcheck in allin1-ubuntu (#62998)
* get the container health status by
```
docker inspect --format='{{.State.Health.Status}}' NAME|ID
```

Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
2025-09-15 10:51:11 +08:00
wyb 908b55543d
[Doc] Add clone metrics doc (#63073)
Signed-off-by: wyb <wybb86@gmail.com>
Signed-off-by: 絵空事スピリット <wanglichen@starrocks.com>
Co-authored-by: 絵空事スピリット <wanglichen@starrocks.com>
2025-09-15 10:08:15 +08:00
shuming.li ace10b8644
[BugFix] Fix mv agg pushdown rewrite bugs (#63060)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-15 10:05:01 +08:00
meegoo dee025063e
[UT] Fix optimize job test (#63096)
Signed-off-by: meegoo <meegoo.sr@gmail.com>
2025-09-15 09:09:58 +08:00
Qian Ye 288abf88fe
Update README.md
Signed-off-by: Qian Ye <yeqian.zju@gmail.com>
2025-09-12 14:17:01 -07:00
wyb d37927c522
[Enhancement] Add fragment instance exec state report thread pool metrics (#63067)
Signed-off-by: wyb <wybb86@gmail.com>
2025-09-12 18:32:06 +08:00
starrocks-xupeng 536a3f40e5
[Enhancement] support s3 path style in shared-data cluster (#62591)
Signed-off-by: starrocks-xupeng <xupeng@starrocks.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-09-12 08:52:37 +00:00
Murphy 12a5ddf241
[BugFix] change tuning guide format (#63024) 2025-09-12 16:38:34 +08:00
shuming.li b8f5ba622d
[UT] Optimize FE tests' logging output (#62985)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-12 16:23:06 +08:00
shuming.li fd76111263
[UT] Fix unstable case test_mv_rewrite_with_time_series_multi_mvs (#63077)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-12 16:13:47 +08:00
Murphy 180b81f3ff
[BugFix] Fix JSON extraction null column consistency and add validation checks (#63054)
Signed-off-by: Murphy <mofei@starrocks.com>
2025-09-12 16:06:44 +08:00
shuming.li daa33f095e
[Enhancement] Optimize removeDuplicateField performance (#62938)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-12 14:12:54 +08:00
shuming.li 54317498bc
[BugFix] Fix mv rewriter binder bugs (#62919)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-12 14:12:35 +08:00
Murphy 3688bc4bd4
[BugFix] fix hour_from_unixtime rule (#63006) 2025-09-12 13:57:33 +08:00
Harbor Liu 96c4a26560
[BugFix] Update default Spark DPP version to 3.4.0 (#63046) 2025-09-12 13:52:20 +08:00
Harbor Liu 2b1866c39d
[Refactor] Refactors the authentication and authorization context handling in the codebase (#63017) 2025-09-12 13:52:06 +08:00
yan zhang 64446954e7
[BugFix] fix iceberg manifest cache npe in data race condition (#63043)
Signed-off-by: yan zhang <dirtysalt1987@gmail.com>
2025-09-12 13:11:29 +08:00
Dan Roscigno b60400ee56
[Doc] Add 'nei cun' (memory) keyword to best practice overview (#63028)
Signed-off-by: Dan Roscigno <dan@roscigno.com>
Signed-off-by: DanRoscigno <dan@roscigno.com>
2025-09-12 12:44:36 +08:00
Murphy 9a5c49824b
[BugFix] fix bugs of FlatJSON with lake table (#62706)
Signed-off-by: Murphy <mofei@starrocks.com>
Signed-off-by: Murphy <96611012+murphyatwork@users.noreply.github.com>
Co-authored-by: Kevin Cai <caixh.kevin@gmail.com>
2025-09-12 10:21:25 +08:00
SevenJ c9a278a380
[BugFix] fix iceberg read null partition bug (#62934)
Signed-off-by: SevenJ <wenjun7j@gmail.com>
2025-09-12 10:10:38 +08:00
wyb 6f0379cce6
[Enhancement] Make some fe metrics leader awareness (#63004)
Signed-off-by: wyb <wybb86@gmail.com>
2025-09-12 10:02:01 +08:00
starrocks-xupeng f5e9bf81cd
[BugFix] fix shared-data cluster MV does not support colocation (#62941)
Signed-off-by: starrocks-xupeng <xupeng@starrocks.com>
2025-09-12 09:15:45 +08:00
shuming.li 46739ddb91
[Enhancement] Choose best candidate mv with considering input query data layout (#62830)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-11 20:49:12 +08:00
He Zhao 0035df76db
[Enhancement] add catalog and queryId info in ShowProcessList (#62552)
Signed-off-by: zhaohehuhu <luoyedeyi@163.com>
2025-09-11 11:04:48 +00:00
yan zhang 79ee456b9e
[BugFix] fix iceberg table scan exception during scan range deploy (#62994)
Signed-off-by: yan zhang <dirtysalt1987@gmail.com>
2025-09-11 18:06:59 +08:00
shuming.li 32810c222f
[BugFix] Fix view based rewrite bugs (#62918)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-11 17:14:32 +08:00
Kevin Cai 2b09c4d884
[BugFix] Revert #62916 (#63007)
Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
2025-09-11 16:53:17 +08:00
Harbor Liu 241a3e5451
[Refactor] Remove hardcoded version numbers in build.gradle.kts and pom.xml (#62987) 2025-09-11 16:14:51 +08:00
Claire ac256e0ec1
[BugFix] Gracefully Shutdown Compute Node on Exit (#62916)
Fixes #62915

Signed-off-by: Claire Fei <cfei@atlassian.com>
2025-09-11 15:56:31 +08:00
Kevin Cai 6582d48d19
[UT] fix ut ASAN leak, wait for all rpc requests done before exit (#62986)
Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
2025-09-11 14:06:56 +08:00
Harbor Liu c7a26ab0ae
[Refactor] Refactors how function references are handled during backup and restore operations (#62923) 2025-09-11 12:58:24 +08:00
PengFei Li 46c2d5cf1d
[BugFix] Fix stream load exec status update NPE (#62921)
Signed-off-by: PengFei Li <lpengfei2016@gmail.com>
2025-09-11 10:04:30 +08:00
Dan Roscigno a533fc23ab
[Doc] Add keywords for resource group documentation (#62959)
Signed-off-by: Dan Roscigno <dan@roscigno.com>
2025-09-11 09:57:10 +08:00
Dan Roscigno e2537370ba
[Doc] Update JDBC connector download link for Tableau (#62960)
Signed-off-by: Dan Roscigno <dan@roscigno.com>
Signed-off-by: 絵空事スピリット <wanglichen@starrocks.com>
Co-authored-by: 絵空事スピリット <wanglichen@starrocks.com>
2025-09-11 09:56:52 +08:00
stdpain 78af5073e1
[BugFix] Fix some use-after-free issues (#62917)
Signed-off-by: stdpain <drfeng08@gmail.com>
2025-09-11 09:52:23 +08:00