Commit Graph

22100 Commits

Author SHA1 Message Date
Qian Ye 7b664baabb
Update README.md
Signed-off-by: Qian Ye <yeqian.zju@gmail.com>
2025-09-24 12:52:28 -07:00
SevenJ ffa6a5f504
[Enhancement] revise some hive catalog cache code (#63459)
Signed-off-by: SevenJ <wenjun7j@gmail.com>
2025-09-24 12:29:46 +00:00
stephen 7d81781448
[Feature] support asof join (BE Part) (#63236)
Signed-off-by: stephen <stephen5217@163.com>
2025-09-24 17:15:36 +08:00
yandongxiao 23965e357e
[BugFix] Remove the deregister logic from container (#63085)
Signed-off-by: yandongxiao <yandongxiao@starrocks.com>
2025-09-24 16:37:38 +08:00
yan zhang 3b0bee9731
[UT] fix unstable distance function cases because of precision (#63502)
Signed-off-by: yan zhang <dirtysalt1987@gmail.com>
2025-09-24 16:24:04 +08:00
Seaven 55e5a292e9
[BugFix] Fix array type analyze (#63371)
Signed-off-by: Seaven <seaven_7@qq.com>
2025-09-24 16:09:27 +08:00
predator4ann 80316d0e75
[Feature] Enable DCG for COLUMN_UPSERT_MODE in Lake PK tables (#61806)
Signed-off-by: predator4ann <yunlong.sun@hotmail.com>
2025-09-24 15:15:47 +08:00
predator4ann 7f5710459a
[BugFix] Fix dcg data not read correctly when switching from column mode to row mode in partial update (#61529)
Signed-off-by: predator4ann <yunlong.sun@hotmail.com>
2025-09-24 15:09:11 +08:00
stephen b9176a4696
[UT] fix unstable sql test (#63503)
Signed-off-by: stephen <stephen5217@163.com>
2025-09-24 15:04:56 +08:00
satanson 0c45329a51
[Enhancement] Low cardinality optimization on analytic operator obove table functions (#63378)
Signed-off-by: satanson <ranpanf@gmail.com>
2025-09-24 14:43:35 +08:00
starrocks-xupeng 6904592d66
[BugFix] update staros to v3.5-rc4 (#63398)
Signed-off-by: starrocks-xupeng <xupeng@starrocks.com>
2025-09-24 04:41:22 +00:00
stephen ffcdee9f20
[UT] Delete the accidentally added jar (#63491)
Signed-off-by: stephen <stephen5217@163.com>
2025-09-24 12:29:06 +08:00
絵空事スピリット 6e343ed0ad
[Doc] Update SQL Blacklist Doc (#63457) 2025-09-24 11:42:09 +08:00
chelsea ebf233f8bb
[Doc]Update iceberg_catalog.md (#63317)
Signed-off-by: chelsea <48942089+wangsimo0@users.noreply.github.com>
Signed-off-by: 絵空事スピリット <wanglichen@starrocks.com>
Co-authored-by: 絵空事スピリット <wanglichen@starrocks.com>
2025-09-24 11:42:00 +08:00
絵空事スピリット dd56f7ea9c
[Doc] Remove SELECT INTO OUTFILE from Doc (#63478) 2025-09-24 11:24:18 +08:00
Martin Bogusz 4f33574e11
[Enhancement] Replace assert_regexp_matches with assert_regex for python 3.12 in test/lib (#63456)
## Why I'm doing:
nose.tools maps assert_regexp_matches to unittest `AssertRegexpMatches`.
`AssertRegexpMatches` got renamed to `AssertRegex` and  is deprecated since python 3.2. The alias got removed in 3.12 ([changelog](49e83e31bd/Doc/whatsnew/3.12.rst (unittest-1))). 
When running with `python >= 3.12` this will result in `AttributeError: module 'nose.tools' has no attribute 'assert_regexp_matches'`.

## What I'm doing:
Replacing occurences of assert_regexp_matches with assert_regex.

Signed-off-by: m.bogusz <m.bogusz@celonis.com>
2025-09-24 11:19:19 +08:00
Gavin 746392b8d2
[Doc] Add document for iceberg table sorting function. (#63392)
Signed-off-by: GavinMar <yangguansuo@starrocks.com>
Signed-off-by: 絵空事スピリット <wanglichen@starrocks.com>
Co-authored-by: 絵空事スピリット <wanglichen@starrocks.com>
2025-09-24 02:50:44 +00:00
PengFei Li 51cbf55797
[BugFix] Fix zone map incorrect filtering after CHAR to VARCHAR fast schema evolution in shared-data (#63377)
Signed-off-by: PengFei Li <lpengfei2016@gmail.com>
2025-09-24 09:55:00 +08:00
gengjun-git 55917b4f85
[Refactor] Refactor NodeMgr/SystemInfoService/BrokerMgr persist code to update memory state in WALApplier (#62336)
Signed-off-by: gengjun-git <gengjun@starrocks.com>
2025-09-24 09:34:40 +08:00
Youngwb 0086d0fd33
[Enhancement] Cache parquet column batch for delta lake metadata (#63441) 2025-09-24 09:32:32 +08:00
before-Sunrise 86fdf35bcf
[BugFix] Fix query detail lost audit items (#63237)
Signed-off-by: before-Sunrise <unclejyj@gmail.com>
2025-09-23 09:00:42 -07:00
Yixin Luo 5ae19c32f4
[Enhancement] enable pk parallel execution when meet large import and compaction (#63219)
Signed-off-by: luohaha <18810541851@163.com>
2025-09-23 12:20:19 +00:00
meegoo cff0ceb1e9
[Enhancement] Pass stream load label directly to TransactionStmtExecutor (#63334)
Signed-off-by: meegoo <meegoo.sr@gmail.com>
2025-09-23 20:13:37 +08:00
Murphy 8679ef0d0f
[BugFix] remove the annoying warning log of json (#63414) 2025-09-23 18:36:52 +08:00
satanson e9d79fb9d9
[BugFix] Forget left join flag of table function when applying array low cardinality optimization (#63419)
Signed-off-by: satanson <ranpanf@gmail.com>
2025-09-23 16:43:40 +08:00
chewbum 2dfa1bc8cd
[BugFix] Call isQueryStmt in execute function (#63387) 2025-09-23 16:09:35 +08:00
stephen 970daa2095
[UT] Fix floating-point precision test failures on ARM platforms (#63427)
Signed-off-by: stephen <stephen5217@163.com>
2025-09-23 15:10:35 +08:00
stephen 4da369ded4
[BugFix] Fix infinite loop when inserting decimal256 data on ARM platforms (#63406)
Signed-off-by: stephen <stephen5217@163.com>
2025-09-23 15:08:34 +08:00
Youngwb 6177074ae5
[Enhancement] Optimize logging error message for delta lake (#63389) 2025-09-23 14:57:53 +08:00
shuming.li b32a74e007
[Enhancement] [BugFix] Ensure fast fail if cngroup is not available (#63314)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-23 14:33:36 +08:00
srlch 5bbd2ed15a
[BugFix] Fix dcg meta inconsistency when partial update with auto increment column in column upsert mode. (#63370)
Signed-off-by: srlch <linzichao@starrocks.com>
2025-09-23 14:12:42 +08:00
PengFei Li 335fddc43e
[BugFix] Fix incompatible bitmap index reuse for fast schema evolution in shared-data (#63315)
Signed-off-by: PengFei Li <lpengfei2016@gmail.com>
2025-09-23 13:37:15 +08:00
nillin d93cbaf2c5
[Enhancement] Add be jvm memory metrics (#62210)
Signed-off-by: wenbinlin <wenbinlin@tencent.com>
2025-09-23 12:18:54 +08:00
He Zhao 179d4720e3
[Enhancement] QueryDetailActionV2 and QueryProfileActionV2 APIs return json result (#63235)
Signed-off-by: zhaohehuhu <luoyedeyi@163.com>
2025-09-23 11:59:28 +08:00
絵空事スピリット 44fed437f5
[Doc] Flink Connector 1.2.12 Doc (#63386) 2025-09-23 11:36:05 +08:00
絵空事スピリット 5050ffc263
[Doc] Flick Connector 1.2.12 Release Notes (#63379) 2025-09-23 11:35:53 +08:00
meegoo 9dad29ab51
[Enhancement] Enforce request consistency for channel stream load (#63347)
Signed-off-by: meegoo <meegoo.sr@gmail.com>
2025-09-23 10:55:21 +08:00
絵空事スピリット eb306cde2d
[Doc] Update Feature Support for Iceberg (#63288)
Signed-off-by: 絵空事スピリット <wanglichen@starrocks.com>
2025-09-23 10:33:43 +08:00
Harbor Liu d2056b78b0
[Enhancement] Support revoke external group and add more test case (#63385) 2025-09-23 10:16:09 +08:00
Murphy c9e682a10f
[Enhancement] optimize analyze profile format (#63326) 2025-09-23 10:15:19 +08:00
stephen 30df6bb044
[Enhancement] Implement SQL standard JOIN USING with MySQL compatibility (#63312)
Signed-off-by: stephen <stephen5217@163.com>
2025-09-23 10:05:50 +08:00
Gavin 67ceccc525
[BugFix] Fix the issue that create spill directory failed when writing data to iceberg table. (#63278)
Signed-off-by: GavinMar <yangguansuo@starrocks.com>
2025-09-23 09:41:43 +08:00
SevenJ 737dc0ed19
[Enhancement] revise iceberg cache paramters (#63373)
Signed-off-by: SevenJ <wenjun7j@gmail.com>
2025-09-22 17:10:11 +08:00
Murphy 91ff95b980
[Refactor] SegmentIterator::ScanContext (#63333)
Signed-off-by: Murphy <mofei@starrocks.com>
Signed-off-by: Murphy <96611012+murphyatwork@users.noreply.github.com>
Co-authored-by: wyb <wybb86@gmail.com>
2025-09-22 15:40:51 +08:00
Harbor Liu 0bbbae8cef
[Enhancement] Implement grant and revoke role functionality for external groups (#63258)
What I'm doing:
This pull request adds support for granting and revoking roles to user groups in the authorization system. It introduces new methods and data structures to manage the mapping between groups and roles, ensures persistence and replay of these operations, and updates the privilege loading logic to include group-based roles. The changes also update relevant SQL analyzers and statement visitors to handle group-related role grants and revokes.

Group-to-Role Grant/Revoke Functionality:

Added a new groupToRoleList map in AuthorizationMgr to track which roles are assigned to each group, along with methods to grant and revoke roles for groups (grantRoleToGroup, revokeRoleFromGroup, and their replay counterparts). These actions are now handled in the main grantRole and revokeRole methods. [1] [2] [3] [4] [5]
Introduced the UpdateGroupToRoleLog class to persist group-to-role assignments and removals, and added new operation types (OP_GRANT_ROLE_TO_GROUP, OP_REVOKE_ROLE_FROM_GROUP) for edit log handling. [1] [2]
Updated the edit log and deserialization logic to support the new group-to-role operations, ensuring they are correctly replayed during recovery. [1] [2] [3]
Privilege Resolution and Query Enhancements:

Modified privilege collection loading to include roles assigned via group membership, so users gain the union of their direct and group-based roles. [1] [2]
Added methods to query roles assigned to a group, both by role ID and by role name, for use in privilege checks and metadata queries. [1] [2]
SQL Analyzer and Visitor Updates:

Updated the SQL analyzer and statement visitor logic to support group-based role grants and revokes, ensuring correct validation and privilege checks for group operations. [1] [2] [3] [4]
Persistence and Initialization:

Ensured that the groupToRoleList map is persisted and restored during authorization manager state load, maintaining group-role relationships across restarts.
These changes collectively enable group-based role management, improving flexibility and scalability of privilege assignment in the system.
2025-09-22 14:56:37 +08:00
kyle-goodale-klaviyo ce6b0525c6
[BugFix] Fix bug where reserved words in iceberg partitions break toThrift (#63243) 2025-09-22 14:11:28 +08:00
Kevin Cai 9cd12321c1
[BugFix] fix delete predicate edge case (#63339)
Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
2025-09-22 04:57:59 +00:00
Yixin Luo bb7a7ace8c
[BugFix] Fix pk index cumulative compaction strategy when max_rss_rowid is same (#63277)
Signed-off-by: luohaha <18810541851@163.com>
2025-09-22 11:48:12 +08:00
Harbor Liu 19bc2cc92b
[Refactor] Add mechanism to normalize names during parsing (#63309) 2025-09-22 10:15:25 +08:00
shuming.li df70c18210
[Enhancement] Enhance iceberg incremental scan read (#63290)
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
2025-09-22 10:02:48 +08:00