Commit Graph

44 Commits

Author SHA1 Message Date
stdpain 6c0693fbf6
[Enhancement] support column zero copy read from page cache (#62331)
Signed-off-by: stdpain <drfeng08@gmail.com>
2025-09-08 14:17:12 +08:00
Murphy bf792a6455
[BugFix] fix builtin_function fuzzy test (#61530)
What I'm doing:
bits_function: the implementation is wrong
change the static DCHECK to dynamic argument validation for some functions
fix some type mapping error in the logical_type.cpp

Signed-off-by: Murphy <mofei@starrocks.com>
2025-08-11 13:39:06 +08:00
Murphy e88244ec37
[Enhancement] FlatJSON-V2 part 1: BE code (#61447)
Signed-off-by: Murphy <mofei@starrocks.com>
2025-08-04 19:21:22 +08:00
cutiechi df156b2fe5
[BugFix] disable ASAN build when gcov is enabled to avoid link failure (#59587)
Signed-off-by: cutiechi <superchijinpeng@gmail.com>
2025-06-06 03:53:17 +00:00
stdpain 4f389a12c3
[Enhancement] Support for dynamic linking to support switching jemalloc with debug option (#57970)
Signed-off-by: stdpain <drfeng08@gmail.com>
Signed-off-by: stdpain <34912776+stdpain@users.noreply.github.com>
2025-04-16 10:45:02 +08:00
stdpain 4b82e29874
[Feature] support ARRAY/MAP input for Java Scalar UDF (#55356)
Signed-off-by: stdpain <drfeng08@gmail.com>
2025-03-26 18:48:17 +08:00
Kevin Cai 9418a1adf8
[UT] Reduce ut overhead (#54893)
shrink the starrocks_test executable size, reduce the binary loading time (~0.4s)
disable global timezone cache (~0.8s)
replace sleep(1) with nap_sleep(1) in lake::CompactionScheduler (~0.5s)

Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2025-01-10 10:57:18 +08:00
Kevin Cai 52c8aaf21c
[Enhancement] Assume --test option in run-be-ut.sh is a single test suite/case name (#51614)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2024-10-11 15:12:30 +08:00
Butao Zhang a3c317bd77
[Enhancement] Add option to choose relative path of BE's debug symbol (#51389)
Signed-off-by: zhangbutao <zhangbutao@cmss.chinamobile.com>
2024-09-29 09:58:25 +08:00
zombee0 637ec3c9a0
[Enhancement]enhance bit unpacking with bmi2 instruction set (#50904)
Signed-off-by: zombee0 <ewang2027@gmail.com>
2024-09-24 17:37:36 +08:00
stdpain d2e2d8ccc7
[Enhancement] make JIT as compile option (#50928)
Signed-off-by: stdpain <drfeng08@gmail.com>
2024-09-19 13:54:33 +08:00
Kevin Cai 501f582f5d
[UT] dynamic link libstdc++ when build test with ASAN (#49756)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2024-08-15 16:57:06 -07:00
Kaiwei Wang d2fae64344
[Enhancement] Add option for with-brpc-keepalive to run-be-ut.sh (#46042)
Why I'm doing:
We have with-brpc-keepalive in build.sh. This PR is to align it in BE UT.
What I'm doing:
Add the flag of with-brpc-keepalive.

Signed-off-by: Kaiwei Wang <k.wang@celonis.com>
2024-05-22 10:43:32 +08:00
Gavin 0dcdf2d324
[Enhancement] Add `without-starcache` build option to control whether build with starcache library. (#40599)
Signed-off-by: Gavin <yangguansuo@starrocks.com>
2024-04-25 09:47:05 +08:00
Kevin Cai faddb6c835
[Enhancement] Upgrade staros v3.3 rc0 (#43887)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
Co-authored-by: silverbullet233 <3675229+silverbullet233@users.noreply.github.com>
2024-04-12 11:33:59 +08:00
Gavin 30e7e97cae
[Enhancement] Remove cachelib library and dependencies to reduce the thirdparty space. (#42660) 2024-03-15 17:49:29 +08:00
trueeyu 89b9699086
[UT] Add option to run-be-ut.sh to filter cases of specific group (#42344)
Why I'm doing:
Currently, some cases need to allocate a large amount of memory, so they will execute very slowly. Here we add a function that can exclude cases under a specific group. Users can decide which cases to run based on different needs.

Cases of slow group will be disabled on asan or debug mode.

What I'm doing:
Usage:

./run-be-ut.sh --excluding-test-suit "SLOW" 
./run-be-ut.sh --excluding-test-suit "SLOW|XXX" 

Signed-off-by: trueeyu <lxhhust350@qq.com>
2024-03-09 15:21:50 +08:00
Gavin b054af81cb
[Enhancement] Support display datacache metircs by http service. (#40220)
Signed-off-by: Gavin <yangguansuo@starrocks.com>
2024-01-30 16:35:48 +08:00
Kevin Cai df32193f7e
[UT] Revert "[Feature] Split storage test into separate file (#37634)" (#39419)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2024-01-22 18:16:42 +08:00
Alex Zhu 532934c20e
[Enhancement] Turn on the detect_stack_use_after_return feature of ASAN (#39116)
Signed-off-by: Alex Zhu <zhuming9011@gmail.com>
2024-01-15 16:28:29 +00:00
Kevin Cai bac90a411c
[BugFix] ensure hdfsFile resource is released during close (#38215)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2024-01-08 10:17:38 +08:00
Yueyang Zhan 7146d59759
[Feature] Split storage test into separate file (#37634)
Signed-off-by: Moonm3n <saxonzhan@gmail.com>
2023-12-25 17:30:23 +08:00
Kevin Cai 751c08d0d6
[BugFix] fix --enable-shared-data option for be ut script (#36685)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2023-12-08 20:02:14 +08:00
Gavin 1e6cb9d594
[Enhancement] Turn on the default starcache UT switch to build the starrocks unittests with datacache. (#34638)
Signed-off-by: Gavin <yangguansuo@starrocks.com>
2023-11-09 15:20:06 +08:00
Kevin Cai 66dd1aff4d
[Enhancement] rename `use-staros` to `enable-shared-data` (#34480)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2023-11-07 14:49:49 +08:00
Gavin 32263e1eaf
[Refactor] Seperate starcache from staros to avoid build staros modules if unnecessary. (#30687)
Signed-off-by: Gavin <yangguansuo@starrocks.com>
2023-09-14 15:46:43 +08:00
Kevin Cai 5b047d8d09
[UT] fix unstable ut (#30976)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2023-09-13 19:55:03 +08:00
Smith Cruise 8fe8a65747
[Enhancement] Replace libdeflate including way (#28695)
Using third-party to manage libdeflate


Signed-off-by: Smith Cruise <chendingchao1@126.com>
2023-08-07 11:09:14 +08:00
Alex Zhu 0f08cc4107
[UT] Fix flaky tests when running in parallel with gtest-parallel (#28308)
Signed-off-by: Alex Zhu <zhuming9011@gmail.com>
2023-07-31 13:57:15 +00:00
dorianzheng f7e54d2535
[Enhancement] improve parquet reader performance (#24566)
- `resize_uninitialized` instead of `append_default` which saves cpu for
generate default value and emplace one by one
- `GetBatchWithDict` which leverages repeated value for set value by
batch and saves cpu
- use libdeflate to decompress gzip for better performance 


Signed-off-by: dorianzheng <xingzhengde72@gmail.com>
2023-07-27 10:04:54 +08:00
Kevin Cai 5820477fe1
[Enhancement] update staros related components version (#25787)
* update starlet/starmgr version to 3.1-rc5
* refactor starlet cmake import
* set starlet related parameters inside CMakeLists.txt
* remove customized parameters from build.sh and run-be-ut.sh

Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2023-06-25 10:19:21 +08:00
Gavin 60453aedb4
[Enhancement] Import the starcachelib to block cache by staros to replace starcache submodule. (#24541)
Fixes #issue

As the starcache library has been installed into staros output and
imported into starrocks. So we remove the original starcache sumodule
and depend on the starcache library directly.

Signed-off-by: GavinMar <yangguansuo@starrocks.com>
2023-06-08 15:41:34 +08:00
Kevin Cai 2590c0185e
[Feature] upgrade staros/starlet versions (#23798)
Reverts StarRocks/starrocks#23775

Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2023-05-19 23:54:12 +08:00
Kevin Cai 859cfd0f9c
Revert "[Feature] upgrade staros/starlet versions" (#23775)
Reverts StarRocks/starrocks#23762
2023-05-19 16:36:35 +08:00
Kevin Cai d73f56a9b5
[Feature] upgrade staros/starlet versions (#23762)
* staros add azblob storage support
* staros file store support

Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2023-05-19 16:25:45 +08:00
Gavin bb4ae3c72e
[Enhancement] Skip the starcache installation when building starrocks BE. (#21823)
Now, starcache is imported as a submodule, and we build it as a subdirectory of starrocks BE sources.
So, the starcache installation is unnecessary. We set the `STARCACHE_SKIP_INSTALL` option to
skip it.

Signed-off-by: GavinMar <yangguansuo@starrocks.com>
2023-04-20 16:12:46 +08:00
Gavin f2fbbf2108
[Enhancement] Import starcache submodule to support DLA block cache. (#20927)
Import starcache submodule as a new block cache engine which support KV interfaces, and provides memory and disk cache. Currently, we support both cachelib and starcache engines, and we set the starcache as the default engine.

Signed-off-by: GavinMar <yangguansuo@starrocks.com>
2023-04-11 20:39:58 +08:00
Gavin a05e8bde34
Revert "[Enhancement] Import starcache submodule to support DLA block cache. (#20164)" (#20422)
This reverts commit ed55db7d09.
2023-03-28 15:11:06 +08:00
Gavin ed55db7d09
[Enhancement] Import starcache submodule to support DLA block cache. (#20164)
Signed-off-by: GavinMar <yangguansuo@starrocks.com>
2023-03-28 13:16:38 +08:00
Kevin Cai 2741473516
[Enhancement] use starrocks libre2 and libprotobuf for starlet (#18810) 2023-03-02 18:33:59 +08:00
Kevin Cai d0be36edd1
[Refactor] change starlet library directory to fixed `lib` (#17830)
* ubuntu/centos has different default CAMKE_INSTALL_LIBDIR, set it to
  fixed `lib`

Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2023-02-15 00:34:48 -08:00
Murphy 665702d313
[Enhancement] disable AVX512 by default (#17209) 2023-02-03 15:55:55 +08:00
Alex Zhu 9f3ce6ff1d
[Feature] Support schema changes to the lake table of primary key (#16850)
Signed-off-by: sduzh <zhuming9011@qq.com>
2023-01-30 16:46:36 +08:00
lichaoyong 3fb0aa2e96
[Refactor] Unify the unit tests related names for BE and FE (#15667)
There are some inconsistencies between the unit tests of BE and FE
This pull request unify the two scripts.
1. rename run-ut.sh to run-be-ut.sh
2. use parameter --test to run specified test
   `./run-fe-ut.sh --run [TEST_NAME]`
   `./run-fe-ut.sh --gtest_filter [TEST_NAME_WILDCARD]`
3. Add a new paramter --dry-run to only compile and build the unit tests
   `./run-fe-ut.sh --dry-run`
   `./run-be-ut.sh --dry-run`
2023-01-10 15:12:33 +08:00