Commit Graph

162 Commits

Author SHA1 Message Date
Harbor Liu 4bb51cbd9e
[Refactor] Refactors the Frontend (FE) module structure versioning management (#63086) 2025-09-16 10:42:43 +08:00
Harbor Liu 241a3e5451
[Refactor] Remove hardcoded version numbers in build.gradle.kts and pom.xml (#62987) 2025-09-11 16:14:51 +08:00
Harbor Liu 835248f265
[Refactor] Make the FE codebase more modular and maintainable with multi module (#62220) 2025-08-22 17:54:20 +08:00
Kevin Cai e5116ba026
[Tool] separate gen_build_version.py, only build java for fe and cpp for be (#61775)
gen_build_version.py allows generating only java or cpp code
skip maven clean phase in fe build

Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
2025-08-12 12:29:13 +08:00
Kevin Cai fbf18fc4fe
[BugFix] remove trailing back slash in build script (#60787)
Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
2025-07-10 17:37:18 +08:00
cutiechi df156b2fe5
[BugFix] disable ASAN build when gcov is enabled to avoid link failure (#59587)
Signed-off-by: cutiechi <superchijinpeng@gmail.com>
2025-06-06 03:53:17 +00:00
stdpain 4f389a12c3
[Enhancement] Support for dynamic linking to support switching jemalloc with debug option (#57970)
Signed-off-by: stdpain <drfeng08@gmail.com>
Signed-off-by: stdpain <34912776+stdpain@users.noreply.github.com>
2025-04-16 10:45:02 +08:00
Rohit Satardekar 84fcfec69c
[Enhancement](Chore) remove unused run_ut option from build script (#56728)
Signed-off-by: Rohit Satardekar <rohitrs1983@gmail.com>
2025-04-10 03:39:30 +00:00
RyanZ 380ea06964
[BugFix] fix hadoop-lib for upgrade compatibility (#57436) 2025-03-31 15:52:40 +08:00
Mesut-Doner b3042640eb
[Enhancement](chore) Add DISABLE_JAVA_CHECK_STYLE option to build (#57314)
Signed-off-by: Mesut-Doner <mesutdonerng@gmail.com>
2025-03-31 10:07:42 +08:00
Rohit Satardekar 5502c3e560
[Enhancement](chore) accelerate FE build - maven parallel builds (#56966)
Signed-off-by: Rohit Satardekar <rohitrs1983@gmail.com>
2025-03-19 12:47:18 +08:00
Rohit Satardekar c64353e8fb
[Enhancement] support custom output directory as input to build script (#56784)
Signed-off-by: Rohit Satardekar <rohitrs1983@gmail.com>
2025-03-19 11:58:28 +08:00
RyanZ 0d96aceafc
[Enhancement] fix CVEs and refactor fe pom.xml (#56725)
Signed-off-by: yanz <dirtysalt1987@gmail.com>
2025-03-13 13:00:00 -07:00
Kevin Cai 386e42499f
[Tool] handle without-java-ext case processing netty package (#56374)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2025-02-27 21:57:31 +08:00
Kevin Cai b398a35785
[BugFix] fix io.netty CVE-2025-24970 (#56216)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2025-02-25 10:12:10 +08:00
Kevin Cai bee52f8147
[Tool] support build maven project in batch mode (#54940)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2025-01-13 14:10:20 +08:00
Zhenchao Wang ed87f90449
[Feature] Add native format writer to access StarRocks data bypass BE Server. (#52700)
Signed-off-by: plotor <zhenchao.wang@hotmail.com>
2024-12-18 21:41:15 +08:00
xiangguangyxg 969593c045
[Feature] Support restoring from a cluster snapshot for shared-data mode (part 1) (#53861)
Signed-off-by: xiangguangyxg <xiangguangyxg@gmail.com>
2024-12-18 19:08:00 +08:00
gengjun-git 66233b22f7
[Enhancement] Upgrade async-profiler to 3.0 (#52230)
Signed-off-by: gengjun-git <gengjun@starrocks.com>
2024-10-28 10:23:39 +08:00
wangfei 8e82fd1307
[Enhancement] A build machine that supports the AVX2 instruction set compiles a package without the AVX2 instruction set. (#51673)
Why I'm doing:
In some virtual machines or containers, the AVX2 instruction set is not supported. However, whether the compiled package from the current build script includes AVX2 support depends on the CPU instruction set of the build machine. Therefore, if the build machine supports the AVX2 instruction set, it is not possible to compile a package that does not include AVX2 support.

What I'm doing:
In the build.sh, add the --without-avx2 option to force the packaging of a product without the AVX2 instruction set. If this option is not added, the default strategy (detecting based on the build machine’s CPU) will be maintained.

Signed-off-by: happut <happut@163.com>
2024-10-10 09:57:44 +08:00
Butao Zhang a3c317bd77
[Enhancement] Add option to choose relative path of BE's debug symbol (#51389)
Signed-off-by: zhangbutao <zhangbutao@cmss.chinamobile.com>
2024-09-29 09:58:25 +08:00
jay 3fbe5184a1
[Feature] Bypass sdk read and write decoupling (#45918)
Signed-off-by: jukejian <jukejian@bytedance.com>
Signed-off-by: plotor <zhenchao.wang@hotmail.com>
2024-09-26 16:50:13 +08:00
zombee0 637ec3c9a0
[Enhancement]enhance bit unpacking with bmi2 instruction set (#50904)
Signed-off-by: zombee0 <ewang2027@gmail.com>
2024-09-24 17:37:36 +08:00
stdpain d2e2d8ccc7
[Enhancement] make JIT as compile option (#50928)
Signed-off-by: stdpain <drfeng08@gmail.com>
2024-09-19 13:54:33 +08:00
Yulong Zhao 406787fd2a
[Feature] Support select vector index (#48521)
Signed-off-by: yulongzhao <yulongzhao@tencent.com>
2024-09-09 14:49:33 +08:00
Kevin Cai c6ea1a7058
[Enhancement] fix `-h` option, add --with-compress-debug-symbol (#50479)
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2024-09-03 14:23:45 +08:00
Murphy 403f5526a6
[Tool] enable the compiler compress (#49704)
Signed-off-by: Murphy <mofei@starrocks.com>
2024-08-13 22:48:48 +08:00
Smith Cruise b47bdebcfc
[Enhancement] Fix cve problems in java-extensions module (#49425)
Signed-off-by: Smith Cruise <chendingchao1@126.com>
2024-08-08 17:05:40 +08:00
Smith Cruise 6b01a165c4
[Enhancement] Fix some hudi cve problems (#49157)
Signed-off-by: Smith Cruise <chendingchao1@126.com>
2024-08-02 10:32:08 +08:00
Kevin Cai 47e85eeef9
[Enhancement] Staros v3.3 rc3 and brpc glog update (#48949)
Signed-off-by: stdpain <drfeng08@gmail.com>
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
Co-authored-by: stdpain <drfeng08@gmail.com>
2024-07-28 22:58:52 -07:00
leorishdu 9ca404197d
[Feature] Introduce TenAnn as the vector index implementation library (#48384)
Signed-off-by: leorishdu <18771113323@163.com>
2024-07-22 03:36:20 +00:00
Xueyan Li eb27d21ad0
[Enhancement] BE remove unused zookeeper for CVEs (#48488)
Signed-off-by: Astralidea <astralidea@163.com>
2024-07-18 09:37:06 +08:00
stdpain cdf632a394
[Feature] (Python UDF) support arrow call stub (#46449)
Signed-off-by: stdpain <drfeng08@gmail.com>
2024-06-06 15:47:58 +08:00
Smith Cruise f77ff8ffb7
[Enhancement] Remove jindo sdk for cve problems (#46297) 2024-05-27 16:04:02 +08:00
Smith Cruise 0fcf3d7eba
[Enhancement] Bump FE/BE's hadoop to 3.4.0 (#45312)
Why I'm doing:
For the CVE problem, we need to upgrade Hadoop SDK from 3.3.6 -> 3.4.0
It will introduce aws java SDK v2, so we can delete SDK v1.

Signed-off-by: Smith Cruise <chendingchao1@126.com>
2024-05-16 14:40:26 +08:00
Hector Gonzalez a6632ef38e
[BugFix] add option for with-brpc-keepalive to build.sh (#45566)
Signed-off-by: Hector <h.gonzalez@celonis.com>
2024-05-14 09:23:10 +08:00
Hector Gonzalez 9a62361644
[Enhancement] Adds config to set socket_keepalive for brpc. Needs brpc 1.8 (#45070)
Why I'm doing:
Enable option to use keepalive on brpc sockets.

What I'm doing:
Adds new config brcp_socket_keepalive
Modifies CMakeLists.txt and build.sh to optionally compile the new setting.
this is necessary as this option requires brpc 1.8
brpc_socket_keepalive is false by default

Signed-off-by: Hector <h.gonzalez@celonis.com>
2024-05-06 14:37:01 +08:00
predator4ann 526602cf19
[Feature] Support reading kudu table (#41090)
Signed-off-by: predator4ann <yunlong.sun@hotmail.com>
2024-04-26 14:28:57 +08:00
Gavin 0dcdf2d324
[Enhancement] Add `without-starcache` build option to control whether build with starcache library. (#40599)
Signed-off-by: Gavin <yangguansuo@starrocks.com>
2024-04-25 09:47:05 +08:00
stephen 633181a8da
[Enhancement] iceberg metadata reader execution (#44632)
Signed-off-by: stephen <stephen5217@163.com>
2024-04-24 10:25:03 +08:00
Yongbing Wang f0fecc4b5a
[Enhancement]Remove Jindo sdk. (#42864) 2024-03-21 15:51:14 +08:00
Gavin 30e7e97cae
[Enhancement] Remove cachelib library and dependencies to reduce the thirdparty space. (#42660) 2024-03-15 17:49:29 +08:00
dirtysalt 8956689a67
[Enhancement] to avoid `s3://` not supported case (#42369)
Signed-off-by: yanz <dirtysalt1987@gmail.com>
2024-03-11 18:09:19 -07:00
Kevin Cai 3a28064dd8
[BugFix] fix cpu instruction detection in build.sh (#41679)
correctly detect avx2 and sse4_2
print sse4_2 info as well

Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
2024-02-27 09:27:46 +08:00
Alex Zhu 858272bb16
[Tool] Get a list of compile time for each C++ file (#41322)
Signed-off-by: Alex Zhu <zhuming9011@gmail.com>
2024-02-21 10:23:45 +00:00
Yueyang Zhan 250a06a7b1
[Enhancement] Revert "[Enhancement] link libLLVM as single shared lib (#35955)" (#40840)
Signed-off-by: Moonm3n <saxonzhan@gmail.com>
2024-02-07 11:30:31 +00:00
Gavin b054af81cb
[Enhancement] Support display datacache metircs by http service. (#40220)
Signed-off-by: Gavin <yangguansuo@starrocks.com>
2024-01-30 16:35:48 +08:00
Murphy 6b07d1da8e
[Tool] add option for ccache (#39758)
Signed-off-by: Murphy <mofei@starrocks.com>
2024-01-23 07:24:53 +00:00
Butao Zhang a0e766fd58
[BugFix] Skip to copy java extention if building BE uses '--without-java-ext' (#39487)
Signed-off-by: zhangbutao <zhangbutao@cmss.chinamobile.com>
2024-01-19 10:45:06 +00:00
dx.dragon ea33c5592f
[Feature] MaxCompute(ODPS) Catalog JNI Reader parts (#36758)
Signed-off-by: 鼎昕 <zhangdingxin.zdx@alibaba-inc.com>
Co-authored-by: 鼎昕 <zhangdingxin.zdx@alibaba-inc.com>
2023-12-28 19:40:54 +08:00