tool
/
starrocks
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
22,203 Commits 506 Branches 0 Tags 934 MiB
Commit Graph

292 Commits

Author SHA1 Message Date
starrocks-xupeng 6904592d66
[BugFix] update staros to v3.5-rc4 (#63398) 
Signed-off-by: starrocks-xupeng <xupeng@starrocks.com>
 2025-09-24 04:41:22 +00:00
Kevin Cai 4958e60057
[BugFix] arrow build respect avx2 settings (#62006) 
Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
 2025-08-18 19:35:15 +08:00
wyb d6088ff298
[Enhancement] Bump librdkafka to 2.11.0 for kafka 4.0 (#61698) 
Signed-off-by: wyb <wybb86@gmail.com>
 2025-08-08 06:31:54 +00:00
Kevin Cai c593e8d171
[Enhancement] upgrade staros to v3.5-rc3 (#61685) 
Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
 2025-08-08 09:33:03 +08:00
Kevin Cai 1e661f5859
[Tool] update thirdparty tar and script (#61500) 
all upper cases to CMAKE ON/OFF switch
update thirdparty tarball
less verbosity of wget downloading archives
less verbosity on aws cpp sdk unzip
less verbosity on extracting archives

Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
 2025-08-01 15:07:20 +08:00
Kevin Cai 5caf273918
[Enhancement] ugprade zstd to v1.5.7 (#56302) 
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
 2025-07-31 21:25:15 +08:00
Murphy ce8c38477a
[BugFix] avoid compile the libdivide (#60874) 
Signed-off-by: Murphy <mofei@starrocks.com>
 2025-07-14 08:58:45 +00:00
stdpain a14c09619a
[Enhancement] update toolchain images (#60719) 
Signed-off-by: stdpain <drfeng08@gmail.com>
 2025-07-11 10:59:41 +08:00
Murphy d9b23cffb4
[Enhancement] function hour_from_unixtime (#60331) 
Signed-off-by: Murphy <mofei@starrocks.com>
 2025-07-10 16:16:51 +08:00
Murphy 46804c47bf
[Enhancement] faster from_unixtime (#60174) 2025-07-09 17:04:12 +08:00
starrocks-xupeng 1222493a81
[Enhancement] update staros to v3.5-rc2 (#60602) 
Signed-off-by: starrocks-xupeng <xupeng@starrocks.com>
 2025-07-07 14:44:09 +08:00
Mesut Döner 8c5f9fda32
[Enhancement] Enhance thirdparty build script (#60156) 
Signed-off-by: Mesut-Doner <mesutdonerng@gmail.com>
 2025-06-26 10:50:29 +08:00
Rohit Satardekar d96b52103a
[Enhancement] bump up breakpad to 2024.02.16 to fix crash in dump_syms (#60005) 
we are using and older version of dump_syms that doesn’t understand the .relr.dyn section

Fixes #60004

update breakpad to version breakpad-2024.02.16

$ bash thirdparty/minidump/gen_minidump_symbols.sh
starrocks_be'size (2153mb) reduced to (556mb)
symbol file is at /home/ubuntu/starrocks/output/be/symbols/starrocks_be/AC7FAB7F8B5BF82100000000000000000

Signed-off-by: Rohit Satardekar <rohitrs1983@gmail.com>
 2025-06-22 07:48:33 +08:00
gengjun-git 6626270de0
[Enhancement] Upgrade async-profiler to 4.0 (#59204) 
Signed-off-by: gengjun-git <gengjun@starrocks.com>
 2025-06-19 14:04:09 +08:00
Rohit Satardekar e3cea5e7f4
[BugFix] Fix third-party build failure for pulsar-client-cpp-3.3.0 mo… (#59904) 
Signed-off-by: Rohit Satardekar <rohitrs1983@gmail.com>
 2025-06-17 13:28:18 +08:00
shuming.li 522f719bf6
[Tool] [BugFix] Fix building format-sdk compile bugs (#59365) 
Signed-off-by: shuming.li <ming.moriarty@gmail.com>
 2025-05-27 16:03:16 +08:00
stdpain 9820cf29dd
[BugFix] update azure install lib dirs (#59336) 
Signed-off-by: stdpain <drfeng08@gmail.com>
 2025-05-26 16:56:23 +08:00
stdpain c60ddf39f3
[BugFix] Fix compilation errors in centos7 (#59273) 
Signed-off-by: stdpain <drfeng08@gmail.com>
 2025-05-23 15:27:05 +08:00
wyb f2752d861e
[Enhancement] Add azure cpp sdk (#59016) 
Signed-off-by: wyb <wybb86@gmail.com>
 2025-05-16 11:15:41 +00:00
gengjun-git 0fc7ab113f
[Enhancement] Change jdk version in thirdparty to 17 (#58964) 
Signed-off-by: gengjun-git <gengjun@starrocks.com>
 2025-05-15 09:54:29 -07:00
Hongkun Xu 86c5c45641
[Tool] Support build avro-cpp module (#58908) 
Signed-off-by: Hongkun Xu <xuhongkun666@163.com>
 2025-05-13 08:56:42 -07:00
starrocks-xupeng 941846a8d6
[Enhancement] upgrade staros to v3.5-rc1 (#58600) 
Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
Signed-off-by: starrocks-xupeng <xupeng@starrocks.com>
Co-authored-by: Kevin Cai <kevin.cai@celerdata.com>
 2025-05-08 17:35:08 +08:00
wyb e0272625e7
[BugFix] Fix avro cpp header path (#58109) 
Signed-off-by: wyb <wybb86@gmail.com>
 2025-04-16 09:35:16 -07:00
stdpain 4f389a12c3
[Enhancement] Support for dynamic linking to support switching jemalloc with debug option (#57970) 
Signed-off-by: stdpain <drfeng08@gmail.com>
Signed-off-by: stdpain <34912776+stdpain@users.noreply.github.com>
 2025-04-16 10:45:02 +08:00
wyb 97464b08fe
[Enhancement] Bump avro to 1.12.0 and add avro cpp library (#57984) 
Signed-off-by: wyb <wybb86@gmail.com>
 2025-04-15 13:39:26 +08:00
yan zhang 38a20f8c4d
[Enhancement] add xsmid thirdparty header files (#57964) 
Signed-off-by: yan zhang <dirtysalt1987@gmail.com>
 2025-04-14 19:32:53 +08:00
Hongkun Xu c3b8e1160a
[Tool] Support build icu thirdparty module (#57451) 2025-04-03 10:10:39 +08:00
eyes_on_me 4c027fe694
[Feature] upper/lower support utf8 (#56192) 
Signed-off-by: silverbullet233 <3675229+silverbullet233@users.noreply.github.com>
 2025-03-24 09:55:55 +08:00
Kevin Cai 9c47f9dddf
[Enhancement] upgrade staros to v3.4-rc5 (#56977) 
Signed-off-by: Kevin Cai <kevin.cai@celerdata.com>
 2025-03-18 19:29:39 +08:00
Kevin Cai 5dfdf44a6b
[Enhancement] upgrade staros to version v3.4-rc4 (#56195) 
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
 2025-02-25 14:32:59 +08:00
zombee0 48cc6fc538
[BugFix]disable chunked upload in aws sdk while we have support it in poco (#55854) 
Signed-off-by: zombee0 <ewang2027@gmail.com>
 2025-02-21 18:48:24 +08:00
Elmi Ahmadov 3eb9baf564
[Tool] Fix main build (#55684) 
Signed-off-by: Elmi Ahmadov <e.ahmadov@celonis.com>
 2025-02-08 09:25:06 +08:00
before-Sunrise e88bb85360
[Enhancement] Optimize code in arm (#55072) 
## Why I'm doing:
arm is slower than x86 in some cases

## What I'm doing:
1. vectorize rf's insert_hash using Neon intrinsics
2. streamvbyte's cmakelist is wrong, which cause performance downgrade in arm because vectorization cannot work properly
3. arm's int128_mul_overflow is super slow becase of divide operation,  __builtin_mul_overflow(int128_t a, int128_t b, int128_t* c) is fast enough when compile with gcc. But gcc's __builtin_mul_overflow is at least 5 times faster then clang in arm, we already reported it to the community: https://github.com/llvm/llvm-project/issues/123262. So we still use gcc as default compiler and use __builtin_mul_overflow to replace original int128_mul_overflow implementation
4. arm's cast int128 to double  is super slow in arm with gcc because the bad implementation of __floattidf, clang runtime-rt's implementation is 20 times faster then gcc, so I used clang compiler-rt's implementation to replace gcc's version


after this pr, arm is faster then gcc in  the most of cases.

```
| Query   | arm-opt | x86 |
|---------|--------|--------|
| QUERY01 | 36     | 61     |
| QUERY02 | 39     | 62     |
| QUERY14 | 1510   | 1514   |
| QUERY15 | 1407   | 1496   |
| QUERY17 | 21     | 88     |
| QUERY20 | 151    | 279    |
| QUERY21 | 1526   | 1529   |
| QUERY24 | 1399   | 1504   |
| QUERY26 | 32     | 122    |
| QUERY27 | 1493   | 1519   |
| QUERY90 | 3399   | 4030   |
| QUERY97 | 3859   | 4776   |
| QUERY98 | 2763   | 3208   |
| QUERY99 | 868    | 1259   |
```

Signed-off-by: before-Sunrise <unclejyj@gmail.com>
 2025-01-27 11:18:10 +08:00
starrocks-xupeng ece066f554
[Enhancement] update staros 3.4-rc3 (#54974) 
Signed-off-by: starrocks-xupeng <xupeng@starrocks.com>
 2025-01-14 10:04:11 +08:00
Kevin Cai f0568fdfd0
[Enhancement] patching flatbuffers CMakeLists.txt (#54579) 
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
 2025-01-02 16:07:32 +08:00
Kevin Cai e494f6e3fb
[Enhancement] remove gcc14 detect in build-thirdparty script (#54576) 
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
 2025-01-02 10:46:02 +08:00
stdpain 681be8b83f
[Enhancement] dump LWP when BE crash (#54089) 
Signed-off-by: stdpain <drfeng08@gmail.com>
 2024-12-20 10:08:15 +08:00
Kevin Cai 03803b2eb4
[Enhancement] update staros to 3.4-rc2 (#54075) 
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
 2024-12-19 16:39:41 +08:00
Youngwb 296c172bba
[Enhancement] upgrade CRoaring lib (#53620) 
Signed-off-by: Youngwb <yangwenbo_mailbox@163.com>
 2024-12-06 11:30:48 +08:00
starrocks-xupeng 8961a653f2
[Enhancement] update staros to 3.4-rc1 (#52901) 
Signed-off-by: starrocks-xupeng <xupeng@starrocks.com>
 2024-11-15 16:32:13 +08:00
liubotao becbf01951
[Feature] Support the Arrow Flight SQL protocol to enhance data transfer efficiency (#50199) 
Signed-off-by: liubotao <316945435@qq.com>
 2024-11-15 15:27:52 +08:00
zombee0 c6913e2f5f
[Enhancement]patch poco for keep-alive (#52599) 
Signed-off-by: zombee0 <ewang2027@gmail.com>
 2024-11-06 15:00:44 +08:00
gengjun-git 66233b22f7
[Enhancement] Upgrade async-profiler to 3.0 (#52230) 
Signed-off-by: gengjun-git <gengjun@starrocks.com>
 2024-10-28 10:23:39 +08:00
jay 3fbe5184a1
[Feature] Bypass sdk read and write decoupling (#45918) 
Signed-off-by: jukejian <jukejian@bytedance.com>
Signed-off-by: plotor <zhenchao.wang@hotmail.com>
 2024-09-26 16:50:13 +08:00
zombee0 1f4e2384b0
[Enhancement]explicit specific arrow use avx2 as default (#51038) 
Signed-off-by: zombee0 <ewang2027@gmail.com>
 2024-09-19 19:51:45 +08:00
Kevin Cai 5db79c8c68
[Tool] update toolchain to 20240831 (#50517) 
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
Signed-off-by: stdpain <drfeng08@gmail.com>
Co-authored-by: stdpain <drfeng08@gmail.com>
 2024-09-09 20:49:20 +08:00
zombee0 12cae590bc
[BugFix]be compatible with content length is zero (#50782) 
Signed-off-by: zombee0 <ewang2027@gmail.com>
 2024-09-06 16:37:08 +08:00
zombee0 33f4361965
[Enhancement]patch poco for zero-copy (#50748) 
Signed-off-by: zombee0 <ewang2027@gmail.com>
 2024-09-05 19:47:37 +08:00
Kevin Cai 1d2ac4933a
[Enhancement] upgrade staros to v3.3-rc5 (#50560) 
Signed-off-by: Kevin Xiaohua Cai <caixiaohua@starrocks.com>
 2024-09-03 19:44:21 +08:00
stdpain 2d67753fbb
[BugFix] Fix compile error in GCC-14 (#50577) 
Signed-off-by: stdpain <drfeng08@gmail.com>
 2024-09-03 15:16:39 +08:00