tool
/
starrocks
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[Refactor] optimize jindosdk decompress procedure (#17028) 

Currently, we will decompress jindosdk-4.6.2.tar.gz when building broker,
this is very time consuming.

In this pr, we optimize this procedure, jindosdk-4.6.2.tar.gz will
only be decompressed in the first time it downloads.

Signed-off-by: xyz <a997647204@gmail.com>
This commit is contained in:
xyz 2023-01-30 14:13:19 +08:00 committed by GitHub
parent 7783e72155
commit 33d56ceac3
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 6 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
.gitignore vendored
View File

@ -34,6 +34,7 @@ fe/fe-core/gen
fe/fe-common/.classpath
fs_brokers/apache_hdfs_broker/src/main/resources/
fs_brokers/apache_hdfs_broker/src/main/thrift/
fs_brokers/apache_hdfs_broker/jindosdk-4.6.2
dependency-reduced-pom.xml
tags
.tags

10
fs_brokers/apache_hdfs_broker/build.sh
View File

@ -52,13 +52,15 @@ mv broker_thirdparty_jars/*.jar ${BROKER_OUTPUT}/lib/
rm -r broker_thirdparty_jars broker_thirdparty_jars.tar.gz
# jindosdk-4.6.2.tar.gz is very large, about 931M, so we cache it in local disk
if [[ ! -f ./jindosdk-4.6.2.tar.gz ]]; then
if [ ! -d ${BROKER_HOME}/jindosdk-4.6.2 ]; then
echo "download aliyun jindo..."
wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/4.6.2/jindosdk-4.6.2.tar.gz
tar xvf jindosdk-4.6.2.tar.gz
fi
tar xvf jindosdk-4.6.2.tar.gz
cp -r jindosdk-4.6.2/lib/*.jar ${BROKER_OUTPUT}/lib/
rm -r jindosdk-4.6.2
if [ -f ${BROKER_HOME}/jindosdk-4.6.2.tar.gz ]; then
rm -r ${BROKER_HOME}/jindosdk-4.6.2.tar.gz
fi
cp -r -p ${BROKER_HOME}/bin/*.sh ${BROKER_OUTPUT}/bin/
@ -68,8 +70,6 @@ cp -r -p ${BROKER_HOME}/conf/log4j.properties ${BROKER_OUTPUT}/conf/
cp -r -p ${BROKER_HOME}/target/lib/* ${BROKER_OUTPUT}/lib/
cp -r -p ${BROKER_HOME}/target/apache_hdfs_broker.jar ${BROKER_OUTPUT}/lib/
echo ""
echo ""
echo ""
echo "***************************************"
echo "**Successfully build StarRocks Broker**"