Commit Graph

58 Commits

Author SHA1 Message Date
0aKarmA_骅文 1859c8263c
[Enhancement] Support type hints and dataclass compatibility for Python under 3.10 (#63131)
Why I'm doing:
starrocks-python-client support most of the python3 version, but there are some new features that is not compatibility for Python under 3.10

What I'm doing:
use Union for supporting type hints in python under 3.10
not setting kw_only for dataclasses in python under 3.10
2025-09-16 15:43:02 +08:00
lang07123 0e1c3185fb
[Feature] Add the way to set AUTO_INCREMENT column when PRIMARY_KEY is on other column for Starrocks python client (#62460)
Signed-off-by: lang07123 <love521991@126.com>
2025-09-10 00:11:21 +00:00
janlink 5395808681
[BugFix] starrocks-python-client: Correct DDL generation for ARRAY type in SQLAlchemy dialect (#61796)
Co-authored-by: Jan Link <link@gipmbh.de>
2025-08-13 00:23:33 +00:00
lang07123 e6b2adc17b
[Feature] add ORDER_BY option for SQLAlchemy when create table in starrocks-python-client/dialect.py (#60596) 2025-08-07 02:09:27 +00:00
wuqicyber feeeb88754
[BugFix] Fix python client type reflection error (#61542)
Signed-off-by: eleanor.zhu <eleanor.zhu@ly.com>
Signed-off-by: eleanor.zhu <eleanore.zhu@gmail.com>
2025-08-04 11:10:16 +08:00
yan zhang f5f8e9bc2c
[Enhancement] support map type in UDAF (#60840)
Signed-off-by: yan zhang <dirtysalt1987@gmail.com>
2025-07-18 09:49:51 +08:00
lang07123 ed197cfc16
[Doc] add Mapped Example for SQLAlchemy 2.x in starrocks-python-client/README.md (#60588)
Signed-off-by: lang07123 <love521991@126.com>
2025-07-04 11:01:25 +08:00
Harbor Liu 58b2e2386e
[Doc] Add AuthenticationOAuth2Client to contrib (#60275) 2025-06-26 09:41:36 +08:00
Karol Gongola 7450976b56
[Refactor][BugFix] SQLAlchamy Starrocks dialect reflection fix, refactor and tests enablement (#56130)
Signed-off-by: Karol Gongola <karol.gongola@cledar.com>
Co-authored-by: Karol Gongola <karolgongola@Karols-MacBook-Pro.local>
2025-06-17 17:41:38 +08:00
Zach 24619d6a48
[Enhancement]Replace exec with ast to load metadata safely (#59377)
Signed-off-by: Zac-saodiseng <3253345336@qq.com>
2025-05-27 17:29:30 +08:00
Zach d2620451d4
[BugFix]Fix table_type (#59368)
Signed-off-by: Zac-saodiseng <3253345336@qq.com>
2025-05-27 14:31:21 +08:00
Zach 2599d8f9fd
[BugFix]Fix Tableau `Table` missing (#57259)
Signed-off-by: Zac-saodiseng <3253345336@qq.com>
2025-03-26 18:06:12 +08:00
Zach 73ad9c04ea
[BugFix] Fix Superset `LARGEINT` compatibility (#57026)
Signed-off-by: Zac-saodiseng <3253345336@qq.com>
2025-03-18 14:54:39 +08:00
Karol Gongola e2b1c9c5f1
[BugFix] Fix generated column comment parsing and partition parsing (#56673)
Signed-off-by: Karol Gongola <karol.gongola@cledar.com>
2025-03-06 19:50:34 +08:00
Yixin Luo e55e165cef
[Refactor] disable in-memory pk index (#56040)
Signed-off-by: luohaha <18810541851@163.com>
2025-02-21 13:59:59 +08:00
Maciej Bryński 7f7ac0d8d6
[Enhancement] Re-add support for SQLAlchemy 1.4 (#55435)
Changing SQLAlchemy version from >=2.0 to >=1.4

Signed-off-by: Maciek Bryński <maciek@brynski.pl>
2025-01-28 08:57:23 +08:00
Edgar Ramírez Mondragón a703be95b8
[BugFix] Replace `sqlalchemy.util.raise` with Python 3 `raise` (#54518)
Signed-off-by: Edgar Ramírez-Mondragón <edgarrm358@gmail.com>
2024-12-31 14:01:11 +08:00
Maciej Bryński 850a8b477f
[Enhancement] Add support for custom Alembic version table name (#53281)
Signed-off-by: Maciek Bryński <maciek@brynski.pl>
2024-12-17 09:55:54 +08:00
Maciej Bryński 32615c5a20
[Feature] Alembic support (#52581)
Signed-off-by: Maciek Bryński <maciek@brynski.pl>
2024-11-21 10:02:29 +08:00
Maciej Bryński 6436984510
[Feature] Add support for PRIMARY KEY AND DISTRIBUTED BY in Python driver (#52479)
Signed-off-by: Maciek Bryński <maciek@brynski.pl>
2024-10-31 11:10:06 +08:00
Maciej Bryński 3b3a67f712
[Feature] Add support for SQLAlchemy 2.0 (#52392)
Signed-off-by: Maciek Bryński <maciek@brynski.pl>
Signed-off-by: Maciej Bryński <maciek@brynski.pl>
2024-10-29 09:02:45 -07:00
Vikas Attiguppa a22f1151ee
[Enhancement] Adding exclusions for libraries to fix CVEs (#50283)
Signed-off-by: Vikas Attiguppa <vikas.as@gmail.com>
2024-09-11 15:56:50 +08:00
Albert T. Wong 46a37fa0d8
[Refactor] removing airbyte and dbt connector from main repo and moving it into a dedicated repo (#42456)
removing airbyte connector from main repo and moving it into a dedicated repo (https://github.com/StarRocks/airbyte-starrocks).

removing dbt connector from main repo and moving it into a dedicated repo (https://github.com/StarRocks/dbt-starrocks).

Fixes #issue

Signed-off-by: alberttwong <atwong@alumni.uci.edu>
2024-03-12 15:05:01 +08:00
fardinsarker 81219aede4
[BugFix] making this version comparison more resilient as it fails issues/41016 (#42198)
Fixed #41016 which causes problems with version 3.2
Used to spit out
'>' not supported between instances of 'int' and 'str'
Signed-off-by: Fardin Sarker <fardin.sarker@gmail.com>
2024-03-06 18:45:41 +08:00
predator4ann 0bba6aff8a
[BugFix] Use mariadb connector (#41279)
Signed-off-by: predator4ann <yunlong.sun@hotmail.com>
2024-02-21 15:53:01 +08:00
Pat Buxton 47b78844ef
[Enhancement] Revise Python SQLAlchemy dialect and add testing (#40972)
Signed-off-by: Pat Buxton <patrick.buxton@tartansolutions.com>
2024-02-19 11:40:32 +08:00
Xueyan Li 5261c5f1e1
[Enhancement] Upgrade trino connector dependencies to a secure version (#40978)
Signed-off-by: Astralidea <astralidea@163.com>
2024-02-08 11:08:04 +08:00
predator4ann f993ca774e
[Doc] fixed incorrect license header (#40490)
Signed-off-by: predator4ann <yunlong.sun@hotmail.com>
2024-02-01 10:55:54 +08:00
predator4ann ff2b6f54a7
[Feature] Add StarRocks Connector for Trino (#16240)
Signed-off-by: predator4ann <yunlong.sun@hotmail.com>
2024-01-30 20:05:23 +08:00
Xueyan Li ae50e3e85f
[Feature] Support set index for dbt (#39017)
Signed-off-by: Astralidea <astralidea@163.com>
2024-01-15 10:21:11 +08:00
Xueyan Li 2cc316330a
[Feature] Support set order by for dbt (#38941)
Signed-off-by: Astralidea <astralidea@163.com>
2024-01-12 11:22:02 +08:00
Xueyan Li ec352bd482
[Feature] Support expression partition for dbt (#38724)
Signed-off-by: Astralidea <astralidea@163.com>
2024-01-09 17:13:04 +08:00
Felix Li 2d9470f736
[Enhancement] Upgrade airbyte vulnerability dependency (#36959)
Signed-off-by: Astralidea <astralidea@163.com>
2023-12-13 17:01:31 +08:00
Felix Li 580f276f7a
[Enhancement] Support read from catalog through source in dbt (#31641)
Signed-off-by: Astralidea <astralidea@163.com>
2023-09-22 20:16:13 +08:00
Felix Li 41a0344319
[Enhancement] Optimize dbt incremental model configuration (#31310)
Signed-off-by: Astralidea <astralidea@163.com>
2023-09-18 19:51:45 +08:00
Felix Li f72495f00c
[Feature] dbt Materialized views support more configuration parameters (#30324)
* Materialized views support more configuration parameters

Signed-off-by: Astralidea <astralidea@163.com>
2023-09-04 10:36:18 +08:00
Dan Roscigno b17bb22b0a
[Doc] Update dbt-starrocks README.md (#29834) 2023-08-24 08:44:24 +08:00
Felix Li 8ef181edbd
[Feature] Refactor & Support Basic Materialized View materialized for dbt Part 4 (#29148)
Fixes #issue

1. Support Simple Materialized View materialization (this will
enhancement in next PR
2. Fix bug  that the definition of View acquisition was inaccurate
3. Add StarRocksRelationType
4. Modify document

Signed-off-by: Astralidea <astralidea@163.com>
2023-08-14 16:30:52 +08:00
Felix Li 86403abba9
[Enhancement] Upgrade dbt-core to 1.6.0 & support py3.11 Part 3 (#29005)
Fixes #issue

Signed-off-by: Astralidea <astralidea@163.com>
2023-08-10 19:37:48 +08:00
lllong33 1a1e37f127
[Enhancement] Support python<3.11 and adjust mysql-connector-python>=8.1 repair c… (#28310)
…onflict protobuf >= 4.0.0

Signed-off-by: lllong33 <lllong33new@gmail.com>
2023-08-01 15:48:35 +08:00
Brian Mei 4e1cf68069
[Tool] AirByte Connector Fixed TLS support (#28235)
Signed-off-by: brmei <m.brian0606@gmail.com>
2023-07-29 09:39:22 +08:00
Brian Mei 827b5538e0
[Tool] Updated AirByte connector (#27697)
Signed-off-by: brmei <m.brian0606@gmail.com>
2023-07-25 10:04:37 +08:00
Felix Li 5b785915fd
[Enhancement] Optimize document & prepare to upload to pypi Part 2 (#27644)
Fixes #issue

Signed-off-by: Astralidea <astralidea@163.com>
2023-07-20 17:12:35 +08:00
liuzhongjun b57f484bef
[Enhancement] Change Sort Key Order and default delimiter for AirByte tables (#26207)
## Description
1. Change Sort Key Order to improve performance for querying newly added
rows by AirByte #25026
2. Change the default row/column delimiter
2023-07-19 18:03:19 -07:00
Felix Li 69912bfacc
[Enhancement] Optimize dbt-connector part 1 (#27387)
Fixes #24012

This PR addresses the following issues:
1. Upgrade dbt-core to version 1.5.2
2. Optimize whitespace in scripts that execute statements
3. Fix the problem that propreties configuration does not recognize
4. Added ability to identify starrocks version, users can also configure
their own version
5. For >=3.1 version distributed_by configuration is not necessary
6. When properties are not configured, the default is
{"replication_num":"1"}
7. Can simply run through the official example jaffle_shop

Signed-off-by: Astralidea <astralidea@163.com>
2023-07-19 16:25:44 +08:00
Ashish Bansal (mrphantom) 4262e45d13
Revert "[Enhancement] Change Sort Key Order for AirByte tables" (#25802)
## Description

https://github.com/StarRocks/starrocks/pull/25026 introduced a bug which
I mentioned here -
https://github.com/StarRocks/starrocks/pull/25026#issuecomment-1595699817

For now, I'm reverting the change.

Basically during data load to StarRocks, we end up inserting
_airbyte_emitted_at value into _airbyte_ab_id and vice-versa.

## What type of PR is this:
- [x] BugFix
- [ ] Feature
- [ ] Enhancement
- [ ] Refactor
- [ ] UT
- [ ] Doc
- [ ] Tool

Signed-off-by: Ashish Bansal <bansal.ashish096@gmail.com>
2023-06-25 14:10:57 +08:00
Ashish Bansal (mrphantom) 82bad405e3
[Enhancement] Change Sort Key Order for AirByte Tables (#25026) 2023-06-12 15:28:25 +08:00
miomiocat 94516fd072
[BugFix] Fix the dataset exception using superset (#24326)
Fixes #24010 

refactor the implementation of `get_columns` and supplement the
necessary interface implementation
2023-05-29 18:58:50 +08:00
miomiocat fd128f2154
[BugFix] Fix the ClassCastException when analyzing table (#20641)
Signed-off-by: miomiocat <284487410@qq.com>
2023-04-12 16:28:29 +08:00
liuzhongjun c8fc909e6b
[Feature]support airbyte destination plugin (#20024)
support airbyte destination plugin

---------
Signed-off-by: liuzhongjun89 <liuzhongjun_leo@163.com>
2023-03-23 13:21:39 +08:00