Commit Graph

588 Commits

Author SHA1 Message Date
Madhan Neethiraj 1e66c8b243 ATLAS-4901: updated JanusGraph to 1.0.0 2024-10-06 07:40:24 -07:00
pareshD 42bf77ba59 ATLAS-4846-Source-the-atlas-env-file-in-ATLAS-import.patch
Signed-off-by: Mandar Ambawane <mandar.ambawane@freestoneinfotech.com>
2024-06-07 17:43:37 +05:30
Amruth S f3ef15afc9 ATLAS-4830: Make ignore patterns generic for all the hooks
Signed-off-by: Radhika Kundam <radhika.kundam@gmail.com>
2024-05-22 10:59:46 -07:00
Dmitrii Chechetkin fd0d3a69fe ATLAS-4789: added couchbase bridge
Signed-off-by: Madhan Neethiraj <madhan@apache.org>
2023-11-02 11:39:00 -07:00
Madhan Neethiraj dc5db3b6c1 ATLAS-4794: fixed initialization failure in HBase and Hive hooks 2023-09-08 16:18:34 -07:00
radhikakundam 1443f25a46 ATLAS-4746: hive_process and hive_process_execution (lineage) being generated for simple DML UPDATE queries run via hive
Signed-off-by: radhikakundam <radhikakundam@apache.org>
2023-08-03 09:33:20 -07:00
radhikakundam 8d8169e83a ATLAS-4335: Hook Notifications through Rest Interface
Signed-off-by: radhikakundam <radhikakundam@apache.org>
2023-08-02 14:49:43 -07:00
Madhan Neethiraj 92861ba9f3 ATLAS-4741: updated Storm version to 2.4.0 2023-04-02 22:56:55 -07:00
radhikakundam 013c8623e9 ATLAS-4734: HiveProcess - Output entity creation is ignored in case of same entity exists both inputs and outputs from context 2023-03-27 14:36:46 -07:00
Madhan Neethiraj fcbc016451 ATLAS-3820: fix import-kafka.sh failures; updated docker setup for Kafka bridge
(cherry picked from commit 2c2d9197e68b809198d6e9f1232473d1c2d9e960)
2022-11-16 20:07:35 -08:00
Madhan Neethiraj 7f9e980f6a ATLAS-4241: fix import-hbase errors
(cherry picked from commit da27bb1b497db7f234c66203255a3ded37af3631)
2022-11-16 20:07:22 -08:00
Madhan Neethiraj 567ffb4089 ATLAS-4445: fix import-hive.sh failure; updated hive version from 3.1.0 to 3.1.2
(cherry picked from commit 1a5bf676218d371398e700c1a348a60c11c52867)
2022-11-16 20:05:44 -08:00
yanxu3 4774ed61d5 ATLAS-4706: Remove unnecessary single quote at the end of flink_model.json
Signed-off-by: Madhan Neethiraj <madhan@apache.org>
2022-11-06 23:17:27 -08:00
Jayendra Parab a0a5c596f6 ATLAS-4692: upgraded Apache Commons Text to 1.10.0
Signed-off-by: Madhan Neethiraj <madhan@apache.org>
2022-11-06 15:51:28 -08:00
prasad.pawar e98c398e62 ATLAS-4677 : Upgrade commons-configuration to 2.8.0
Signed-off-by: Pinal Shah <pinal.shah@freestoneinfotech.com>
2022-10-20 13:03:29 +05:30
chaitali borole 12fe912180 ATLAS-4669 : Upgrade Junit to 4.13.2
Signed-off-by: Pinal Shah <pinal.shah@freestoneinfotech.com>
2022-09-08 18:04:30 +05:30
pareshD 3a98f1fc98 ATLAS-4627 : Delete Existing entity in Atlas which are not present in Hive, DB wise through Import-hive command.
Signed-off-by: Pinal Shah <pinal.shah@freestoneinfotech.com>
2022-09-08 14:29:05 +05:30
Andras Katona 09a8282fa2 ATLAS-4569: Kafka importer should use only kafka-clients from Kafka libs and slf4j-api
Signed-off-by: Pinal Shah <pinal.shah@freestoneinfotech.com>
2022-04-27 19:40:09 +05:30
snehal.ambavkar 742eeba402 ATLAS-4571 : Impala Hook : query-string is too large to store Asset.name (solr.StrField).
Signed-off-by: Pinal Shah <pinal.shah@freestoneinfotech.com>
2022-04-12 12:42:08 +05:30
Sidharth Mishra 362f6c1b61 ATLAS-4548: Added Empty attribute value for queryStr and queryId in case of null value
Signed-off-by: Sidharth Mishra <sidmishra@apache.org>
2022-02-02 14:18:30 -08:00
Radhika Kundam 11ed7f75c0 ATLAS-4492: Atlas to skip external temporary table created in hive
Signed-off-by: Sidharth Mishra <sidmishra@apache.org>
2021-12-09 17:47:55 -08:00
JP Li a4ee6c05ad ATLAS-4370: Persist Metrics for user to retrieve Metrics info at a past timestamp
Co-authored-by: Disha Talreja <dishatalreja@cloudera.com>

Signed-off-by: Sarath Subramanian <sarath@apache.org>
2021-12-02 10:11:12 -08:00
Sidharth Mishra 14e81aa648 ATLAS-4475: Fixed log messages for Import Hive V2 when running with set of tables
Signed-off-by: Sidharth Mishra <sidmishra@apache.org>
2021-11-18 15:32:16 -08:00
Radhika Kundam dd2722599d ATLAS-4482: GCP : Load data in path query throws Referenced entity -guid is not found and the GCP directory is not created in Atlas
Signed-off-by: Sidharth Mishra <sidmishra@apache.org>
2021-11-17 11:00:43 -08:00
Aileen Toleikis b4ee37b6d8 ATLAS-4246: Make Kafka Interface aware of Kafka Schema Registry
Signed-off-by: Sidharth Mishra <sidmishra@apache.org>
2021-11-15 11:21:51 -08:00
Radhika Kundam 10a7c76c8e ATLAS-4470: Creating Hive_Process entity is getting failed due to empty/null startTime
Signed-off-by: Sidharth Mishra <sidmishra@apache.org>
2021-11-09 12:58:21 -08:00
Sidharth Mishra 041e7d737e ATLAS-4424: Enhanced the Import hive utility to create export zip files and run bulk import
Signed-off-by: Sidharth Mishra <sidmishra@apache.org>
2021-11-03 16:48:51 -07:00
chaitali borole 7581672b7a ATLAS-4428 : Enhance Atlas hook messages to capture hook version & message source
Signed-off-by: Pinal Shah <pinal.shah@freestoneinfotech.com>
2021-11-01 11:38:52 +05:30
Sidharth Mishra 65bcd9f573 ATLAS-4462: Upgraded Surefire version, Updated the pom to stop jetty before start, Added retry logic for Embedded Kafka start having port bind issue
Signed-off-by: Sidharth Mishra <sidmishra@apache.org>
2021-10-28 17:31:18 -07:00
Sidharth Mishra 8ed4c5e7cb ATLAS-4351 Reverted the changes
Signed-off-by: Sidharth Mishra <sidmishra@apache.org>
2021-10-28 15:19:21 -07:00
chaitali borole a0e08b5ee8 ATLAS-4351 : Maven-jetty throwing warnings when running Integration tests for conflicting jars in classpath
Signed-off-by: Pinal Shah <pinal.shah@freestoneinfotech.com>
2021-09-30 20:27:59 +05:30
Disha Talreja 0aa45c8657 ATLAS-4421: [Atlas: Hive Import] When import-hive is run with incorrect input the information is not conveyed to the user
Signed-off-by: Sarath Subramanian <sarath@apache.org>
2021-09-29 11:05:57 -07:00
chaitali borole 953f65b9c4 ATLAS-4377 : Atlas - Upgrade Spring Security to 5.4.4+/5.3.8+/5.2.9+
Signed-off-by: Pinal Shah <pinal.shah@freestoneinfotech.com>
2021-09-14 09:38:05 +05:30
Disha Talreja 6e4d369fd8 ATLAS-4369: import-hive.sh does not write logs to /var/log/atlas/import-hive.log file
Signed-off-by: Sarath Subramanian <sarath@apache.org>
2021-09-13 11:19:03 -07:00
Radhika Kundam b612a94580 ATLAS-4398: Add additional path types to Hive DDL filter
Signed-off-by: Sarath Subramanian <sarath@apache.org>
2021-08-26 09:52:07 -07:00
Sarath Subramanian a7ac64d549 ATLAS-4340: Set Solr wait-searcher property to false by default to make Solr commits async 2021-07-27 14:59:48 -07:00
Radhika Kundam 98c6cea014 ATLAS-4324: FS entity created for load data inpath is created as shell entity - adding ozone_key
Signed-off-by: Sarath Subramanian <sarath@apache.org>
2021-07-27 11:22:39 -07:00
Radhika Kundam 8725f31af9 ATLAS-4348: Atlas-Kafka Hook : When a producer publishes messages to multiple topics, the latest relationship is marked ACTIVE , rest are marked DELETED
Signed-off-by: Sarath Subramanian <sarath@apache.org>
2021-07-16 15:16:38 -07:00
Radhika Kundam c1dc84cdee ATLAS-4354: atlas import-hive.sh fails with java.lang.AbstractMethodError
Signed-off-by: nixonrodrigues <nixon@apache.org>
2021-07-13 15:46:10 +05:30
Radhika Kundam 77b03aa140 ATLAS-4339: Atlas should support skip temporary tables using config property
Signed-off-by: Sarath Subramanian <sarath@apache.org>
2021-06-24 12:01:44 -07:00
Ashutosh Mestry 0ac4b12be7 ATLAS-4324: FS entity created for 'load data inpath' Part 2 2021-06-11 09:20:42 -07:00
Radhika Kundam 01f5eea5c6 ATLAS-4333: [MATERIALIZED VIEW]Column Lineage and hive_process missing in case of CREATE MATERIALIZED VIEW query at Hive 2021-06-10 13:36:21 -07:00
Josh Yeh 005d8674e0 ATLAS-3812: Apache Flink model for Atlas.
Signed-off-by: nixonrodrigues <nixon@apache.org>
2021-06-04 14:51:22 +05:30
JP Li ff0c65a49f ATLAS-4322: Hive HOOK NPE
Signed-off-by: sidmishra <sidmishra@apache.org>
2021-06-03 10:30:56 -07:00
Radhika Kundam a9e528bca9 ATLAS-4324: FS entity created for load data inpath is created as shell entity
Signed-off-by: Sarath Subramanian <sarath@apache.org>
2021-06-03 09:33:31 -07:00
Mandar Ambawane e993f85d7b ATLAS-4301 Handle Integration Test Failures on HiveHook module
Signed-off-by: Sarath Subramanian <sarath@apache.org>
2021-06-03 09:12:40 -07:00
Benedict Jin ab23b99c50
ATLAS-4319 : Code refactoring in kafka bridge #136 2021-06-01 20:30:57 +05:30
Ashutosh Mestry bbdae91054 ATLAS-4204: Configure HS2 hook to send lineage-only messages. Part-2 2021-04-13 09:25:19 -07:00
Ashutosh Mestry 2588540ebe ATLAS-4204: Configure HS2 hook to send lineage-only messages. 2021-04-12 09:30:04 -07:00
sidmishra 2aa448c110 ATLAS-4226: Add new model types to support Google Cloud Platform
Signed-off-by: Sarath Subramanian <sarath@apache.org>
2021-03-31 12:09:50 -07:00