Skip to content

RANGER-5658: Tag Sync: remove atlas.kafka.zookeeper.connect and fix Atlas Kafka consumer for Kafka 3.9#1045

Merged
ramackri merged 1 commit into
ranger-2.9from
RANGER-5658-backport-ranger-2.9
Jul 4, 2026
Merged

RANGER-5658: Tag Sync: remove atlas.kafka.zookeeper.connect and fix Atlas Kafka consumer for Kafka 3.9#1045
ramackri merged 1 commit into
ranger-2.9from
RANGER-5658-backport-ranger-2.9

Conversation

@ramackri

@ramackri ramackri commented Jul 4, 2026

Copy link
Copy Markdown
Contributor

Summary

Backport of deaf13df3 / #1037 to ranger-2.9.

Remove the legacy atlas.kafka.zookeeper.connect requirement from Tag Sync's Atlas Kafka source and fix Atlas Kafka consumer setup for Kafka 3.9+ / KRaft (PLAINTEXT and Kerberos).

Fixes RANGER-5658.

Changes

  • AtlasTagSource.java — remove ZK validation; load config via ApplicationProperties; validate bootstrap servers + consumer group only
  • setup.py — emit Kerberos JAAS only for SASL protocols; fix rangerTagsync_password jceks credential
  • Installer/templates — drop TAG_SOURCE_ATLAS_KAFKA_ZOOKEEPER_CONNECT from install properties and templates
  • ranger-tagsync-services.sh — pass -Datlas.conf for Atlas properties
  • AtlasTagSourceConfigTest.java — unit tests for required Kafka properties
  • dev-support/README-TAGSYNC-ATLAS-KAFKA-CONFIG.md — operator documentation

Note: AtlasTagSource.java conflict on backport was resolved by taking the #1037 version (includes formatting update from master).

Test plan

  • mvn test -pl tagsync -Dtest=AtlasTagSourceConfigTest -Drat.skip=true -Dcheckstyle.skip=true -Dpmd.skip=true -Dspotbugs.skip=true
  • Fresh install: atlas-application.properties has bootstrap servers + consumer group, no atlas.kafka.zookeeper.connect
  • PLAINTEXT Atlas Kafka: Tag Sync starts and consumes entity notifications
  • Kerberos (SASL): JAAS entries present only when security protocol is SASL
  • CI build-8 green on ranger-2.9

…tlas Kafka consumer for Kafka 3.9

Backport of deaf13d (#1037) to ranger-2.9.

- Remove obsolete atlas.kafka.zookeeper.connect requirement from Tag Sync
- Fix Atlas Kafka consumer for Kafka 3.9 / KRaft (PLAINTEXT and Kerberos)
- Load atlas-application.properties via ApplicationProperties and -Datlas.conf
- Fix TagSync setup.py rangerTagsync_password credential for jceks
- Add AtlasTagSourceConfigTest and operator documentation
@ramackri ramackri merged commit f7950da into ranger-2.9 Jul 4, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant