Skip to content

HIVE-29707: Upgrade Apache Druid from 0.17.1 to 26.0.0#6594

Open
saihemanth-cloudera wants to merge 3 commits into
apache:masterfrom
saihemanth-cloudera:HIVE-29707
Open

HIVE-29707: Upgrade Apache Druid from 0.17.1 to 26.0.0#6594
saihemanth-cloudera wants to merge 3 commits into
apache:masterfrom
saihemanth-cloudera:HIVE-29707

Conversation

@saihemanth-cloudera

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Upgrade Apache Druid to CVE free version

Why are the changes needed?

Avoid critical CVEs in the older version

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Unit tests

The Druid 26 upgrade increases the hive-it-qfile test classpath footprint,
leaving too little heap in the forked TestMiniLlapCliDriver JVM for Tez AM
and mini-cluster components that run in-process alongside LLAP.
Cap in-process mini LLAP executor and cache memory in LlapItUtils so Tez AM,
mini YARN, and mini HDFS retain heap (fixes script_env_var2.q). Bump the
qfile Surefire fork heap to 4 GB for additional headroom.
Rewrite llap_io_cache.q to evaluate RPAD at runtime instead of constant-
folding a ~16 MB string into the Tez MapWork plan, which OOMs the Tez AM
during Kryo deserialization of map.xml. Update the expected q.out for the
new INSERT shape and lineage.
@sonarqubecloud

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants