Skip to content

TEZ-4713: Sync 3rd party dependency with Hadoop-3.5.0#490

Open
Aggarwal-Raghav wants to merge 1 commit intoapache:masterfrom
Aggarwal-Raghav:TEZ-4713
Open

TEZ-4713: Sync 3rd party dependency with Hadoop-3.5.0#490
Aggarwal-Raghav wants to merge 1 commit intoapache:masterfrom
Aggarwal-Raghav:TEZ-4713

Conversation

@Aggarwal-Raghav
Copy link
Copy Markdown
Contributor

  • Update BouncyCastle to 1.82
  • Update Guava to 33.4.8-jre
  • Update RoaringBitmap to 1.3.0
  • Add Jackson 2.18.6 and jackson-bom
  • Add Reload4j 1.2.22
  • Remove jsr305 dependency version

- Update BouncyCastle to 1.82
- Update Guava to 33.4.8-jre
- Update RoaringBitmap to 1.3.0
- Add Jackson 2.18.6 and jackson-bom
- Add Reload4j 1.2.22
- Remove jsr305 dependency version
Comment thread pom.xml
<!--dependency versions in alphabetical order-->
<asynchttpclient.version>2.12.4</asynchttpclient.version>
<bouncycastle.version>1.79</bouncycastle.version>
<bouncycastle.version>1.82</bouncycastle.version>
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

to be in sync with hadoop-3.5.0

Comment thread pom.xml
<plexus-velocity.version>2.3.0</plexus-velocity.version>
<frontend-maven-plugin.version>1.15.0</frontend-maven-plugin.version>
<guava.version>32.0.1-jre</guava.version>
<guava.version>33.4.8-jre</guava.version>
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

to be in sync with hadoop-3.5.0

Comment thread pom.xml
<jackson.version>2.18.6</jackson.version>
<jersey.version>1.19.4</jersey.version>
<jettison.version>1.5.4</jettison.version>
<jsr305.version>3.0.0</jsr305.version>
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can't find any usage

Comment thread pom.xml
<protobuf.version>3.25.5</protobuf.version>
<protoc-jar-maven-plugin.version>3.11.4</protoc-jar-maven-plugin.version>
<protoc.path>${env.PROTOC_PATH}</protoc.path>
<reload4j.version>1.2.22</reload4j.version>
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

two version of reload4j was coming 1.2.22 and 1.2.19. Better to define our own version than relying on hadoop.
1.2.19 was coming from slf4j-reload4j dependency

Comment thread pom.xml
<reload4j.version>1.2.22</reload4j.version>
<restrict-imports.enforcer.version>3.0.0</restrict-imports.enforcer.version>
<roaringbitmap.version>1.2.1</roaringbitmap.version>
<roaringbitmap.version>1.3.0</roaringbitmap.version>
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

proactively done for iceberg-1.10.x

Comment thread pom.xml
</dependency>
<dependency>
<groupId>com.fasterxml.jackson</groupId>
<artifactId>jackson-bom</artifactId>
Copy link
Copy Markdown
Contributor Author

@Aggarwal-Raghav Aggarwal-Raghav Apr 27, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

import.*jackson explicitly used in tez java file but it is relying on hadoop for jackson jars. IMO, this is not correct.

Also 2 version of jackson-core are coming in tez-dist/.../lib 2.14.3 and 2.12.7

 +- org.apache.avro:avro:jar:1.11.4:compile
[INFO]    |  \- com.fasterxml.jackson.core:jackson-core:jar:2.14.3:compile
INFO] |  +- org.apache.hadoop:hadoop-yarn-common:jar:3.4.2:compile
[INFO] |  |  +- com.sun.jersey:jersey-core:jar:1.19.4:compile
[INFO] |  |  |  \- javax.ws.rs:jsr311-api:jar:1.1.1:compile
[INFO] |  |  +- com.google.inject.extensions:guice-servlet:jar:4.2.3:compile
[INFO] |  |  +- com.google.inject:guice:jar:4.2.3:compile
[INFO] |  |  |  +- javax.inject:javax.inject:jar:1:compile
[INFO] |  |  |  \- aopalliance:aopalliance:jar:1.0:compile
[INFO] |  |  +- com.sun.jersey.contribs:jersey-guice:jar:1.19.4:compile
[INFO] |  |  +- com.fasterxml.jackson.core:jackson-core:jar:2.12.7:compile

@tez-yetus
Copy link
Copy Markdown

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ docker 3m 20s Docker failed to build run-specific yetus/tez:tp-7858}.
Subsystem Report/Notes
GITHUB PR #490
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/1/console
versions git=2.34.1
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@Aggarwal-Raghav
Copy link
Copy Markdown
Contributor Author

CC @abstractdog , can you please help with CI privilege issue?

15:01:41  
15:01:41  #2 [internal] load metadata for docker.io/yetus/tez:240665345
15:01:41  #2 ERROR: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants