8000 HADOOP-19343. Add Google Cloud Storage Connector by arunkumarchacko · Pull Request #7656 · apache/hadoop · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

HADOOP-19343. Add Google Cloud Storage Connector #7656

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 8 commits into from
Closed

HADOOP-19343. Add Google Cloud Storage Connector #7656

wants to merge 8 commits into from

Conversation

arunkumarchacko
Copy link

Add implementation for create() API

Description of PR

How was this patch tested?

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

@arunkumarchacko
HADOOP-19343. Add Google Cloud Storage Connector
ffc0a6d 
Add implementation for create() API
@arunkumarchacko arunkumarchacko marked this pull request as draft April 28, 2025 15:33
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 20s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ HADOOP-19343 Compile Tests _
+0 🆗 mvndep 6m 33s Maven dependency ordering for branch
+1 💚 mvninstall 18m 43s HADOOP-19343 passed
+1 💚 compile 8m 22s HADOOP-19343 passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 compile 7m 16s HADOOP-19343 passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 checkstyle 1m 55s HADOOP-19343 passed
+1 💚 mvnsite 1m 27s HADOOP-19343 passed
+1 💚 javadoc 2m 7s HADOOP-19343 passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javadoc 1m 45s HADOOP-19343 passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+0 🆗 spotbugs 0m 31s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 💚 shadedclient 22m 46s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 1m 38s Maven dependency ordering for patch
+1 💚 mvninstall 10m 32s the patch passed
+1 💚 compile 8m 7s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javac 8m 7s the patch passed
+1 💚 compile 7m 16s the patch passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 javac 7m 16s the patch passed
-1 ❌ blanks 0m 0s /blanks-tabs.txt The patch 2 line(s) with tabs.
-0 ⚠️ checkstyle 2m 0s /results-checkstyle-root.txt root: The patch generated 45 new + 0 unchanged - 0 fixed = 45 total (was 0)
+1 💚 mvnsite 1m 51s the patch passed
-1 ❌ javadoc 0m 27s /results-javadoc-javadoc-hadoop-tools_hadoop-gcp-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt hadoop-tools_hadoop-gcp-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)
-1 ❌ javadoc 1m 37s /results-javadoc-javadoc-hadoop-tools-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt hadoop-tools-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 generated 3 new + 445 unchanged - 0 fixed = 448 total (was 445)
-1 ❌ javadoc 0m 27s /results-javadoc-javadoc-hadoop-tools_hadoop-gcp-jdkPrivateBuild-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06.txt hadoop-tools_hadoop-gcp-jdkPrivateBuild-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06 with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06 generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)
-1 ❌ javadoc 1m 24s /results-javadoc-javadoc-hadoop-tools-jdkPrivateBuild-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06.txt hadoop-tools-jdkPrivateBuild-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06 with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06 generated 3 new + 449 unchanged - 0 fixed = 452 total (was 449)
+0 🆗 spotbugs 0m 26s hadoop-project has no data from spotbugs
-1 ❌ spotbugs 0m 29s /patch-spotbugs-hadoop-tools_hadoop-gcp.txt hadoop-gcp in the patch failed.
-1 ❌ spotbugs 3m 4s /patch-spotbugs-hadoop-tools.txt hadoop-tools in the patch failed.
+1 💚 shadedclient 20m 5s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 24s hadoop-project in the patch passed.
+1 💚 unit 0m 29s hadoop-gcp in the patch passed.
+1 💚 unit 71m 10s hadoop-tools in the patch passed.
+1 💚 asflicense 0m 46s The patch does not generate ASF License warnings.
208m 47s
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/1/artifact/out/Dockerfile
GITHUB PR #7656
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 16c7e6a33aa0 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision HADOOP-19343 / ffc0a6d
Default Java Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/1/testReport/
Max. process+thread count 1047 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-gcp hadoop-tools U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/1/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 22s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ HADOOP-19343 Compile Tests _
+0 🆗 mvndep 5m 46s Maven dependency ordering for branch
+1 💚 mvninstall 18m 45s HADOOP-19343 passed
+1 💚 compile 8m 35s HADOOP-19343 passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 compile 7m 25s HADOOP-19343 passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 checkstyle 2m 1s HADOOP-19343 passed
+1 💚 mvnsite 1m 27s HADOOP-19343 passed
+1 💚 javadoc 2m 6s HADOOP-19343 passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javadoc 1m 48s HADOOP-19343 passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+0 🆗 spotbugs 0m 33s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 💚 shadedclient 22m 39s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 1m 17s Maven dependency ordering for patch
+1 💚 mvninstall 10m 29s the patch passed
+1 💚 compile 8m 12s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javac 8m 12s the patch passed
+1 💚 compile 7m 21s the patch passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 javac 7m 21s the patch passed
-1 ❌ blanks 0m 0s /blanks-tabs.txt The patch 2 line(s) with tabs.
-0 ⚠️ checkstyle 2m 0s /results-checkstyle-root.txt root: The patch generated 46 new + 0 unchanged - 0 fixed = 46 total (was 0)
+1 💚 mvnsite 1m 55s the patch passed
+1 💚 javadoc 2m 16s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javadoc 2m 16s the patch passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+0 🆗 spotbugs 0m 28s hadoop-project has no data from spotbugs
-1 ❌ spotbugs 0m 28s /patch-spotbugs-hadoop-tools_hadoop-gcp.txt hadoop-gcp in the patch failed.
-1 ❌ spotbugs 3m 2s /patch-spotbugs-hadoop-tools.txt hadoop-tools in the patch failed.
+1 💚 shadedclient 19m 52s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 27s hadoop-project in the patch passed.
+1 💚 unit 0m 29s hadoop-gcp in the patch passed.
+1 💚 unit 70m 35s hadoop-tools in the patch passed.
+1 💚 asflicense 0m 44s The patch does not generate ASF License warnings.
207m 26s
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/2/artifact/out/Dockerfile
GITHUB PR #7656
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 8d14745ce81f 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision HADOOP-19343 / 14d8d96
Default Java Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/2/testReport/
Max. process+thread count 1041 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-gcp hadoop-tools U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/2/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 25s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ HADOOP-19343 Compile Tests _
+0 🆗 mvndep 6m 2s Maven dependency ordering for branch
+1 💚 mvninstall 18m 44s HADOOP-19343 passed
+1 💚 compile 8m 24s HADOOP-19343 passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 compile 7m 14s HADOOP-19343 passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 checkstyle 2m 0s HADOOP-19343 passed
+1 💚 mvnsite 1m 30s HADOOP-19343 passed
+1 💚 javadoc 2m 7s HADOOP-19343< 8000 /a> passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javadoc 1m 51s HADOOP-19343 passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+0 🆗 spotbugs 0m 30s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 💚 shadedclient 23m 39s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 1m 23s Maven dependency ordering for patch
+1 💚 mvninstall 10m 29s the patch passed
+1 💚 compile 8m 7s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javac 8m 7s the patch passed
+1 💚 compile 7m 20s the patch passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 javac 7m 20s the patch passed
-1 ❌ blanks 0m 0s /blanks-tabs.txt The patch 2 line(s) with tabs.
-0 ⚠️ checkstyle 1m 54s /results-checkstyle-root.txt root: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+1 💚 mvnsite 1m 57s the patch passed
+1 💚 javadoc 2m 33s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javadoc 2m 15s the patch passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+0 🆗 spotbugs 0m 27s hadoop-project has no data from spotbugs
-1 ❌ spotbugs 3m 26s /new-spotbugs-hadoop-tools.html hadoop-tools generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)
+1 💚 shadedclient 23m 13s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 26s hadoop-project in the patch passed.
+1 💚 unit 0m 30s hadoop-gcp in the patch passed.
-1 ❌ unit 71m 25s /patch-unit-hadoop-tools.txt hadoop-tools in the patch passed.
+1 💚 asflicense 0m 46s The patch does not generate ASF License warnings.
210m 47s
Reason Tests
SpotBugs module:hadoop-tools
Field only ever set to null:null: org.apache.hadoop.fs.gs.CreateOptions$CreateOperationOptionsBuilder.contentEncoding At CreateOptions.java:[line 116]
Redundant nullcheck of com.google.cloud.storage.BlobInfo.getMetadata(), which is known to be non-null in org.apache.hadoop.fs.gs.GoogleCloudStorage.createItemInfoForBlob(StorageResourceId, Blob) Redundant null check at GoogleCloudStorage.java:is known to be non-null in org.apache.hadoop.fs.gs.GoogleCloudStorage.createItemInfoForBlob(StorageResourceId, Blob) Redundant null check at GoogleCloudStorage.java:[line 182]
Load of known null value in org.apache.hadoop.fs.gs.StringPaths.fromComponents(String, String) At StringPaths.java:in org.apache.hadoop.fs.gs.StringPaths.fromComponents(String, String) At StringPaths.java:[line 117]
Failed junit tests hadoop.yarn.sls.scheduler.TestTaskRunner
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/3/artifact/out/Dockerfile
GITHUB PR #7656
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux f2099f5f9256 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision HADOOP-19343 / 7e203c6
Default Java Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/3/testReport/
Max. process+thread count 1020 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-gcp hadoop-tools U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/3/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 20s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 xmllint 0m 1s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ HADOOP-19343 Compile Tests _
+0 🆗 mvndep 6m 16s Maven dependency ordering for branch
+1 💚 mvninstall 18m 48s HADOOP-19343 passed
+1 💚 compile 8m 31s HADOOP-19343 passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 compile 7m 28s HADOOP-19343 passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 checkstyle 1m 57s HADOOP-19343 passed
+1 💚 mvnsite 1m 23s HADOOP-19343 passed
+1 💚 javadoc 2m 5s HADOOP-19343 passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javadoc 1m 50s HADOOP-19343 passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+0 🆗 spotbugs 0m 30s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 💚 shadedclient 22m 53s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 1m 26s Maven dependency ordering for patch
+1 💚 mvninstall 10m 18s the patch passed
+1 💚 compile 8m 12s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javac 8m 12s the patch passed
+1 💚 compile 7m 29s the patch passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 javac 7m 29s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 59s /results-checkstyle-root.txt root: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+1 💚 mvnsite 1m 54s the patch passed
+1 💚 javadoc 2m 36s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javadoc 2m 18s the patch passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+0 🆗 spotbugs 0m 27s hadoop-project has no data from spotbugs
-1 ❌ spotbugs 3m 24s /new-spotbugs-hadoop-tools.html hadoop-tools generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)
+1 💚 shadedclient 23m 22s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 25s hadoop-project in the patch passed.
+1 💚 unit 0m 30s hadoop-gcp in the patch passed.
+1 💚 unit 70m 46s hadoop-tools in the patch passed.
+1 💚 asflicense 0m 46s The patch does not generate ASF License warnings.
210m 4s
Reason Tests
SpotBugs module:hadoop-tools
Unread field:CreateOptions.java:[line 100]
Unread field:CreateOptions.java:[line 101]
Redundant nullcheck of com.google.cloud.storage.BlobInfo.getMetadata(), which is known to be non-null in org.apache.hadoop.fs.gs.GoogleCloudStorage.createItemInfoForBlob(StorageResourceId, Blob) Redundant null check at GoogleCloudStorage.java:is known to be non-null in org.apache.hadoop.fs.gs.GoogleCloudStorage.createItemInfoForBlob(StorageResourceId, Blob) Redundant null check at GoogleCloudStorage.java:[line 182]
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/4/artifact/out/Dockerfile
GITHUB PR #7656
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 9004e3814a0a 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision HADOOP-19343 / aa6a149
Default Java Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/4/testReport/
Max. process+thread count 1027 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-gcp hadoop-tools U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/4/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

cnauroth
cnauroth reviewed May 13, 2025
View reviewed changes
Copy link
Contributor
@cnauroth cnauroth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hello @arunkumarchacko . Looks like this is going in the right direction overall! I entered a few questions regarding the build process.

hadoop-project/pom.xml Outdated
@@ -86,7 +86,7 @@

<!-- Protobuf version for backward compatibility -->
<!-- This is used in hadoop-common for compilation only -->
<protobuf.version>2.5.0</protobuf.version>
<protobuf.version>3.25.3</protobuf.version>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was intentionally kept at a lower version for backward-compatibility with other Hadoop RPC clients. HADOOP-17046 has more background. I'm not sure it's safe to upgrade this now. Internally, Hadoop gets its protobuf as a shaded dependency from the hadoop-thirdparty project:

https://github.com/apache/hadoop-thirdparty

Can we use that?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GCS client needs this protobuf version to function. Since the dependency is from GCS client, I do not think we can use hadoop-thridparty.

Thank you for the feedback. I will see if there is any alternate way to resolve this.

hadoop-tools/hadoop-gcp/pom.xml Outdated
</build>
</profile>

<!-- Turn on scale tests-->
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does the pom.xml have some stuff cloned from hadoop-tools/hadoop-aws/pom.xml that isn't relevant for this module?

Copy link
Author
< 8000 button class="flash-close js-comment-hide-minimize-form" type="button">

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, this is cloned from hadoop-aws/pom.xml. I kept it since we plan to have parity with other clients. I will remove this for now and add when we actually add those tests.

@arunkumarchacko
Remove unused properties from pom.xml
8ee2957 
Fix some spotbug issues
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 8m 33s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ HADOOP-19343 Compile Tests _
+0 🆗 mvndep 7m 17s Maven dependency ordering for branch
+1 💚 mvninstall 18m 42s HADOOP-19343 passed
+1 💚 compile 8m 21s HADOOP-19343 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 compile 7m 33s HADOOP-19343 passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 checkstyle 1m 58s HADOOP-19343 passed
+1 💚 mvnsite 1m 24s HADOOP-19343 passed
+1 💚 javadoc 2m 10s HADOOP-19343 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javadoc 1m 49s HADOOP-19343 passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+0 🆗 spotbugs 0m 32s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 💚 shadedclient 23m 1s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 1m 17s Maven dependency ordering for patch
+1 💚 mvninstall 10m 28s the patch passed
+1 💚 compile 8m 4s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javac 8m 4s the patch passed
+1 💚 compile 7m 23s the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 javac 7m 23s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 59s /results-checkstyle-root.txt root: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+1 💚 mvnsite 1m 54s the patch passed
+1 💚 javadoc 2m 33s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javadoc 2m 19s the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+0 🆗 spotbugs 0m 26s hadoop-project has no data from spotbugs
-1 ❌ spotbugs 3m 27s /new-spotbugs-hadoop-tools.html hadoop-tools generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚 shadedclient 23m 11s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 25s hadoop-project in the patch passed.
+1 💚 unit 0m 29s hadoop-gcp in the patch passed.
-1 ❌ unit 71m 10s /patch-unit-hadoop-tools.txt hadoop-tools in the patch passed.
+1 💚 asflicense 0m 45s The patch does not generate ASF License warnings.
219m 17s
Reason Tests
SpotBugs module:hadoop-tools
Redundant nullcheck of com.google.cloud.storage.BlobInfo.getMetadata(), which is known to be non-null in org.apache.hadoop.fs.gs.GoogleCloudStorage.createItemInfoForBlob(StorageResourceId, Blob) Redundant null check at GoogleCloudStorage.java:is known to be non-null in org.apache.hadoop.fs.gs.GoogleCloudStorage.createItemInfoForBlob(StorageResourceId, Blob) Redundant null check at GoogleCloudStorage.java:[line 182]
Failed junit tests hadoop.yarn.sls.scheduler.TestTaskRunner
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/5/artifact/out/Dockerfile
GITHUB PR #7656
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux aa6c3fdaef37 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision HADOOP-19343 / 8ee2957
Default Java Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/5/testReport/
Max. process+thread count 1030 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-gcp hadoop-tools U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/5/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 20s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ HADOOP-19343 Compile Tests _
+0 🆗 mvndep 7m 10s Maven dependency ordering for branch
+1 💚 mvninstall 18m 58s HADOOP-19343 passed
+1 💚 compile 8m 26s HADOOP-19343 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 compile 7m 34s HADOOP-19343 passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 checkstyle 2m 6s HADOOP-19343 passed
+1 💚 mvnsite 1m 20s HADOOP-19343 passed
+1 💚 javadoc 2m 7s HADOOP-19343 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javadoc 1m 48s HADOOP-19343 passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+0 🆗 spotbugs 0m 33s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 💚 shadedclient 22m 25s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 1m 20s Maven dependency ordering for patch
-1 ❌ mvninstall 4m 53s /patch-mvninstall-hadoop-tools_hadoop-gcp.txt hadoop-gcp in the patch failed.
-1 ❌ mvninstall 5m 12s /patch-mvninstall-hadoop-tools.txt hadoop-tools in the patch failed.
+1 💚 compile 8m 5s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javac 8m 5s the patch passed
+1 💚 compile 7m 29s the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 javac 7m 29s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 58s /results-checkstyle-root.txt root: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+1 💚 mvnsite 1m 50s the patch passed
+1 💚 javadoc 2m 31s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javadoc 2m 18s the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+0 🆗 spotbugs 0m 27s hadoop-project has no data from spotbugs
-1 ❌ spotbugs 3m 25s /new-spotbugs-hadoop-tools.html hadoop-tools generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚 shadedclient 23m 5s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 26s hadoop-project in the patch passed.
+1 💚 unit 0m 29s hadoop-gcp in the patch passed.
+1 💚 unit 71m 18s hadoop-tools in the patch passed.
+1 💚 asflicense 0m 47s The patch does not generate ASF License warnings.
210m 34s
Reason Tests
SpotBugs module:hadoop-tools
Possible null pointer dereference in org.apache.hadoop.fs.gs.GoogleCloudStorage.createItemInfoForBlob(StorageResourceId, Blob) due to return value of called method Method invoked at GoogleCloudStorage.java:org.apache.hadoop.fs.gs.GoogleCloudStorage.createItemInfoForBlob(StorageResourceId, Blob) due to return value of called method Method invoked at GoogleCloudStorage.java:[line 182]
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/6/artifact/out/Dockerfile
GITHUB PR #7656
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 248035955b36 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision HADOOP-19343 / 87ec68a
Default Java Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/6/testReport/
Max. process+thread count 1049 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-gcp hadoop-tools U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/6/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@arunkumarchacko
Add tests
6901f5d 
Supress a style issue
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 8m 0s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ HADOOP-19343 Compile Tests _
+0 🆗 mvndep 7m 30s Maven dependency ordering for branch
+1 💚 mvninstall 18m 32s HADOOP-19343 passed
+1 💚 compile 8m 26s HADOOP-19343 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 compile 7m 32s HADOOP-19343 passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 checkstyle 1m 55s HADOOP-19343 passed
+1 💚 mvnsite 1m 25s HADOOP-19343 passed
+1 💚 javadoc 2m 4s HADOOP-19343 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javadoc 1m 49s HADOOP-19343 passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+0 🆗 spotbugs 0m 32s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 💚 shadedclient 22m 50s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 1m 15s Maven dependency ordering for patch
+1 💚 mvninstall 10m 22s the patch passed
+1 💚 compile 8m 4s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javac 8m 4s the patch passed
+1 💚 compile 7m 29s the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 javac 7m 29s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 2m 3s the patch passed
+1 💚 mvnsite 1m 51s the patch passed
+1 💚 javadoc 2m 36s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javadoc 2m 21s the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+0 🆗 spotbugs 0m 27s hadoop-project has no data from spotbugs
-1 ❌ spotbugs 3m 27s /new-spotbugs-hadoop-tools.html hadoop-tools generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚 shadedclient 23m 3s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 26s hadoop-project in the patch passed.
+1 💚 unit 0m 35s hadoop-gcp in the patch passed.
-1 ❌ unit 71m 20s /patch-unit-hadoop-tools.txt hadoop-tools in the patch passed.
+1 💚 asflicense 0m 43s The patch does not generate ASF License warnings.
218m 46s
Reason Tests
SpotBugs module:hadoop-tools
Possible null pointer dereference in org.apache.hadoop.fs.gs.GoogleCloudStorage.createItemInfoForBlob(StorageResourceId, Blob) due to return value of called method Method invoked at GoogleCloudStorage.java:org.apache.hadoop.fs.gs.GoogleCloudStorage.createItemInfoForBlob(StorageResourceId, Blob) due to return value of called method Method invoked at GoogleCloudStorage.java:[line 182]
Failed junit tests hadoop.yarn.sls.scheduler.TestTaskRunner
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/7/artifact/out/Dockerfile
GITHUB PR #7656
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux d3153ef3ea66 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision HADOOP-19343 / 6901f5d
Default Java Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/7/testReport/
Max. process+thread count 1013 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-gcp hadoop-tools U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/7/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 24s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ HADOOP-19343 Compile Tests _
+0 🆗 mvndep 7m 24s Maven dependency ordering for branch
+1 💚 mvninstall 19m 52s HADOOP-19343 passed
+1 💚 compile 8m 25s HADOOP-19343 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 compile 7m 22s HADOOP-19343 passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 checkstyle 2m 3s HADOOP-19343 passed
+1 💚 mvnsite 1m 22s HADOOP-19343 passed
+1 💚 javadoc 2m 5s HADOOP-19343 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javadoc 1m 49s HADOOP-19343 passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+0 🆗 spotbugs 0m 33s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 💚 shadedclient 22m 42s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 1m 28s Maven dependency ordering for patch
+1 💚 mvninstall 10m 28s the patch passed
+1 💚 compile 8m 8s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javac 8m 8s the patch passed
+1 💚 compile 7m 31s the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 javac 7m 31s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 58s the patch passed
+1 💚 mvnsite 1m 53s the patch passed
+1 💚 javadoc 2m 33s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javadoc 2m 19s the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+0 🆗 spotbugs 0m 27s hadoop-project has no data from spotbugs
+1 💚 shadedclient 22m 44s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 22s hadoop-project in the patch passed.
+1 💚 unit 0m 35s hadoop-gcp in the patch passed.
+1 💚 unit 71m 4s hadoop-tools in the patch passed.
+1 💚 asflicense 0m 46s The patch does not generate ASF License warnings.
211m 47s
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/8/artifact/out/Dockerfile
GITHUB PR #7656
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux c2ec07649de4 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision HADOOP-19343 / 58f1de4
Default Java Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/8/testReport/
Max. process+thread count 1073 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-gcp hadoop-tools U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7656/8/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@arunkumarchacko arunkumarchacko marked this pull request as ready for review May 27, 2025 02:54
cnauroth
cnauroth approved these changes May 27, 2025
View reviewed changes
Copy link
Contributor
@cnauroth cnauroth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1. I'll commit this to the feature branch shortly.

cnauroth pushed a commit that referenced this pull request May 27, 2025
@arunkumarchacko @cnauroth
HADOOP-19343: GCS / Add implementation for create() API
31e2480 
Closes #7656

Signed-off-by: Chris Nauroth <cnauroth@apache.org>
@cnauroth
Copy link
Contributor

I have committed this to the feature branch. @arunkumarchacko , thank you for this initial contribution!

@cnauroth cnauroth closed this May 27, 2025
cnauroth pushed a commit that referenced this pull request Jun 10, 2025
@arunkumarchacko @cnauroth
HADOOP-19343: GCS / Add implementation for create() API
579bd2b 
Closes #7656

Signed-off-by: Chris Nauroth <cnauroth@apache.org>
cnauroth pushed a commit that referenced this pull request Jun 18, 2025
@arunkumarchacko @cnauroth
HADOOP-19343: GCS / Add implementation for create() API
4935405 
Closes #7656

Signed-off-by: Chris Nauroth <cnauroth@apache.org>
cnauroth pushed a commit that referenced this pull request Jun 25, 2025
@arunkumarchacko @cnauroth
HADOOP-19343: GCS / Add implementation for create() API
61a12f7 
Closes #7656

Signed-off-by: Chris Nauroth <cnauroth@apache.org>
cnauroth pushed a commit that referenced this pull request Jul 2, 2025
@arunkumarchacko @cnauroth
HADOOP-19343: GCS / Add implementation for create() API
50ca43d 
Closes #7656

Signed-off-by: Chris Nauroth <cnauroth@apache.org>
cnauroth pushed a commit that referenced this pull request Jul 8, 2025
@arunkumarchacko @cnauroth
HADOOP-19343: GCS / Add implementation for create() API
b79cf93 
Closes #7656

Signed-off-by: Chris Nauroth <cnauroth@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cnauroth cnauroth cnauroth approved these changes

Assignees
No one assigned
Labels
build TOOLS trunk
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@arunkumarchacko @hadoop-yetus @cnauroth
0