8000 Update maven installer to not use `search.maven.org` by asnare · Pull Request #1611 · databrickslabs/lakebridge · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Update maven installer to not use search.maven.org #1611

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 29, 2025

Conversation

asnare
Copy link
Contributor
@asnare asnare commented May 28, 2025

Changes

What does this PR do?

This PR updates MavenInstaller so that it no longer uses search.maven.org to either:

  • Locate the current version of an artefact; or
  • Download the actual artefact.

Relevant implementation details

The installer now fetches the metadata needed for detecting the version, as well as the artefact itself, from the maven central repository directly. This is the CDN-backed service where artefacts are supposed to be fetched from, and it is much more reliable than the search service.

In addition to this, the installer had some logic that could abort the installation if a file already exists at the target location on the local filesystem. This check now happens before the download so that it aborts immediately rather than first performing the (ultimately futile) download.

Caveats/things to watch out for when reviewing:

In addition to using the repository directly, this PR starts plumbing through support for providing the artefact classifier. Another PR will be needed to:

1. Expose the classifier as a parameter.
2. Update install_morpheus() to provide the classifier.

(Without these the normal installer will fail even after we publish morpheus because we're not currently specifying the classifier.)

[It looks like we're not publishing with a classifier, so this isn't needed.]

Linked issues

Resolves #1602

Functionality

  • modified existing command: databricks labs remorph install-transpile

Tests

  • updated integration tests

… the search service.

This covers both determining the latest version and downloading the actual artifact.
@asnare asnare self-assigned this May 28, 2025
@asnare asnare added the bug Something isn't working label May 28, 2025
@asnare asnare marked this pull request as ready for review May 28, 2025 16:07
@asnare asnare requested a review from a team as a code owner May 28, 2025 16:07
Copy link
github-actions bot commented May 28, 2025

✅ 22/22 passed, 1 skipped, 32s total

Running from acceptance #863

@asnare asnare marked this pull request as draft May 28, 2025 16:42
@asnare asnare marked this pull request as ready for review May 28, 2025 16:55
Copy link
Collaborator
@sundarshankar89 sundarshankar89 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Collaborator
@sundarshankar89 sundarshankar89 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@asnare while testing this manually this worked correctly by identifying the new release as 0.3.0 unlike the old search but
os.rename(self._product_path, backup_path) failed with a non empty directory error.

@asnare
Copy link
Contributor Author
asnare commented May 29, 2025

@asnare while testing this manually this worked correctly by identifying the new release as 0.3.0 unlike the old search but os.rename(self._product_path, backup_path) failed with a non empty directory error.

I noticed the same. Examining the published JAR, it looks like it contains lsp-config.yml instead of lsp/config.yml and is the same error I encountered when testing #1581. This should have been fixed by databrickslabs/morpheus#359, but that doesn't seem to have been included in the 0.3.0 release.

@asnare asnare requested review from a team and sundarshankar89 May 29, 2025 09:23
Copy link
Collaborator
@gueniai gueniai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@gueniai gueniai merged commit 50a1119 into main May 29, 2025
10 checks passed
@gueniai gueniai deleted the remove-search-maven-dependency branch May 29, 2025 15:20
ericvergnaud added a commit that referenced this pull request Jun 3, 2025
* main:
  Drop post-install support for Java-based transpilers (#1616)
  Distinguish errors from warnings in the output query header (#1620)
  configure synapse credentials (#1535)
  Fix timestamp in morpheus transpiler state file (#1615)
  Telemetry  (#1618)
  Patch Prompt Question with Default (#1617)
  Modify Analyzer CLI (#1609)
  Update maven installer to not use `search.maven.org` (#1611)

# Conflicts:
#	src/databricks/labs/remorph/cli.py
#	src/databricks/labs/remorph/install.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG]: Don't use search.maven.org when installing morpheus
3 participants
0