8000 Add dataset update feature · Issue #13 · LLNL/dapper · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

8000 Add dataset update feature #13

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
nightlark opened this issue Dec 6, 2024 · 2 comments
Open

Add dataset update feature #13

nightlark opened this issue Dec 6, 2024 · 2 comments
Assignees
@monwen
Labels
enhancement New feature or request

Comments

@nightlark
Copy link
Collaborator

For the dapper tools, add a way to check for and download updated datasets. This will involve keeping track of which datasets are currently downloaded and their versions.

Relates to #6, in that we will need some way to know what the latest version available is with an identifier for recognizing when the available version is newer than the dataset we currently have.
@nightlark nightlark added the enhancement New feature or request label Dec 6, 2024
@monwen
Copy link
Collaborator
monwen commented May 15, 2025

Getting error when attempting to build Dapper project. Steps:

  • Cargo build
  • cargo run .
    Errors:
    (dapper_env) shen14@wl-5597473:~/dapper$ cargo run .
    Finished dev profile [unoptimized + debuginfo] target(s) in 0.03s
    Running target/debug/dapper .

thread 'main' panicked at src/walker.rs:32:6:
Failed to prepare statement: SqliteFailure(Error { code: Unknown, extended_code: 1 }, Some("no such table: package_files"))
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace

@nightlark
Copy link
Collaborator Author
  • Hosted dataset_list.toml file listing URLs for all available datasets that can be download, and info on versions/category for each
  • Local dataset_info.toml stored in XDG/standard directory on user's system that tracks datasets user has already downloaded (version info, category, filepath to db) -- when downloading new/updating a db, this file needs updating

Trigger download of a dataset with command line argument: --download-dataset <category/name>

@nightlark nightlark mentioned this issue May 17, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@monwen monwen

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@nightlark @monwen
0