8000 Parquet: Update parquet-mimir with parquet converter by jesusvazquez · Pull Request #11239 · grafana/mimir · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Parquet: Update parquet-mimir with parquet converter #11239

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Apr 16, 2025
Merged

Parquet: Update parquet-mimir with parquet converter #11239

merged 3 commits into from
Apr 16, 2025

Conversation

jesusvazquez
Copy link
Contributor

This PR is simply updating our experimental branch parquet-mimir with the recent changes.

@jesusvazquez jesusvazquez force-pushed the jvp/parquet-compactor branch from 545923b to 40d62d5 Compare April 16, 2025 15:40
@github-actions GitHub Actions
Copy link
Contributor
github-actions bot commented Apr 16, 2025 •
edited
Loading

💻 Deploy preview deleted.

@jesusvazquez jesusvazquez force-pushed the jvp/parquet-compactor branch from 40d62d5 to cdcec28 Compare April 16, 2025 15:43
jesusvazquez and others added 3 commits April 16, 2025 17:44
@jesusvazquez @npazosmendez @francoposa
Parquet converter
474e5e4 
Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>
@francoposa @jesusvazquez
move readTsdb to parquet storage sub-package; rename method & vars fo…
0904b7c 
…r clarity & testability (#11222)

* move readTsdb to parquet storage sub-package; rename method & vars for clarity

* add license header
@jesusvazquez @npazosmendez
Parquet: Initialize parquet converter module (#11226)
1a692cd 
* Initialize parquet compactor module

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Rename to parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Implement allowlist

* fix reader tests

* Update docs

* also skip disallowed tenants when converting blocks

* fix initialization of allowedTenants

* various name changes

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>
@jesusvazquez jesusvazquez force-pushed the jvp/parquet-compactor branch from cdcec28 to 1a692cd Compare April 16, 2025 15:46
@jesusvazquez jesusvazquez marked this pull request as ready for review April 16, 2025 15:51
@jesusvazquez jesusvazquez requested review from stevesg, a team and tacole02 as code owners April 16, 2025 15:51
@jesusvazquez jesusvazquez merged commit a102a4a into parquet-mimir Apr 16, 2025
19 of 21 checks passed
@jesusvazquez jesusvazquez deleted the jvp/parquet-compactor branch April 16, 2025 15:51
jesusvazquez added a commit that referenced this pull request Apr 21, 2025
@jesusvazquez @npazosmendez @francoposa
Parquet: Update parquet-mimir with parquet converter (#11239)
9a6dcfb 
* Parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>

* move readTsdb to parquet storage sub-package; rename method & vars for clarity & testability (#11222)

* move readTsdb to parquet storage sub-package; rename method & vars for clarity

* add license header

* Parquet: Initialize parquet converter module (#11226)

* Initialize parquet compactor module

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Rename to parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Implement allowlist

* fix reader tests

* Update docs

* also skip disallowed tenants when converting blocks

* fix initialization of allowedTenants

* various name changes

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>
Co-authored-by: Franco Posa <franco@francoposa.io>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>
francoposa added a commit that referenced this pull request Apr 23, 2025
@jesusvazquez @npazosmendez @francoposa
Parquet: Update parquet-mimir with parquet converter (#11239)
6fe5b28 
* Parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>

* move readTsdb to parquet storage sub-package; rename method & vars for clarity & testability (#11222)

* move readTsdb to parquet storage sub-package; rename method & vars for clarity

* add license header

* Parquet: Initialize parquet converter module (#11226)

* Initialize parquet compactor module

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Rename to parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Implement allowlist

* fix reader tests

* Update docs

* also skip disallowed tenants when converting blocks

* fix initialization of allowedTenants

* various name changes

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>
Co-authored-by: Franco Posa <franco@francoposa.io>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>
jesusvazquez added a commit that referenced this pull request Apr 24, 2025
@jesusvazquez @npazosmendez @francoposa
Parquet: Update parquet-mimir with parquet converter (#11239)
cd8b60b 
* Parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>

* move readTsdb to parquet storage sub-package; rename method & vars for clarity & testability (#11222)

* move readTsdb to parquet storage sub-package; rename method & vars for clarity

* add license header

* Parquet: Initialize parquet converter module (#11226)

* Initialize parquet compactor module

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Rename to parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Implement allowlist

* fix reader tests

* Update docs

* also skip disallowed tenants when converting blocks

* fix initialization of allowedTenants

* various name changes

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>
Co-authored-by: Franco Posa <franco@francoposa.io>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>
jesusvazquez added a commit that referenced this pull request May 2, 2025
@jesusvazquez @npazosmendez @francoposa
Parquet: Update parquet-mimir with parquet converter (#11239)
922432c 
* Parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>

* move readTsdb to parquet storage sub-package; rename method & vars for clarity & testability (#11222)

* move readTsdb to parquet storage sub-package; rename method & vars for clarity

* add license header

* Parquet: Initialize parquet converter module (#11226)

* Initialize parquet compactor module

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Rename to parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Implement allowlist

* fix reader tests

* Update docs

* also skip disallowed tenants when converting blocks

* fix initialization of allowedTenants

* various name changes

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>
Co-authored-by: Franco Posa <franco@francoposa.io>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>
francoposa added a commit that referenced this pull request May 7, 2025
@jesusvazquez @npazosmendez @francoposa
Parquet: Update parquet-mimir with parquet converter (#11239)
f526051 
* Parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>

* move readTsdb to parquet storage sub-package; rename method & vars for clarity & testability (#11222)

* move readTsdb to parquet storage sub-package; rename method & vars for clarity

* add license header

* Parquet: Initialize parquet converter module (#11226)

* Initialize parquet compactor module

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Rename to parquet converter

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>

* Implement allowlist

* fix reader tests

* Update docs

* also skip disallowed tenants when converting blocks

* fix initialization of allowedTenants

* various name changes

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>

---------

Signed-off-by: Jesus Vazquez <jesus.vazquez@grafana.com>
Co-authored-by: Nico Pazos <nicolas.pazos-mendez@grafana.com>
Co-authored-by: Franco Posa <franco.posa@grafana.com>
Co-authored-by: Franco Posa <franco@francoposa.io>
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@francoposa francoposa Awaiting requested review from francoposa

@npazosmendez npazosmendez Awaiting requested review from npazosmendez

@stevesg stevesg Awaiting requested review from stevesg stevesg is a code owner

@tacole02 tacole02 Awaiting requested review from tacole02 tacole02 is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jesusvazquez @francoposa
0