Releases: rucio/rucio
Releases · rucio/rucio
Rucio 37.4.0 minor release
General
Enhancements
- Docker & Kubernetes: Improve
docker-compose.yml
anddocker-compose.ports.yml
volume/ports mapping #7728 - Rules: Judge Evaluator log entries do not contain thread information #6471
- Testing: Update activemq image used in testing #7212
- Testing: Ruff: UP027 has been removed but is still mentioned, PLR and PLW selections are not enabled because preview is not enabled #7655
- Transfers: Configure transfer limits via the client #7661
Bugs
- Docker & Kubernetes: Make
docker-compose.yml
compatible with Podman #7715 - Transfers: Is
ftshosts
configuration removed from conveyors? #7696
Clients
Bugs
Rucio 32.8.6 LTS patch release
Rucio 37.3.0 minor release
Rucio 37.2.0 minor release
General
Enhancements
- Core & Internals: Add option to ignore duplicate content in did to did attachment #7585
- REST & API: Support for encoded slashes in URL #7551
- REST & API: Credentials API: deprecated
appid
andip
parameters #7612 - Release management: Dependencies: Remove
dataclasses
dependency from client requires #7266
Bugs
- Database: Query instability of list_dids wildcard queries #7682
- REST & API: Gateway:
issuer
is markedOptional
and defaults toNone
, but it is required for permission checking (like other authenticated BPs) #7609
Clients
Enhancements
Rucio 37.1.0.post1 hotfix release
10000
Rucio 37.1.0 minor release
General
Enhancements
- Core & Internals: Legacy config support #7376
- Core & Internals: Standardize account limits methods for clarity #7483
- Documentation: Rucio Python Client docstrings enhancement (
Lifetimeclient
) #7633 - Policies: Add better error message for scope name splitting #7486
- REST & API: Standardize usage of
generate_http_error_flask
in API to return errors #7509 - Testing: Extend Pylint Rules in Ruff #7499
- Testing: Skip
test_x509
intests/test_clients.py
#7541
Bugs
- Database: Fix psycopg dependency install in server and dev installs #7462
- Transfers: Destination RSE type is wrongly reported in the events #7557
Clients
Bugs
Rucio 37.0.0 "Dungeons & Donkeys" major release
Important changes
- PostgreSQL deployments: Rucio has upgraded from
psycopg2
to the newPsycopg 3
library. Psycopg 3 uses a different driver name (psycopg
instead ofpsycopg2
), so any SQLAlchemy connection URLs that previously usedpostgresql://
must now explicitly include +psycopg (i.e.,postgresql+psycopg://
) to ensure the correct driver is loaded. Concerned files:rucio.cfg
andalembic.ini
- This release includes
staging_metadata
(#7451) in all tape transfers to FTS. It needs to be insured that theStagingMetadataSizeLimit
(StagingMetadataSizeLimit = <size_in_bytes> (default 1024)
) configuration in FTS is set to a reasonable limit to be able to intake the sent staging_metadata.
Upgrade Instructions
This major release requires a database schema upgrade. Please consult the documentation about upgrading your database schema.
The following changes are necessary and are covered by the alembic upgrade head
command:
- Extending the
redirect_msg
column inoauth_requests table (Alembic revision
30d5206e9cad`)
General
Features
- Monitoring & Traces: Ability to submit traces in bulk #7368
Enhancements
- Core & Internals: Remove C3PO daemon #6872
- Core & Internals: Minor checksum improvements #7488
- Database: Create context managers for database session handling to replace current
*_session
decorators #7407 - Database: SQLA 2.0: remove deprecated
future=True
flags that were used during migration #7433 - Deletion: Reaper - Do not exit when no RSE are found #7471
- Deletion: Reaper - Remove deprecated aternative spelling for options #7474
- Life time model:
add_lifetime_exception
summary: refactor dict keys into proper names #7443 - Messaging: Add services into messages_history table #7181
- Metadata: Elasticsearch metadata plugin #6059
- Metadata: Improve MongoDB connection parameter handling and validation #7217
- Policies: Remove LIGO and Xenon lfn2pfn algorithms from main code #7187
- Policies: Standardize permission policy check logic #7206
- Protocols: Remove
gsiftp.py
#7347 - Release management: Release 37 dependency upgrade #7455
- Release management: Remove
match_define_requirements
#7463 - Release management: Publish wheels #7546
- Testing: Allow only one concurrent GitHub Action per PR #7401
- Testing: Replace
flake8
andpylint
inrun_tests.sh
withruff
#7467 - Transfers: Activity passing in Tape REST API during tape staging missing for davs/https protocol missing #7451
Bugs
- Authentication & Authorisation: Restricted (oidc) token size limiting group membership #7136
- Database:
psycopg2-binary
should not be used in production -psycopg2
should be used instead #6669 - Database: Database migration scripts do not pass the Ruff check #7295
- Messaging: Unused older rows in the messages table prevents newer messages for other functional services from being delivered #6684
- Metadata: get_metadata_bulk does only look at JSON metadata #6455
- Multi VO: Script to convert a single-VO to multi-VO instance fails #7390
- Policies: ATLAS policy is set when no permission option is defined in cfg under policy #7332
- Protocols: Avoid GFAL error when
exists(None)
is called. #7398 - REST & API: API identity put calls don't fail if email or identity key name are not passed, despite them being required by the SQLA model #7448
- Release management: Docker build failures due to missing
setuptools
#7524 - Testing: TC006 Ruff errors in CI #7491
- Testing:
test-curl
tests fails in dev envoriments #7507
Clients
Enhancements
- Clients: New CLI: retrieving the list of parent DIDs should be under the ‘list’ command #7233
- Clients: New CLI: Replace argparse with Click #7253
Bugs
- Clients: Client must specify the account when uploading data #7349
Rucio 37.0.0rc4 major release candidate
Release Candidate
This is a release candidate! Only to be used in testing environments!
General
Features
- Monitoring & Traces: Ability to submit traces in bulk #7368
Enhancements
- Core & Internals: Remove C3PO daemon #6872
- Core & Internals: Minor checksum improvements #7488
- Database: Create context managers for database session handling to replace current
*_session
decorators #7407 - Database: SQLA 2.0: remove deprecated
future=True
flags that were used during migration #7433 - Deletion: Reaper - Do not exit when no RSE are found #7471
- Deletion: Reaper - Remove deprecated aternative spelling for options #7474
- Life time model:
add_lifetime_exception
summary: refactor dict keys into proper names #7443 - Messaging: Add services into messages_history table #7181
- Metadata: Elasticsearch metadata plugin #6059
- Metadata: Improve MongoDB connection parameter handling and validation #7217
- Policies: Remove LIGO and Xenon lfn2pfn algorithms from main code #7187
- Policies: Standardize permission policy check logic #7206
- Protocols: Remove
gsiftp.py
#7347 - Release management: Release 37 dependency upgrade #7455
- Release management: Remove
match_define_requirements
#7463 - Release management: Publish wheels #7546
- Testing: Allow only one concurrent GitHub Action per PR #7401
- Testing: Replace
flake8
andpylint
inrun_tests.sh
withruff
#7467 - Transfers: Activity passing in Tape REST API during tape staging missing for davs/https protocol missing #7451
Bugs
- Authentication & Authorisation: Restricted (oidc) token size limiting group membership #7136
- Database:
psycopg2-binary
should not be used in production -psycopg2
should be used instead #6669 - Database: Database migration scripts do not pass the Ruff check #7295
- Messaging: Unused older rows in the messages table prevents newer messages for other functional services from being delivered #6684
- Metadata: get_metadata_bulk does only look at JSON metadata #6455
- Multi VO: Script to convert a single-VO to multi-VO instance fails #7390
- Policies: ATLAS policy is set when no permission option is defined in cfg under policy #7332
- Protocols: Avoid GFAL error when
exists(None)
is called. #7398 - REST & API: API identity put calls don't fail if email or identity key name are not passed, despite them being required by the SQLA model #7448
- Release management: Docker build failures due to missing
setuptools
#7524 - Testing: TC006 Ruff errors in CI #7491
- Testing:
test-curl
tests fails in dev envoriments #7507
Clients
Enhancements
- Clients: New CLI: retrieving the list of parent DIDs should be under the ‘list’ command #7233
- Clients: New CLI: Replace argparse with Click #7253
Bugs
- Clients: Client must specify the account when uploading data #7349
Rucio 37.0.0rc3 major release candidate
Release Candidate
This is a release candidate! Only to be used in testing environments!
General
Features
- Messaging: factorize duplicate messaging code into a common module or class #6423
- Monitoring & Traces: Ability to submit traces in bulk #7368
Enhancements
- Core & Internals: Remove C3PO daemon #6872
- Core & Internals: Minor checksum improvements #7488
- Database: Create context managers for database session handling to replace current
*_session
decorators #7407 - Database: SQLA 2.0: remove deprecated
future=True
flags that were used during migration #7433 - Deletion: Reaper - Do not exit when no RSE are found #7471
- Deletion: Reaper - Remove deprecated aternative spelling for options #7474
- Life time model:
add_lifetime_exception
summary: refactor dict keys into proper names #7443 - Messaging: Add services into messages_history table #7181
- Metadata: Elasticsearch metadata plugin #6059
- Metadata: Improve MongoDB connection parameter handling and validation #7217
- Policies: Remove LIGO and Xenon lfn2pfn algorithms from main code #7187
- Policies: Standardize permission policy check logic #7206
- Protocols: Remove
gsiftp.py
#7347 - Release management: Release 37 dependency upgrade #7455
- Release management: Remove
match_define_requirements
#7463 - Release management: Publish wheels #7546
- Testing: Allow only one concurrent GitHub Action per PR #7401
- Testing: Replace
flake8
andpylint
inrun_tests.sh
withruff
#7467 - Transfers: Activity passing in Tape REST API during tape staging missing for davs/https protocol missing #7451
Bugs
- Authentication & Authorisation: Restricted (oidc) token size limiting group membership #7136
- Database:
psycopg2-binary
should not be used in production -psycopg2
should be used instead #6669 - Database: Database migration scripts do not pass the Ruff check #7295
- Messaging: Unused older rows in the messages table prevents newer messages for other functional services from being delivered #6684
- Messaging: Receiver can’t connect to message broker #7583
- Messaging: Hermes doesn’t deliver messages to ActiveMQ #7584
- Metadata: get_metadata_bulk does only look at JSON metadata #6455
- Multi VO: Script to convert a single-VO to multi-VO instance fails #7390
- Policies: ATLAS policy is set when no permission option is defined in cfg under policy #7332
- Protocols: Avoid GFAL error when
exists(None)
is called. #7398 - REST & API: API identity put calls don't fail if email or identity key name are not passed, despite them being required by the SQLA model #7448
- Release management: Docker build failures due to missing
setuptools
#7524 - Testing: TC006 Ruff errors in CI #7491
- Testing:
test-curl
tests fails in dev envoriments #7507
Clients
Enhancements
- Clients: New CLI: retrieving the list of parent DIDs should be under the ‘list’ command #7233
- Clients: New CLI: Replace argparse with Click #7253
Bugs
- Clients: Client must specify the account when uploading data #7349
Rucio 37.0.0rc2 major release candidate
Release Candidate
This is a release candidate! Only to be used in testing environments!
General
Features
- Messaging: factorize duplicate messaging code into a common module or class #6423
- Monitoring & Traces: Ability to submit traces in bulk #7368
Enhancements
- Core & Internals: Remove C3PO daemon #6872
- Core & Internals: Minor checksum improvements #7488
- Database: Create context managers for database session handling to replace current
*_session
decorators #7407 - Database: SQLA 2.0: remove deprecated
future=True
flags that were used during migration #7433 - Deletion: Reaper - Do not exit when no RSE are found #7471
- Deletion: Reaper - Remove deprecated aternative spelling for options #7474
- Life time model:
add_lifetime_exception
summary: refactor dict keys into proper names #7443 - Messaging: Add services into messages_history table #7181
- Metadata: Elasticsearch metadata plugin #6059
- Metadata: Improve MongoDB connection parameter handling and validation #7217
- Policies: Remove LIGO and Xenon lfn2pfn algorithms from main code #7187
- Policies: Standardize permission policy check logic #7206
- Protocols: Remove
gsiftp.py
#7347 - Release management: Release 37 dependency upgrade #7455
- Release management: Remove
match_define_requirements
#7463 - Release management: Publish wheels #7546
- Testing: Allow only one concurrent GitHub Action per PR #7401
- Testing: Replace
flake8
andpylint
inrun_tests.sh
withruff
#7467 - Transfers: Activity passing in Tape REST API during tape staging missing for davs/https protocol missing #7451
Bugs
- Authentication & Authorisation: Restricted (oidc) token size limiting group membership #7136
- Database:
psycopg2-binary
should not be used in production -psycopg2
should be used instead #6669 - Database: Database migration scripts do not pass the Ruff check #7295
- Messaging: Unused older rows in the messages table prevents newer messages for other functional services from being delivered #6684
- Metadata: get_metadata_bulk does only look at JSON metadata #6455
- Multi VO: Script to convert a single-VO to multi-VO instance fails #7390
- Policies: ATLAS policy is set when no permission option is defined in cfg under policy #7332
- Protocols: Avoid GFAL error when
exists(None)
is called. #7398 - REST & API: API identity put calls don't fail if email or identity key name are not passed, despite them being required by the SQLA model #7448
- Release management: Docker build failures due to missing
setuptools
#7524 - Testing: TC006 Ruff errors in CI #7491
- Testing:
test-curl
tests fails in dev envoriments #7507
Clients
Enhancements
- Clients: New CLI: retrieving the list of parent DIDs should be under the ‘list’ command #7233
- Clients: New CLI: Replace argparse with Click #7253
Bugs
- Clients: Client must specify the account when uploading data #7349