Hot backup for S3:errmsg:EntityTooLarge : Unable to parse ExceptionName: EntityTooLarge Message #2
+11,019,550
−2,461,116
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ch mongodb-master (#22658) GitOrigin-RevId: a491356
…s (#22649) GitOrigin-RevId: c979d9b
… $search document source planning metadata (#22488)" (#22666) GitOrigin-RevId: 4989ee7
… in $group (#22609)" (#22668) GitOrigin-RevId: e27f90a
…eldNonCaching (#22647) GitOrigin-RevId: a23bb1c
GitOrigin-RevId: ce4ccad
…t (#22427) GitOrigin-RevId: f0a4bf8
…ckets collection during interrupt (#21980) GitOrigin-RevId: 396d9b9
GitOrigin-RevId: 788ee85
10000
…fig transition check (#22685) GitOrigin-RevId: 97bba95
GitOrigin-RevId: 96cf3d3
…uring query analysis (#22652) GitOrigin-RevId: 1413cac
… by default (#22566) GitOrigin-RevId: c67ff08
GitOrigin-RevId: 218d7df
…ants (#22682) GitOrigin-RevId: dac8a7f
…ove shard (#22325) GitOrigin-RevId: 598a3b6
…22641) GitOrigin-RevId: d800865
…lMonitor staleConfig errors (#22676) GitOrigin-RevId: fd90232
… ns when issuing awaitdata getMore on oplog (#21558) GitOrigin-RevId: 8944d7b
…639) GitOrigin-RevId: 91eac92
…595) GitOrigin-RevId: 710402b
GitOrigin-RevId: 6308d83
…ing capped resharding oplog application. (#22681) GitOrigin-RevId: b6f4547
…hen the ReshardingImprovemnts flag is not enabled. (#22451) GitOrigin-RevId: c0abe3a
Fix creating audit log file if provided as a relative path when forking.
Eliminate unneccessary copying of the string from the buffer when flushing the audit log file. This is possible due to std::ostringstream having a str() overload which is rvalue-ref qualified. Added in C++20 p0408r7.
Check is basic_stringbuf::str()&& overload exists in order to determine if an explicit call to clear the buffer is required after attempting to move-construct the string out of the buffer.
Adding tests for psmdb-1227 to check that authenticatedUserRoles in the connectionStatus: 1 command is still viewable if the dn attribute is added to the queryTemplate string in mongod.conf.
Accept the 'security.kmip.useLegacyProtocol' option and print warning message is used, because the KMIP protocol version 1.0 is always used.
* PSMDB-1617 KMIP client: improve error messages In the `Asio` (and `Boost.Asio`) library, most of the throwing functions provide very littly context in their exception messages. For certain functions, the patch uses the overloads accepting an error code and constructs more specific error messages manually.
Improve audit options validation by ensuring the audit log file can be created when a default path is used. This ensures consistent behavior and avoids exceptions in the Audit class constructor if the default path is invalid or inaccessible.
Do not create an audit log file during audit options validations in if the destination is not to a file. This avoids creating an empty file.
Make the port configurable and not hardcoded
PSMDB-1614 Update percona-server-mongodb-enable-auth.sh
The 'failed' flag was created to delay freeing connection resources to the moment when connection is no longer borrowed. But since we implemented a call to ldap_unbind_ext() in the return_ldap_connection() we can remove failed connections info from the connection pool even if connection is borrowed - it will be correctly disposed when borrower calls to return_ldap_connection().
Conflicts: README.md buildscripts/resmokeconfig/suites/audit.yml buildscripts/resmokeconfig/suites/external_auth.yml buildscripts/resmokeconfig/suites/ssl.yml src/mongo/base/error_codes.yml src/mongo/db/auth/builtin_roles.yml
Conflicts: src/mongo/db/audit.cpp src/mongo/db/storage/storage_engine_impl.cpp
Fix creating audit log file if destination is not set. In such case audit is disabled and thus the default file path shall not be validated for permissions.
Conflicts: src/mongo/db/auth/authz_manager_external_state_local.cpp
Conflicts: src/mongo/base/error_codes.yml
Conflicts: jstests/auth/lib/commands_lib.js src/mongo/config.h.in src/mongo/db/SConscript src/mongo/db/curop.cpp src/mongo/db/curop.h
Cherry-picking this commit to allow building on Ubuntu24 before actual merge of commit 3cba432
Conflicts: src/mongo/embedded/SConscript src/mongo/embedded/mongo_embedded/SConscript src/mongo/embedded/mongo_embedded/mongo_embedded_test.cpp
Conflicts: SConstruct buildscripts/setup_multiversion_mongodb.py src/mongo/SConscript src/mongo/db/SConscript src/mongo/db/auth/SConscript src/mongo/db/commands/SConscript src/mongo/db/fts/SConscript src/mongo/db/storage/SConscript src/mongo/db/storage/wiredtiger/SConscript src/mongo/dbtests/SConscript src/mongo/s/SConscript src/mongo/transport/SConscript src/mongo/util/SConscript
Conflicts: src/mongo/SConscript src/mongo/config.h.in src/mongo/db/SConscript src/mongo/db/curop.cpp src/mongo/db/mongod_main.cpp
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Use version:4.0.12-6
Use S3 equipment for hot backup
command:
db.runCommand({createBackup: 1, s3: {bucket: "mongobackup",
path: "wjs/mongodb_backup",
scheme: "HTTP",
endpoint: "**********",
useVirtualAddressing: false,
profile: "localminio"}})
error:
{
"ok" : 0,
"errmsg" : "Cannot backup '/-29-7545783987985807831.wt' : EntityTooLarge : Unable to parse ExceptionName: EntityTooLarge Message: ",
"operationTime" : Timestamp(1576636321, 24),
"$clusterTime" : {
"clusterTime" : Timestamp(1576636321, 24),
"signature" : {
"hash" : BinData(0,"bON+Efo7mgez50xriHl5Yo/ZKHw="),
"keyId" : NumberLong("6737552503321133058")
}
}
}
I looked at some documentation:
aws/aws-sdk-cpp#386
I think it's probably an SDK usage issue
so !
Can you help locate the problem