8000 TensorFlow serving on RTX 5090D · Issue #4112 · tensorflow/serving · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
TensorFlow serving on RTX 5090D #4112
Open
@reindeergao

Description

@reindeergao

I use latest docker mirror tensorflow/serving:2.19.0-gpu on the Nvidia RTX 5090D
The following error was reported:

W external/org_tensorflow/tensorflow/core/framework/op_kernel.cc:1829] INTERNAL: 'cuLaunchKernel(function, gridX, gridY, gridZ, blockX, blockY, blockZ, 0, reinterpret_cast(stream), params, nullptr)' failed with 'CUDA_ERROR_INVALID_HANDLE'
W external/org_tensorflow/tensorflow/compiler/mlir/tools/kernel_gen/tf_gpu_runtime_wrappers.cc:40] 'cuModuleLoadData(&module, data)' failed with 'CUDA_ERROR_INVALID_PTX'
W external/org_tensorflow/tensorflow/compiler/mlir/tools/kernel_gen/tf_gpu_runtime_wrappers.cc:40] 'cuModuleGetFunction(&function, module, kernel_name)' failed with 'CUDA_ERROR_INVALID_HANDLE'

Could a tensorflow_model_server or docker image that supports Nvidia RTX 5090D be provided?

Thanks!!!

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

    0