Tags: haijohn/kfserving
Tags
Parallel inference support (kserve#1637) * Decouple http handler with KFModel * Add model type enum * Throw exception for unknown type * Implement model worker with RayServe deployment API * Add ray remote custom example * Update custom model server doc * Update custom model inference yaml * Check the model deployment type * Fix linting * Add local testing instruction * Fix image name * Reduce cpu resource
Generate 0.6.0 RC release manifests (kserve#1556) * Generate 0.6 release manifests * Update to 0.6.0-rc0 * Update version instruction for local gateway * Update kfserving to 0.6.0rc0
Publish final 0.5 RC release candidate 0.5.0-rc2 (kserve#1289)
Cherry-pick of OpenShift fixes (kserve#1122 and kserve#1134) to relea… …se-0.4 (kserve#1136) * Fixed issues on openshift (kserve#1122) - change to use port 9443 - add rbac for finalizer * Add inferenceservice finalizer rbac rules (kserve#1134) This is an additional change needed for Openshift clusters. Co-authored-by: Gang Pu <pugangxa@cn.ibm.com>
Publish KFServing 0.4 release (kserve#933) * Publish v0.4.0 release * add license
PreviousNext