An example of using Redis + RedisAI for a microservice that predicts consumer loan probabilities using Redis as a feature and model store and RedisAI as an inference server.
-
Updated
Jan 13, 2023 - Jupyter Notebook
#
inference-server
Here are 47 public repositories matching this topic...
-
Updated
Jul 15, 2019 - C++
Different ways of implementing an API to serve an image classification model
-
Updated
Oct 13, 2024
Run your own production inference code with Sagemaker
-
Updated
Jun 15, 2020 - Python
Basic MLPlatform includes Model Registry and Inference Server
python flask unit-testing machine-learning web-server grafana prometheus inference-server model-registry mlplatform
-
Updated
May 20, 2024 - Python
Serve pytorch inference requests using batching with redis for faster performance.
-
Updated
Apr 11, 2021 - Python
This repository contains a project for detecting flags in images using the YOLOv7 object detection model. Designed for applications in events, sports, and public gatherings, this project enables accurate flag localization through advanced deep learning.
python machine-learning ai computer-vision deep-learning image-annotation image-processing object-detection inference-server model-training custom-dataset real-time-detection yolov7 flag-detection inference-triton
-
Updated
Feb 19, 2024 - Jupyter Notebook
Bundle of Repositories that power up all the Crop Prediction Applications
-
Updated
Sep 11, 2021
An AI-powered mobile crop advisory app for farmers, gardeners that can provide information about crops using an image taken by the user. This supports 10 crops and 37 kinds of crop diseases. The AI model is a ResNet network that has been fine-tuned using crop images that were collected by web-scraping from Google Images and Plant-Village Dataset.
-
Updated
Aug 16, 2020 - Python
Effortlessly Deploy and Serve Large Language Models in the Cloud as an API Endpoint for Inference
-
Updated
Jun 30, 2024 - Python
This repository serves as a client to send sensor messages from ROS or other sources to the Inference server and processes the inference results.
grpc python3 ros object-detection client-server inference-server grpc-client lidar-point-cloud pointpillars 3d-detector triton-inference-server openpcdet
-
Updated
Feb 3, 2025 - Python
A networked inference server for Whisper speech recognition
-
Updated
Jun 9, 2025 - Python
create your own llm inference server from scratch
-
Updated
Nov 24, 2024 - Python
-
Updated
Mar 20, 2021 - Python
Inference Server Implementation from Scratch for Machine Learning Models
-
Updated
Dec 31, 2020 - Python
Serving distributed deep learning models with model parallel swapping.
-
Updated
Jun 19, 2023 - Jupyter Notebook
Audio components for geniusrise framework
-
Updated
May 15, 2024 - Python
The Universal LLM Gateway - Integrate ANY AI Model with One Consistent API
ai cross-platform cpp rest-api high-performance chatbot cuda api-client http-server api-wrapper language-model inference-server api-integration universal-api ai-tools llm gpu-accelerated llm-integration openai-compatible
-
Updated
May 12, 2025 - C++
Vision and vision-multi-modal components for geniusrise framework
-
Updated
Oct 10, 2024 - Python
Improve this page
Add a description, image, and links to the inference-server topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the inference-server topic, visit your repo's landing page and select "manage topics."