Serve, optimize and scale PyTorch models in production
-
Updated
Aug 6, 2025 - Java
#
serving
Here are 10 public repositories matching this topic...
A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and ultra-low latency.
structured-data serving unstructured-data unified-sql vector-database mysql-compatibility hybrid-search embedding-search embedding-store key-value-distributed-store vector-ocean real-time-semantic-search
-
Updated
Sep 23, 2026 - Java
A universal scalable machine learning model deployment solution
-
Updated
Sep 22, 2026 - Java
A stand alone industrial serving system for angel.
-
Updated
Apr 12, 2022 - Java
This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.
machine-learning spark pipeline sparkml inference serving sagemaker mleap inference-pipeline mleap-serialized-spark
-
Updated
Sep 14, 2023 - Java
Enterprise-grade LLMOps platform to accelerate the development and deployment of generative AI applications.
-
Updated
Feb 25, 2026 - Java
Exposes a serialized machine learning model through a HTTP API.
-
Updated
Jun 11, 2023 - Java
A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and ultra-low latency.
structured-data serving unstructured-data unified-sql vector-database mysql-compatibility embedding-search embedding-store key-value-distributed-store vector-ocean
-
Updated
Apr 25, 2024 - Java
Fork of pytorch/serve. Serve, optimize and scale PyTorch models in production
docker kubernetes machine-learning cpu deep-learning metrics gpu optimization pytorch serving mlops upstream-fork
-
Updated
Jul 30, 2026 - Java
Add this topic to your repo
To associate your repository with the serving topic, visit your repo's landing page and select "manage topics."