batching

Here are 5 public repositories matching this topic...

🦀 Rust server plugin for deploying deep learning models with batched prediction

rust deep-learning batching

🛒 I got 99 problems, but a batch ain't one

concurrency batching batch

A high-performance, lock-free batched queue implementation for Rust.

rust queue batching concurrent

image editor optimized for batch editing, with ❤️ in Rust

rust rust-language batching imageeditor

A tiny Rust proxy that batches high-QPS embedding requests before forwarding them to Hugging Face Text Embeddings Inference (TEI).

proxy batching batch tei vector-database

Add a description, image, and links to the batching topic page so that developers can more easily learn about it.

To associate your repository with the batching topic, visit your repo's landing page and select "manage topics."