Skip to content
TechIndexSubmit
Back to directory

RustingStrata

Dev Tools175New

A pure-Rust GGUF inference engine with CUDA and Vulkan backends, designed for efficient local execution of large AI models like DeepSeek-V4.1-Flash.

Similar tools

  • A high-performance inference engine built in Rust, supporting models like Qwen 3.8 27b and Flash next. It achieves high token per second rates for LLM serving.

    Dev Tools
  • 🦀 Decoder-only LLM built from scratch in pure Rust using Candle — no Python, no PyTorch. Gated DeltaNet + sparse attention, fine-grained MoE, native video/document understanding, long-horizon tool agents, quantization-aware training. Scales: Tiny (25M) to Large (1.3B).

    Models
  • Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

    AI Apps
  • JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

    Dev Tools
  • A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.

    Skills
  • Obscura is a headless browser engine written in Rust, built for web scraping and AI agent automation. It runs real JavaScript via V8, supports the Chrome DevTools Protocol, and acts as a drop-in replacement for headless Chrome with Puppeteer and Playwright.

    AI Apps