Eventual-Inc/Daft
High-performance Rust-powered data engine for processing multimodal AI workloads including images, audio, video, and embeddings.

Daft is a distributed data engine built for AI pipelines that processes images, audio, video, and structured data at scale. It provides built-in AI operations including LLM prompting via OpenAI, embedding generation, and model-based classification using Transformers or custom models. The engine scales from local processing to distributed Ray or Kubernetes clusters and supports connectors to Hugging Face, Iceberg, Delta Lake, and major cloud storage platforms.