Ntropy

Ntropy is building domain-specific caching infrastructure for LLMs that makes it possible to reduce p99 latencies by 1000x and costs by 4-5 orders of magnitude for real-world, high-throughput tasks. Currently targeting the financial and banking domain and will expand over time. Well funded by top investors (QED & Lakestar).