Machine Learning Engineer position in San Francisco, CA. Involved in building domain-specific caching infrastructure for LLMs targeting the financial and banking domain.
Ntropy is building domain-specific caching infrastructure for LLMs that makes it possible to reduce p99 latencies by 1000x and costs by 4-5 orders of magnitude for real-world, high-throughput tasks. Currently targeting the financial and banking domain and will expand over time. Well funded by top investors (QED & Lakestar).
