Senior Backend Engineer position in San Francisco, CA. Involved in building domain-specific caching infrastructure for LLMs targeting the financial and banking domain.
Location
San Francisco, CA
Salary
130K
to
200K
Benefits
Not Specified
Tech Tags
Backend
Senior Role
Date Listed
02 April, 2024 (over 1 year ago)
Ntropy
Ntropy is building domain-specific caching infrastructure for LLMs that makes it possible to reduce p99 latencies by 1000x and costs by 4-5 orders of magnitude for real-world, high-throughput tasks. Currently targeting the financial and banking domain and will expand over time. Well funded by top investors (QED & Lakestar).