Rendered at 16:20:01 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
rfw300 4 days ago [-]
I don't understand why their "Instant Grep + roundtrip to us-east-1" is so slow. First of all, the round-trip latency should not be nearly so bad to us-east-1. But second, and much more importantly, the LLM runs in the cloud. Shouldn't you just situate the LLM, agent runtime, and regex index in the same region? Wouldn't that be faster than round-tripping to the user's local machine?
HeyMeco 4 days ago [-]
Instant Grep 13ms vs 16.8s ripgrep seems very useful