11. good framing from @ch3nweiii - a lot of agent steps are yes/no calls, not generation Jev answers th... good framing from @ch3nweiii - a lot of agent steps are yes/no calls, not generation Jev answers those as typed questions with calibrated probabilities, so the frontier model stick 10/10 12:31 ♡
12. This is great point Goodharts law: when a measure becomes a target, it ceases to be a good measure ... This is great point Goodharts law: when a measure becomes a target, it ceases to be a good measure Initial take: eval driven development works for narrowly scoped things, but for m 10/09 16:28 ♡
13. eval driven development eval driven development Jerry Liu @jerryjliu0 These days, you can pretty much solve any task by defining an eval and hillclimbing over it, instead of directly defining the determin 10/09 15:50 ♡
14. trajectory labeling is really several questions, not one pass/fail - nice framing here that's how J... trajectory labeling is really several questions, not one pass/fail - nice framing here that's how Jev as a judge works in LangSmith evals: difficulty and correctness each get t 10/09 15:06 ♡
15. Sam on where decision models fit in a harness and how to use Jev with LangChain https://t.co/TgYoOi... Sam on where decision models fit in a harness and how to use Jev with LangChain langchain.com/blog/building-… x.com/jaminball/stat… Jamin Ball @jaminball Next up on First Pass: a c 10/09 03:03 ♡
16. interrupt london is next tuesday really looking forward to hearing from Orange and OVO on what's ac... interrupt london is next tuesday really looking forward to hearing from Orange and OVO on what's actually working with agents in production. we're also running hands-on wor 10/08 03:51 ♡
17. One cool thing deepagents now supports: dynamically loading tools when is a skill is loaded Some sk... One cool thing deepagents now supports: dynamically loading tools when is a skill is loaded Some skills require specific tools that you may not always want to have available. This 10/08 02:58 ♡
18. W We have a really strong team :) Come join us! We have a really strong team :) Come join us! 💬 7 🔄 6 ❤️ 91 👀 17721 📊 20 ⚡ Powered by xgo.ing 10/07 17:34 ♡
19. Good take on harnesses Good take on harnesses David Cramer @zeeg You’re living in a bubble. You need to understand that a whole world lives beyond the constraints you have manufactured or imagined. For e 10/06 12:26 ♡
20. cool to see cognition doing "dreaming" - memory needs an offline cleanup loop, not just better retri... cool to see cognition doing "dreaming" - memory needs an offline cleanup loop, not just better retrieval, otherwise stale records pile up open q is how inferred memories get valida 10/06 04:28 ♡
