rillr
About Guidelines Privacy Terms Log in Join Rillr
← Programming
www.infoq.com · Nov 11

JioHotstar Benchmarks Knowledge Bases for AI Coding Agents

JioHotstar evaluated 6 approaches to code retrieval for AI coding agents using SWE, CodeScale Bench, and an internal question-answering harness. Structural search performed well on concrete tasks, while semantic retrieval helped with ambiguous requirements. The findings highlight trade-offs in accuracy, token use, and tool design, underscoring the need to match retrieval tools to task types. By Leela Kumili

Visit article ↗ ▲ 0 💬 0
Discussion

0 comments

No comments yet. Start the discussion.