Discover · softwareengineeringdaily.com

Chroma and Agentic Retrieval

Software Engineering Daily softwareengineeringdaily.com

Data retrieval is a fundamental challenge in AI systems, and the approaches for solving it are still evolving. Vector search was an early answer to the retrieval problem, but the rise of agentic systems has raised the stakes considerably. Agents issue queries at machine speed, decompose complex questions into parallel searches, and require retrieval infrastructure that can keep pace without becoming prohibitively expensive.

Chroma is a company building open source infrastructure for AI applications, best known for its widely used database of the same name.  The company also published the influential Context Rot paper, which documented how model performance degrades as context window utilization increases, and recently released Context One, a 20 billion parameter retrieval sub-agent trained to do agentic search at frontier model quality but at an order of magnitude lower cost and higher speed.

Length
52:20
More ways to use this
Open on another device
Scan this QR code to open the same public page

Scan to open this page. Your saved notes and account access are not included.

Download QR code

Open the page link

Keep going

Each of these is read from what this estate already kept: the feed a piece came through, the publisher behind it, the credits and topics the publisher printed. None of it is a recommendation, an identity or a record kept anywhere else.

Also from Software Engineering Daily

  1. The Technical Interview Is BrokenSED Production softwareengineeringdaily.com
  2. Fraud Prevention in the Age of AI AgentsSED Production softwareengineeringdaily.com
  3. GitLab and the Evolution of DevSecOpsSED Production softwareengineeringdaily.com
  4. SED News: PHP’s Megabug, a Hidden Mic at OpenAI, and Dead AI ProductsSED Production softwareengineeringdaily.com
  5. Demis Hassabis and the Race to Build AI with Sebastian MallabySED Production softwareengineeringdaily.com
  6. AI Regulation and What Every Tech Company Should KnowSED Production softwareengineeringdaily.com