Joshua Valdez

Dev tools for agents

A common theme I've seen emerging lately is dev tools built specifically for agentic use cases. I think the next billion dollar companies in dev tools will be here.

To clarify, I mean tools that LLM agents can use directly for the purposes of software engineering. Agentic tools are a broader category that includes web browsing, payments, etc. I think those will be big. However, I'm primarily interested in tools that AI SWEs use.

A few examples that resonate in this space are:

I think evals, memory and agentic frameworks will also play a role in AI SWEs. My take is that these will be AI SWE-specific, but I have yet to form a strong opinion on how these pieces will be tangibly different from the same infra for agents broadly.

Weights and Biases is building an interesting trace-based approach to AI SWE evals.