Introduction to Agents

The developer can see every inference step, tool call, and shield result. So far, we’ve been using the Inference API to send prompts and receive responses. This is powerful, but it’s also limited since every interaction is a single query. There's no persistence, no memory, no external actions. We are relying on pure language modeling to solve all problems.

But real-world AI applications often need more. They need to reason across multiple steps, retrieve relevant information, invoke tools, and guard against harmful output while maintaining a conversational state.

That’s where agents come in.