Product Updates

Introducing AI Agent Testing: Fora AI Isn’t Just a Code Scanner Anymore

Fora AI now lets you test prompts and AI agents directly — latency, token usage, estimated cost, and pass/fail matching, across Groq, OpenAI, Gemini, and Claude.

F Fora AI Team July 22, 2026 6 min read

Fora AI started as a static code security scanner: paste in code, upload a file, or drop a ZIP, and get back a security score with a fix for every issue found. That part isn't going anywhere — it's still the core of the product. But it's no longer the whole product. Today we're shipping the first piece of something bigger: AI Agent Testing.

Why a security scanner is adding agent testing

More teams are shipping AI agents and LLM-powered features into production than ever, and a pattern keeps showing up: the code around the agent gets reviewed carefully, but the agent's actual behavior — what it says, how fast, at what cost, and whether it holds up across different models — doesn't get tested with the same rigor as everything else in the codebase. Quality has become one of the biggest blockers to shipping agents with confidence, and most of that gap comes down to a simple problem: teams aren't measuring agent output the way they measure everything else they ship.

That's the gap Fora AI's new AI Engineering section starts to close. Security scanning tells you your code is safe. Agent testing tells you your AI is actually doing what you built it to do.

What you can do right now

Head to AI Engineering → Agent Testing in your dashboard. You'll get a simple form:

Hit run, and you get back the full reply along with the numbers that actually matter for shipping an agent to production: response latency in milliseconds, prompt and completion token counts, and an estimated cost for that single call. If you set an expected output, you'll also see a pass or fail based on a simple contains-check against the reply.

Why these specific metrics

Latency, token usage, and cost aren't vanity numbers — they're the three things that turn "the agent works in my testing" into "the agent works at the volume and budget I actually have." A prompt that produces a great answer but costs ten times more than a shorter, equally good prompt is a real trade-off worth seeing before it's buried in a monthly API bill. A response that's accurate but takes six seconds might be fine for a background job and unacceptable for a chat widget. Testing each combination side by side, instead of guessing, is the whole point.

Every test is saved

Every run lands in your Test History, so you can go back and compare how the same prompt behaved on a different model, or how a system prompt tweak changed the response, the cost, or both. It's a lightweight log today; version comparison and side-by-side model runs are next on the roadmap.

What's next

This manual, single-prompt test is the first slice of a larger AI Engineering platform we're building on top of Fora AI's existing security core — batch testing against a CSV of test cases, side-by-side model comparison, and a pre-deploy check that runs your security scan and your agent evaluation together before you ship. Each piece ships as its own usable feature rather than one big release, so you can start using agent testing today without waiting on the rest.

Free to try

Every account gets free agent tests to start, no separate signup or credit card needed — the same no-friction approach we've always taken with scanning. Go run your first test and see what your agent actually costs per call.

← Back to all posts
Fimi
Hey i'am Fimi, the official AI assistant for Fora AI. Ask me anything about security concepts or how to use the Fora AI. 🙂