# How to Test Intercom Fin Before You Set It Live

*How-to — 2026-10-17 — by Mahmoud Zalt*

Previews, batch tests, procedure simulations and limited audience rollouts, and which of the four to use at each stage of setup.

**Short answer.** **Fin gives you four testing tools and they are not interchangeable.** Previews are for quick manual checks while you build, batch tests measure answer quality across many real questions, simulations validate a single procedure end to end, and an audience rule lets you launch to your own team before anyone else sees it. Use all four, in that order.

**About this guide.** This guide is based on publicly available information and Intercom's own documentation, checked on 17 August 2026. Sistava is not affiliated with Intercom. Interfaces and pricing change often, so confirm the current steps in their documentation before you rely on them.

The temptation with Fin is to add ten articles, hit the button, and see what happens. It usually works well enough that nothing looks broken, which is the problem. The failures are the twenty percent of questions your content never covered, and you will only find those by looking for them deliberately.

Intercom has built a decent amount of testing tooling here, more than most agents in this category ship. This guide covers what each tool does, what it does not do, and the order that catches the most problems for the least effort.

Before any of this, remember the gate. Intercom's chat deployment documentation states you need at least ten public articles live in your Help Center before you can set Fin live over chat, so testing on an empty knowledge base tells you nothing useful.

## What are the four ways to test Fin?

Intercom publishes a page comparing three of them directly, and the fourth is a deployment setting rather than a testing tool. Here is what each is for.

| Tool | What it does | Best for | Stated limits |
|---|---|---|---|
| Preview | A manual panel where you type a message and see Fin's response plus an event log in real time | Quick spot checks while you are still editing content or guidance | No usage limits stated |
| Batch test | Runs a set of questions through Fin and shows you every answer to review | Checking content coverage across many real customer questions at once | Up to 50 questions per test group, no charge |
| Simulation | Automated end to end test of a single procedure, where an AI plays the customer and judges the outcome | Validating procedure logic and catching regressions after an edit | Monthly run limits, documented as ranging from 250 to 12,500 depending on plan |
| Limited audience | A real deployment restricted to a segment you define | The final check with actual traffic before a full launch | Depends on the attributes you have available |

The most useful thing on that table is what previews show you. Intercom's documentation describes previews as available throughout Fin's training areas, including Content, Guidance, Attributes, Escalation, Procedures and Deploy, so you can check a change without leaving the screen you made it on.

## How do you run a batch test?

Batch testing lives under Fin AI Agent, then Test. It is the tool that answers the question you actually care about before launch, which is whether your content covers what people really ask.

### Running a batch test

1. **Open Fin AI Agent, then Test** — This is the batch testing screen. It is separate from the preview panels you see while editing content.
2. **Get your questions in** — Intercom documents four routes: generate from past conversations across all conversations or a specific AI topic, generate by topic using AI Topics, add questions manually, or upload a CSV with a single column of questions.
3. **Mind the limits** — Intercom's page states up to 50 questions per test group, and notes that generating from your inbox needs at least one conversation in the last 90 days. Large question sets get split across groups.
4. **Run it and read every answer** — This is the unglamorous part and it is where the value is. Skimming defeats the exercise.
5. **Rate each response** — Intercom's documented ratings are Acceptable, where you can add an internal note, and Poor, where you pick a root cause from categories covering content, clarification, misuse, tone, length, language and other.
6. **Use the evaluate panel to diagnose** — The Evaluate answer panel shows what shaped a given response, including personality settings, guidance, the content sources used and any automations that triggered. That is how you tell a content gap from a guidance conflict.

**The root cause categories are the real feature.** Marking twenty answers Poor tells you nothing actionable. Marking twelve of them Poor for content and three Poor for tone tells you exactly where to spend the next afternoon. Be honest about the category even when it points at your documentation rather than at Fin.

## Where do batch test questions come from?

Generate from past conversations first, because those are the questions customers genuinely ask, in the words they genuinely use. Questions written by your team are always cleaner and better spelled than real ones, which makes Fin look better than it is.

Then add manual questions for the cases you cannot afford to get wrong. Intercom's documentation notes manual entry is useful for compliance scenarios where you have no historical data. Refund policy, cancellation terms, anything with a legal edge, write those yourself and test them explicitly.

There is a decent middle path too. Intercom's live testing documentation suggests building a set of control questions and asking colleagues to mark whether Fin gave the best response, which doubles as a way to find gaps in your support content.

## How do you test procedures?

Procedures need simulations rather than batch tests, because a procedure has branches and a batch test only checks one answer. Intercom describes a simulation as an automated end to end test where an AI acts as the customer and judges whether the outcome was correct.

The habit worth copying from their documentation is running the whole suite after every edit. Their guidance is to use Run all before going live, on the basis that a simulation which newly fails is a regression your last change introduced.

Their advice on suite coverage is also sound: build scenarios for the normal path, for graceful failure, and for customers behaving unexpectedly. Those three categories catch most of what breaks in production.

## How do you launch to your own team first?

Use an audience rule on the deployment itself. Intercom's live testing documentation describes going to Fin AI Agent, then Deploy, then Chat, and using the Who will see Fin section to restrict who Fin appears for. The email equivalent is under Deploy, then Email.

The trick their documentation gives for internal testing is to select Users and filter on the email address containing your company domain. Fin is genuinely live, on real infrastructure, but only your colleagues can reach it.

For a limited customer rollout, the same audience mechanics accept richer conditions. Intercom's page describes targeting on custom data attributes such as plan or account tier, on user type using Users or Leads only, on product usage attributes, on the current page URL so Fin appears only on specific pages, and on combinations like last seen and region.

**Start with the segment that forgives.** If you are picking a first live audience, free plan users on a low risk page is a kinder place to learn than your largest accounts. Roll forward from there once the batch tests and the real conversations agree with each other.

## A note on how much of this is testing versus rehearsal

Everything above is real engineering practice and Intercom deserves credit for shipping it. It is also, honestly, a lot of process to run before a support agent can answer its first question.

That preparation load is what we approached differently at Sistava. Instead of building a configuration and then proving it works, you hire an AI Employee and tell it in plain English what you want handled. It has its tools connected already and it asks you when it is unsure, so the checking happens in the conversation rather than in a test suite you have to maintain alongside it.

Both approaches are defensible. A test suite gives you evidence you can show a stakeholder, and at high volume that evidence is worth the effort. A worker that asks gives you speed, and for a small team that speed is often the difference between shipping and not.

## What does a sensible testing order look like?

If you only have an afternoon, run it in this sequence. Each step catches a different class of problem, and doing them out of order means re-testing work you already changed.

- **Preview as you build. **Every time you add content or write guidance, type one question at it. Cheap, immediate, unlimited.
- **Batch test from past conversations. **Fifty real questions will find your content gaps faster than anything else on this list.
- **Fix the content, then batch test again. **The second run is the one that tells you whether your fixes landed.
- **Simulate every procedure. **Run all, and treat a newly failing simulation as a regression rather than a flaky test.
- **Deploy to your own domain. **Live infrastructure, colleagues only, using the audience filter on the deploy screen.
- **Deploy to a forgiving customer segment. **Then widen it once the reporting agrees with what your tests predicted.

## FAQ

### How do I test Fin without customers seeing it?

Two ways. Use previews, which are available inside Fin's training areas and never touch a customer, or set an audience rule on the deployment under Fin AI Agent, then Deploy, then Chat, restricting Fin to email addresses on your own domain.

### How many questions can a Fin batch test include?

Intercom's batch testing documentation states up to 50 questions per test group, whether you generate them, add them manually, or upload a single column CSV.

### Where do I find batch testing in Intercom?

Go to Fin AI Agent, then Test. That screen is separate from the preview panels that appear inside the content, guidance and procedure editors.

### What is the difference between a simulation and a batch test?

A batch test checks Fin's answers across up to 50 questions. A simulation is an automated end to end test of a single procedure, where an AI plays the customer and judges the outcome, so it validates branching logic rather than answer quality.

### Do batch tests cost anything?

Intercom's comparison page states batch tests carry no charge and previews have no usage limits, while simulations have a documented monthly run limit that varies by plan. Confirm the current figures in their documentation.

### How many articles do I need before I can test Fin properly?

Intercom requires at least ten published public articles in your Help Center to set Fin live over chat. That is the floor for deployment, not the point at which coverage is good, so expect to need considerably more before batch test results look healthy.

### What should I do with a Poor rating in a batch test?

Pick the root cause category honestly. Intercom's documented categories cover content, clarification, misuse, tone, length, language and other, and the split between them tells you whether to rewrite documentation, rewrite guidance, or change nothing.

## Sources

- [Intercom Help, ](https://www.intercom.com/help/en/articles/10521711-batch-test-fin-ai-agent)Batch test Fin AI Agent
- [Intercom Help, ](https://www.intercom.com/help/en/articles/14077180-simulations-vs-batch-tests-vs-previews)Simulations vs. Batch tests vs. Previews
- [Intercom Help, ](https://www.intercom.com/help/en/articles/7837527-live-testing-fin-with-your-team-or-customer-segments)Live testing Fin with your team or customer segments
- [Intercom Help, ](https://www.intercom.com/help/en/articles/8286630-deploy-fin-ai-agent-over-chat)Deploy Fin AI Agent over chat
- [Intercom Help, ](https://www.intercom.com/help/en/articles/7837514-add-your-content-for-fin-ai-agent)Add your content for Fin AI Agent

**Tags:** intercom-fin, ai-testing, ai-customer-support, batch-testing, support-automation