Skip to content
Agentic AI services

Vector databases, retrieval and data clustering

Fig AI Systems builds the data foundation AI agents run on: retrieval, semantic search and clustering that turn messy business data - documents, records, tickets, catalogs - into context an agent can actually use.

What it is
The data foundation agents run on: retrieval, semantic search, clustering
Best for
Answers that have to come from your own documents and records
Comes first
Before the agents that depend on it

What a vector database does

A vector database stores text, images or records as numeric vectors that encode meaning. Ask it for the items most similar to a query. It is a similarity index, not a reasoning engine.

A question phrased in one vocabulary can find material written in another. A support ticket about a charge appearing twice can surface a policy page about duplicate transactions, with no word in common. Similarity is not relevance, though. The design work sits in what gets indexed, how it is split and what metadata it carries.

What retrieval-augmented generation is

Retrieval-augmented generation, usually shortened to RAG, is a four-step pattern. It grounds an answer in your own material.

  1. Split. Break source material into passages small enough to be specific and large enough to stand alone. This step decides more about final quality than any other.
  2. Index. Store each passage as a vector with metadata worth filtering on - source, date, owner, access level.
  3. Retrieve. Turn the question into a vector, fetch the nearest passages, then filter and re-rank them.
  4. Ground. Pass those passages to the model. It answers from them, cites what it used, and flags gaps.

RAG teaches the model nothing. It changes only what the model can see at the moment it answers. So fixing a wrong answer usually means fixing the index.

When retrieval is not the right answer

Retrieval is proposed far more often than it is warranted.

  • The material is small enough to pass in full. Chunking a short handbook loses the context that made it coherent. Send the whole thing.
  • The question needs an exact value from structured data. A balance, a status or a date should come from a query or an API call.
  • The task needs a whole document, in order. Grading, summarizing or comparing a report depends on reading all of it. Report Grader segments documents so they can be processed in parallel.
  • The user wants something done, not looked up. If the job is to place, change or route something, the missing pieces are tools and coordination.
  • The underlying data is wrong or contradictory. Retrieval will surface bad material faithfully and confidently. Fixing or retiring the source has to happen first.

Clustering messy business data

Clustering groups records by what they mean rather than by a field somebody remembered to fill in. A pile of tickets, documents or catalog entries becomes a structure an agent can navigate.

Clustering collapses near-duplicates that keyword matching misses. It discovers the categories a corpus actually contains. It isolates outliers worth a human look, and segments a large corpus so different agents can handle different parts. Report Grader applies the same idea in a stricter form. Skill-enabled agents are mapped to a domain-specific corpus, so grading is anchored to the review criteria that apply.

An agent with well-organized context and a narrow instruction beats a more elaborate agent reading an uncurated corpus.

How the data layer fits the system

Retrieval is a component, not a product. It earns its place when it makes a specific agent behave better.

The data layer is designed alongside the agent that consumes it, described on the custom AI agent development page. Where several agents share a corpus, the routing between them is designed on the multi-agent orchestration page. A retrieval change can improve one class of question while quietly breaking another. So every change is measured through closed-loop evaluation.

Frequently asked questions

Do we need a vector database to build an AI agent?

No. Many useful agents just read a record, call an API and write a result. Nothing about that requires embeddings. A vector database earns its place when an agent depends on material too large for every prompt and too unstructured to query. Retrieval that the workflow does not need buys an indexing pipeline and no extra correctness.

Will retrieval stop an AI system from making things up?

It reduces invention but does not remove it. Retrieval-augmented generation gives the model your own material to answer from. The model can still misread a passage, and retrieval can still return one that only looks relevant. Fig AI Systems therefore pairs retrieval with closed-loop evaluation that checks answers against their source passages.

What do you need from us to start a retrieval project?

A representative sample of the real material, and the questions people actually ask of it. Send the messy version. Mixed formats, near-duplicates and outdated records all change the design.

Ready when you are

Is your data ready for agents?

Describe the material your team relies on and what people ask of it. You will get a straight answer, including whether you need retrieval at all.