Skip to content
Cloudata
AI for data operations

Enterprise RAG: answers with sources, permissions and current data

A RAG system must retrieve authorized evidence, keep it current and check whether it answers the question. This guide proposes an architecture for policies, manuals and operational knowledge, with evaluation criteria and a safe response when sources are insufficient.

What you will take away

  • Apply permissions before retrieving content and before sending it to the model.
  • Treat versions, deletions and access changes as part of index updates.
  • Evaluate retrieval, answer support and isolation between users separately.
  • Show verifiable sources and allow the system to say it lacks sufficient evidence.

The useful question: what evidence supports the answer?

Retrieval-augmented generation, or RAG, connects a question to relevant content before generating an answer. Microsoft describes this pattern as a way to ground answers in proprietary content [1]. It helps query policies, procedures and documented incidents. The goal is to reduce manual searches without turning a plausible answer into an automatic decision.

For this October 2026 edition, the priority is to move from a search demonstration to a service with identity, updates and evaluation. Adding documents or changing the model does not, by itself, fix a permissions, versioning or evidence problem.

Apply permissions before retrieval

The authenticated identity and its groups determine eligible documents. The service applies restrictions before selecting passages and building the model context. Filtering only on-screen citations is insufficient: restricted content would already have reached the model. Microsoft documents query-time controls using permission metadata; some implementations are in preview and require checking their limitations [2].

  • Keep the document identifier, owner, version, classification and access rules alongside its passages.
  • Resolve identity on the server; do not trust a group or tenant freely supplied by the browser.
  • Revalidate permissions when opening a source and isolate caches by identity and access context.
  • Reject retrieval when permissions are missing or their validity cannot be verified.

An index also needs a retirement policy

Storing the ingestion date helps, but it does not prove that a policy is still current. Recording the source version, modification date and status allows replaced or deleted passages to be removed. Permission changes must propagate to the index and caches within a defined window. If that window cannot be met for sensitive information, the retriever must consult current authorization or temporarily suspend that content.

Example: an assistant for return policies

A team starts with a bounded set of approved policies for two countries. Each document has a country, effective period and owner. For a query, the service identifies the user, filters their scope and retrieves the current policy. The answer includes the passage supporting the condition and the authorized link. When policies conflict, it asks for the country or escalates the query. This example is an implementation proposal, not a result attributed to Cloudata or a confirmed Dova feature.

During the pilot, the assistant explains procedures; it does not approve refunds or modify orders. Separating queries from execution makes it possible to evaluate knowledge quality before introducing actions with financial impact.

Measure more than an answer that sounds right

Build known, ambiguous, unanswerable and unauthorized questions. Keep test cases versioned and repeat them when documents, indexes, prompts or models change. Evaluations help check behavior against defined criteria [3]; acceptable limits should be agreed with the process owner.

Scrollable table
IndicatorWhat to check
RetrievalThe expected evidence appears among eligible results.
SupportEvery material statement is supported by the cited passage.
AbstentionThe system recognizes questions without sufficient evidence.
IsolationA user cannot obtain passages or inferences from another scope.
Freshness and costChange propagation time, latency and cost per useful query.

Before opening access to more users

  • Define eligible documents, an editorial owner and a correction mechanism.
  • Test group changes, deleted documents and links that are no longer accessible.
  • Review answers with conflicting sources and malicious content.
  • Record evidence and evaluation results without unnecessarily storing secrets or complete documents.
  • Agree on alerts, service withdrawal and a channel for reporting incorrect answers.

Dova is presented as a data integration platform with mappings, workflows, sessions, workers and monitoring. These capabilities belong to data flow preparation and operation. This RAG architecture requires additional components and its own validation; it does not assume that Dova includes a RAG engine or these authorization controls.

Questions worth asking

Does RAG eliminate invented answers?

No. It can provide evidence, but incomplete retrieval or incorrect interpretation can still produce errors. Evaluations, verifiable citations and abstention are needed.

Is a vector database mandatory?

No. Retrieval can combine keyword searches, filters and semantic methods. The choice depends on the documents and evaluation results.

Is hiding restricted sources in the interface enough?

No. Their content must stay out of retrieval and the model context when the user is not authorized.

Where Dova fits

Explore Dova's available data integration features in its product information and documentation. Discuss your AI use case with Cloudata to define the data, integrations and controls it needs.

Sources & further reading

  1. RAG and Generative AI - Azure AI SearchMicrosoft Learn · Accessed

    Official explanation of grounding, retrieval and permission-aware enterprise knowledge.

  2. Query-Time ACL and RBAC Enforcement - Azure AI SearchMicrosoft Learn · Accessed

    Official query-time permission filtering documentation. The documented capability is marked preview; the article discusses the architectural requirement, not general availability.

  3. Working with evalsOpenAI · Accessed

    Official guidance for evaluating model behavior against specified criteria.

  4. LLM01:2025 Prompt InjectionOWASP Gen AI Security Project · Accessed

    Official prompt injection risk and mitigations; the 2025 identifier is the source edition, not an October 2026 announcement.

Practical guidance for the October 2026 edition. Sources support the technical principles; examples are illustrative, not product announcements or customer results.

Dova · Cloudata

Bring these ideas into your data operation.

Dova is Cloudata’s data integration platform. Explore the product, review the documentation or discuss the workflow you need to improve.