AutomationMart
Home/Browse/Evaluate RAG response accuracy with OpenAI: document groundedness metric
n8n

Evaluate RAG response accuracy with OpenAI: document groundedness metric

n8nn8n21 modulesv1.0
OpenAI

This n8n template demonstrates how to calculate the evaluation metric "RAG document groundedness" which in this scenario, measures the ability to provide or reference information included only in retrieved vector store documents. The scoring approach is adapted from How it works This evaluation works best for an agent that requires document retrieval from a vector store or similar source. For our scoring, we need to collect the agent's response and the documents retrieved and use an LLM to as

At a glance

Evaluate RAG response accuracy with OpenAI: document groundedness metric is a ready-made n8n workflow you import as a workflow JSON file — no build required. It connects OpenAI. It's free to download. Follow the 5-step import below to go live in minutes.

Platform
n8n
Connects
OpenAI
Modules
21
Price
Free
Version
v1.0
Evaluate RAG response accuracy with OpenAI: document groundedness metric workflow diagram

About this workflow

This n8n template demonstrates how to calculate the evaluation metric "RAG document groundedness" which in this scenario, measures the ability to provide or reference information included only in retrieved vector store documents. The scoring approach is adapted from How it works This evaluation works best for an agent that requires document retrieval from a vector store or similar source. For our scoring, we need to collect the agent's response and the documents retrieved and use an LLM to assess if the former is based off the latter. A key factor is to look out information in the response which is not mentioned in the documents. A high score indicates LLM adherence and alignment whereas a low score could signal inadequate prompt or model hallucination. Requirements n8n version 1.94+ Check out this Google Sheet for a sample data

n8n

How to import this n8n workflow

  1. 1

    Download the workflow JSON file after purchase.

  2. 2

    Open n8n → click the menu → Import from File.

  3. 3

    Select the downloaded JSON and import.

  4. 4

    Set up credentials for each node that requires them.

  5. 5

    Click Execute Workflow to test, then activate.

Setup guide

Setup guide included

Purchase to unlock the full step-by-step guide

Related N8n workflows

Shopify VIP alerts: AI summary & Slack notification for big orders

VIP Radar: Instantly Spot & Summarize High-Value Shopify Orders with AI + Slack Alerts Automatically detect when a new Shopify order exceeds $200, fetch the customer’s purchase history, generate an AI-powered summary, and alert your team in Slack—so no VIP goes unnoticed. --- 🛠️ Workflow Overview | Feature | Description | |------------------------|-----------------------------------------------------------------------------| | Trigger | Shopify “New Order” webhook | | Conditional Check | Filters

Free

Scrape Trustpilot reviews with DeepSeek, analyze sentiment with OpenAI

Workflow Overview This workflow automates the process of scraping Trustpilot reviews, extracting key details, analyzing sentiment, and saving the results to Google Sheets. It uses OpenAI for sentiment analysis and HTML parsing for review extraction. --- How It Works 1. Scrape Trustpilot Reviews - HTTP Request: - Fetches review pages from Trustpilot ( - Paginates through pages (up to maxpage limit). - HTML Parsing: - Extracts review URLs using CSS selectors - Splits the URLs into indiv

Free

Generate Instagram reels with Veo3 and GPT for AI-powered ad creation

Veo3 Instagram Reel Generator – AI-Powered Ad Creation in Minutes Description: This no-code workflow transforms your creative brief into an engaging Instagram Reel using OpenAI and Veo3 API (via Wavespeed) — fully automated in n8n. Just type a product, theme, or trend via chat, and get a short-form video plus caption delivered and logged, ready to post. Perfect for marketers, creators, and content teams looking to scale their ad content output without hiring editors or creative agencies. Wa

Free

Curate Hackernews, Make a brief audio news and Delivery to Telegram

This template automates a full “news curation → AI briefing → audio generation → Telegram delivery” workflow. It begins by requesting the Hacker News top-stories list and slicing the first 30 IDs. Each ID is iterated to fetch detailed items such as title and URL. The aggregator then collects all fetched stories into a single array, forming the dataset used in the AI prompt. An OpenAI Chat Completion module receives the full list of stories and a predefined set of user interests. It produces a J

Free

Automated Facebook comment management with GPT-4o and LangChain

Facebook AI Agent with MCP Server – Built for Smart Engagement and Automation Hi! I’m Amanda 🥰😘 — I build intelligent automations with n8n and Make. This powerful workflow was designed to help teams automatically handle Facebook page interactions with AI. Using Meta Graph API, LangChain, MCP Server, and GPT-4o, it allows your AI agent to search for posts, read captions, fetch comments, and even reply or message followers, all through structured tools. --- 🔧 What the workflow does - Searches for

Free

Generate blog posts and images in WordPress using Google Sheets and ChatGPT

This template generates engaging blog posts and images in WordPress using data from Google Sheets and ChatGPT, streamlining your content creation process.

Free

Estimate Construction Costs from Revit/IFC Models with GPT-4 and Claude

Estimate material price and total cost for grouped BIM/CAD elements using an LLM-driven analysis. The workflow accepts an existing XLSX (from your model) or, if missing, can trigger a local RvtExporter.exe to generate one. It enriches each element group with quantities, pricing, confidence, and produces a multi-sheet Excel report plus a polished HTML executive report. What it does - Reads grouped element data (from XLSX or extracted via RvtExporter.exe). - Builds enhanced prompts with clear rule

Free

Invoices from Gmail to Drive and Google Sheets

Attachments Gmail to Drive and Google Sheets Description Automatically process invoice emails by saving attachments to Google Drive and extracting key invoice data to Google Sheets using AI. This workflow monitors your Gmail for unread emails with attachments, saves PDFs to a specified Google Drive folder, and uses OpenAI's GPT-4o to extract invoice details (date, description, amount) into a structured spreadsheet. Use cases - Invoice Management: Automatically organize and track in

Free

Reviews

No reviews yet

Be the first to buy and share your experience.

Leave a review

Sign in to share your experience with this workflow.

Log in to review
Free
No ratings yet

Create a free account to purchase workflows.

  • JSON blueprint — instant download
  • Setup guide PDF included
  • 5 downloads · valid 30 days
  • Works with n8n

Need help setting this up?

Book a 3-hour live setup session with an Agility consultant.

₹2,499/ session
3 hrs · video call
  • Configure live on Google Meet / Zoom
  • Free follow-up if workflow has defects
  • Platform expert assigned to you
Book installation session
Free