AutomationMart
Home/Browse/Evaluations metric: answer similarity
n8n

Evaluations metric: answer similarity

n8nn8n18 modulesv1.0
UNSUPPORTED_SLUG_FORMAT

This n8n template demonstrates how to calculate the evaluation metric "Similarity" which in this scenario, measures the consistency of the agent. The scoring approach is adapted from the open-source evaluations project RAGAS and you can see the source here How it works This evaluation works best where questions are close-ended or about facts where the answer can have little to no deviation. For our scoring, we generate embeddings for both the AI's response and ground truth and calculate the c

At a glance

Evaluations metric: answer similarity is a ready-made n8n workflow you import as a workflow JSON file — no build required. It connects UNSUPPORTED_SLUG_FORMAT. It's free to download. Follow the 5-step import below to go live in minutes.

Platform
n8n
Connects
UNSUPPORTED_SLUG_FORMAT
Modules
18
Price
Free
Version
v1.0
Evaluations metric: answer similarity workflow diagram

About this workflow

This n8n template demonstrates how to calculate the evaluation metric "Similarity" which in this scenario, measures the consistency of the agent. The scoring approach is adapted from the open-source evaluations project RAGAS and you can see the source here How it works This evaluation works best where questions are close-ended or about facts where the answer can have little to no deviation. For our scoring, we generate embeddings for both the AI's response and ground truth and calculate the cosine similarity between them. A high score indicates LLM consistency with expected results whereas a low score could signal model hallucination. Requirements n8n version 1.94+ Check out this Google Sheet for a sample data

n8n

How to import this n8n workflow

  1. 1

    Download the workflow JSON file after purchase.

  2. 2

    Open n8n → click the menu → Import from File.

  3. 3

    Select the downloaded JSON and import.

  4. 4

    Set up credentials for each node that requires them.

  5. 5

    Click Execute Workflow to test, then activate.

Setup guide

Setup guide included

Purchase to unlock the full step-by-step guide

Related N8n workflows

Collect historical price data from Polymarket Up/Down markets into Supabase

This workflow automatically collects historical price data from Polymarket Up/Down markets and stores it in Supabase, creating a structured and query-ready dataset for analysis. By continuously fetching price movements from prediction markets such as Bitcoin, S&P 500, and other Up/Down series, the automation enables reliable historical tracking without manual intervention. The data is normalized and persisted in Supabase, making it easy to run SQL queries, build dashboards, perform quantitative

Free

Generate QR codes from URLs with QR Server API and downloadable images

Easily generate QR codes from any URL! This workflow lets users submit a URL via a simple form and instantly receive a downloadable QR code image—perfect for quick sharing or promotions. Setup is fast and user-friendly, so you’ll be up and running in minutes! --- 🚀 How it works - The end user submits a URL through a simple online form. - The workflow automatically sends the submitted URL to a QR code generation API. - The user receives a downloadable QR code image corresponding to their URL. ---

Free

Fetch live ETF metrics from JustETF to Excel with one-click updates

Automate Your ETF Comparison: Real-Time Data & Analysis Automate ETF research in Excel with one click. This n8n workflow pulls live data from justetf.com using ISIN codes from your Excel table, extracts key metrics (dividends, fees, 5-year performance), and updates your “Div study” sheet instantly — all triggered by a button in Excel. Perfect for dividend investors, ETF screeners, or portfolio trackers who want fresh, accurate data without manual copy-paste. --- How it wor

Free

Host your own JWT authentication system with Data Tables and token management

Description A production-ready authentication workflow implementing secure user registration, login, token verification, and refresh token mechanisms. Perfect for adding authentication to any application without needing a separate auth service. Get started with n8n now! What it does This template provides a complete authentication backend using n8n workflows and Data Tables: - User Registration: Creates accounts with secure password hashing

Free

Create new Dubb contacts from Braintree

When a new customer is created in Braintree, a new contact is created in Dubb.

Free

Get Malaysia tax ID number (TIN) for multiple business reg num (SSM) or NRIC

BACKGROUND Malaysia's Inland Revenue (LHDN) provides an API to get the tax id number for a business entity, based on a given Business Registration number (BRN or SSM), or NRIC (MyKad). PROBLEM However, the API only allows one search at a time. SOLUTION This free workflow lets you do a batch search to get TIN for multiple SSM or NRIC. This is useful if you need to prepare your internal DB for e-invoicing PRE-REQUISITES 1) Get your connection client id and client secret from myhasil.gov.my websi

Free

Create a data analyst chatbot for real-time Google Sheets analysis with GPT-5

Who is this for? This workflow is ideal for: Business analysts and data professionals who need to quickly analyze spreadsheet data through natural conversation Small to medium businesses seeking AI-powered insights from their Google Sheets without complex dashboard setups Sales teams and marketing professionals who want instant access to customer, product, and order analytics --- What problem is this workflow solving? Traditional data analysis requires technical skills and time-consuming manu

Free

Generate new video audio and merge the final result with Fal.run and Google Drive

Quick overview This workflow collects a video URL via an n8n form, uses Fal.run APIs to generate music from the video and merge it back into a new video, then downloads the final file and uploads it to Google Drive. How it works 1. Receives a video URL from an n8n form submission. 2. Sends the video URL to Fal.run (sonilo/video-to-music) to generate an audio track and waits before polling the job status until it is completed. 3. Fetches the generated audio details from Fal.run using the request

Free

Reviews

No reviews yet

Be the first to buy and share your experience.

Leave a review

Sign in to share your experience with this workflow.

Log in to review
Free
No ratings yet

Create a free account to purchase workflows.

  • JSON blueprint — instant download
  • Setup guide PDF included
  • 5 downloads · valid 30 days
  • Works with n8n

Need help setting this up?

Book a 3-hour live setup session with an Agility consultant.

₹2,499/ session
3 hrs · video call
  • Configure live on Google Meet / Zoom
  • Free follow-up if workflow has defects
  • Platform expert assigned to you
Book installation session
Free