AutomationMart
Home/Browse/Split test different agent prompts with Supabase and OpenAI
n8n

Split test different agent prompts with Supabase and OpenAI

n8nn8n9 modulesv1.0
OpenAI

Split Test Agent Prompts with Supabase and OpenAI Use Case Oftentimes, it's useful to test different settings for a large language model in production against various metrics. Split testing is a good method for doing this. What it Does This workflow randomly assigns chat sessions to one of two prompts, the baseline and the alternative. The agent will use the same prompt for all interactions in that chat session. How it Works 1. When messages arrive, a table containing information regarding sessi

At a glance

Split test different agent prompts with Supabase and OpenAI is a ready-made n8n workflow you import as a workflow JSON file — no build required. It connects OpenAI. It's free to download. Follow the 5-step import below to go live in minutes.

Platform
n8n
Connects
OpenAI
Modules
9
Price
Free
Version
v1.0
Split test different agent prompts with Supabase and OpenAI workflow diagram

About this workflow

Split Test Agent Prompts with Supabase and OpenAI Use Case Oftentimes, it's useful to test different settings for a large language model in production against various metrics. Split testing is a good method for doing this. What it Does This workflow randomly assigns chat sessions to one of two prompts, the baseline and the alternative. The agent will use the same prompt for all interactions in that chat session. How it Works 1. When messages arrive, a table containing information regarding session ID and which prompt to use is checked to see if the chat already exists 2. If it does not, the session ID is added to the table and a prompt is randomly assigned 3. These values are then used to generate a response Setup 1. Create a table in Supabase called splittestsessions. It needs to have the following columns: sessionid (text) and showalternative (bool) 2. Add your Supabase, OpenAI, and PostgreSQL credentials 3. Modify the Define Path Values node to set the baseline and alternative prompt values. 4. Activate the workflow and test by sending messages through n8n's inbuilt chat 5. Experiment with different chat sessions to test see both prompts in action Next Steps - Modify the workflow to test different LLM settings such as temperature - Add a method to measure the efficacy of the two alternative prompts

n8n

How to import this n8n workflow

  1. 1

    Download the workflow JSON file after purchase.

  2. 2

    Open n8n → click the menu → Import from File.

  3. 3

    Select the downloaded JSON and import.

  4. 4

    Set up credentials for each node that requires them.

  5. 5

    Click Execute Workflow to test, then activate.

Setup guide

Setup guide included

Purchase to unlock the full step-by-step guide

Related N8n workflows

AI image generator from text built on fal.ai

Who this template is for This template is for developers, content creators, or application builders who want to integrate an AI-powered text-to-image generation service into their applications or systems via an API endpoint. Use case Creating a secure API endpoint that converts text prompts into AI-generated images, with built-in content moderation to prevent inappropriate content generation. This can be used for creative applications, content creation tools, prototyping interfaces, or

Free

Free AI image generator - n8n automation workflow with Gemini/ChatGPT

This n8n template demonstrates how to use AI to generate custom images from scratch - fully automated, prompt-driven, and ready to deploy at scale. Use cases are many: You can use it for marketing visuals, character art, digital posters, storyboards, or even daily image generation for your personal purposes. How It Works - The flow is triggered by a chat message in N8N or via Telegram. The default image size is 1080 x 1920 pixels. To use a different size, update the values in the “Fie

Free

Send to data to Google Sheets with ChatGPT using converted HTML to text from HTTP

Automatically send data to Google Sheets using ChatGPT after converting the HTML to text received from HTTP. Add rows for streamlined data management and analysis.

Free

Automatic Gmail categorization and labeling with AI

This workflow contains community nodes that are only compatible with the self-hosted version of n8n. Who is this for? If your inbox is full of unread emails, this workflow is for you. Instead of reading through them one by one, let AI do the sorting. It reads your emails and flags only what needs action. What does it solve? This workflow reads your unread Gmail emails and uses AI to decide what’s important — and what’s not. It labels emails that need your attention, identifies re

Free

Ai-powered degree audit system with Google Sheets and GPT-5

Run an AI-powered degree audit for each senior student. This template reads student rows from Google Sheets, evaluates completed courses against hard-coded program requirements, and writes back an AI Degree Summary of what's still missing (major core, Gen Eds, major electives, and upper-division credits). It's designed for quick advisor/registrar review and SIS prototypes. Trigger: Manual — When clicking "Execute workflow" Core nodes: Google Sheets, OpenAI Chat Model, (o

Free

Screen and score investment deals with AI using OpenAI, Gmail, and Telegram

Screen and Score Investment Deals with AI using OpenAI, Gmail, and Telegram Automatically screens incoming deal submissions using AI, scores them against investment criteria, and routes to the right action. Who is this for? VC firms, PE funds, angel investors, or M&A advisors who receive deal flow via email or form submissions. What problem does this solve? Manually reviewing every pitch deck and deal memo is time-consuming. Most deals don't meet investment criteria. This agent screens, scores,

Free

Create and publish AI recipe infographics with Gemini, Nanobanana Pro and Blotato

Overview This workflow automatically creates and publishes AI-generated recipe infographics using n8n and AI agents. By entering a single dish name, the system researches the recipe, generates structured cooking content, designs a visual infographic using Nanobanana Pro, uploads the image to Blotato’s media server, and publishes the post to Facebook using Blotato as the posting service. The workflow is designed for food content creators, social media managers, and automation builders who want to

Free

Generate & publish professional COE blogs with Gemini AI and Google Drive

This n8n workflow transforms simple chat requests into professional Center of Excellence (COE) blog posts using AI, then automatically publishes them to Google Drive. What Is This? An intelligent blog creation system that takes a topic from chat and produces executive-level blog posts. Uses three AI stages to ensure high-quality, professional content suitable for business consumption. Why Use This? - Professional Content: Creates sophisticated blogs with business insights - Save Time: Topic to p

Free

Reviews

No reviews yet

Be the first to buy and share your experience.

Leave a review

Sign in to share your experience with this workflow.

Log in to review
Free
No ratings yet

Create a free account to purchase workflows.

  • JSON blueprint — instant download
  • Setup guide PDF included
  • 5 downloads · valid 30 days
  • Works with n8n

Need help setting this up?

Book a 3-hour live setup session with an Agility consultant.

₹2,499/ session
3 hrs · video call
  • Configure live on Google Meet / Zoom
  • Free follow-up if workflow has defects
  • Platform expert assigned to you
Book installation session
Free