Skip to main content
Stay up to date with the latest improvements to Freeplay. This changelog covers platform features, SDK releases, API additions, and bug fixes that improve what you can do with Freeplay.
For developers: Watch for SDK and API updates that may require code changes. Breaking changes are clearly marked.

​
February 2026

February 6, 2026

Freeplay MCP Server (Experimental)

Integrate Freeplay capabilities into MCP-compatible tools and workflows with our experimental Model Context Protocol server, now available as a public repository.View on GitHub →Additional links:

​
🏚️Project Home Page

We’ve added a new Home page to every project with key metrics, insights about the project, and bookmark-able metrics. It’s a much faster way to understand what’s happening in your project. See this Loom for more information. 

​
🤖 Models

Claude Opus 4.6 — Added the newest Claude Opus 4.6 to Freeplay’s prompt playground.Claude Haiku 4 media support — Full image and file upload support for Anthropic Claude Haiku 4 models via both direct Anthropic API and AWS Bedrock.

​
🔧 API

User management endpoints — Filter deleted users via include_deleted query parameter and reactivate soft-deleted users through new admin endpoints.Insights Endpoints - You can now get insights from Freeplay by using the /project/{project_id}/insights api endpoint.Insight filtering in search — Search API supports filtering by insight_id across review themes and evaluation insights.

​
📚 Documentation

Filtering and search documentation — New documentation explaining tokenization behavior, phrase matching, field-type specific search, and ‘contains’ semantics in the observability UI.

​
🐛 Bug fixes / Improvements

  • UI improvements including scrollable evaluation explanations, better test run comparison alignment, and standardized tab styling.

​
January 2026

January 13, 2026

New Search APIs

Query your observability data programmatically with three new search endpoints for sessions, traces, and completions. Build complex queries with compound filters (AND, OR, NOT), paginate through results, and use advanced filtering by eval score, cost, latency, metadata, and more.View Search API Operators →

New year, new docs

Major refresh to our documentation including an OpenAPI spec, a new llms.txt as the starting place for coding agents, and restructured SDK documentation. We’ve also added this changelog. Let us know what you think.Explore the docs →

​
📦 SDK

Google GenAI tool schema update — Define tool schemas using GenaiFunction and GenaiTool dataclasses in Python, with full TypeScript type safety in Node.Python SDK v0.5.5–0.5.6 — Standardized documentation, improved variable naming conventions, and reorganized capabilities. (See full Python SDK changelog)Node SDK v0.5.2–0.5.3 — Revamped README for open source release with improved examples and documentation. (See full Node SDK changelog)

​
🐛 Bug fixes

  • Fixed tool call import when saving test cases from completions

SDKs now open source

Python and Node.js SDKs are now available under the Apache-2.0 license.

​
🖥️ Platform

Run all evaluations button — Trigger evaluation runs for all completions and traces in a session with a single click.CSV export for traces — Export trace data directly from the observability view for offline analysis.Bulk dataset operations — Select multiple rows in datasets to bulk delete, duplicate, or move test cases. Sort by name, compatibility, or creation date with shareable URL parameters.

​
🔧 API

Model Management API — Programmatically create, read, update, and delete model configurations through new CRUD endpoints.OpenAPI specification — Complete schema with descriptions for all 67 API endpoints, accessible in the Freeplay app with interactive playground. View API Reference →

​
📦 SDK

Metadata updates — Update session and trace metadata after creation via client.metadata.updateSession() and client.metadata.updateTrace() in Python, Node, and JVM SDKs.

​
December 2025

December 18, 2025

Review Insights

Our new AI agent works alongside your human reviewers to perform real-time root cause analysis, automatically surfacing patterns and actionable improvements as reviews happen.Learn more →

Automations

Define custom searches, then automatically run evaluations, add results to review queues or datasets, or trigger Slack notifications. Build weekly review queues of low-scoring logs, curate important results, or get alerts for evaluation failures.See the guide →

​
🖥️ Platform

Updated session view — Session cards now display evaluation scores, notes, auto-categorization results, and multiselect values. Tree view includes colored performance icons (green → red) to quickly identify problem areas. View documentation →

​
🤖 Models

New models — GPT-5.2, Gemini Pro 3 Flash Preview, Gemini 3 (with thinking_level parameter), and Mistral 3 series.LiteLLM for evaluations — LiteLLM models now supported for automated evaluations.

​
🏢 Enterprise

Directory sync — Automatically sync users and groups from your identity provider via SCIM. Map directory groups to Freeplay roles with automatic provisioning and deprovisioning. Learn more →

​
🐛 Bug fixes

  • Fixed Bedrock provider tool_result handling
  • Fixed CSV export timeout issues
  • Improved text search with exact phrase matching

​
🖥️ Platform

Create evaluations from review themes — When you find a common issue, turn it into an LLM judge evalution directly from review themes so you can catch the issue next time it happens.Prompt optimization from review themes — Use learning from a review to launch a targeted AI-powered prompt optimization experiment, using reviewed sessions as a data source.Slack integration — Connect Slack workspaces to receive automation notifications with direct links to filtered views.

​
🤖 Models

New models — Claude Opus 4.5 and GPT-5.1 available in playground and for automated evaluations.

​
🐛 Bug fixes

  • Fixed Anthropic Bedrock tool call handling with tool call history

​
November 2025

New integrations

Native support for LangGraph workflows, Vercel AI SDK, and Google Agent Development Kit with full observability and prompt management.View integrations →

​
🖥️ Platform

Tool span tracing — Log tool calls as explicit spans with kind="tool". Add custom names for clearer identification in traces. See the Tools guide →Review Agent (Beta) — Automatically surfaces review themes by analyzing patterns across your review queues. Includes auto-assignment, automatic status updates, and keyboard shortcuts.One-click curation — Add completions to review queues or datasets directly from session view. Edit inputs/outputs and create golden test cases in one step.Multimodal dataset history — Create test cases with images and media across multiple conversation turns.

​
📦 SDK

Node.js/TypeScript SDK v0.5.2 — Official release with full support for prompts, sessions, traces, recordings, and test runs.
npm install freeplay
Python SDK v0.5.4 — Improved package management, documentation, and multimodal data handling.
pip install freeplay
Get started →

​
October 2025

Structured outputs

End-to-end structured output support across Python, Node.js, and JVM SDKs. Define output schemas in prompt templates for validated JSON responses with OpenAI and Azure providers.Learn more →

​
🖥️ Platform

Review queues for traces — Systematically evaluate traces with customizable themes and automatic categorization. Trigger evaluations from OpenTelemetry data streams. Learn more →

​
🔧 API

Prompt Templates API — Create, read, update, and delete prompt versions programmatically. Update environment assignments through SDK methods. View API Reference →Environments API — Full CRUD operations for deployment environments. Learn more →

​
🤖 Models

New models — Claude Haiku 4.5, Nova Models on AWS Bedrock (with multimedia and tool calls), and Gemini updates with fixed tool use.AWS Bedrock Converse API — Comprehensive support including tool calling and multimedia inputs. See the recipe →

​
🐛 Bug fixes

  • Fixed sessions not displaying in review queue context
  • Fixed observability date filter functionality
  • Fixed duplicate test case updates
  • Fixed span indentation for childless spans
  • Fixed Anthropic cost calculation with OpenInference

​
🖥️ Platform

Dataset curation improvements — Edit outputs when saving logs to datasets for better ground truth. View ground truth in playground after loading datasets.Bulk auto-evaluations — Run evaluations across multiple completions at once. Auto-trigger when completions are added to review queues.Trace display options — Toggle between plain text, Markdown, and JSON formats for inputs and outputs.

​
🔧 API

Dataset APIs — Endpoints for getting, updating, and deleting prompt and agent datasets. OpenAPI docs support live testing in browser. Explore →

​
🔧 API

Dataset Management APIs — POST endpoints for creating datasets with configurable input names, media inputs, and history support.

​
🖥️ Platform

OpenTelemetry expansion — Capture Freeplay-specific attributes including provider/model info, environment tags, prompt/test IDs, metadata, and tool schemas. Learn more →

​
🐛 Bug fixes

  • Fixed agent cost calculation showing $0.00 for top-level costs
  • Fixed auto-evaluations not working on traces
  • Fixed auto-evaluation failures for criteria without eval_prompt

​
🔧 API

Delete API for prompt template versions — Programmatic removal through the v2 API.

​
🐛 Bug fixes

  • Fixed “mark as best” auto-navigation behavior
  • Restored next/previous navigation on filtered test runs

​
September 2025

Auto-categorization

Automatically categorize logs using your own classification criteria—similar to LLM judges but for content analysis. Identify issue types that lead to evaluation failures or negative feedback.Learn more →

Prompt optimization

AI-powered optimization uses your live logs, evaluations, human labels, and customer feedback to recommend better prompts—and can update prompts for new models.

​
🐛 Bug fixes

  • Fixed Gemini tool call correlation with OpenInference instrumentation
  • Fixed next/previous navigation on filtered test runs
  • Fixed test run execution with Gemini models
  • Improved error messages for malformed OpenTelemetry data

​
🖥️ Platform

Multi-modal template variables — Access all variables from multi-modal prompts when creating datasets or configuring evaluations.

​
🖥️ Platform

Selective evaluation control — Choose which evaluations run during tests via UI or SDK for targeted testing and cost savings.Test run comparison — Clearer cost and latency metrics rolled up at prompt and trace levels.Multimodal evaluations — Target image and audio attachments with auto-evaluators. Models automatically filtered by supported media types.Project-level data retention — Set shorter retention windows for sensitive projects. Learn more →

​
August 2025

SDK breaking changes — These changes enable optional prompt management, OTel logging support, nested traces, and multi-modal dataset management.
  1. project_id is now the first required argument to RecordPayload:
RecordPayload(project_id=project_id, ...)
  1. PromptInfo renamed to PromptVersionInfo (now optional):
RecordPayload(
    project_id=project_id,
    prompt_version_info=formatted_prompt.prompt_info,
    ...
)

​
🖥️ Platform

Media input support — Create and upload media-backed test cases with automatic type inference.Tree-based session interface — Left-hand tree navigation, resizable review panel, and deep-linking for shareable session URLs.Multi-project service accounts — Service accounts can now access multiple projects.

​
🤖 Models

Tool calling expansion — Vertex AI and Gemini tool calling, including native support in JVM SDK.

​
🐛 Bug fixes

  • Fixed navigation stale selections during pagination
  • Fixed Gemini test runs with proper message type conversion
  • Fixed table flickering and media preview reloading
  • Improved error handling for API keys from deleted users

​
🤖 Models

New models — GPT-5 available in playground and for evaluations. Claude Opus 4.1 and GPT-OSS models (20B/120B) can be added for your preferred inference provider.

Agent evaluations

Create trace-level LLM judges in the Freeplay UI to evaluate full agent behavior. Filter and graph agent evals separately from prompt-level evals.Learn more →

​
🖥️ Platform

Playground diff view — Row-level change comparison for any two columns to compare prompt iterations.Prompt optimization (experimental) — Use log examples, eval scores, human labels, and feedback to suggest prompt improvements.Test results filtering — Filter graphs and test case rows together to explore metrics for different data slices.

​
🐛 Bug fixes

  • Fixed filtering operators to respect numeric types (greater than, less than) instead of only string operators

​
July 2025

​
🔒 Security

WorkOS authentication — Upgraded authentication for enhanced security and smoother logins.

​
🔧 API

User-scoped API keys — Full API use with private projects:
  • Private projects → Accessible only to API keys from project members
  • Public projects → Accessible to all API keys

​
June 2025