Changelog
Back to All

4/16/24 Updates

12 months ago by Jeremy Silva

📣

Recent Updates: Comparative Tests UI, faster Session browsing, Prompt editor improvements & New Freeplay API

  • Instantly compare test results to benchmark data
  • Move faster through data reviews with new Session browser
  • Configure JSON Mode & other advanced parameters on prompt templates
  • Freeplay Public API offers full parity to SDKs

See all the details here

New Tests UI

We’ve made it easier to immediately compare a new prompt or model change to another dataset across multiple criteria at the same time – so you can quickly decide which one is the winner. Any time you want to try out a new prompt change or test a new model, you always want to compare it to a baseline to see if it’s better or worse. This has long been possible in Freeplay using our Comparisons feature, but now it’s the default view for any Test.

This feature works the same whether testing via the Freeplay app or via the SDK, making it easier for anyone on your team to quantify the results from a new Test.

New UI to Browse Sessions & Completions

Explore Sessions more efficiently with our redesigned interface. Quickly toggle between Session details using the new side panel, which displays key details at a glance. Within each Session, essential elements of the Completions can be expanded or collapsed for streamlined viewing. Large variables like RAG context are collapsed by default for easier viewing as well, but can be expanded when needed.

Prompt Editor Upgrades: JSON Mode & Advanced Parameters

JSON Mode for OpenAI models is now available in the prompt editor, as well as improved rendering for JSON outputs. In addition we’ve expanded our suite of parameters configurable in the prompt playground to include things like top_p, frequency_penalty, presence_penalty, and seed for applicable models.

Launch of Freeplay Public API

We’re excited to announce the official launch of our Public API, which provides full parity with our core SDKs for Python, Node, and Java. This release responds to customer requests for a versatile API solution that supports languages beyond our current SDKs and caters to those who prefer APIs over SDKs. Now, all customers can achieve the same integration experience using the Public API. More functionality for CRUD actions including the ability to export Sessions and update Prompt Templates or Datasets coming soon.