> ## Documentation Index
> Fetch the complete documentation index at: https://docs.freeplay.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Review Queues

> Streamline human review of your AI outputs with organized queues, team assignments, and actionable insights.

## Introduction

Streamline human review of your LLM systems with Freeplay's Review Queues. Organize work assignments, generate actionable insights, and transform observations into meaningful improvements.

Review Queues help you establish systematic, organized human review processes for your LLM systems in Freeplay. Easily select completions for your team to evaluate, assign specific work to team members, and generate comprehensive insight reports to share findings across your organization. Review Queues make it simple to maintain consistent review practices and transform observations into actionable improvements.

## Creating Review Queues

<img src="https://mintcdn.com/freeplay-485a287e/0Gd2SRSxIc4qaRiv/images/fb3d8bd0981196893476a0c23e0c2a797b4b9a24f07fdca222695eb52b1749ab-image.png?fit=max&auto=format&n=0Gd2SRSxIc4qaRiv&q=85&s=51e0fd85a6759aabc8ec9d3fe4dc5b01" alt="" width="3248" height="2112" data-path="images/fb3d8bd0981196893476a0c23e0c2a797b4b9a24f07fdca222695eb52b1749ab-image.png" />

From the Reviews tab, you can create a new Review Queue with customized instructions for your team and an optional due date to help manage project timelines effectively.

## Building Effective Review Queues

Review Queues serve multiple purposes: addressing issues flagged by evaluations, investigating team-identified concerns, or conducting systematic quality assessments. By creating thoughtfully curated review queues, you gain the ability to dive deep into your data, understand underlying patterns, identify areas for improvement, and drive meaningful product enhancements.

Teams that actively use Review Queues develop a much deeper understanding of their LLM applications, enabling them to implement targeted changes that deliver real improvements to their products.

### Adding Data to Review Queues

You can add Traces or Completions to a Review Queue for comprehensive analysis. Choose from two convenient methods:

Bulk AddIndividual Add

Perfect for adding multiple items at once:

1. **Search** across specific criteria such as metadata, evaluation scores, or input fields
2. **Select** multiple Completions from the filtered results
3. **Add** them all to your Review Queue in one action

<img src="https://mintcdn.com/freeplay-485a287e/CgjLL0ybwTxi2RvX/images/97253be6e98833c6f629888fda1047457e67f640dbc0a9a2613899f31e2506be-image.png?fit=max&auto=format&n=CgjLL0ybwTxi2RvX&q=85&s=b198790985e55466b336a30fe890d73c" alt="" width="3240" height="2112" data-path="images/97253be6e98833c6f629888fda1047457e67f640dbc0a9a2613899f31e2506be-image.png" />

### Managing Review Workflows

<img src="https://mintcdn.com/freeplay-485a287e/CgjLL0ybwTxi2RvX/images/7d6c4c99244700061dd5bd28870fce29c45fa0676c91b046fcf760f547dd9b80-image.png?fit=max&auto=format&n=CgjLL0ybwTxi2RvX&q=85&s=ab52919b85bbded1ace312f2d49ba57a" alt="" width="3248" height="2112" data-path="images/7d6c4c99244700061dd5bd28870fce29c45fa0676c91b046fcf760f547dd9b80-image.png" />

Once you've created your Review Queue, you can assign specific Completions to different team members based on their expertise and availability. This ensures the right people are reviewing the most relevant content.

Domain experts and analysts can efficiently work through their assigned Completions, providing detailed feedback and analysis. The interface is designed to streamline the review process while capturing comprehensive insights.

## Generating Actionable Insights

Every Review Queue automatically generates a comprehensive insights report, enabling analysts to:

* **Share findings** broadly across the organization
* **Highlight key takeaways** for stakeholders
* **Identify actionable improvements** for the LLM system
* **Track progress** over time

These insights reports transform individual review observations into strategic recommendations that drive meaningful system improvements.

<img src="https://mintcdn.com/freeplay-485a287e/CgjLL0ybwTxi2RvX/images/6de290e5561075cce6e0b4fd8d3eaea63ed4ff6b0d2e0c47eb92660eb66a1279-Screenshot_2025-01-25_at_12.48.38_PM.png?fit=max&auto=format&n=CgjLL0ybwTxi2RvX&q=85&s=78dc878f713a2be15b3d412b607c30d1" alt="" width="1050" height="1460" data-path="images/6de290e5561075cce6e0b4fd8d3eaea63ed4ff6b0d2e0c47eb92660eb66a1279-Screenshot_2025-01-25_at_12.48.38_PM.png" />

***

[Auto-categorization](/core-concepts/evaluations/auto-categorization)

[Datasets](/core-concepts/datasets/datasets)
