How it works
- You define category types that align with your business needs (e.g., product areas, user intent types, issue categories)
- For each category, you provide a clear name and description
- As logs flow through Freeplay, the AI classifies them according to your categories
- Categories appear in the observability dashboard for filtering and analysis
Use cases
- Usage analysis: Understand what types of questions users ask most frequently
- Issue identification: Track which product areas generate the most problems
- Dataset curation: Filter logs by category to build targeted test datasets
- Review queue creation: Focus review efforts on specific categories
Configuration
Auto-categorization is configured at the prompt template or agent level, similar to other evaluations:- Navigate to your prompt template or agent
- Create a new evaluation with type Multi-select
- Enable auto-categorization and define your categories
- Each category needs a name (max 32 characters) and description (max 500 characters)
- Configure whether items can be tagged with multiple categories or just one