Evaluation Forms let QA Managers create standardized assessments for Voice and Chat interactions. Each form aligns scoring with operational goals, ensures consistent evaluations across agent queues, and supports AutoQA and manual audits. QA Managers can set a minimum duration threshold to exclude short or incomplete contacts from scoring.
Each queue supports one evaluation form per channel. The system evaluates only ingested contacts that meet the duration threshold.
Key Features
| Feature | Description |
|---|
| Multi-language support | Localized metrics for accurate global team assessments |
| Flexible scoring | Percentage-based (simpler forms) or points-based (complex evaluations) |
| Advanced scoring options | Negative scoring, fatal criteria, and pass-score thresholds |
| Channel-specific configuration | Separate settings for Voice and Chat |
| Queue and channel assignment | Assign forms to specific queues and channels |
| AutoQA and manual audits | Evaluate interactions automatically or manually |
| Minimum Duration Threshold | Exclude contacts below a configured duration from AutoQA scoring |
- Evaluation Forms — defines the overall scoring structure, scoring type, language, channel, pass threshold, and queue assignments.
- Assignments — Maps the queues and conversation sources.
- Evaluation Metrics — defines the individual quality parameters used to measure agent performance.
QA managers create forms with weighted metrics totaling 100% and assign them to queues and channels for AutoQA scoring and manual audits.
How It Works
QA Managers create evaluation forms with weighted metrics (100% for percentage-based forms or flexible points for points-based forms). The system assigns these forms to specific queues and channels for auditing and AutoQA scoring.
Navigate to Quality AI > CONFIGURE > Evaluation Forms.
The list shows the following columns:
| Column | Description |
|---|
| Name | Evaluation form name |
| Description | Short description |
| Queues | Assigned and unassigned queues |
| Channel | Voice or Chat |
| Created By | Form creator |
| Pass Score | Minimum score for the agent to pass |
| Status | Enable or disable scoring for this form |
| Search | Quick search by name |
Enable Auto QA in Quality AI Settings before creating evaluation forms.
- Select the Evaluation Forms tab.
- Select + New Evaluation Forms in the upper right.
The creation process has three sections: General Settings, Assignments, and Evaluation Metrics.
General Settings
- Enter a Name and optional Description.
- Select the required Language.
- Select a Channel:
- Chat-shows only Chat-relevant metrics; excludes speech-based and Voice-specific Playbook metrics.
- Voice-shows all Voice-related metrics, including speech and Playbook metrics.
- Select a Scoring Type (Percentage or Points).
- (Optional) Toggle on to Set the minimum duration required to complete evaluations.
- Enter a threshold value in minutes (MIN) and seconds (SEC).
- Set the minimum Pass Score.
- Select Next.
Assignments
Assignments define queues and conversation sources.
- Search and select queues.
- Select Add Queues.
- Add or remove queues as needed.
- Select Conversation Source:
- Quality AI Express-Express-based processing.
- CCAI Integration-Ingests conversation data from CCAI.
- Agent AI Integration-Processes interactions from Agent AI.
- Select Next.
If you assign CCAI or Agent AI queues together with Quality AI Express queues in the same form, By Playbook and By Dialog metrics become unavailable.
Queue Assignment Rules
- One form per queue per channel.
- Users see only queues they can access.
- Metric availability depends on channel, conversation source, and language.
Evaluation Metrics
- Use the search bar to find evaluation metrics.
- Add the selected metrics to the form.
- Select Edit to configure each metric.
- Choose the correct Response (what constitutes a match for this metric).
- Assign a Weightage based on the scoring type:
-
Percentage-enter a percentage value.
-
Points-enter a points value.
Outcome Configuration
For each metric, define outcomes (for example, Yes or No) and assign positive, zero, or negative weight based on the expected response.
- Optionally enable Fatal Error for compliance-critical metrics.
- Select Create to finalize the form.
How Minimum Duration Threshold Works
The minimum duration threshold defines the shortest contact duration that qualifies for AutoQA evaluation on an evaluation form. Before scoring begins, the evaluation engine checks the contact duration against the configured threshold.
The system evaluates contact duration before scoring.
| Contact Duration Status | Assigned Result | Notes |
|---|
| Meets or exceeds threshold | — | Evaluated normally. |
| Falls below threshold | Below Threshold | Excluded from scoring and quality metrics. |
| Duration Unresolved | Duration unavailable | Excluded from evaluation. |
Duration Calculation By Channel
| Channel | Duration Measured As |
|---|
| Voice | Full call duration, including hold time. |
| Chat | Time between the first and last message timestamps. |
| Quality AI Express (FTP) | Based on the start_time and end_time fields. |
The system may exclude a contact for one scorecard but evaluate it for another if their thresholds differ. Leaving this disabled will evaluate all contacts, and supervisors can manually evaluate contacts that were excluded.
Scoring Types
Percentage-Based
- Assign metric weights as percentages.
- Total weight must equal 100%.
- Best for smaller forms (fewer than 20 metrics).
Points-Based
- Assign metric weights as point values-no upper limit on total positive points.
- Total negative points can’t exceed total positive points.
- Recommended for complex forms (20+ metrics, ideal for 40+).
- Supports Manual Evaluation metrics.
Points-Based Formula:
Kore Evaluation Score = [∑(Myi × Wyi) − ∑(Mni × Wni) / ∑(Wyi)] × 100
Where:
- Myi, Wyi = adhered metrics and positive points
- Mni, Wni = non-adhered metrics and negative points
Scoring Logic
- Pass-score ≥ Pass Score threshold.
- Fail-score < Pass Score threshold.
- Fatal error-sets the score to 0 and marks the interaction as failed, regardless of other metric scores.
Comparison
| Feature | Percentage-Based | Points-Based |
|---|
| Best for | Smaller forms (under ~20 metrics) | Larger forms (20+ metrics) |
| Total weight | Must equal 100% | No fixed maximum |
| Scalability | Limited by 100% cap | High flexibility |
| Weight per metric | Decreases as metrics increase | Assign any point value |
| Negative scoring | Managed within 100% | Allowed, can’t exceed total positive |
| Final score | Direct percentage (0-100) | Normalized to percentage (0-100) |
Language Selection
- Evaluation forms support multi-language selection.
- The system shows only By-Question metrics configured for all selected languages (AND condition).
- Example: selecting English and Dutch shows only metrics available in both.
- Select the three-dot menu next to the form.
- Select Edit to update, or Delete to remove.
- Select Update to save changes.
Switching Scoring Types
Changing the scoring type clears all existing metric weights and requires reconfiguration. Ensure the total meets validation rules for the new type.
Warnings and Error Handling
Language Configuration Warnings
Changes to language settings can affect speech recognition accuracy and metric results.
Metric Deletion Warnings
- The system shows a warning if any form uses the metric.
- Remove the metric from all associated forms before deleting.
- Reassign any linked attributes to a different metric.
- Deletion is only possible after all dependencies are resolved.
This error occurs when you add a language to a form, but some metrics don’t support it.
To resolve:
- Review language settings for each metric in the form.
- Update each metric to support the new language.
- Add the language to the form after updating all metrics.
Metric-Level Language Limitation
This warning appears when a metric doesn’t support a language configured at the form level.
To resolve:
- Configure the required language in the metric.
- Or replace the metric with one that supports all form languages.
Channel Mode Change Warning
- Switching between Voice and Chat deletes speech-based metrics automatically.
- Update remaining metrics and adjust weights accordingly.
- Select Update to save.
