Flow Health Dashboard - NLP

The Flow Health dashboard summarizes how well the flows of your app are performing and shows the coverage of intents and transitions in the app definition. It displays the overall pass or fail percentage of test cases with options to view transition coverage and intent summaries. Use the test result analysis to identify issues in dialog task definitions and fix them with actionable recommendations to improve overall flow health. Go to: Testing > Regression Testing > Health & Monitoring > Flow tab

Flow Metrics

The Flow Health dashboard aggregates all test suite results from Conversation Testing and presents the following metrics:

Metric	Description
Pass	Total number of test cases passed across all test suites.
Fail	Total number of test cases failed across all test suites.
Not Executed	Total number of test cases aborted or not executed across all test suites.

View Test Suites

Click View Test Suites to see all test suites considered for the app:

Column	Description
Test Suite	Name of the test suite.
Result	Result of the test suite: Passed, Failed, Aborted, or Not Executed.
Duration	Time taken to execute the test suite.
Test Cases	Total number of test cases in the suite.
Pass	Number of test cases that passed.
Fail	Number of test cases that failed.
Not Executed	Number of test cases not executed.
Pass %	Overall pass percentage of the test cases.

Click a Test Suite Name to analyze its test results. Select the Test Coverage tab to view which Dialog Intents, FAQs, and Small Talks are covered or not covered in the suite.

The Flow Health dashboard considers standard responses in test cases when calculating overall percentages, but has no separate summary tile for Standard Responses. This may cause slight differences in overall counts or percentages.

Dialog Intent Summary

The Dialog Intent Summary shows test results analysis for dialog intents from Conversation Testing, including insights into flow transitions that are covered and missed.

All test cases across test suites that expect a dialog node for assertion are considered when generating the flow summary.

Transitions Coverage

The Transitions Coverage section shows how many transitions in your app definition are covered by test cases.

Metric	Description
Total Transitions Covered	All covered transitions out of total transitions in the app definition.
Covered	Number of transitions covered in test cases.
Not Covered	Percentage of transitions not covered in test cases.

Click the icon beside the percentages to open the Dialog Transitions page:

Column	Description
Task Name	Name of the dialog intent.
From Node	Starting node of the transition.
To Node	Destination node of the transition.
Status	Whether the transition is covered or not covered.

Use the From Node, To Node, and Coverage Status filters to search and filter transitions. Click the icon beside Not Covered to view only missed transitions, then create a new test suite to record and cover them. See Conversation Testing.

Conversation Test Results Analysis

The Conversation Test Results Analysis section summarizes all test suite results:

Metric	Description
Total Test Cases	Total number of test cases in the test suite.
Pass	Count and percentage of test cases that passed.
Fail	Count and percentage of test cases that failed.
Not Executed	Count and percentage of test cases not executed.

View Intent Summary

Click View Intent Summary to open the Dialog Intent Details view, which shows all intents covered in a test suite with:

Total transitions covered and missed.
Percentage of test cases with Pass, Fail, or Not Executed status per intent.

Click Covered By for any intent to see which test suites cover it and the breakdown of transitions and test case results. Click the > icon on any intent to open its intent details summary, then click a Test Suite Name to view that suite’s test results analysis. A test case failure typically indicates a mismatch between expected and actual output. See Test Case Assertion.

FAQ Summary

The FAQ Summary section displays FAQ coverage and Conversation Test Results Analysis for all FAQ intents across the selected test suite. Click View Intent Summary to open the FAQ Intent Details window:

Column	Description
Intent Name	Name of the FAQ intent.
Path	Node path in the Knowledge Graph.
Covered by (Test Suites)	Number of test suites covering the FAQ intent.
Total Test Cases	Number of test cases for that FAQ intent.
Pass	Number of FAQ test cases that passed.
Fail	Number of FAQ test cases that failed.
Not Executed	Number of FAQ test cases not executed.
Pass %	Overall pass percentage.

Small Talk Summary

The Small Talk Summary section displays Small Talk coverage and Conversation Test Results Analysis for all Small Talk intents in the selected test suite. Click View Intent Summary to open the Small Talk Details window:

Column	Description
Intent Name	Intent name from the Small Talk interaction.
Group	Group to which the Small Talk interaction is mapped.
Covered by (Test Suites)	Number of test suites covering the Small Talk intent.
Total Test Cases	Number of test cases for that Small Talk intent.
Pass	Number of Small Talk test cases that passed.
Fail	Number of Small Talk test cases that failed.
Not Executed	Number of Small Talk test cases not executed.
Pass %	Overall pass percentage.

​Flow Metrics

​View Test Suites

​Dialog Intent Summary

​Transitions Coverage

​Conversation Test Results Analysis

​View Intent Summary

​FAQ Summary

​Small Talk Summary

Flow Metrics

View Test Suites

Dialog Intent Summary

Transitions Coverage

Conversation Test Results Analysis

View Intent Summary

FAQ Summary

Small Talk Summary