Overview
Want to make changes to your matching configuration and test the changes to confirm they have the intended effect? Well now you can with the Matching Simulation UI!
The matching simulation tool makes it easy to make changes that you can be confident about.
The matching simulation UI brings more knowledge to the hands of your admin. From the match configuration page, you can access two kinds of simulation testing:
Test the configuration against specific activities to verify that they result in the matches that they want.
Test the configuration against the original configuration to see, at an aggregate, how many activities would be affected and the expected change to match quality.
Let’s get into how you can make that happen.
Where to Find the Specific Activity Simulation UI
You can find the “Test” button in the bottom right corner of the Configuration Profile’s Matching tab.
There are two ways to run a simulation test:
Test Specific Activities - If there are specific activities that you are trying to influence with the changes you’ve made, you can choose them and test using your changes.
You can specify a list of past activities and compare the original match to what it would be given the current (unsaved) configuration.
Should you need to narrow down the initial list of activities for selection, you have a few options. You can use the:
Search bar: Search for a specific participant, account or opportunity.
Date filter: Use the predefined time ranges or the calendar widget to specify your desired time range.
Matching dropdown: This dropdown can be used to filter by matched or unmatched activities.
Note that only activities which have been matched using the current configuration profile, will appear for selection. If you cannot find the activity you are looking for, it may have been matched using a different configuration profile, and hence would not be affected by the changes you are making to this configuration profile.
Clicking on any of the activities in the Activity Selection section will move them over to the Baseline Set. Once you have the list of activities you want to compare, hit the “Run Simulation” button at the bottom of the list.
The green activities are the activities that would match differently due to the change in configuration, whereas the gray activities would keep the same match. These results can help determine whether or not the prospective changes you’ve made to a configuration profile are done correctly.
Large Scale Test
Instead of testing the new configuration on specific activities, you can test on a large sampled set of activities to estimate how many activities will have new matches as a result of these changes.
When this test is run, the system runs a large-scale simulation:
Up to a 10K sample of activities is taken, using a 10-day lookback.
Only activities which were previously matched using the current configuration profile, are included in the sample.
Both emails and meetings will be included in the simulation
It will take some time (30 minutes to several hours) to complete. Once it is completed, you (the logged-in user) will receive an email with the test results.
The test results will show before and after values for match quality metrics such as:
Match rate & breakdown - What % of activities were matched to Accounts, Opportunities, etc, what % activities were unmatched.
Match changes - What % of activities have a different match result with the new configuration. You can also see a breakdown of those activities:
Changed Matches Breakdown - gives you a better idea of where the differences are if there are changed matches:
Unchanged match with previous - matched before, same match now
“Unchanged no match with previous” - didn’t match before, didn’t match now
“New match with previous” - didn’t match before, match now
“More specific match with previous” - Account match before, Oppty match now
“Different match with previous” - matched before, different match now (does not include “More specific match with previous”)
The email also contains a list of example activities for each of these change categories, in case you want to review them to see if the new matches are better.
--
Have any questions on Matching? Check out our main article on Matching or reach out to our Support team at support@backstory.ai!