A/B experiment validation implementations are presented that generally validate an A/B experiment prior to its release. One implementation involves employing multiple test execution engines to test a A/B experiment, and then aggregating the results. More particularly, a request to validate an A/B experiment is received from a requesting entity along with data pertaining to the A/B experiment. A category of the A/B experiment is then determined, and test execution engines applicable to the A/B experiment category are identified. For each test execution engine identified, the A/B experiment data is passed to the test execution engine, the test execution engine is requested to execute a test for the A/B experiment, and test results from the test of the A/B experiment are received. Once test results are received from the identified test execution engines, the test results are aggregated to produce a validation indicator.
展开▼
