首页>
外国专利>
Systems and methods for multiple comparison correction during configurable application feature experiments
Systems and methods for multiple comparison correction during configurable application feature experiments
展开▼
机译:用于在可配置应用程序特性实验期间进行多次比较校正的系统和方法
展开▼
页面导航
摘要
著录项
相似文献
摘要
A method and apparatus for configurable application feature experiments is described. The method may include receiving a set of metrics to be collected after a feature treatment is deployed to configurable applications executed by a plurality of end user systems, a significance threshold for detection of feature treatment impact on one or more metrics within the set of metrics, and a request to perform multiple comparison correction when detecting the feature treatment impact. The method may also include receiving, from the configurable applications, event messages that include metric values associated with the set of metrics. Further, the method may also include performing a statistical analysis of the metric values to determine whether the feature treatment caused a statistically significant change in values associated with one or more of the metrics, where the statistical analysis adjusts one or more parameters used to perform the statistical analysis based on a multiple comparison correction analysis.
展开▼