APPARATUS AND METHOD FOR ESTIMATING CUMULATIVE ENTROPY USING RELATIVE INDEPENDENCY

摘要

The present invention provides an apparatus and a method for estimating cumulative entropy using relative independence, capable of statistically estimating the minimum value of the entropy for a repeated sample by monitoring the minimum entropy of a sequential sample based on a statistical theory using a statistical distance (SD) of a sample space and relative independence of the repeated sample. The apparatus includes: an entropy input unit that collects noise sources through initial idle rotation by at least N bits which are preset by a user; a random number counter management unit that stores the noise sources, which are collected by the input unit, into a random number pool, and selects the size of a component-vector to manage a counter; a probability distribution estimation unit that estimates component probability distributions X and Y and vector coupling probability distributions (X,Y) of the sample using the counter managed by the random number counter management unit; a relative independence measurement unit that calculates relative independence (RI) using the probability distribution of the sample counter estimated by the probability distribution estimation unit and calculates a lower limit of vector entropy of the repetition sample using the component entropy of the noise source (H_(X), H_) and the relative independence; and a cumulative entropy output unit that outputs vector entropy of a sample cumulative amount calculated by the relative independence measurement unit.