Entropy
Entropy at a given node t:
(NOTE: p( j | t) is the relative frequency of class j at node t).
- Measures homogeneity of a node.
- Maximum (log nc) when records are equally distributed among all classes implying least information
- Minimum (0.0) when all records belong to one class, implying most information
- Entropy based computations are similar to the GINI index computations
Download di link berikut
Tugas Entropi (Arman)

Advertisement
