class DecisionTreeID3wp extends DecisionTreeID3
The DecisionTreeID3wp class implements a Decision Tree classifier using the
ID3 algorithm with pruning. The classifier is trained using a data matrix 'x' and a
classification vector 'y'. Each data vector in the matrix is classified into
one of 'k' classes numbered '0, ..., k-1'. Each column in the matrix represents
a feature (e.g., Humidity). The 'vc' array gives the number of distinct values
per feature (e.g., 2 for Humidity).
- Alphabetic
- By Inheritance
- DecisionTreeID3wp
- DecisionTreeID3
- DecisionTree
- ClassifierInt
- Error
- Classifier
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
DecisionTreeID3wp(x: MatriI, y: VectoI, fn_: Strings = null, k: Int = 2, cn_: Strings = null, vc_: Array[Int] = null, td_: Int = -1)
- x
the data vectors stored as rows of a matrix
- y
the class array, where y_i = class for row i of the matrix x
- fn_
the names for all features/variables
- k
the number of classes
- cn_
the names for all classes
- vc_
the value count array indicating number of distinct values per feature
- td_
the maximum tree depth to allow (defaults to 0 => number of features, -1 no constraint
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
buildTree(path: List[(Int, Int)], depth: Int): FeatureNode
Recuresively build the decision tree given a path e.g.
Recuresively build the decision tree given a path e.g. ((outlook, sunny), ...).
- path
an existing path in the tree ((feature, value), ...)
- depth
the depth of the subtree being built
- Definition Classes
- DecisionTreeID3
-
def
calcCorrelation: MatriD
Calculate the correlation matrix for the feature vectors 'fea'.
Calculate the correlation matrix for the feature vectors 'fea'. If the correlations are too high, the independence assumption may be dubious.
- Definition Classes
- ClassifierInt
-
def
calcCorrelation2(zrg: Range, xrg: Range): MatriD
Calculate the correlation matrix for the feature vectors of Z (Level 3) and those of X (level 2).
Calculate the correlation matrix for the feature vectors of Z (Level 3) and those of X (level 2). If the correlations are too high, the independence assumption may be dubious.
- zrg
the range of Z-columns
- xrg
the range of X-columns
- Definition Classes
- ClassifierInt
-
def
classify(z: VectoI): (Int, String, Double)
Given a data vector z, classify it returning the class number (0, ..., k-1) by following a decision path from the root to a leaf.
Given a data vector z, classify it returning the class number (0, ..., k-1) by following a decision path from the root to a leaf. If no branch found given maximal decision of current node. Return the best class, its name and FIX.
- z
the data vector to classify
- Definition Classes
- DecisionTreeID3 → Classifier
-
def
classify(xx: MatriI): VectoI
Classify all of the row vectors in matrix 'xx'.
Classify all of the row vectors in matrix 'xx'.
- xx
the row vectors to classify
- Definition Classes
- ClassifierInt
-
def
classify(z: VectoD): (Int, String, Double)
Given a new continuous data vector 'z', determine which class it fits into, returning the best class, its name and its relative probability.
Given a new continuous data vector 'z', determine which class it fits into, returning the best class, its name and its relative probability. Override in classes that require precise real values for classification.
- z
the real vector to classify
- Definition Classes
- ClassifierInt → Classifier
-
def
clone(): AnyRef
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @native() @throws( ... )
-
var
cn: Strings
- Attributes
- protected
- Definition Classes
- ClassifierInt
-
def
compareModel(folds: Int, threshold: Double): Unit
This method is used to compare pruned versus unpruned via cross validation.
This method is used to compare pruned versus unpruned via cross validation.
- folds
specfies the fold required for CV
- threshold
specifies the user-defined threshold for pruning
-
def
crossValidate(nx: Int = 10, show: Boolean = false): Double
Test the accuracy of the classified results by cross-validation, returning the accuracy.
Test the accuracy of the classified results by cross-validation, returning the accuracy. The "test data" starts at 'testStart' and ends at 'testEnd', the rest of the data is "training data'. FIX - should return a StatVector
- nx
the number of crosses and cross-validations (defaults to 10x).
- show
the show flag (show result from each iteration)
- Definition Classes
- Classifier
-
def
crossValidateRand(nx: Int = 10, show: Boolean = false): Double
Test the accuracy of the classified results by cross-validation, returning the accuracy.
Test the accuracy of the classified results by cross-validation, returning the accuracy. This version of cross-validation relies on "subtracting" frequencies from the previously stored global data to achieve efficiency. FIX - are the comments correct? FIX - should return a StatVector
- nx
number of crosses and cross-validations (defaults to 10x).
- show
the show flag (show result from each iteration)
- Definition Classes
- Classifier
-
def
dataset(f: Int, path: List[(Int, Int)]): Array[(Int, Int)]
Extract column from matrix, filtering out (x-value, y-value) pairs that are not on path.
Extract column from matrix, filtering out (x-value, y-value) pairs that are not on path.
- f
the feature to consider (e.g., 2 (Humidity))
- path
the path -- FIX explain
- Definition Classes
- DecisionTreeID3
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
featureSelection(TOL: Double = 0.01): Unit
Perform feature selection on the classifier.
Perform feature selection on the classifier. Use backward elimination technique, that is, remove the least significant feature, in terms of cross- validation accuracy, in each round.
- TOL
tolerance indicating negligible accuracy loss when removing features
- Definition Classes
- ClassifierInt
-
def
finalize(): Unit
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
def
fit(y: VectoI, yp: VectoI, k: Int = 2): VectoD
Return the quality of fit including 'acc', 'prec', 'recall', 'kappa'.
Return the quality of fit including 'acc', 'prec', 'recall', 'kappa'. Override to add more quality of fit measures.
- y
the actual class labels
- yp
the predicted class labels
- k
the number of class labels
- Definition Classes
- Classifier
- See also
ConfusionMatmedium.com/greyatom/performance-metrics-for-classification-problems-in-machine-learning-part-i-b085d432082b
-
def
fitLabel: Seq[String]
Return the labels for the fit.
Return the labels for the fit. Override when necessary.
- Definition Classes
- Classifier
-
def
fitMap(y: VectoI, yp: VectoI, k: Int = 2): Map[String, String]
Build a map of quality of fit measures (use of
LinedHashMapmakes it ordered).Build a map of quality of fit measures (use of
LinedHashMapmakes it ordered). Override to add more quality of fit measures.- y
the actual class labels
- yp
the predicted class labels
- k
the number of class labels
- Definition Classes
- Classifier
-
final
def
flaw(method: String, message: String): Unit
- Definition Classes
- Error
-
var
fn: Strings
- Attributes
- protected
- Definition Classes
- ClassifierInt
-
def
frequency(dset: Array[(Int, Int)], value: Int): (Double, VectoI, VectoD)
Given a feature column (e.g., 2 (Humidity)) and a value (e.g., 1 (High)) use the frequency of occurrence of the value for each classification (e.g., 0 (no), 1 (yes)) to estimate k probabilities.
Given a feature column (e.g., 2 (Humidity)) and a value (e.g., 1 (High)) use the frequency of occurrence of the value for each classification (e.g., 0 (no), 1 (yes)) to estimate k probabilities. Also, determine the fraction of training cases where the feature has this value (e.g., fraction where Humidity is High = 7/14).
- dset
the list of dataset pairs to consider (e.g., (x-value, y-value))
- value
one of the possible values for this feature (e.g., 1 (High))
- Definition Classes
- DecisionTreeID3
-
val
fset: Array[Boolean]
the set of features to turn on or off.
the set of features to turn on or off. All features are on by default. Used for feature selection.
- Attributes
- protected
- Definition Classes
- ClassifierInt
-
def
gain(f: Int, dset: Array[(Int, Int)]): (Double, VectoI)
Compute the information gain due to using the values of a feature/attribute to distinguish the training cases (e.g., how well does Humidity with its values Normal and High indicate whether one will play tennis).
Compute the information gain due to using the values of a feature/attribute to distinguish the training cases (e.g., how well does Humidity with its values Normal and High indicate whether one will play tennis).
- f
the feature to consider (e.g., 2 (Humidity))
- dset
the possibly restricted dataset to consider
- Definition Classes
- DecisionTreeID3
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
val
m: Int
the number of data vectors in training/test-set (# rows)
the number of data vectors in training/test-set (# rows)
- Attributes
- protected
- Definition Classes
- ClassifierInt
-
val
md: Double
the training-set size as a Double
the training-set size as a Double
- Attributes
- protected
- Definition Classes
- ClassifierInt
-
def
mode(y: Array[Int]): Int
Find the most frequent classification.
Find the most frequent classification.
- y
the array of discrete classifications
- Definition Classes
- DecisionTree
-
def
multivalued(x: MatriD): Boolean
Determine whether the matrix 'x' is multivalued (>= 2 distinct rows).
Determine whether the matrix 'x' is multivalued (>= 2 distinct rows).
- x
the given vector
- Definition Classes
- DecisionTree
-
val
n: Int
the number of features/variables (# columns)
the number of features/variables (# columns)
- Attributes
- protected
- Definition Classes
- ClassifierInt
-
val
nd: Double
the feature-set size as a Double
the feature-set size as a Double
- Attributes
- protected
- Definition Classes
- ClassifierInt
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
printTree(vc: Array[Int]): Unit
Print the decision tree using 'prinT' method from
Nodeclass.Print the decision tree using 'prinT' method from
Nodeclass.- vc
the value count array (number of values for each feature)
- Definition Classes
- DecisionTree
-
def
prune(threshold: Double, fold: Int = 5): DecisionTreeID3
Prune the tree.
Prune the tree. If entropy of node considered for pruning < threshold, then remove the node from the decision tree.
- threshold
user-specified threshold which controls pruning.
- fold
defines cross-validation folds
-
def
reset(): Unit
Reset or re-initialize counters, if needed.
Reset or re-initialize counters, if needed.
- Definition Classes
- DecisionTree
-
def
shiftToZero(): Unit
Shift the 'x' Matrix so that the minimum value for each column equals zero.
Shift the 'x' Matrix so that the minimum value for each column equals zero.
- Definition Classes
- ClassifierInt
-
def
size: Int
Return the number of data vectors/points in the entire dataset (training + testing),
Return the number of data vectors/points in the entire dataset (training + testing),
- Definition Classes
- ClassifierInt → Classifier
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
var
td: Int
- Attributes
- protected
- Definition Classes
- DecisionTreeID3
-
def
test(xx: MatriI, yy: VectoI): Double
Test the quality of the training with a test-set and return the fraction of correct classifications.
Test the quality of the training with a test-set and return the fraction of correct classifications.
- xx
the integer-valued test vectors stored as rows of a matrix
- yy
the test classification vector, where 'yy_i = class' for row 'i' of 'xx'
- Definition Classes
- ClassifierInt
-
def
test(itest: IndexedSeq[Int]): Double
Test the quality of the training with a test-set and return the fraction of correct classifications.
Test the quality of the training with a test-set and return the fraction of correct classifications.
- itest
indices of the instances considered test data
- Definition Classes
- ClassifierInt → Classifier
-
def
test(testStart: Int, testEnd: Int): Double
Test the quality of the training with a test dataset and return the fraction of correct classifications.
Test the quality of the training with a test dataset and return the fraction of correct classifications. Can be used when the dataset is randomized so that the testing/training part of a dataset corresponds to simple slices of vectors and matrices.
- testStart
the beginning of test region (inclusive).
- testEnd
the end of test region (exclusive).
- Definition Classes
- Classifier
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
def
train(itest: IndexedSeq[Int]): DecisionTreeID3
Train the decision tree.
Train the decision tree.
- itest
the indices for the test data
- Definition Classes
- DecisionTreeID3 → Classifier
-
def
train(): Classifier
Train the classifier by computing the probabilities from a training dataset of data vectors and their classifications.
Train the classifier by computing the probabilities from a training dataset of data vectors and their classifications. Must be implemented in any extending class. Can be used when the whole dataset is used for training.
- Definition Classes
- Classifier
-
def
train(testStart: Int, testEnd: Int): Classifier
Train the classifier by computing the probabilities from a training dataset of data vectors and their classifications.
Train the classifier by computing the probabilities from a training dataset of data vectors and their classifications. Must be implemented in any extending class. Can be used when the dataset is randomized so that the training part of a dataset corresponds to simple slices of vectors and matrices.
- testStart
starting index of test region (inclusive) used in cross-validation
- testEnd
ending index of test region (exclusive) used in cross-validation
- Definition Classes
- Classifier
-
var
vc: Array[Int]
- Attributes
- protected
- Definition Classes
- DecisionTreeID3
-
def
vc_default: Array[Int]
Return default values for binary input data (value count 'vc' set to 2).
Return default values for binary input data (value count 'vc' set to 2).
- Definition Classes
- ClassifierInt
-
def
vc_fromData: Array[Int]
Return value counts calculated from the input data.
Return value counts calculated from the input data. May wish to call 'shiftToZero' before calling this method.
- Definition Classes
- ClassifierInt
-
def
vc_fromData2(rg: Range): Array[Int]
Return value counts calculated from the input data.
Return value counts calculated from the input data. May wish to call 'shiftToZero' before calling this method.
- rg
the range of columns to be considered
- Definition Classes
- ClassifierInt
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @throws( ... )