class NeuralNet_3L extends NeuralNet
The NeuralNet_3L class supports multi-output, 3-layer (input, hidden and output)
Neural-Networks. It can be used for both classification and prediction,
depending on the activation functions used. Given several input vectors and output
vectors (training data), fit the weights/parameters 'aa' and 'bb' connecting the layers,
so that for a new input vector 'v', the net can predict the output value, i.e.,
yp = f2 (bb * f1V (aa * v))
where 'f1' and 'f2' are the activation functions and the parameter matrices 'aa' and 'bb' gives the weights between input-hidden and hidden-output layers. Note, if 'a0' is to be treated as bias/intercept, 'x0' must be 1.0.
- Alphabetic
- By Inheritance
- NeuralNet_3L
- NeuralNet
- Error
- Predictor
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
NeuralNet_3L(x: MatriD, y: MatriD, nz: Int = -1, eta: Double = 0.1, bsize: Int = 5, f1: FunctionS2S = sigmoid, f1D: FunctionM_2M = sigmoidDM, f2: FunctionS2S = sigmoid, f2D: FunctionM_2M = sigmoidDM)
- x
the m-by-nx input matrix (training data consisting of m input vectors)
- y
the m-by-ny output matrix (training data consisting of m output vectors)
- nz
the number of nodes in hidden layer
- eta
the learning/convergence rate (typically less than 1.0)
- f1
the input-hidden layer activation function (mapping scalar => scalar)
- f1D
the derivative of the vector activation function
Value Members
-
def
coefficient: VectoD
Return the vector of coefficient/parameter values.
Return the vector of coefficient/parameter values.
- Definition Classes
- Predictor
-
def
crossVal(k: Int = 10): Unit
Perform 'k'-fold cross-validation.
-
def
crossValidate(algor: (MatriD, MatriD) ⇒ NeuralNet, k: Int = 10): Array[Statistic]
- Definition Classes
- NeuralNet
- var eta: Double
-
def
eval(xx: MatriD, yy: MatriD): Unit
Evaluate the quality of the fit for the parameter/weight matrices on the test dataset.
Evaluate the quality of the fit for the parameter/weight matrices on the test dataset.
- xx
the test input data matrix
- yy
the test output response matrix
- Definition Classes
- NeuralNet
-
def
eval(): Unit
Evaluate the quality of the fit for the parameter weight matrices on the the entire dataset or the training dataset.
-
def
eval(xx: MatriD, yy: VectoD): Unit
Compute the error and useful diagnostics for the test dataset.
Compute the error and useful diagnostics for the test dataset.
- xx
the test data matrix
- yy
the test response vector FIX - implement in classes
- Definition Classes
- Predictor
-
def
fitLabel: Seq[String]
Return the labels for the quality of fit measures.
Return the labels for the quality of fit measures.
- Definition Classes
- NeuralNet
-
def
fitMap(): Unit
Show 'fitMap' for each y-column.
Show 'fitMap' for each y-column.
- Definition Classes
- NeuralNet
-
final
def
flaw(method: String, message: String): Unit
- Definition Classes
- Error
-
def
predict(x: MatriD): MatriD
Given a new input matrix 'z', predict the output/response matrix 'f(z)'.
Given a new input matrix 'z', predict the output/response matrix 'f(z)'.
- Definition Classes
- NeuralNet_3L → NeuralNet
-
def
predict(z: VectoD): Double
Given a new input vector 'z', predict the output/response value 'f(z)'.
-
def
predict(z: VectoI): Double
Given a new discrete data vector z, predict the y-value of f(z).
Given a new discrete data vector z, predict the y-value of f(z).
- z
the vector to use for prediction
- Definition Classes
- Predictor
-
def
predictV(v: VectoD): VectoD
Given a new input vector 'v', predict the output/response vector 'f(v)'.
Given a new input vector 'v', predict the output/response vector 'f(v)'.
- v
the new input vector
- Definition Classes
- NeuralNet_3L → NeuralNet
-
def
reset(eta_: Double): Unit
Reset the learning rate 'eta'.
-
def
residual: VectoD
Return the vector of residuals/errors.
Return the vector of residuals/errors.
- Definition Classes
- Predictor
-
def
setWeights(stream: Int = 0, limit: Double = 1.0 / sqrt (nx)): Unit
Set the initial weight matrices 'aa' and 'bb' with values in (0, limit) before training.
Set the initial weight matrices 'aa' and 'bb' with values in (0, limit) before training.
- stream
the random number stream to use
- limit
the maximum value for any weight
- Definition Classes
- NeuralNet_3L → NeuralNet
-
def
train(): NeuralNet_3L
Given training data 'x' and 'y', fit the parameter/weight matrices 'aa' and 'bb'.
Given training data 'x' and 'y', fit the parameter/weight matrices 'aa' and 'bb'. Iterate over several epochs, where each epoch divides the training set into 'nbat' batches. Each batch is used to update the weights.
- Definition Classes
- NeuralNet_3L → NeuralNet
-
def
train(yy: VectoD): NeuralNet
Given training data 'x' and 'yy', fit the parameter/weight matrix.
-
def
weights: Array[MatriD]
Return the weight matrices 'aa' and 'bb'.
Return the weight matrices 'aa' and 'bb'.
- Definition Classes
- NeuralNet_3L → NeuralNet