CNN_1D

scalation.modeling.neuralnet.CNN_1D
See theCNN_1D companion object
class CNN_1D(x: MatrixD, y: MatrixD, fname_: Array[String], nf: Int, nc: Int, hparam: HyperParameter, f: AFF, f1: AFF, val itran: FunctionM2M) extends PredictorMV, Fit

The CNN_1D class implements a Convolutionsl Network model. The model is trained using a data matrix x and response matrix y.

Value parameters

f

the activation function family for layers 1->2 (input to hidden)

f1

the activation function family for layers 2->3 (hidden to output)

fname_

the feature/variable names (defaults to null)

hparam

the hyper-parameters for the model/network

itran

the inverse transformation function returns responses to original scale

nc

the width of the filters (size of cofilters)

nf

the number of filters for this convolutional layer

x

the input/data matrix with instances stored in rows

y

the output/response matrix, where y_i = response for row i of matrix x

Attributes

Companion
object
Graph
Supertypes
trait Fit
trait FitM
trait PredictorMV
trait Model
class Object
trait Matchable
class Any
Show all

Members list

Type members

Inherited classlikes

case class BestStep(col: Int, qof: VectorD, mod: PredictorMV & Fit)

The BestStep is used to record the best improvement step found so far. Only considers the first response variable y(0) => qof(?, 0).

The BestStep is used to record the best improvement step found so far. Only considers the first response variable y(0) => qof(?, 0).

Value parameters

col

the column/variable to ADD/REMOVE for this step

mod

the model including selected features/variables for this step

qof

the Quality of Fit (QoF) for this step

Attributes

Inherited from:
PredictorMV
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Value members

Concrete methods

def buildModel(x_cols: MatrixD): CNN_1D

Build a sub-model that is restricted to the given columns of the data matrix.

Build a sub-model that is restricted to the given columns of the data matrix.

Value parameters

x_cols

the columns that the new model is restricted to

Attributes

def filter(i: Int, f: Int): VectorD

Filter the i-th input vector with the f-th filter.

Filter the i-th input vector with the f-th filter.

Value parameters

f

the index of the f-th filter

i

the index of the i-th row of the matrix

Attributes

override def parameters: NetParams

Return the parameters c and b.

Return the parameters c and b.

Attributes

Definition Classes

Given a new input vector z, predict the output/response vector f(z).

Given a new input vector z, predict the output/response vector f(z).

Value parameters

z

the new input vector

Attributes

override def predict(z: MatrixD): MatrixD

Given an input matrix z, predict the output/response matrix f(z).

Given an input matrix z, predict the output/response matrix f(z).

Value parameters

z

the input matrix

Attributes

Definition Classes
def test(x_: MatrixD, y_: MatrixD): (MatrixD, MatrixD)

Test a predictive model y_ = f(x_) + e and return its QoF vector. Testing may be be in-sample (on the training set) or out-of-sample (on the testing set) as determined by the parameters passed in. Note: must call train before test.

Test a predictive model y_ = f(x_) + e and return its QoF vector. Testing may be be in-sample (on the training set) or out-of-sample (on the testing set) as determined by the parameters passed in. Note: must call train before test.

Value parameters

x_

the testing/full data/input matrix (defaults to full x)

y_

the testing/full response/output matrix (defaults to full y)

Attributes

def train(x_: MatrixD, y_: MatrixD): Unit

Given training data x_ and y_, fit the parametera a and b. This is a simple algorithm that iterates over several epochs using gradient descent. It does not use batching nor a sufficient stopping rule. In practice, use the train or train2 methods that use better optimizers.

Given training data x_ and y_, fit the parametera a and b. This is a simple algorithm that iterates over several epochs using gradient descent. It does not use batching nor a sufficient stopping rule. In practice, use the train or train2 methods that use better optimizers.

Value parameters

x_

the training/full data/input matrix

y_

the training/full response/output matrix

Attributes

override def train2(x_: MatrixD, y_: MatrixD): Unit

Given training data x_ and y_, fit the parameters c and b. Iterate over several epochs, where each epoch divides the training set into batches. Each batch is used to update the weights. FIX - to be implemented

Given training data x_ and y_, fit the parameters c and b. Iterate over several epochs, where each epoch divides the training set into batches. Each batch is used to update the weights. FIX - to be implemented

Value parameters

x_

the training/full data/input matrix

y_

the training/full response/output matrix

Attributes

Definition Classes
def updateFilterParams(f: Int, vec2: VectorD): Unit

Update filter fs parameters.

Update filter fs parameters.

Value parameters

f

the index for the filter

vec2

the new paramters for the filter's vector

Attributes

Inherited methods

def backwardElim(cols: LinkedHashSet[Int], idx_q: Int, first: Int): BestStep

Perform backward elimination to find the least predictive variable to remove from the existing model, returning the variable to eliminate, the new parameter matrix and the new Quality of Fit (QoF). May be called repeatedly.

Perform backward elimination to find the least predictive variable to remove from the existing model, returning the variable to eliminate, the new parameter matrix and the new Quality of Fit (QoF). May be called repeatedly.

Value parameters

cols

the columns of matrix x currently included in the existing model

first

first variable to consider for elimination (default (1) assume intercept x_0 will be in any model)

idx_q

index of Quality of Fit (QoF) to use for comparing quality

Attributes

See also

Fit for index of QoF measures.

Inherited from:
PredictorMV
def backwardElimAll(idx_q: Int, first: Int, cross: Boolean): (LinkedHashSet[Int], MatrixD)

Perform backward elimination to find the least predictive variables to remove from the full model, returning the variables left and the new Quality of Fit (QoF) measures for all steps.

Perform backward elimination to find the least predictive variables to remove from the full model, returning the variables left and the new Quality of Fit (QoF) measures for all steps.

Value parameters

cross

whether to include the cross-validation QoF measure

first

first variable to consider for elimination

idx_q

index of Quality of Fit (QoF) to use for comparing quality

Attributes

See also

Fit for index of QoF measures.

Inherited from:
PredictorMV
def crossValidate(k: Int, rando: Boolean): Array[Statistic]

Attributes

Inherited from:
PredictorMV
override def diagnose(y: VectorD, yp: VectorD, w: VectorD): VectorD

Diagnose the health of the model by computing the Quality of Fit (QoF) measures, from the error/residual vector and the predicted & actual responses. For some models the instances may be weighted.

Diagnose the health of the model by computing the Quality of Fit (QoF) measures, from the error/residual vector and the predicted & actual responses. For some models the instances may be weighted.

Value parameters

w

the weights on the instances (defaults to null)

y

the actual response/output vector to use (test/full)

yp

the predicted response/output vector (test/full)

Attributes

See also

Regression_WLS

Definition Classes
Fit -> FitM
Inherited from:
Fit
def fit: VectorD

Return the Quality of Fit (QoF) measures corresponding to the labels given. Note, if sse > sst, the model introduces errors and the rSq may be negative, otherwise, R^2 (rSq) ranges from 0 (weak) to 1 (strong). Override to add more quality of fit measures.

Return the Quality of Fit (QoF) measures corresponding to the labels given. Note, if sse > sst, the model introduces errors and the rSq may be negative, otherwise, R^2 (rSq) ranges from 0 (weak) to 1 (strong). Override to add more quality of fit measures.

Attributes

Inherited from:
Fit
def forwardSel(cols: LinkedHashSet[Int], idx_q: Int): BestStep

Perform forward selection to find the most predictive variable to add the existing model, returning the variable to add and the new model. May be called repeatedly.

Perform forward selection to find the most predictive variable to add the existing model, returning the variable to add and the new model. May be called repeatedly.

Value parameters

cols

the columns of matrix x currently included in the existing model

idx_q

index of Quality of Fit (QoF) to use for comparing quality

Attributes

See also

Fit for index of QoF measures.

Inherited from:
PredictorMV
def forwardSelAll(idx_q: Int, cross: Boolean): (LinkedHashSet[Int], MatrixD)

Perform forward selection to find the most predictive variables to have in the model, returning the variables added and the new Quality of Fit (QoF) measures for all steps.

Perform forward selection to find the most predictive variables to have in the model, returning the variables added and the new Quality of Fit (QoF) measures for all steps.

Value parameters

cross

whether to include the cross-validation QoF measure

idx_q

index of Quality of Fit (QoF) to use for comparing quality

Attributes

See also

Fit for index of QoF measures.

Inherited from:
PredictorMV

Return the best model found from feature selection.

Return the best model found from feature selection.

Attributes

Inherited from:
PredictorMV
def getFname: Array[String]

Return the feature/variable names.

Return the feature/variable names.

Attributes

Inherited from:
PredictorMV
def getX: MatrixD

Return the used data matrix x. Mainly for derived classes where x is expanded from the given columns in x_.

Return the used data matrix x. Mainly for derived classes where x is expanded from the given columns in x_.

Attributes

Inherited from:
PredictorMV
def getY: MatrixD

Return the used response matrix y. Mainly for derived classes where y is transformed.

Return the used response matrix y. Mainly for derived classes where y is transformed.

Attributes

Inherited from:
PredictorMV
def help: String

Return the help string that describes the Quality of Fit (QoF) measures provided by the Fit trait. Override to correspond to fitLabel.

Return the help string that describes the Quality of Fit (QoF) measures provided by the Fit trait. Override to correspond to fitLabel.

Attributes

Inherited from:
Fit

Return the hyper-parameters.

Return the hyper-parameters.

Attributes

Inherited from:
PredictorMV
def ll(ms: Double, s2: Double, m2: Int): Double

The log-likelihood function times -2. Override as needed.

The log-likelihood function times -2. Override as needed.

Value parameters

ms

raw Mean Squared Error

s2

MLE estimate of the population variance of the residuals

Attributes

See also
Inherited from:
Fit
def makePlots(yy: MatrixD, yp: MatrixD): Unit

Make plots for each output/response variable (column of matrix y). Must override if the response matrix is transformed or rescaled.

Make plots for each output/response variable (column of matrix y). Must override if the response matrix is transformed or rescaled.

Value parameters

yp

the testing/full predicted response/output matrix (defaults to full y)

yy

the testing/full actual response/output matrix (defaults to full y)

Attributes

Inherited from:
PredictorMV
def mse_: Double

Return the mean of the squares for error (sse / df). Must call diagnose first.

Return the mean of the squares for error (sse / df). Must call diagnose first.

Attributes

Inherited from:
Fit
def numTerms: Int

Return the number of terms/parameters in the model, e.g., b_0 + b_1 x_1 + b_2 x_2 has three terms.

Return the number of terms/parameters in the model, e.g., b_0 + b_1 x_1 + b_2 x_2 has three terms.

Attributes

Inherited from:
PredictorMV
def orderByY(y_: VectorD, yp_: VectorD): (VectorD, VectorD)

Order vectors y_ and yp_ accroding to the ascending order of y_.

Order vectors y_ and yp_ accroding to the ascending order of y_.

Value parameters

y_

the vector to order by (e.g., true response values)

yp_

the vector to be order by y_ (e.g., predicted response values)

Attributes

Inherited from:
PredictorMV

Return only the first matrix of parameter/coefficient values.

Return only the first matrix of parameter/coefficient values.

Attributes

Inherited from:
PredictorMV
def rSq0_: Double

Attributes

Inherited from:
FitM
def rSq_: Double

Return the coefficient of determination (R^2). Must call diagnose first.

Return the coefficient of determination (R^2). Must call diagnose first.

Attributes

Inherited from:
FitM
override def report(ftMat: MatrixD): String

Return a basic report on a trained and tested multi-variate model.

Return a basic report on a trained and tested multi-variate model.

Value parameters

ftMat

the matrix of qof values produced by the Fit trait

Attributes

Definition Classes
Inherited from:
PredictorMV
def report(ftVec: VectorD): String

Return a basic report on a trained and tested model.

Return a basic report on a trained and tested model.

Value parameters

ftVec

the vector of qof values produced by the Fit trait

Attributes

Inherited from:
Model
def resetBest(): Unit

Reset the best-step to default

Reset the best-step to default

Attributes

Inherited from:
PredictorMV
def resetDF(df_update: (Double, Double)): Unit

Reset the degrees of freedom to the new updated values. For some models, the degrees of freedom is not known until after the model is built.

Reset the degrees of freedom to the new updated values. For some models, the degrees of freedom is not known until after the model is built.

Value parameters

df_update

the updated degrees of freedom (model, error)

Attributes

Inherited from:
Fit

Return the matrix of residuals/errors.

Return the matrix of residuals/errors.

Attributes

Inherited from:
PredictorMV
def selectFeatures(tech: SelectionTech, idx_q: Int, cross: Boolean): (LinkedHashSet[Int], MatrixD)

Perform feature selection to find the most predictive variables to have in the model, returning the variables added and the new Quality of Fit (QoF) measures for all steps.

Perform feature selection to find the most predictive variables to have in the model, returning the variables added and the new Quality of Fit (QoF) measures for all steps.

Value parameters

cross

whether to include the cross-validation QoF measure

idx_q

index of Quality of Fit (QoF) to use for comparing quality

tech

the feature selection technique to apply

Attributes

See also

Fit for index of QoF measures.

Inherited from:
PredictorMV
def sse_: Double

Return the sum of the squares for error (sse). Must call diagnose first.

Return the sum of the squares for error (sse). Must call diagnose first.

Attributes

Inherited from:
FitM
def stepRegressionAll(idx_q: Int, cross: Boolean): (LinkedHashSet[Int], MatrixD)

Perform stepwise regression to find the most predictive variables to have in the model, returning the variables left and the new Quality of Fit (QoF) measures for all steps. At each step it calls 'forwardSel' and 'backwardElim' and takes the best of the two actions. Stops when neither action yields improvement.

Perform stepwise regression to find the most predictive variables to have in the model, returning the variables left and the new Quality of Fit (QoF) measures for all steps. At each step it calls 'forwardSel' and 'backwardElim' and takes the best of the two actions. Stops when neither action yields improvement.

Value parameters

cross

whether to include the cross-validation QoF measure

idx_q

index of Quality of Fit (QoF) to use for comparing quality

Attributes

See also

Fit for index of QoF measures.

Inherited from:
PredictorMV
def summary(x_: MatrixD, fname: Array[String], b: VectorD, vifs: VectorD): String

Produce a QoF summary for a model with diagnostics for each predictor x_j and the overall Quality of Fit (QoF). Note: `Fac_Cholesky is used to compute the inverse of xtx.

Produce a QoF summary for a model with diagnostics for each predictor x_j and the overall Quality of Fit (QoF). Note: `Fac_Cholesky is used to compute the inverse of xtx.

Value parameters

b

the parameters/coefficients for the model

fname

the array of feature/variable names

vifs

the Variance Inflation Factors (VIFs)

x_

the testing/full data/input matrix

Attributes

Inherited from:
Fit
def test(x_: MatrixD, y_: VectorD): (VectorD, VectorD)

Test/evaluate the model's Quality of Fit (QoF) and return the predictions and QoF vectors. This may include the importance of its parameters (e.g., if 0 is in a parameter's confidence interval, it is a candidate for removal from the model). Extending traits and classess should implement various diagnostics for the test and full (training + test) datasets.

Test/evaluate the model's Quality of Fit (QoF) and return the predictions and QoF vectors. This may include the importance of its parameters (e.g., if 0 is in a parameter's confidence interval, it is a candidate for removal from the model). Extending traits and classess should implement various diagnostics for the test and full (training + test) datasets.

Value parameters

x_

the testiing/full data/input matrix (impl. classes may default to x)

y_

the testiing/full response/output vector (impl. classes may default to y)

Attributes

Inherited from:
PredictorMV
inline def testIndices(n_test: Int, rando: Boolean): IndexedSeq[Int]

Return the indices for the test-set.

Return the indices for the test-set.

Value parameters

n_test

the size of test-set

rando

whether to select indices randomly or in blocks

Attributes

See also

scalation.mathstat.TnT_Split

Inherited from:
PredictorMV
def train(x_: MatrixD, y_: VectorD): Unit

Train the model 'y_ = f(x_) + e' on a given dataset, by optimizing the model parameters in order to minimize error '||e||' or maximize log-likelihood 'll'.

Train the model 'y_ = f(x_) + e' on a given dataset, by optimizing the model parameters in order to minimize error '||e||' or maximize log-likelihood 'll'.

Value parameters

x_

the training/full data/input matrix (impl. classes may default to x)

y_

the training/full response/output vector (impl. classes may default to y)

Attributes

Inherited from:
PredictorMV
def trainNtest(x_: MatrixD, y_: MatrixD)(xx: MatrixD, yy: MatrixD): (MatrixD, MatrixD)

Train and test the predictive model y_ = f(x_) + e and report its QoF and plot its predictions. FIX - currently must override if y is transformed, @see TranRegression

Train and test the predictive model y_ = f(x_) + e and report its QoF and plot its predictions. FIX - currently must override if y is transformed, @see TranRegression

Value parameters

x_

the training/full data/input matrix (defaults to full x)

xx

the testing/full data/input matrix (defaults to full x)

y_

the training/full response/output matrix (defaults to full y)

yy

the testing/full response/output matrix (defaults to full y)

Attributes

Inherited from:
PredictorMV
def trainNtest2(x_: MatrixD, y_: MatrixD)(xx: MatrixD, yy: MatrixD): (MatrixD, MatrixD)

Train and test the predictive model y_ = f(x_) + e and report its QoF and plot its predictions. This version does auto-tuning. FIX - currently must override if y is transformed, @see TranRegression

Train and test the predictive model y_ = f(x_) + e and report its QoF and plot its predictions. This version does auto-tuning. FIX - currently must override if y is transformed, @see TranRegression

Value parameters

x_

the training/full data/input matrix (defaults to full x)

xx

the testing/full data/input matrix (defaults to full x)

y_

the training/full response/output matrix (defaults to full y)

yy

the testing/full response/output matrix (defaults to full y)

Attributes

Inherited from:
PredictorMV
def validate(rando: Boolean, ratio: Double)(idx: IndexedSeq[Int]): MatrixD

Attributes

Inherited from:
PredictorMV
def vif(skip: Int): VectorD

Compute the Variance Inflation Factor (VIF) for each variable to test for multi-collinearity by regressing x_j against the rest of the variables. A VIF over 50 indicates that over 98% of the variance of x_j can be predicted from the other variables, so x_j may be a candidate for removal from the model. Note: override this method to use a superior regression technique.

Compute the Variance Inflation Factor (VIF) for each variable to test for multi-collinearity by regressing x_j against the rest of the variables. A VIF over 50 indicates that over 98% of the variance of x_j can be predicted from the other variables, so x_j may be a candidate for removal from the model. Note: override this method to use a superior regression technique.

Value parameters

skip

the number of columns of x at the beginning to skip in computing VIF

Attributes

Inherited from:
PredictorMV

Concrete fields

Inherited fields

var modelConcept: URI

The optional reference to an ontological concept

The optional reference to an ontological concept

Attributes

Inherited from:
Model
var modelName: String

The name for the model (or modeling technique).

The name for the model (or modeling technique).

Attributes

Inherited from:
Model