Performance Metrics
Compute measures of agreement between observed and predicted responses.
accuracy(
observed,
predicted = NULL,
cutoff = MachineShop::settings("cutoff"),
...
)
auc(
observed,
predicted = NULL,
metrics = c(MachineShop::tpr, MachineShop::fpr),
stat = MachineShop::settings("stat.Curve"),
...
)
brier(observed, predicted = NULL, ...)
cindex(observed, predicted = NULL, ...)
cross_entropy(observed, predicted = NULL, ...)
f_score(
observed,
predicted = NULL,
cutoff = MachineShop::settings("cutoff"),
beta = 1,
...
)
fnr(observed, predicted = NULL, cutoff = MachineShop::settings("cutoff"), ...)
fpr(observed, predicted = NULL, cutoff = MachineShop::settings("cutoff"), ...)
kappa2(
observed,
predicted = NULL,
cutoff = MachineShop::settings("cutoff"),
...
)
npv(observed, predicted = NULL, cutoff = MachineShop::settings("cutoff"), ...)
ppv(observed, predicted = NULL, cutoff = MachineShop::settings("cutoff"), ...)
pr_auc(observed, predicted = NULL, ...)
precision(
observed,
predicted = NULL,
cutoff = MachineShop::settings("cutoff"),
...
)
recall(
observed,
predicted = NULL,
cutoff = MachineShop::settings("cutoff"),
...
)
roc_auc(observed, predicted = NULL, ...)
roc_index(
observed,
predicted = NULL,
cutoff = MachineShop::settings("cutoff"),
f = function(sensitivity, specificity) (sensitivity + specificity)/2,
...
)
rpp(observed, predicted = NULL, cutoff = MachineShop::settings("cutoff"), ...)
sensitivity(
observed,
predicted = NULL,
cutoff = MachineShop::settings("cutoff"),
...
)
specificity(
observed,
predicted = NULL,
cutoff = MachineShop::settings("cutoff"),
...
)
tnr(observed, predicted = NULL, cutoff = MachineShop::settings("cutoff"), ...)
tpr(observed, predicted = NULL, cutoff = MachineShop::settings("cutoff"), ...)
weighted_kappa2(observed, predicted = NULL, power = 1, ...)
gini(observed, predicted = NULL, ...)
mae(observed, predicted = NULL, ...)
mse(observed, predicted = NULL, ...)
msle(observed, predicted = NULL, ...)
r2(observed, predicted = NULL, dist = NULL, ...)
rmse(observed, predicted = NULL, ...)
rmsle(observed, predicted = NULL, ...)observed |
observed responses; or confusion, performance curve, or resample result containing observed and predicted responses. |
predicted |
predicted responses if not contained in
|
cutoff |
numeric (0, 1) threshold above which binary factor probabilities are classified as events and below which survival probabilities are classified. |
... |
arguments passed to or from other methods. |
metrics |
list of two performance metrics for the calculation [default: ROC metrics]. |
stat |
function or character string naming a function to compute a
summary statistic at each cutoff value of resampled metrics in performance
curves, or |
beta |
relative importance of recall to precision in the calculation of
|
f |
function to calculate a desired sensitivity-specificity tradeoff. |
power |
power to which positional distances of off-diagonals from the
main diagonal in confusion matrices are raised to calculate
|
dist |
character string specifying a distribution with which to estimate
the survival mean in the total sum of square component of |
Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.