MachineShop: performance_curve – R documentation

Become an expert in R — Interactive courses, Cheat Sheets, certificates and more!

performance_curve

Model Performance Curves

Description

Calculate curves for the analysis of tradeoffs between metrics for assessing performance in classifying binary outcomes over the range of possible cutoff probabilities. Available curves include receiver operating characteristic (ROC) and precision recall.

Usage

performance_curve(x, ...)

## Default S3 method:
performance_curve(
  x,
  y,
  metrics = c(MachineShop::tpr, MachineShop::fpr),
  na.rm = TRUE,
  ...
)

## S3 method for class 'Resamples'
performance_curve(
  x,
  metrics = c(MachineShop::tpr, MachineShop::fpr),
  na.rm = TRUE,
  ...
)

Arguments

`x`	observed responses or resample result containing observed and predicted responses.
`...`	arguments passed to other methods.
`y`	predicted responses if not contained in `x`.
`metrics`	list of two performance metrics for the analysis [default: ROC metrics]. Precision recall curves can be obtained with `c(precision, recall)`.
`na.rm`	logical indicating whether to remove observed or predicted responses that are `NA` when calculating metrics.

Value

PerformanceCurve class object that inherits from data.frame.

Examples

## Requires prior installation of suggested package gbm to run

data(Pima.tr, package = "MASS")

res <- resample(type ~ ., data = Pima.tr, model = GBMModel)

## ROC curve
roc <- performance_curve(res)
plot(roc)
auc(roc)

MachineShop

Machine Learning Models and Tools

v2.8.0

GPL-3

Authors

Brian J Smith [aut, cre]

Initial release

2021-04-16