Skip to main content

Carlos Santos's Library tagged evaluation →  View Popular

10 Apr 09

Binary classification evaluation in R via ROCR - Brendan O'Connor's Blog

So there are a zillion ways to evaluate a binary classifier. Accuracy? Accuracy on different item types (sens, spec)? Accuracy on different classifier decisions (prec, npv)? And worse, over the years every field has given these metrics different names. Signal detection, bioinformatics, medicine, statistics, machine learning, and more I’m sure. But in R, there’s the excellent ROCR package to compute and visualize all the different metrics.

anyall.org/...ation-evaluation-in-r-via-rocr - Preview

R statistics roc analysis evaluation MachineLearning

  • So there are a zillion ways to evaluate a binary classifier. Accuracy? Accuracy on different item types (sens, spec)? Accuracy on different classifier decisions (prec, npv)? And worse, over the years every field has given these metrics different names. Signal detection, bioinformatics, medicine, statistics, machine learning, and more I’m sure. But in R, there’s the excellent ROCR package to compute and visualize all the different metrics.


02 Apr 09

ICML ML Evaluation 2009 - OpenResearch.org

this workshop intends to continue the debate within the
machine learning community into how we evaluate new algorithms.

openresearch.org/...ICML_ML_Evaluation_2009 - Preview

icml MachineLearning evaluation research

  • this workshop intends to continue the debate within the
    machine learning community into how we evaluate new algorithms.
  • In the course of three previous workshops, the debate has evolved to focus around
    the following issues which have captured the interest of the community:

    * the role of experiments in evaluation

    * the use of one, community wide, evaluation measure (e.g., Accuracy, AUC,
    F-measure)

    * the relevance of statistical tests to evaluation

    * the effectiveness of the UCI data sets for evaluation

    * the need for sharing and characterizing benchmark data sets in general

    * how to promote the views of this workshop to the rest of the community
  • 2 more annotations...
1 - 9 of 9
Showing 20▼ items per page

Selected Tags

Related Tags

Sponsored Links

Ads by Google

Highlighter, Sticky notes, Tagging, Groups and Network: integrated suite dramatically boosting research productivity. Learn more »

Join Diigo