To cite package benchmark in publication use:

Manuel J. A. Eugster and Friedrich Leisch. Bench Plot and Mixed Effects Models: First Steps toward a Comprehensive Benchmark Analysis Toolbox. Compstat 2008---Proceedings in Computational Statistics, 299-306, 2008. http://epub.ub.uni-muenchen.de/3206/

Manuel J. A. Eugster, Torsten Hothorn and Friedrich Leisch. Exploratory and Inferential Analysis of Benchmark Experiments Technical Report 30, Department of Statistics, Ludwig-Maximilians-Universitaet Muenchen, Germany. 2008. http://epub.ub.uni-muenchen.de/4134/

To cite dataset characteristics and their relations to algorithm performances in publications use:

Manuel J. A. Eugster, Friedrich Leisch and Carolin Strobl. (Psycho-)Analysis of Benchmark Experiments -- A Formal Framework for Investigating the Relationship between Data Sets and Learning Algorithms Computational Statistics & Data Analysis, 71:986-1000, 2014. http://www.sciencedirect.com/science/article/pii/S0167947313002946

To cite interactive analysis of benchmark experiments in publications use:

Manuel J. A. Eugster and Friedrich Leisch. Exploratory Analysis of Benchmark Experiments -- An Interactive Approach Computational Statistics, 26(4):699-710, 2011. DOI 10.1007/s00180-010-0227-z. http://epub.ub.uni-muenchen.de/10604/

To cite domain-based benchmark experiments in publications use:

Manuel J. A. Eugster, Torsten Hothorn, and Friedrich Leisch. Domain-based benchmark experiments: Exploratory and inferential analysis. Austrian Journal of Statistics, 41(1):5-26, 2012. http://www.stat.tugraz.at/AJS/ausg121/121Leisch.pdf

Corresponding BibTeX entries:

  @InProceedings{benchplot2008,
    title = {Bench Plot and Mixed Effects Models: First Steps toward a
      Comprehensive Benchmark Analysis Toolbox},
    author = {Manuel J. A. Eugster and Friedrich Leisch},
    booktitle = {Compstat 2008---Proceedings in Computational
      Statistics},
    editor = {Paula Brito},
    publisher = {Physica Verlag, Heidelberg, Germany},
    year = {2008},
    pages = {299--306},
    url = {http://epub.ub.uni-muenchen.de/3206/},
  }

  @TechReport{benchplot2010,
    author = {Manuel J. A. Eugster and Torsten Hothorn and Friedrich
      Leisch},
    title = {Exploratory and Inferential Analysis of Benchmark
      Experiments},
    institution = {Institut fuer Statistik,
      Ludwig-Maximilians-Universitaet Muenchen, Germany},
    year = {2008},
    type = {Technical Report},
    number = {30},
    url = {http://epub.ub.uni-muenchen.de/4134/},
  }

  @Article{psychobench2014,
    author = {Manuel J. A. Eugster and Friedrich Leisch and Carolin
      Strobl},
    title = {(Psycho-)Analysis of Benchmark Experiments -- A Formal
      Framework for Investigating the Relationship between Data Sets
      and Learning Algorithms},
    journal = {Computational Statistics & Data Analysis},
    year = {2014},
    number = {71},
    pages = { 986--1000},
    url =
      {http://www.sciencedirect.com/science/article/pii/S0167947313002946},
  }

  @Article{ibenchplot2011,
    author = {Manuel J. A. Eugster and Friedrich Leisch},
    title = {Exploratory Analysis of Benchmark Experiments -- An
      Interactive Approach},
    journal = {Computational Statistics},
    year = {2011},
    volume = {26},
    number = {4},
    pages = {699--710},
    doi = {10.1007/s00180-010-0227-z},
    url = {http://epub.ub.uni-muenchen.de/10604/},
  }

  @Article{lsbenchplot2012,
    author = {Manuel J. A. Eugster and Torsten Hothorn and Friedrich
      Leisch},
    title = {Domain-Based Benchmark Experiments: Exploratory and
      Inferential Analysis},
    journal = {Austrian Journal of Statistics},
    year = {2012},
    volume = {41},
    number = {1},
    pages = {5--26},
    url = {http://www.stat.tugraz.at/AJS/ausg121/121Leisch.pdf},
  }