Reporting Guidelines

These guidelines can be referred to by citing the package:

Reporting Guidelines

Based on the previous comparison of point-estimates and indices of effect existence, we can draw the following recommendations.

To minimally describe the posterior distribution of a parameter, we suggest reporting 1) the median as an index of centrality, 2) the 89% CI (using HDI rather than quantiles) as an index of centrality and, in the context of null-hypothesis testing, the Probability of Direction (pd) for effect existence and, especially in the context of confirmatory analyses, the ROPE percentage (full, i.e., based on the full posterior distribution) with an explicitly specified range for effect significance.

Effect Existence and significance

The pd and the ROPË are two indices that give different and independent information: The pd is a marker of existence, consistency and direction of a parameter (whether a parameter has a consistent effect in one or another direction), whereas the percentage in ROPE is a index of significance (in its primary meaning); informing us whether a parameter is related or not to a non-negligible change (in terms of magnitude) in the outcome.

Interpretation Rules of Thumb

The following thresholds are presented as landmarks only, and any use of such “labels” should be explicitly justified. Please consider with caution.

Note: If you have any advice, opinion or such, we encourage you to let us know by opening an discussion thread or making a pull request.

Template Sentence

Based on these suggestions, a template sentence for minimal reporting of a parameter based on its posterior distribution could be: