Welcome to the RAMI V result page!
This page provides an interactive interface to the intercomparison of the model submissions for each experiment covered by the RAMI V phase.
It is based on a series of interactive and clickable hierarchically organized heatmaps. The metric of the heatmaps can be selected by a drop-down color of the heatmaps.
By clicking a specific cell, it is possible to navigate to the experiments pertaining to the selection. The color of the heatmaps can be selected with the "Metric" drop-down list widget among:
This list might be extended in future implementations. Gray cells indicate absence of submissions for the specific experiment. When metrics other than N are selected, gray cells may occur due to an incomplete implementation of the metric calculation for certain measurements (ftran_tot_vprof, ftran_loc and thp).
The entry point heat map (level-1) lists the scenes on the y-axis and the measurement on the x-axis. Scenes can be filtered by selecting a family of scenes from a drop-down list widget, or using a the "free search" textbox (* wildcard allowed). Other than for bhr, for which the cell directly linked to the comparison is returned, a level-2 heat map will automatically appear in cascade, with the possibility to perform a finer selection in terms of geometry and band.
The final graph, accessible by further clicking the level-2 heatmap cells (except for bhr measure clicking the level-1), consists of the comparison between models as x-y scatter plot.
Functionalities are:
Each model can be removed or reincluded on the graph by clicking on its label, allowing the user to focus on a specific subset of models. The y-axis range will be updated to reflect the filtered selection.
Additionally, two model-to-model correlation matrices reporting Mean Absolute Relative Error (MARE), Root-Mean Squared Relative Error (RMSRE), Relative Bias (RBIAS) and Pearson coefficient are created to support a preliminary quantitative evaluation of the comparison.
The following video summarizes all of these functionalities.
Note that for brf_sat and ftran_loc measurements, the number of submitted files into the second heatmap (Geometry/Band) is the same (duplicate) value for all mandatory bands (axis x, Band).
Taylor, J. (1997). Introduction to error analysis, the study of uncertainties in physical measurements.
Here, the list of saved bookmarks.
© European Union, 1999 - 2026
The Commission's reuse policy is implemented by the Commission Decision of 12 December 2011 on the reuse of Commission documents.
Unless otherwise indicated (e.g. in individual copyright notices), content owned by the EU on this website is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) licence. This means that reuse is allowed, provided appropriate credit is given and changes are indicated.
You may be required to clear additional rights if a specific content depicts identifiable private individuals or includes third-party works. To use or reproduce content that is not owned by the EU, you may need to seek permission directly from the right holders. Software or documents covered by industrial property rights, such as patents, trade marks, registered designs, logos and names, are excluded from the Commission's reuse policy and are not licensed to you.