Skip to content

Commit

Permalink
make metrics more clear
Browse files Browse the repository at this point in the history
  • Loading branch information
xuanlinli17 committed May 7, 2024
1 parent 35096d9 commit fe7b015
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -366,7 +366,8 @@ <h3 class="title is-4">Evaluating and Comparing Policies</h3>
<div class="content has-text-justified">
<p>
SIMPLER can be used to evaluate four types of high level tasks, with many intra-task variations, for each of two robot embodiments (Google Robot and WidowX).
It can also be used to compare the performance of different policies and perform checkpoint selection.
It can also be used to compare the performance of different policies and perform checkpoint selection. Policy performances evaluated in SIMPLER have strong
correlation with those in the real world (illustrated by high MMRV and low Pearson r).
</p>
</div>
<div class="columns is-vcentered interpolation-panel">
Expand Down Expand Up @@ -426,7 +427,7 @@ <h3 class="title is-4">Analyzing and Predicting Policy Behaviors under Distribut
<div class="content has-text-justified">
<p>
SIMPLER can be used to analyze the policies' finegrained behaviors, such as their robustness to common distribution shifts like lightings, backgrounds, camera poses,
distractor objects, and table textures. The findings from SIMPLER are highly correlated with those in the real-world.
distractor objects, and table textures. The findings from SIMPLER are highly correlated with those in the real-world (illustrated by high MMRV and low Pearson r).
Additionally, SIMPLER can predict policy behaviors under novel distribution shifts, such as changes in arm textures.
</p>
<div style="text-align: center;">
Expand Down

0 comments on commit fe7b015

Please sign in to comment.