You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
When reading the paper and checking issue #1 , I found that the numerical results in Appendix C&F are inconsistent with the provided expert scores. For example, in Figure 7, ICM with 10^5 pretraining on walker_walk has about 50% normalized score, and the numerical result in Table 5 is (302+-45). As the expert score is 971 mentioned in #1 , this is equivalent to about 31% normalized score. Did I miss something here? Also, it seems that the score for pretraining methods, in general, cannot compete with SOTA methods like CURL and DrQ, which do not require any pretraining. Is there any explanation for this? Thanks!
The text was updated successfully, but these errors were encountered:
Hi,
When reading the paper and checking issue #1 , I found that the numerical results in Appendix C&F are inconsistent with the provided expert scores. For example, in Figure 7, ICM with 10^5 pretraining on walker_walk has about 50% normalized score, and the numerical result in Table 5 is (302+-45). As the expert score is 971 mentioned in #1 , this is equivalent to about 31% normalized score. Did I miss something here? Also, it seems that the score for pretraining methods, in general, cannot compete with SOTA methods like CURL and DrQ, which do not require any pretraining. Is there any explanation for this? Thanks!
The text was updated successfully, but these errors were encountered: