Reproduce Table 1 in paper

[bkj]

I'm interested in trying to reproduce the numbers in Table 1 of the paper, but the example script you have for training a downstream model gets substantially better performance than shown in the table -- do you have ideas why that may be? Different dataset perhaps?

Thanks!