Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

RoBERTa-tiny-clue 和RoBERTa-tiny-pair的异同 #2

Open
chros425 opened this issue Mar 6, 2020 · 2 comments
Open

RoBERTa-tiny-clue 和RoBERTa-tiny-pair的异同 #2

chros425 opened this issue Mar 6, 2020 · 2 comments

Comments

@chros425
Copy link

chros425 commented Mar 6, 2020

请问，这两个超小型模型有什么不同吗，RoBERTa-tiny-pair 支持输出一个句子的向量，然后再通过计算余弦的方式来计算相似度吗，还是只能输入两个句子，通过分类的方式判断二者是否相似，如果是后者的话，易用性和扩展性上是否不及前者的方式，请大佬指教！
@brightmart
Copy link
Member

RoBERTa-tiny-pair也能和正常的预训练模型一样用的，只是它在句子对任务上效果可以更好一些。

@drzqb
Copy link

drzqb commented Mar 9, 2020

句子队任务的RoBERTa-tiny-pair的ckpt文件里面为什么没有pool层出口处的（312,2）的张量权重呢？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@brightmart @chros425 @drzqb