Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

load_word_vectors problems #32

Open
funnytestingcase opened this issue Dec 25, 2020 · 4 comments
Open

load_word_vectors problems #32

funnytestingcase opened this issue Dec 25, 2020 · 4 comments

Comments

@funnytestingcase
Copy link

I have torchtext 0.1.1 , python 2.7
but function "load_word_vectors" would not download the correct zip file (the 2.18GB one)
when it starts downloading
"glove.840B.300d: 8.19kB [00:00, 9.51kB/s]"
and it always ends up with a bad zip file

was I missing anything?

@lanwuwei
Copy link
Owner

torchtext 0.1.1 is correct, how about your network speed?

@funnytestingcase
Copy link
Author

I solved this error by modifying vocab.py file from torchtext, basically I bypassed the downloading the unzip step.

and, What's your memory size when implementing those four frameworks? My 4GB was quickly run out.

@lanwuwei
Copy link
Owner

4GB is too small, I ran this code in a server with tens of GB of memory. ESIM is memory efficient, as it uses the file iterator without loading all the data into memory. You can try ESIM first with your 4GB memory.

@funnytestingcase
Copy link
Author

thx for the quick reply !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants