Skip to content

Latest commit

 

History

History
22 lines (15 loc) · 1 KB

README.md

File metadata and controls

22 lines (15 loc) · 1 KB
Raw

OpenSubtitles

This repository is a collection of scripts that help download and parse the OpenSubtitles corpus.

  • opensubtitles.sh: downloads, extracts, and merges the 2012/2013 corpora from http://opus.lingfil.uu.se
  • opensubtitles.py: naieve attempt at trying to download a single english subtitle for each imdb id. rate limits at 200 downloads per day
  • analyze.py: tries to cluster a single year of movie transcripts
  • explore.py: prints a list of all genres for the given year
  • load.py: loads all subtitles into memory for a given year, used by all other scripts
  • xml.py: parse xml file into subtitle.txt file
  • parse.py: find corresponding imdb id from opensubtitles id and get json of metadata

Citations

OpenSubtitles: http://www.opensubtitles.org/

Jörg Tiedemann, 2012, Parallel Data, Tools and Interfaces in OPUS. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC 2012)