An error occurred while analyzing the dataset (out-of-memory)

[Youssef1313]

I'm analyzing a simple 1.5MB zip file consisting of Java files, but getting out-of-memory.

[rien]

Hi @Youssef1313 how many files are you analyzing? How big are they?

Do you get this problem with the web server? Or using the CLI?

[Youssef1313]

@rien Using the web server. 1461 Java files.

[rien]

I've take a closer look at the logs and it seems like the submissions you want to analyze have multiple files per submission.

We currently don't support grouping files together, so each file would be compared with all the others instead of with other groups. This needs a lot of memory and would give sub-par results.

In the mean time (until #1121 is implemented), you could try concatenating all files that belong to the same submission into one file (if you're using linux: cat **/*.java > combined.java).

Let me know if you need more help with this.

[Youssef1313]

Great. Thanks!