Low performance when using EventTimeInputBuilder

[fschoell]

I'm currently using flink-spector to read a "large" (about 10.000 values) dataset from a CSV file and use the EventTimeInputBuilder to create a data stream from it. However, the performance drops significantly the larger the input gets. My application needs about 30 minutes to process those data (even though the algorithm basically just calculates a moving average). Cutting down the input to 5.000 values drops the runtime to 5 minutes.

I used a profiler to dig into the problem and it seems that InputUtil.produceWatermarks is quite time consuming.

I'm using the InputBuilder now and assign timestamps and watermarks myself which drops the runtime to a couple of seconds. Just wanted to report this.

[lofifnc]

This is interesting. I will investigate this.