You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
First it should be a reverse of the file source connector:
-one file per message
-option to put the date from metadata of message on date of file.
-atomic write, write to tempdir on same mount, and move file to destination
-if write fails, don't consume message
And later features:
Write to single file, roll to next file after x size/lines/time
Call an executable to process a file.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
First it should be a reverse of the file source connector:
-one file per message
-option to put the date from metadata of message on date of file.
-atomic write, write to tempdir on same mount, and move file to destination
-if write fails, don't consume message
And later features:
Write to single file, roll to next file after x size/lines/time
Call an executable to process a file.
Beta Was this translation helpful? Give feedback.
All reactions