Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bagger producer #86

Open
wants to merge 19 commits into
base: master
Choose a base branch
from
Open

Bagger producer #86

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
059a5e6
Add hashtable (HTable) data structure
zilder Apr 7, 2020
47d9480
Added bagger postgres producer with tuple routing and separate buffers
zilder Apr 16, 2020
2803db6
Deduplicate the code of bagger module
zilder Apr 17, 2020
f1c7519
bagger.c: Write the rest of json in the last column
zilder Apr 20, 2020
3ac4ee0
Add murmur2 hashing function; some cleanup
zilder Apr 20, 2020
7a1c364
bagger.c: remove properly the needles from json that is going to be
zilder Apr 20, 2020
2a9c90b
bagger.c: fix partition name generation; change the buffer flush cond…
zilder Apr 21, 2020
844edaa
A bugfix in hashtable implementation; cleanup
zilder Apr 22, 2020
1d9a390
Separate formatters for binary and text COPY formats
zilder Apr 23, 2020
fda364f
bagger.c: Bugfix in buffer_write()
zilder Apr 24, 2020
3f88de1
bagger.c: introduce buffer epochs which prevent premature half empty …
zilder Apr 24, 2020
5327953
bagger.c: customizable dbname and user; fix COPY command
zilder Apr 27, 2020
57b69f8
bagger.c: added 'replica' option to allow duplicate all COPY queries to
zilder Apr 28, 2020
0a825d4
bagger.c: escape backslash character
zilder May 11, 2020
476f2e7
bagger.c: fix memory management issues
zilder May 13, 2020
7efe461
exports.c: add `text_esc` type formatter which is the same as `text` but
zilder May 18, 2020
8704b15
postgres.h: add missing header
zilder Jun 4, 2020
83709ea
Use libpq's function to escape special characters (PQescapeLiteral)
zilder Oct 16, 2020
a92c4ca
Use PQescapeLiteral for format function too
zilder Oct 21, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
639 changes: 639 additions & 0 deletions src/bagger.c
View file
Open in desktop

Large diffs are not rendered by default.

16 changes: 16 additions & 0 deletions src/bagger.h
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
#ifndef _SCHAUFEL_BAGGER_H_
#define _SCHAUFEL_BAGGER_H_

#include <libconfig.h>

#include "producer.h"
#include "consumer.h"
#include "validator.h"
#include "queue.h"


Producer bagger_producer_init(config_setting_t *config);
Consumer bagger_consumer_init(config_setting_t *config);
Validator bagger_validator_init();

#endif
Loading