Entry: Postgresql, Output: typesense | CDC not working #35398
Unanswered
florian-deroo
asked this question in
Connector Questions
Replies: 2 comments 1 reply
-
This is still an issue for me. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi everyone! I'm having some trouble when i'm trying to use CDC with the postgres connector. When i add new values to my table, the value is not sent to my output which is typesense. However, it's working when i'm doing a manual sync, so i guess i have misconfigured the CDC, here is my current config in postgresql.conf (i've restarted my postgres server)
wal_level = 'logical'
max_wal_senders = 1
max_replication_slots = 1
When i verify my config with the postgres requests:
![image](https://private-user-images.githubusercontent.com/59513489/305721802-ada972ac-f20c-4100-9ad0-03cecefb1565.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzMjgzNjcsIm5iZiI6MTczOTMyODA2NywicGF0aCI6Ii81OTUxMzQ4OS8zMDU3MjE4MDItYWRhOTcyYWMtZjIwYy00MTAwLTlhZDAtMDNjZWNlZmIxNTY1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDAyNDEwN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTIxZDAxNjQ4ZGY5Mzc5NTM2NjVjNzZiMDk4MTE0MGFjZDM5YWE3ZmU3ODllZmI1NzRkZWMxNDBmMjUxMDZhOGUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.ycFo53Wdf_V9WfIxZphRUogQRw_nFiQfCvXTJjmP65s)
![image](https://private-user-images.githubusercontent.com/59513489/305721833-69c7fb4b-ca2e-4516-838d-16068cc3cd27.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzMjgzNjcsIm5iZiI6MTczOTMyODA2NywicGF0aCI6Ii81OTUxMzQ4OS8zMDU3MjE4MzMtNjljN2ZiNGItY2EyZS00NTE2LTgzOGQtMTYwNjhjYzNjZDI3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDAyNDEwN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWNkZWI3YjJmOGM2NTJmMDU1MzU5ZWEwNTEyN2U1ZWNkZjkwN2VhYzdlM2VlZDg0OTFhY2JmYjgzZGI2ZTJiZWUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.kIaXl97lo16KIPxorb3gPxeHK-rdx_aQvcfUoRJRyKE)
![image](https://private-user-images.githubusercontent.com/59513489/305721867-f4ff687a-208c-4935-9897-bdb27eaf3de7.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzMjgzNjcsIm5iZiI6MTczOTMyODA2NywicGF0aCI6Ii81OTUxMzQ4OS8zMDU3MjE4NjctZjRmZjY4N2EtMjA4Yy00OTM1LTk4OTctYmRiMjdlYWYzZGU3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDAyNDEwN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTM2YzkzNmJlZTgzOGUxOTczNmE3M2IyMzY1YzkwZjBlYWJiNjBkNmI0ZTNhMGY5ZmQxZjQxZTI0NWRlZjc1ZTQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.Q9U8mNJozd0rRZGR2LW7_wUxza6aGchq8Z2DK4Zn6iQ)
SHOW max_wal_senders;
SHOW wal_level;
SHOW max_replication_slots ;
Publication table:
![image](https://private-user-images.githubusercontent.com/59513489/305721909-8f4a5640-547b-4bd0-82a7-711374f417a2.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzMjgzNjcsIm5iZiI6MTczOTMyODA2NywicGF0aCI6Ii81OTUxMzQ4OS8zMDU3MjE5MDktOGY0YTU2NDAtNTQ3Yi00YmQwLTgyYTctNzExMzc0ZjQxN2EyLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDAyNDEwN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTY0ZmUyZjBiNmI5ZDdmZDhhNzZhOTJiNGQ3YjgzMDBlMjgwNjEzZjlhY2NhZTBhMTBhZTA4MmFlZDc3ZmRmNTMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.GxlWf9svPYPshuc0_5UeqrWKsav8hf0hRCIQPA5fdrY)
SELECT * FROM pg_publication_tables;
Replication slots
![image](https://private-user-images.githubusercontent.com/59513489/305722002-71803359-ad67-4ccd-962d-389e973e26cf.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzMjgzNjcsIm5iZiI6MTczOTMyODA2NywicGF0aCI6Ii81OTUxMzQ4OS8zMDU3MjIwMDItNzE4MDMzNTktYWQ2Ny00Y2NkLTk2MmQtMzg5ZTk3M2UyNmNmLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDAyNDEwN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTlmYTE4YWM4ZjI0MzUwNjBiZTZmZDU2Y2M4OTQ0MDg2MDBmMmUxMGVhMDM4ZDM4M2E3Mzc1YjAwYTdlOWZhMTAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.wfU_bI5O37_n5NyhQ0AY1WbE2Z7Fo8-5gbnaMrvMliQ)
SELECT * FROM pg_replication_slots;
On the previous screen we can see that active is false but i have no idea why?
Here is my CDC Config on postgresql:
![image](https://private-user-images.githubusercontent.com/59513489/305722229-0f386817-076a-4cc7-8815-64e71d8568a9.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzMjgzNjcsIm5iZiI6MTczOTMyODA2NywicGF0aCI6Ii81OTUxMzQ4OS8zMDU3MjIyMjktMGYzODY4MTctMDc2YS00Y2M3LTg4MTUtNjRlNzFkODU2OGE5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDAyNDEwN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTk2MDJkMWMxYWM3ZjI4MTA3MzMwYjQ3Mzk4ZjFhNGVhNzFiOTljYmJiM2RmZmJhYWY2Nzc0NDhjMDY3ZmEzOWYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.gu4gyznNKCQjXOTWiNi6yJ9Iwc3JdDwVykYq4cHCp3w)
Do you have an idea why it's not working?
Beta Was this translation helpful? Give feedback.
All reactions