[help] trouble with sync by prefix white list file.

[timandy]

Describe the bug
The finder worker search by white list should not add root slash char.

To Reproduce
Steps to reproduce the behavior.

Expected behavior
The finder worker dot not add '/' char.

Please complete the following information about the solution:

• Version: v2.5.2

[YikaiHu]

Hi @timandy , could you provide the Cloudformation parameters?

[timandy]

@YikaiHu
I deploy DTH in beijing region

the sync task parameter

[YikaiHu]

The parameter looks ok, could you provide a example in your prefixlist txt file? to_sync.txt

[YikaiHu]

May be you should follow this format for your prefix-list file
https://github.com/awslabs/data-transfer-hub/blob/main/docs/USING_PREFIX_LIST.md#step-1-create-a-prefix-list-file

[timandy]

@YikaiHu txt content

operation-manual/
oversea/

[YikaiHu]

Hi @timandy , I think I found the root cause

Please set Need Data Comparison before Transfer to Yes.

If you want to use prefix-list feature, you have to set this parameter to Yes.

[timandy]

@YikaiHu Thanks for your answer. I create a new sync task as your said, but still not work.

[YikaiHu]

@timandy Hi, sorry for the late reply.

I have tested in my environment, with the latest version v2.6.0, but I haven't been able to reproduce your issue.

Here is my prefixlist file:

I also tested every folder ending with /:

And is still worked:

At the same time, I don’t think it’s a system error that added a / in front of the prefix, which caused your transfer to fail. You can refer to my screenshot.

And my S3 bucket's object structure is like:

According to my testing, I suggest you upgrade the version of Data Transfer Hub to v2.6.0 and have a try.

[timandy]

@YikaiHu Thanks for your reply. I will upgrade my DTH and test again in next days.