Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

got the fs.default.name from remote path #118

Open
Nicole00 opened this issue Nov 30, 2022 · 0 comments
Open

got the fs.default.name from remote path #118

Nicole00 opened this issue Nov 30, 2022 · 0 comments
Labels
affects/master PR/issue: this bug affects master version. severity/none Severity of bug type/enhancement Type: make the code neat or more efficient

Comments

@Nicole00
Copy link
Contributor

Introduction

now the sst path config includes local, remote, hdfs.namenode. we can get the fs.default.name from remote path, and remove the hdfs.namenode config. Then user must config remote path by format hdfs://ip:port/path/

Related work

modify the config resolve process and hdfs access process.
@Nicole00 Nicole00 added the type/enhancement Type: make the code neat or more efficient label Nov 30, 2022
@github-actions github-actions bot added affects/none PR/issue: this bug affects none version. severity/none Severity of bug labels Nov 30, 2022
@Nicole00 Nicole00 added affects/master PR/issue: this bug affects master version. and removed affects/none PR/issue: this bug affects none version. labels Nov 30, 2022
@wey-gu wey-gu mentioned this issue Dec 3, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
affects/master PR/issue: this bug affects master version. severity/none Severity of bug type/enhancement Type: make the code neat or more efficient
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Nicole00