Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Access private protected object storage #51

Open
ccancellieri opened this issue Oct 8, 2021 · 0 comments
Open

Access private protected object storage #51

ccancellieri opened this issue Oct 8, 2021 · 0 comments

Comments

@ccancellieri
Copy link

ccancellieri commented Oct 8, 2021

Hi,
I'm proposing to add an option to let ckan instance to work as a proxy to download private data.

Currently if I would like to access to a bucket (not Azure, etc, I'm on Google) I've to set it as public.

If file object is protected I get:


<Error>
<Code>AccessDenied</Code>
<Message>Access denied.</Message>
<Details>Anonymous caller does not have storage.objects.get access to the Google Cloud Storage object.</Details>
</Error>

ccancellieri added a commit to ccancellieri/ckanext-cloudstorage that referenced this issue Oct 9, 2021
ccancellieri added a commit to ccancellieri/ckanext-cloudstorage that referenced this issue Jan 25, 2024
* pgrade libcloud to 2.8.3

This implements: Upgrade libcloud to the latest release supporting python TkTech#53

* introduce Google Cloud Bucket support TkTech#51

* add internal proxy for private files

* introduce Google Cloud Bucket signed temporary url

* better document google installation and configuration

* safer fail fast check

* fix for safe url

* update requirements

* update generate_signed_url

* update generate_signed_url (#3)

Co-authored-by: boxdev <[email protected]>

* update requirements.txt

* Add Function for Generating Signed URLs with User Impersonation in Google Cloud Storage

* Refactor and Extend Cloud Storage Integration for Enhanced Azure, Google Cloud, and Error Handling

* Implement Bucket Management and IAM Permission Features for Google Cloud Storage Integration

* Implement Command Pattern for Group Management and GCP Bucket Creation

* Add Exception Handling for GCP Group Creation, Deletion, and Member Management

* Add Functionality for Creating Authorized Sessions with GCP ID Tokens

* Implement Authorization Checks for GCP Group and Member Management

* Integrate GCP Group Workspace Management with CKAN Organization Actions

* Extend CloudStoragePlugin with Organization and Member Management Actions

* update bucket path

* Add etl feature

* Update readme file

* Add check_resource_directories

* Add Storage dir constant

* remove ckan api key form constants

* Add ckan root path constant

* update readme file

---------

Co-authored-by: Carlo Cancellieri <[email protected]>
Co-authored-by: boxdev <[email protected]>
Co-authored-by: Carlo Cancellieri <[email protected]>
Co-authored-by: Carlo Cancellieri <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant