Skip to content

Rewrite the data-loader in go and allow the data-loader to be modified #2254

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 6 commits into
base: main
Choose a base branch
from

Conversation

johscheuer
Copy link
Member

Description

Rewrite the data-loader in go and allow the data-loader to be modified

Type of change

  • Other

Discussion

This allows to load more data into a. cluster if wanted. I also changed the data-loader to be in go instead of Python, that makes it easier to make the dependencies.

Testing

Ran the tests manually with the new image.

Documentation

Follow-up

@johscheuer johscheuer requested a review from nicmorales9 March 19, 2025 16:49
@foundationdb-ci
Copy link
Contributor

Result of fdb-kubernetes-operator-pr on Linux CentOS 7

  • Commit ID: ce6dbeb
  • Duration 0:05:24
  • Result: ❌ FAILED
  • Error: Error while executing command: IMG=${REGISTRY}/${OPERATOR_IMAGE} make container-build container-push. Reason: exit status 2
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

Result of fdb-kubernetes-operator-pr on Linux CentOS 7

  • Commit ID: bdd528d
  • Duration 3:13:08
  • Result: ❌ FAILED
  • Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

Result of fdb-kubernetes-operator-pr on Linux CentOS 7

  • Commit ID: ab1ec08
  • Duration 3:21:52
  • Result: ❌ FAILED
  • Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

Result of fdb-kubernetes-operator-pr on Linux CentOS 7

  • Commit ID: 6da4b0b
  • Duration 2:21:09
  • Result: ❌ FAILED
  • Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@johscheuer johscheuer force-pushed the update-data-loader-job branch from 6da4b0b to 8313e41 Compare March 26, 2025 09:28
@foundationdb-ci
Copy link
Contributor

Result of fdb-kubernetes-operator-pr on Linux CentOS 7

  • Commit ID: 8313e41
  • Duration 1:48:38
  • Result: ❌ FAILED
  • Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

Result of fdb-kubernetes-operator-pr on Linux CentOS 7

  • Commit ID: 9ac94c1
  • Duration 2:33:26
  • Result: ❌ FAILED
  • Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

Copy link
Contributor

@nicmorales9 nicmorales9 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would definitely test the multi-cluster path but otherwise LGTM

@johscheuer johscheuer force-pushed the update-data-loader-job branch from 9ac94c1 to 19bbc19 Compare May 13, 2025 17:28
@foundationdb-ci
Copy link
Contributor

Result of fdb-kubernetes-operator-pr on Linux RHEL 9

  • Commit ID: 19bbc19
  • Duration 1:50:47
  • Result: ❌ FAILED
  • Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants