feat: Spark benchmarking updates with generic files

[vara-bonthu]

What does this PR do?

🛑 Please open an issue first to discuss any significant work and flesh out details/direction. When we triage the issues, we will add labels to the issue like "Enhancement", "Bug" which should indicate to you that this issue can be worked on and we are looking forward to your PR. We would hate for your time to be wasted.
Consult the CONTRIBUTING guide for submitting pull-requests.

• Generic Managed node groups for Spark benchmarking
• One node group for EBS and another one for SSD. x86 and ARM can be modified accrodingly
• Apache YuniKorn is disabled due to some issues with either latest YuniKorn or the integration with Spark operator. Will investigate further
• Updated Spark Operator Manifests - one for EBS and another one for SSD to use shuffle as storage

Motivation

More

• Yes, I have tested the PR using my local account setup (Provide any test evidence report under Additional Notes)
• Mandatory for new blueprints. Yes, I have added a example to support my blueprint PR
• Mandatory for new blueprints. Yes, I have updated the website/docs or website/blog section for this feature
• Yes, I ran pre-commit run -a with this PR. Link for installing pre-commit locally

For Moderators

• E2E Test successfully complete before merge?

Additional Notes

[alanty]

LGTM