Extend Configuration of AWS EBS SCI StorageClass

[YuryHrytsuk]

What would you like to be added

Current template does not let configure Parameters or Annotations of Storage Class.

For example,

• template hardcodes gp2 type which is not the best practice anymore (https://aws.amazon.com/blogs/storage/migrate-your-amazon-ebs-volumes-from-gp2-to-gp3-and-save-up-to-20-on-costs/)
• there is no way to configure storage class to be default (https://kubernetes.io/docs/concepts/storage/storage-classes/#default-storageclass)

kind: StorageClass
apiVersion: storage.k8s.io/v1
metadata:
  name: ebs-sc
provisioner: ebs.csi.aws.com
volumeBindingMode: WaitForFirstConsumer
parameters:
  csi.storage.k8s.io/fstype: xfs
  type: gp2
{% if restrict_az_provisioning %}
allowedTopologies:
- matchLabelExpressions:
  - key: topology.ebs.csi.aws.com/zone
    values:
{% for value in aws_ebs_availability_zones %}
      - {{ value }}
{% endfor %}
{% endif %}

Why is this needed

• I want to make AWS EBS SCI Storage Class a default (basic use case)
• I want to override default type of ebs and use gp3 (or other types based on need)
  • I potentially want to optimise iops or throughput of EBS

[KubeKyrie]

/assign