disable custom metrics

[pfrcks]

This pull request primarily introduces the ability to enable custom metrics in the system. It also makes adjustments to the conditions under which resource optimization is performed and modifies several configuration files.

The key changes are as follows:

Environment Variable Introduction:

• build/common/installer/scripts/fluent-bit-conf-customizer.rb: Introduced a new environment variable ENABLE_CUSTOM_METRICS to enable or disable custom metrics.

Condition Modification:

• build/common/installer/scripts/fluent-bit-conf-customizer.rb: Modified the condition for resource optimization. Now, resource optimization will be performed if the system is Linux and custom metrics are not enabled, or if the system is Windows and Fluent Bit is not disabled.

Disabling Resource Optimization:

• build/common/installer/scripts/tomlparser-agent-config.rb: If custom metrics are enabled, resource optimization is disabled.

Custom Metrics Enabling:

• build/common/installer/scripts/tomlparser-common-agent-config.rb: Added the ability to enable custom metrics through the parsed configuration.

Configuration File Changes:

• build/linux/installer/conf/container-cm.conf, build/linux/installer/conf/kube-cm.conf: Added new configurations for custom metrics. [1] [2]
• build/linux/installer/conf/container.conf, build/linux/installer/conf/kube.conf: Removed configurations related to custom metrics. [1] [2] [3] [4] [5] [6]

[pfrcks]

@ganga1980 Do I need the changes in charts/azuremonitor-containers in charts/azuremonitor-containers-geneva as well?

[ganga1980]

@ganga1980 Do I need the changes in charts/azuremonitor-containers in charts/azuremonitor-containers-geneva as well?

no, we dont need.

[pfrcks]

1. Tested MSI and Legacy Mode
2. Tested enablement of custom metrics via cm
3. Tested updated livenessprobe functionality of windows by manually stopping fluentd in normal scenarios
4. Tested fluentd presence on windows for legacy mode and absence for msi mode

All comparison in order -> image with disabled custom metrics followed by image 3.1.20

MSI Linux DS MEM

MSI Linux DS CPU

MSI Linux RS MEM

MSI Linux RS CPU

MSI Windows DS WorkingSet Bytes

MSI Windows DS CPU

Legacy DS MEM

Legacy DS CPU

Legacy RS MEM

Legacy RS CPU

Legacy Windows WorkingSet

Legacy Windows CPU

Major improvement in Windows platform for both Legacy and MSI (30 MB improvement in Legacy vs 125 MB improvement in MSI)
Minor improvement in RS for both Legacy and MSI
Similar values in DS for both Legacy and MSI