Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

constantly getting tail inotify_fs_add() kind of logs in fluent bit #9981

Open
manasa-lingala opened this issue Feb 21, 2025 · 0 comments
Open

Comments

@manasa-lingala
Copy link

manasa-lingala commented Feb 21, 2025

I am not seeing logs but only seeing the below logs :

[2025/02/21 10:36:26] [ info] [input:tail:tail.0] inotify_fs_add(): inode=3355 watch_fd=20 name=/var/log/containers/menuservice-jsreport-preliveemea-84c4459f86-z9spd_menuservice_menuservice-jsreport-9269347a317a6aacc60ceb1a6e9f2295192792cc0f1167ebae74844af638d238.log
[2025/02/21 10:36:26] [ info] [input:tail:tail.0] inotify_fs_add(): inode=566379 watch_fd=21 name=/var/log/containers/notification-service-api-prelive-78489597c4-677w9_pds_api-970bfe811be3d69e37c2259df2ede85eeb78db5f7cc6c2feeceaf4b2fd742ecf.log
[2025/02/21 10:36:26] [ info] [input:tail:tail.0] inotify_fs_add(): inode=583580 watch_fd=22 name=/var/log/containers/notification-service-api-prelive-78489597c4-677w9_pds_vault-agent-init-9ad8433c3a85e1f3fb2b849aed7c2082fb9c61dd6ef6652cdc5e55adbbeb3a41.log
[2025/02/21 10:36:26] [ info] [input:tail:tail.0] inotify_fs_add(): inode=568172 watch_fd=23 name=/var/log/containers/notification-service-listener-emea-746cccf77c-n6hp5_pds_vault-agent-init-c12778990130f8c0aa60df6f13309b668bc6a433a9be7dd8fcb8bbe8c740820f.log
[2025/02/21 10:36:26] [ info] [input:tail:tail.0] inotify_fs_add(): inode=3443 watch_fd=24 name=/var/log/containers/ps-docman-report-preliveemea-79c68f76bf-927cz_coreapi_ps-docman-report-preliveemea-ed70cd3c66497fe93c6d8fa91d54c8cd1aee7911b5556af4488aeb50fffb00fc.log
[2025/02/21 10:36:26] [ info] [input:tail:tail.0] inotify_fs_add(): inode=3150 watch_fd=25 name=/var/log/containers/ps-docman-report-prodemea-6c4ff6559-csgmm_coreapi_ps-docman-report-prodemea-d782c50e4960a75b8fe573fe58498069203f5a389763707046a941620087008e.log
[2025/02/21 10:36:26] [ info] [input:tail:tail.0] inotify_fs_add(): inode=3339 watch_fd=26 name=/var/log/containers/ps-employee-preliveemea-87d4dff-9qwx9_coreapi_ps-employee-preliveemea-5e9a2b5885c54053ef5a6e041c3baf7a401f7cbfa9ea1ba6ffe3ab4a5420d8dc.log
[2025/02/21 10:36:26] [ info] [input:tail:tail.0] inotify_fs_add(): inode=3366 watch_fd=27 name=/var/log/containers/ps-statustopicfunction-preliveemea-c68f9567d-4vbv2_coreapi_ps-statustopicfunction-preliveemea-028b6ec3638425b61e6ad4bfaf153d0446ee15a31a0232a87660a891b7a6873c.log
[2025/02/21 10:36:26] [ info] [input:tail:tail.0] inotify_fs_add(): inode=583700 watch_fd=28 name=/var/log/containers/transferservice-api-prodemea-665fc84bb-8h8ws_coreapi_api-1b6d8586d71748c7be06659b1dcfeb89cd4acdcb331943ee315f4641e2b2851d.log
[2025/02/21 10:36:26] [ info] [input:tail:tail.0] inotify_fs_add(): inode=583687 watch_fd=29 name=/var/log/containers/transferservice-api-prodemea-665fc84bb-8h8ws_coreapi_vault-agent-init-eb57a7d1a6bcc29a12b86df4e088a66daadebe3b026592091ec37adb1aa6b942.log
[2025/02/21 10:36:26] [ info] [inpu


The below is the configuration:

apiVersion: v1
kind: ConfigMap
metadata:
name: collection-fluent-bit
labels:
app: collection-fluent-bit
data:
custom_parsers.conf: |
[PARSER]
Name multi_line
Format regex
Regex (?^{"log":"\d{4}-\d{1,2}-\d{1,2}.\d{2}:\d{2}:\d{2}.)
[PARSER]
Name crio
Format regex
Regex ^(?[^ ]+) (?stdout|stderr) (?[^ ]
) (?.)$
Time_Key time
Time_Format %Y-%m-%dT%H:%M:%S.%L%z
[PARSER]
Name containerd
Format regex
Regex ^(?[^ ]+) (?stdout|stderr) (?[^ ]
) (?.*)$
Time_Key time
Time_Format %Y-%m-%dT%H:%M:%S.%LZ

fluent-bit.conf: |
[SERVICE]
Flush 1
Daemon Off
Log_Level info
Parsers_File parsers.conf
Parsers_File custom_parsers.conf
HTTP_Server On
HTTP_Listen 0.0.0.0
HTTP_Port 2020

[INPUT]
    Name                tail
    Path                /var/log/containers/*.log
    Multiline.parser    cri
    Tag                 containers.*
    Refresh_Interval    10
    Rotate_Wait         10
    Mem_Buf_Limit       5MB
    Skip_Long_Lines     On
    DB                  /tail-db/tail-containers-state-sumo.db
    DB.Sync             Normal
    Buffer_Chunk_Size   64k
    Buffer_Max_Size     256k
[INPUT]
    Name            systemd
    Tag             host.*
    DB              /tail-db/systemd-state-sumo.db
    Systemd_Filter  _SYSTEMD_UNIT=addon-config.service
    Systemd_Filter  _SYSTEMD_UNIT=addon-run.service
    Systemd_Filter  _SYSTEMD_UNIT=cfn-etcd-environment.service
    Systemd_Filter  _SYSTEMD_UNIT=cfn-signal.service
    Systemd_Filter  _SYSTEMD_UNIT=clean-ca-certificates.service
    Systemd_Filter  _SYSTEMD_UNIT=containerd.service
    Systemd_Filter  _SYSTEMD_UNIT=coreos-metadata.service
    Systemd_Filter  _SYSTEMD_UNIT=coreos-setup-environment.service
    Systemd_Filter  _SYSTEMD_UNIT=coreos-tmpfiles.service
    Systemd_Filter  _SYSTEMD_UNIT=dbus.service
    Systemd_Filter  _SYSTEMD_UNIT=docker.service
    Systemd_Filter  _SYSTEMD_UNIT=efs.service
    Systemd_Filter  _SYSTEMD_UNIT=etcd-member.service
    Systemd_Filter  _SYSTEMD_UNIT=etcd.service
    Systemd_Filter  _SYSTEMD_UNIT=etcd2.service
    Systemd_Filter  _SYSTEMD_UNIT=etcd3.service
    Systemd_Filter  _SYSTEMD_UNIT=etcdadm-check.service
    Systemd_Filter  _SYSTEMD_UNIT=etcdadm-reconfigure.service
    Systemd_Filter  _SYSTEMD_UNIT=etcdadm-save.service
    Systemd_Filter  _SYSTEMD_UNIT=etcdadm-update-status.service
    Systemd_Filter  _SYSTEMD_UNIT=flanneld.service
    Systemd_Filter  _SYSTEMD_UNIT=format-etcd2-volume.service
    Systemd_Filter  _SYSTEMD_UNIT=kube-node-taint-and-uncordon.service
    Systemd_Filter  _SYSTEMD_UNIT=kubelet.service
    Systemd_Filter  _SYSTEMD_UNIT=ldconfig.service
    Systemd_Filter  _SYSTEMD_UNIT=locksmithd.service
    Systemd_Filter  _SYSTEMD_UNIT=logrotate.service
    Systemd_Filter  _SYSTEMD_UNIT=lvm2-monitor.service
    Systemd_Filter  _SYSTEMD_UNIT=mdmon.service
    Systemd_Filter  _SYSTEMD_UNIT=nfs-idmapd.service
    Systemd_Filter  _SYSTEMD_UNIT=nfs-mountd.service
    Systemd_Filter  _SYSTEMD_UNIT=nfs-server.service
    Systemd_Filter  _SYSTEMD_UNIT=nfs-utils.service
    Systemd_Filter  _SYSTEMD_UNIT=node-problem-detector.service
    Systemd_Filter  _SYSTEMD_UNIT=ntp.service
    Systemd_Filter  _SYSTEMD_UNIT=oem-cloudinit.service
    Systemd_Filter  _SYSTEMD_UNIT=rkt-gc.service
    Systemd_Filter  _SYSTEMD_UNIT=rkt-metadata.service
    Systemd_Filter  _SYSTEMD_UNIT=rpc-idmapd.service
    Systemd_Filter  _SYSTEMD_UNIT=rpc-mountd.service
    Systemd_Filter  _SYSTEMD_UNIT=rpc-statd.service
    Systemd_Filter  _SYSTEMD_UNIT=rpcbind.service
    Systemd_Filter  _SYSTEMD_UNIT=set-aws-environment.service
    Systemd_Filter  _SYSTEMD_UNIT=system-cloudinit.service
    Systemd_Filter  _SYSTEMD_UNIT=systemd-timesyncd.service
    Systemd_Filter  _SYSTEMD_UNIT=update-ca-certificates.service
    Systemd_Filter  _SYSTEMD_UNIT=user-cloudinit.service
    Systemd_Filter  _SYSTEMD_UNIT=var-lib-etcd2.service
    Max_Entries     1000
    Read_From_Tail  true

[FILTER]
    Name kubernetes
    Match kube.*
    Merge_Log On
    Keep_Log Off
    K8S-Logging.Parser On
    K8S-Logging.Exclude On

[OUTPUT]
    Name          forward
    Match         *
    Host          ${FLUENTD_LOGS_SVC}.${NAMESPACE}.svc.cluster.local.
    Port          24321
    Retry_Limit   False
    tls           off
    tls.verify    on
    tls.debug     1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant