[CSIT-1977] E810: Unsent packets at moderate load can fail soak

[vvalderrv]

Description

Depending on where in the search the trial with unsent packet happens, the test may not fail, just report low critical load, which is worse than failing. For high load, unsent packets are expected as a symptom of duration stretching. But at not so high load, unsent packets count as loss that has large consequences due to fitting functions. Here [0] the fifth trial had 326 unsent packets. I do not think the AVF driver on VPP side is guilty, this is probably a trex issue. Infra workaround by using more reliable NIC is preferred, but if that is not viable, soak tests could include additional workarounds to filter out bad trials.

[0] https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-vpp-perf-report-iterative-2410-2n-icx/60/log.html.gz#s1-s1-s1-s4-s2-t1-k2-k9-k13

Assignee

Vratko Polak

Reporter

Vratko Polak

Comments

No comments.

Original issue: https://jira.fd.io/browse/CSIT-1977

[vrpolakatcisco]

Looking at release results [1], this issue is either fixed or less frequent. After two migrations (ubuntu2404 and dev_iavf) some anomalies are visible in trending [2], but they do not exhibit unsent packets (outside max load trial), so they will be tracked as a different issue. This one can be closed.

[1] https://csit.fd.io/report/#eNrtlMFuwjAMhp-mXCajxDR0lx0GfQ8UghlogWZJqMaeHoM2ORXbYReEpl0SR98f2_EvJeUu0iKRf6rMrGpmFTbbFS_V5PmBt-gT1lpBHwJgPeYokiebCHAPKUTQSr0QBk2PWrk3sP0aPMK0XoJ2QHnDp3e3PF9InX09J8b5Z-KrKkJXhyyUaw9IT1HgoCmRhc2x0PzUquhtJCsXPArJlIpeyheJZh3tjtL2g0TIExDueMaCtBtmz8dQ0K8xNe1F8q0jRuENHOEq_4781hEz5ujeHCmb-mOOmHa07-Lu8nuZ9gT11UeD
[2] https://csit.fd.io/trending/#eNp1kMsSgjAMRb-mbpzM0CrixoXIfzilBGHkUZuK4tdbHJ3Awk3T9tzcPMj3Ds-EzUHEqUhSoZK6CIfYHNchDNaC6oCsAxlFF1RW4l5G5gZ6KKFRsNvmIA2gr8LraXJNCNTr62ShTpNFcfcLPya2Gpn8rcJ67VBzQqOYeKRZkXkzrCmdbpHqF7IwNM_chEUwkmbp7kc7o78Jk0zE2arrXftZX7hT1T_Au1o39P16A9JdYH0