🩺 nic-health.sh 2.16.0  host server-01.example.net  2026-10-20T17:45:53Z  window 5.55s  level deep

Hardware
  0000:01:00  Mellanox Technologies MT2894 Family [ConnectX-6 Lx]  (mlx5_core, fw 26.47.1026 (LNV0000000036))
    └─ ens1f0np0 (up)  ens1f1np1 (up)
  0000:41:00  Mellanox Technologies MT2894 Family [ConnectX-6 Lx]  (mlx5_core, fw 26.47.1026 (LNV0000000037))
    └─ ens13f0np0 (up)  ens13f1np1 (up)
  0000:c1:00  Mellanox Technologies MT2894 Family [ConnectX-6 Lx]  (mlx5_core, fw 26.47.1026 (LNV0000000036))
    └─ ens5f0np0 (up)  ens5f1np1 (up)
  0000:e1:00  Mellanox Technologies MT2894 Family [ConnectX-6 Lx]  (mlx5_core, fw 26.47.1026 (LNV0000000036))
    └─ ens4f0np0 (up)  ens4f1np1 (up)

Checks
  SEVERITY  SCOPE  TARGET      CHECK              VALUE                                                       THRESHOLD                        HINT
  CRIT      port   ens1f0np0   mlx5.phy.errors    rx_symbol_err_phy=+66 rx_pcs_symbol_err_phy=+66 per window  >0 CRIT, pre-FEC BER>1e-06 WARN  Active FEC is Off at 25000 Mb/s: links at 25G and above normally rely on RS-FEC to correct routine bit errors; check that FEC matches on both ends. Uncorrectable symbol errors: traffic is being lost; clean/replace the optic or cable, check peer port and FEC mode
  WARN      port   ens1f0np0   mlx5.frame.errors  rx_crc_errors_phy=+67 per window                            >0 WARN                          Frame errors: CRC/fragments/jabbers point to cabling or optics; oversize frames to an MTU mismatch with the peer
  CRIT      port   ens13f1np1  mlx5.phy.errors    rx_symbol_err_phy=+15 rx_pcs_symbol_err_phy=+15 per window  >0 CRIT, pre-FEC BER>1e-06 WARN  Active FEC is Off at 25000 Mb/s: links at 25G and above normally rely on RS-FEC to correct routine bit errors; check that FEC matches on both ends. Uncorrectable symbol errors: traffic is being lost; clean/replace the optic or cable, check peer port and FEC mode
  WARN      port   ens13f1np1  mlx5.frame.errors  rx_crc_errors_phy=+15 per window                            >0 WARN                          Frame errors: CRC/fragments/jabbers point to cabling or optics; oversize frames to an MTU mismatch with the peer
  CRIT      port   ens5f0np0   mlx5.phy.errors    rx_symbol_err_phy=+4 rx_pcs_symbol_err_phy=+4 per window    >0 CRIT, pre-FEC BER>1e-06 WARN  Active FEC is Off at 25000 Mb/s: links at 25G and above normally rely on RS-FEC to correct routine bit errors; check that FEC matches on both ends. Uncorrectable symbol errors: traffic is being lost; clean/replace the optic or cable, check peer port and FEC mode
  WARN      port   ens5f0np0   mlx5.frame.errors  rx_crc_errors_phy=+4 per window                             >0 WARN                          Frame errors: CRC/fragments/jabbers point to cabling or optics; oversize frames to an MTU mismatch with the peer
  CRIT      port   ens4f1np1   mlx5.phy.errors    rx_symbol_err_phy=+4 rx_pcs_symbol_err_phy=+4 per window    >0 CRIT, pre-FEC BER>1e-06 WARN  Active FEC is Off at 25000 Mb/s: links at 25G and above normally rely on RS-FEC to correct routine bit errors; check that FEC matches on both ends. Uncorrectable symbol errors: traffic is being lost; clean/replace the optic or cable, check peer port and FEC mode
  WARN      port   ens4f1np1   mlx5.frame.errors  rx_crc_errors_phy=+4 per window                             >0 WARN                          Frame errors: CRC/fragments/jabbers point to cabling or optics; oversize frames to an MTU mismatch with the peer
  WARN      port   ens1f0np0   mlx5.deep.fec      link: No FEC                                                module FEC = link FEC            Module is specified for operation with FEC but the link runs without it: enable RS-FEC on both ends (NIC and switch port)
  WARN      port   ens1f0np0   mlx5.deep.ber      effective 5E-10 raw 5E-10                                   effective<1E-12                  Average since the last counter clear (71744.6 min) exceeds 1E-12: clean/replace the optic or cable, check FEC; mlx5.phy.errors shows whether errors are still growing
  WARN      port   ens1f1np1   mlx5.deep.fec      link: No FEC                                                module FEC = link FEC            Module is specified for operation with FEC but the link runs without it: enable RS-FEC on both ends (NIC and switch port)
  WARN      port   ens13f0np0  mlx5.deep.fec      link: No FEC                                                module FEC = link FEC            Module is specified for operation with FEC but the link runs without it: enable RS-FEC on both ends (NIC and switch port)
  WARN      port   ens13f1np1  mlx5.deep.fec      link: No FEC                                                module FEC = link FEC            Module is specified for operation with FEC but the link runs without it: enable RS-FEC on both ends (NIC and switch port)
  WARN      port   ens13f1np1  mlx5.deep.ber      effective 8E-11 raw 8E-11                                   effective<1E-12                  Average since the last counter clear (71744.8 min) exceeds 1E-12: clean/replace the optic or cable, check FEC; mlx5.phy.errors shows whether errors are still growing
  WARN      port   ens5f0np0   mlx5.deep.fec      link: No FEC                                                module FEC = link FEC            Module is specified for operation with FEC but the link runs without it: enable RS-FEC on both ends (NIC and switch port)
  WARN      port   ens5f0np0   mlx5.deep.ber      effective 6E-12 raw 6E-12                                   effective<1E-12                  Average since the last counter clear (71744.6 min) exceeds 1E-12: clean/replace the optic or cable, check FEC; mlx5.phy.errors shows whether errors are still growing
  WARN      port   ens5f1np1   mlx5.deep.fec      link: No FEC                                                module FEC = link FEC            Module is specified for operation with FEC but the link runs without it: enable RS-FEC on both ends (NIC and switch port)
  WARN      port   ens4f0np0   mlx5.deep.fec      link: No FEC                                                module FEC = link FEC            Module is specified for operation with FEC but the link runs without it: enable RS-FEC on both ends (NIC and switch port)
  WARN      port   ens4f1np1   mlx5.deep.fec      link: No FEC                                                module FEC = link FEC            Module is specified for operation with FEC but the link runs without it: enable RS-FEC on both ends (NIC and switch port)
  WARN      port   ens4f1np1   mlx5.deep.ber      effective 3E-11 raw 3E-11                                   effective<1E-12                  Average since the last counter clear (71744.7 min) exceeds 1E-12: clean/replace the optic or cable, check FEC; mlx5.phy.errors shows whether errors are still growing
  160 OK/N/A rows hidden (-a/--all to show)

Summary: ✅ 160 OK   ⚠️ 16 WARN   ❌ 4 CRIT   ❔ 0 UNKNOWN   ➖ 0 N/A   → CRIT (exit 2)
