[ 0.000000] Linux version 5.14.0-570.125.1.el9_6.x86_64 (mockbuild@x86-64-03.build.eng.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-5), GNU ld version 2.35.2-63.el9_6.1) #1 SMP PREEMPT_DYNAMIC Wed Jun 24 21:38:21 EDT 2026 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,gpt3)/boot/ostree/rhcos-fa3028af2416c8a48a9fc8ad94cb16943b8b00a80ec6eff250e0837db5acadba/vmlinuz-5.14.0-570.125.1.el9_6.x86_64 rw ostree=/ostree/boot.0/rhcos/fa3028af2416c8a48a9fc8ad94cb16943b8b00a80ec6eff250e0837db5acadba/0 ignition.platform.id=aws console=tty0 console=ttyS0,115200n8 root=UUID=c0db8a3e-936d-4a00-8937-48466aace162 rw rootflags=prjquota boot=UUID=d5bbad84-da2d-4a74-9d03-e483c5975593 systemd.unified_cgroup_hierarchy=1 cgroup_no_v1=all [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffe8fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffe9000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000e03fffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000008229fffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000822a00000-0x000000083fffffff] reserved [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 2.7 present. [ 0.000000] DMI: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 15488173059 cycles [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000005] tsc: Detected 2499.998 MHz processor [ 0.000485] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000488] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000493] last_pfn = 0x822a00 max_arch_pfn = 0x400000000 [ 0.000523] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs [ 0.000526] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000561] last_pfn = 0xbffe9 max_arch_pfn = 0x400000000 [ 0.007596] Using GB pages for direct mapping [ 0.007896] RAMDISK: [mem 0x2b091000-0x31840fff] [ 0.007907] ACPI: Early table checksum verification disabled [ 0.007909] ACPI: RSDP 0x00000000000F8F00 000014 (v00 AMAZON) [ 0.007913] ACPI: RSDT 0x00000000BFFEDF40 000044 (v01 AMAZON AMZNRSDT 00000001 AMZN 00000001) [ 0.007918] ACPI: WAET 0x00000000BFFEFFC0 000028 (v01 AMAZON AMZNWAET 00000001 AMZN 00000001) [ 0.007922] ACPI: SLIT 0x00000000BFFEFF40 00006C (v01 AMAZON AMZNSLIT 00000001 AMZN 00000001) [ 0.007925] ACPI: APIC 0x00000000BFFEFE80 0000A6 (v01 AMAZON AMZNAPIC 00000001 AMZN 00000001) [ 0.007928] ACPI: SRAT 0x00000000BFFEFD80 000100 (v01 AMAZON AMZNSRAT 00000001 AMZN 00000001) [ 0.007931] ACPI: FACP 0x00000000BFFEFC40 000114 (v01 AMAZON AMZNFACP 00000001 AMZN 00000001) [ 0.007936] ACPI: DSDT 0x00000000BFFEEA80 00115A (v01 AMAZON AMZNDSDT 00000001 AMZN 00000001) [ 0.007939] ACPI: FACS 0x00000000000F8EC0 000040 [ 0.007941] ACPI: HPET 0x00000000BFFEFC00 000038 (v01 AMAZON AMZNHPET 00000001 AMZN 00000001) [ 0.007944] ACPI: SSDT 0x00000000BFFEE0C0 0009AC (v01 AMAZON AMZNSSDT 00000001 AMZN 00000001) [ 0.007947] ACPI: SSDT 0x00000000BFFEDFC0 0000D1 (v01 AMAZON AMZNSSDT 00000001 AMZN 00000001) [ 0.007949] ACPI: Reserving WAET table memory at [mem 0xbffeffc0-0xbffeffe7] [ 0.007950] ACPI: Reserving SLIT table memory at [mem 0xbffeff40-0xbffeffab] [ 0.007951] ACPI: Reserving APIC table memory at [mem 0xbffefe80-0xbffeff25] [ 0.007952] ACPI: Reserving SRAT table memory at [mem 0xbffefd80-0xbffefe7f] [ 0.007952] ACPI: Reserving FACP table memory at [mem 0xbffefc40-0xbffefd53] [ 0.007953] ACPI: Reserving DSDT table memory at [mem 0xbffeea80-0xbffefbd9] [ 0.007954] ACPI: Reserving FACS table memory at [mem 0xf8ec0-0xf8eff] [ 0.007955] ACPI: Reserving HPET table memory at [mem 0xbffefc00-0xbffefc37] [ 0.007955] ACPI: Reserving SSDT table memory at [mem 0xbffee0c0-0xbffeea6b] [ 0.007956] ACPI: Reserving SSDT table memory at [mem 0xbffedfc0-0xbffee090] [ 0.008009] SRAT: PXM 0 -> APIC 0x00 -> Node 0 [ 0.008011] SRAT: PXM 0 -> APIC 0x01 -> Node 0 [ 0.008013] SRAT: PXM 0 -> APIC 0x02 -> Node 0 [ 0.008014] SRAT: PXM 0 -> APIC 0x03 -> Node 0 [ 0.008016] SRAT: PXM 0 -> APIC 0x04 -> Node 0 [ 0.008017] SRAT: PXM 0 -> APIC 0x05 -> Node 0 [ 0.008019] SRAT: PXM 0 -> APIC 0x06 -> Node 0 [ 0.008020] SRAT: PXM 0 -> APIC 0x07 -> Node 0 [ 0.008023] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff] [ 0.008026] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x83fffffff] [ 0.008037] NUMA: Initialized distance table, cnt=1 [ 0.008040] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x8229fffff] -> [mem 0x00000000-0x8229fffff] [ 0.008050] NODE_DATA(0) allocated [mem 0x8229d4000-0x8229fefff] [ 0.008332] Zone ranges: [ 0.008332] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008334] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008335] Normal [mem 0x0000000100000000-0x00000008229fffff] [ 0.008337] Device empty [ 0.008338] Movable zone start for each node [ 0.008340] Early memory node ranges [ 0.008340] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.008342] node 0: [mem 0x0000000000100000-0x00000000bffe8fff] [ 0.008343] node 0: [mem 0x0000000100000000-0x00000008229fffff] [ 0.008347] Initmem setup node 0 [mem 0x0000000000001000-0x00000008229fffff] [ 0.008355] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008398] On node 0, zone DMA: 97 pages in unavailable ranges [ 0.016959] On node 0, zone Normal: 23 pages in unavailable ranges [ 0.017293] On node 0, zone Normal: 22016 pages in unavailable ranges [ 0.017715] ACPI: PM-Timer IO Port: 0xb008 [ 0.017727] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.017788] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 [ 0.017791] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.017793] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.017794] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.017795] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.017799] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.017800] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.017803] TSC deadline timer available [ 0.017809] CPU topo: Max. logical packages: 1 [ 0.017809] CPU topo: Max. logical dies: 1 [ 0.017810] CPU topo: Max. dies per package: 1 [ 0.017815] CPU topo: Max. threads per core: 2 [ 0.017815] CPU topo: Num. cores per package: 4 [ 0.017816] CPU topo: Num. threads per package: 8 [ 0.017817] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.017833] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() [ 0.017849] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.017851] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.017852] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.017853] PM: hibernation: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.017855] PM: hibernation: Registered nosave memory: [mem 0xbffe9000-0xbfffffff] [ 0.017856] PM: hibernation: Registered nosave memory: [mem 0xc0000000-0xdfffffff] [ 0.017857] PM: hibernation: Registered nosave memory: [mem 0xe0000000-0xe03fffff] [ 0.017858] PM: hibernation: Registered nosave memory: [mem 0xe0400000-0xfffbffff] [ 0.017858] PM: hibernation: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.017860] [mem 0xc0000000-0xdfffffff] available for PCI devices [ 0.017861] Booting paravirtualized kernel on KVM [ 0.017863] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.023585] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.023978] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.023983] pcpu-alloc: s225280 r8192 d28672 u262144 alloc=1*2097152 [ 0.023985] pcpu-alloc: [0] 0 1 2 3 4 5 6 7 [ 0.024410] kvm-guest: PV spinlocks disabled, no host support [ 0.024411] Kernel command line: BOOT_IMAGE=(hd0,gpt3)/boot/ostree/rhcos-fa3028af2416c8a48a9fc8ad94cb16943b8b00a80ec6eff250e0837db5acadba/vmlinuz-5.14.0-570.125.1.el9_6.x86_64 rw ostree=/ostree/boot.0/rhcos/fa3028af2416c8a48a9fc8ad94cb16943b8b00a80ec6eff250e0837db5acadba/0 ignition.platform.id=aws console=tty0 console=ttyS0,115200n8 root=UUID=c0db8a3e-936d-4a00-8937-48466aace162 rw rootflags=prjquota boot=UUID=d5bbad84-da2d-4a74-9d03-e483c5975593 systemd.unified_cgroup_hierarchy=1 cgroup_no_v1=all [ 0.024561] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,gpt3)/boot/ostree/rhcos-fa3028af2416c8a48a9fc8ad94cb16943b8b00a80ec6eff250e0837db5acadba/vmlinuz-5.14.0-570.125.1.el9_6.x86_64 ostree=/ostree/boot.0/rhcos/fa3028af2416c8a48a9fc8ad94cb16943b8b00a80ec6eff250e0837db5acadba/0 boot=UUID=d5bbad84-da2d-4a74-9d03-e483c5975593", will be passed to user space. [ 0.024580] random: crng init done [ 0.029174] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.031474] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.031605] Fallback order for Node 0: 0 [ 0.031608] Built 1 zonelists, mobility grouping on. Total pages: 8138817 [ 0.031609] Policy zone: Normal [ 0.031936] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.031941] software IO TLB: area num 8. [ 0.059008] Memory: 3103712K/33072668K available (16384K kernel code, 5760K rwdata, 13672K rodata, 4060K init, 7360K bss, 798432K reserved, 0K cma-reserved) [ 0.059212] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.059222] Kernel/User page tables isolation: enabled [ 0.059249] ftrace: allocating 49216 entries in 193 pages [ 0.068270] ftrace: allocated 193 pages with 3 groups [ 0.068992] Dynamic Preempt: voluntary [ 0.069052] rcu: Preemptible hierarchical RCU implementation. [ 0.069053] rcu: RCU event tracing is enabled. [ 0.069054] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.069055] Trampoline variant of Tasks RCU enabled. [ 0.069056] Rude variant of Tasks RCU enabled. [ 0.069056] Tracing variant of Tasks RCU enabled. [ 0.069057] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.069058] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069067] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 0.069069] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 0.069071] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 0.073112] NR_IRQS: 524544, nr_irqs: 488, preallocated irqs: 16 [ 0.073333] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.073445] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.220385] Console: colour VGA+ 80x25 [ 0.220388] printk: legacy console [tty0] enabled [ 0.799959] printk: console [ttyS0] enabled [ 0.957660] ACPI: Core revision 20230331 [ 0.961347] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns [ 0.968733] APIC: Switch to symmetric I/O mode setup [ 0.973051] x2apic enabled [ 0.976550] APIC: Switched APIC routing to: physical x2apic [ 1.048777] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x240937b9988, max_idle_ns: 440795218083 ns [ 1.056728] Calibrating delay loop (skipped) preset value.. 4999.99 BogoMIPS (lpj=2499998) [ 1.057724] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.057724] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.057724] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.057724] Spectre V2 : Mitigation: Retpolines [ 1.057724] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.057724] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.057724] RETBleed: WARNING: Spectre v2 mitigation leaves CPU vulnerable to RETBleed attacks, data leaks possible! [ 1.057724] RETBleed: Vulnerable [ 1.057724] Speculative Store Bypass: Vulnerable [ 1.057724] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.057724] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.057724] GDS: Unknown: Dependent on hypervisor status [ 1.057724] ITS: Mitigation: Aligned branch/return thunks [ 1.057724] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.057724] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.057724] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.057724] x86/fpu: Supporting XSAVE feature 0x008: 'MPX bounds registers' [ 1.057724] x86/fpu: Supporting XSAVE feature 0x010: 'MPX CSR' [ 1.057724] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' [ 1.057724] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' [ 1.057724] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' [ 1.057724] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' [ 1.057724] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.057724] x86/fpu: xstate_offset[3]: 832, xstate_sizes[3]: 64 [ 1.057724] x86/fpu: xstate_offset[4]: 896, xstate_sizes[4]: 64 [ 1.057724] x86/fpu: xstate_offset[5]: 960, xstate_sizes[5]: 64 [ 1.057724] x86/fpu: xstate_offset[6]: 1024, xstate_sizes[6]: 512 [ 1.057724] x86/fpu: xstate_offset[7]: 1536, xstate_sizes[7]: 1024 [ 1.057724] x86/fpu: xstate_offset[9]: 2560, xstate_sizes[9]: 8 [ 1.057724] x86/fpu: Enabled xstate features 0x2ff, context size is 2568 bytes, using 'compacted' format. [ 1.057724] Freeing SMP alternatives memory: 40K [ 1.057724] pid_max: default: 32768 minimum: 301 [ 1.057724] LSM: initializing lsm=lockdown,capability,landlock,yama,integrity,selinux,bpf [ 1.057724] landlock: Up and running. [ 1.057724] Yama: becoming mindful. [ 1.057724] SELinux: Initializing. [ 1.057724] LSM support for eBPF active [ 1.057724] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.057724] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.057724] cgroup: Disabling cpuset control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling cpu control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling cpuacct control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling blkio control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling memory control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling devices control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling freezer control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling net_cls control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling perf_event control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling net_prio control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling hugetlb control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling pids control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling rdma control group subsystem in v1 mounts [ 1.057724] cgroup: Disabling misc control group subsystem in v1 mounts [ 1.057724] smpboot: CPU0: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz (family: 0x6, model: 0x55, stepping: 0x7) [ 1.058930] Performance Events: unsupported p6 CPU model 85 no PMU driver, software events only. [ 1.060763] signal: max sigframe size: 3632 [ 1.061785] Estimated ratio of average max frequency by base frequency (times 1024): 1351 [ 1.063764] rcu: Hierarchical SRCU implementation. [ 1.064727] rcu: Max phase no-delay instances is 400. [ 1.070040] NMI watchdog: Perf NMI watchdog permanently disabled [ 1.071792] smp: Bringing up secondary CPUs ... [ 1.073543] smpboot: x86: Booting SMP configuration: [ 1.073728] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.077915] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.079727] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.083872] smp: Brought up 1 node, 8 CPUs [ 1.084729] smpboot: Total of 8 processors activated (39999.96 BogoMIPS) [ 1.116233] node 0 deferred pages initialised in 30ms [ 1.120797] devtmpfs: initialized [ 1.121756] x86/mm: Memory block size: 128MB [ 1.124822] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.125732] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.126812] pinctrl core: initialized pinctrl subsystem [ 1.128219] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.128865] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.129730] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.130729] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.131743] audit: initializing netlink subsys (disabled) [ 1.132742] audit: type=2000 audit(1783370086.857:1): state=initialized audit_enabled=0 res=1 [ 1.132826] thermal_sys: Registered thermal governor 'fair_share' [ 1.133731] thermal_sys: Registered thermal governor 'step_wise' [ 1.134727] thermal_sys: Registered thermal governor 'user_space' [ 1.135737] cpuidle: using governor menu [ 1.137871] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.138861] PCI: Using configuration type 1 for base access [ 1.141448] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.141761] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.142728] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.143728] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.144727] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.145785] Demotion targets for Node 0: null [ 1.146768] cryptd: max_cpu_qlen set to 1000 [ 1.147792] ACPI: Added _OSI(Module Device) [ 1.148728] ACPI: Added _OSI(Processor Device) [ 1.149728] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.150738] ACPI: Added _OSI(Processor Aggregator Device) [ 1.152422] ACPI: 3 ACPI AML tables successfully acquired and loaded [ 1.153023] ACPI: _OSC evaluation for CPUs failed, trying _PDC [ 1.153963] ACPI: Interpreter enabled [ 1.154736] ACPI: PM: (supports S0 S4 S5) [ 1.155728] ACPI: Using IOAPIC for interrupt routing [ 1.156795] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.157728] PCI: Using E820 reservations for host bridge windows [ 1.158808] ACPI: Enabled 2 GPEs in block 00 to 0F [ 1.161597] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 1.161731] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.162728] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 1.163734] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge [ 1.165040] acpiphp: Slot [3] registered [ 1.165748] acpiphp: Slot [4] registered [ 1.166741] acpiphp: Slot [5] registered [ 1.167741] acpiphp: Slot [6] registered [ 1.168742] acpiphp: Slot [7] registered [ 1.169741] acpiphp: Slot [8] registered [ 1.170741] acpiphp: Slot [9] registered [ 1.171741] acpiphp: Slot [10] registered [ 1.172741] acpiphp: Slot [11] registered [ 1.173741] acpiphp: Slot [12] registered [ 1.174741] acpiphp: Slot [13] registered [ 1.175742] acpiphp: Slot [14] registered [ 1.176743] acpiphp: Slot [15] registered [ 1.177742] acpiphp: Slot [16] registered [ 1.178741] acpiphp: Slot [17] registered [ 1.179741] acpiphp: Slot [18] registered [ 1.180742] acpiphp: Slot [19] registered [ 1.181744] acpiphp: Slot [20] registered [ 1.182741] acpiphp: Slot [21] registered [ 1.183741] acpiphp: Slot [22] registered [ 1.184741] acpiphp: Slot [23] registered [ 1.185741] acpiphp: Slot [24] registered [ 1.186741] acpiphp: Slot [25] registered [ 1.187741] acpiphp: Slot [26] registered [ 1.188742] acpiphp: Slot [27] registered [ 1.189741] acpiphp: Slot [28] registered [ 1.190741] acpiphp: Slot [29] registered [ 1.191741] acpiphp: Slot [30] registered [ 1.192740] acpiphp: Slot [31] registered [ 1.193736] PCI host bridge to bus 0000:00 [ 1.194730] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.195728] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 1.196727] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.197728] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 1.198729] pci_bus 0000:00: root bus resource [mem 0x840000000-0x20083fffffff window] [ 1.199728] pci_bus 0000:00: root bus resource [bus 00-ff] [ 1.200770] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint [ 1.202177] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint [ 1.203608] pci 0000:00:01.3: [8086:7113] type 00 class 0x000000 conventional PCI endpoint [ 1.204375] pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI [ 1.204742] pci 0000:00:01.3: quirk: [io 0xb100-0xb10f] claimed by PIIX4 SMB [ 1.205782] pci 0000:00:01.3: PIIX4 devres E PIO at fff0-ffff [ 1.206741] pci 0000:00:01.3: PIIX4 devres F MMIO at ffc00000-ffffffff [ 1.207741] pci 0000:00:01.3: PIIX4 devres G PIO at fff0-ffff [ 1.208741] pci 0000:00:01.3: PIIX4 devres H MMIO at ffc00000-ffffffff [ 1.209741] pci 0000:00:01.3: PIIX4 devres I PIO at fff0-ffff [ 1.210742] pci 0000:00:01.3: PIIX4 devres J PIO at fff0-ffff [ 1.211998] pci 0000:00:03.0: [1d0f:1111] type 00 class 0x030000 conventional PCI endpoint [ 1.213729] pci 0000:00:03.0: BAR 0 [mem 0xfe400000-0xfe7fffff pref] [ 1.214810] pci 0000:00:03.0: ROM [mem 0xfebd0000-0xfebdffff pref] [ 1.215815] pci 0000:00:03.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.217010] pci 0000:00:04.0: [1d0f:8061] type 00 class 0x010802 PCIe Endpoint [ 1.218739] pci 0000:00:04.0: BAR 0 [mem 0xfebf0000-0xfebf3fff] [ 1.220276] pci 0000:00:05.0: [1d0f:ec20] type 00 class 0x020000 PCIe Endpoint [ 1.221738] pci 0000:00:05.0: BAR 0 [mem 0xfebf4000-0xfebf7fff] [ 1.222742] pci 0000:00:05.0: BAR 2 [mem 0xfe800000-0xfe8fffff pref] [ 1.223741] pci 0000:00:05.0: BAR 4 [mem 0xfebe0000-0xfebeffff] [ 1.225613] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 1.225819] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.226814] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 1.227816] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.228769] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 1.230176] iommu: Default domain type: Translated [ 1.230728] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.231828] SCSI subsystem initialized [ 1.232752] ACPI: bus type USB registered [ 1.233746] usbcore: registered new interface driver usbfs [ 1.234762] usbcore: registered new interface driver hub [ 1.235738] usbcore: registered new device driver usb [ 1.236754] pps_core: LinuxPPS API ver. 1 registered [ 1.237727] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.238732] PTP clock support registered [ 1.239745] EDAC MC: Ver: 3.0.0 [ 1.240936] NetLabel: Initializing [ 1.241728] NetLabel: domain hash size = 128 [ 1.242726] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.243743] NetLabel: unlabeled traffic allowed by default [ 1.244729] PCI: Using ACPI for IRQ routing [ 1.245728] PCI: pci_cache_line_size set to 64 bytes [ 1.245863] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [ 1.245868] e820: reserve RAM buffer [mem 0xbffe9000-0xbfffffff] [ 1.245871] e820: reserve RAM buffer [mem 0x822a00000-0x823ffffff] [ 1.245890] pci 0000:00:03.0: vgaarb: setting as boot VGA device [ 1.246724] pci 0000:00:03.0: vgaarb: bridge control possible [ 1.246724] pci 0000:00:03.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.246728] vgaarb: loaded [ 1.247813] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.248728] hpet0: 8 comparators, 32-bit 62.500000 MHz counter [ 1.252776] clocksource: Switched to clocksource kvm-clock [ 1.265327] VFS: Disk quotas dquot_6.6.0 [ 1.268354] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.272260] pnp: PnP ACPI init [ 1.275342] pnp: PnP ACPI: found 5 devices [ 1.284710] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.291027] NET: Registered PF_INET protocol family [ 1.294659] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.302988] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.309174] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.315129] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.321445] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.327336] TCP: Hash tables configured (established 262144 bind 65536) [ 1.331463] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.337432] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.341428] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.347498] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.351079] NET: Registered PF_XDP protocol family [ 1.354345] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.358003] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.361629] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.365476] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.369314] pci_bus 0000:00: resource 8 [mem 0x840000000-0x20083fffffff window] [ 1.375125] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.378747] PCI: CLS 0 bytes, default 64 [ 1.381755] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.381811] Trying to unpack rootfs image as initramfs... [ 1.385563] software IO TLB: mapped [mem 0x00000000bbfe9000-0x00000000bffe9000] (64MB) [ 1.385589] ACPI: bus type thunderbolt registered [ 1.398233] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x240937b9988, max_idle_ns: 440795218083 ns [ 1.405149] clocksource: Switched to clocksource tsc [ 1.409896] Initialise system trusted keyrings [ 1.413011] Key type blacklist registered [ 1.416084] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.419718] zbud: loaded [ 1.422744] integrity: Platform Keyring initialized [ 1.426036] integrity: Machine keyring initialized [ 1.436748] NET: Registered PF_ALG protocol family [ 1.440011] xor: automatically using best checksumming function avx [ 1.443864] Key type asymmetric registered [ 1.446912] Asymmetric key parser 'x509' registered [ 1.450207] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.456033] io scheduler mq-deadline registered [ 1.459211] io scheduler kyber registered [ 1.462253] io scheduler bfq registered [ 1.466803] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.470830] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.474681] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 1.480584] ACPI: button: Power Button [PWRF] [ 1.483776] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input1 [ 1.489714] ACPI: button: Sleep Button [SLPF] [ 1.493251] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.497103] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.503286] Non-volatile memory driver v1.3 [ 1.507028] rdac: device handler registered [ 1.510132] hp_sw: device handler registered [ 1.513223] emc: device handler registered [ 1.516309] alua: device handler registered [ 1.519586] usbcore: registered new interface driver usbserial_generic [ 1.523319] usbserial: USB Serial support registered for generic [ 1.526925] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 1.533008] i8042: Warning: Keylock active [ 1.537146] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 1.540436] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 1.543837] mousedev: PS/2 mouse device common for all mice [ 1.547415] rtc_cmos 00:00: RTC can wake from S4 [ 1.551518] rtc_cmos 00:00: registered as rtc0 [ 1.554813] rtc_cmos 00:00: setting system clock to 2026-07-06T20:34:47 UTC (1783370087) [ 1.560839] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram [ 1.564466] intel_pstate: P-states controlled by the platform [ 1.568088] hid: raw HID events driver (C) Jiri Kosina [ 1.571466] usbcore: registered new interface driver usbhid [ 1.574929] usbhid: USB HID core driver [ 1.577910] drop_monitor: Initializing network drop monitor service [ 1.593718] Initializing XFRM netlink socket [ 1.596868] NET: Registered PF_INET6 protocol family [ 1.844931] Freeing initrd memory: 106176K [ 1.854568] Segment Routing with IPv6 [ 1.857529] NET: Registered PF_PACKET protocol family [ 1.860873] mpls_gso: MPLS GSO support [ 1.864551] resctrl: No MBM correction factor available [ 1.867947] IPI shorthand broadcast: enabled [ 1.871000] AVX2 version of gcm_enc/dec engaged. [ 1.874280] AES CTR mode by8 optimization enabled [ 1.877547] sched_clock: Marking stable (894107743, 983384162)->(2679830106, -802338201) [ 1.883663] registered taskstats version 1 [ 1.887171] Loading compiled-in X.509 certificates [ 1.891366] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 4ff0deed5a017644b545bfb8194601984678f9ce' [ 1.898661] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 1.905880] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 1.912681] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 1.918889] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 1.925146] Loaded X.509 cert 'NVIDIA Jetson SoC OOT signing 001: 7e60d156a289e05b18f70ac4a2d8296c5c8ab797' [ 1.931571] Loaded X.509 cert 'NVIDIA Bluefield DPU OOT signing 001: e251cec14b15b5d4c0e452770ca269261ea466bc' [ 1.940071] Demotion targets for Node 0: null [ 1.943253] page_owner is disabled [ 1.946219] Key type .fscrypt registered [ 1.949297] Key type fscrypt-provisioning registered [ 1.952627] Key type big_key registered [ 1.958883] Key type encrypted registered [ 1.961896] ima: No TPM chip found, activating TPM-bypass! [ 2.057940] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2 [ 2.066471] Loading compiled-in module X.509 certificates [ 2.076650] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 4ff0deed5a017644b545bfb8194601984678f9ce' [ 2.083459] ima: Allocated hash algorithm: sha256 [ 2.086742] ima: No architecture policies found [ 2.089940] evm: Initialising EVM extended attributes: [ 2.093276] evm: security.selinux [ 2.096113] evm: security.SMACK64 (disabled) [ 2.099267] evm: security.SMACK64EXEC (disabled) [ 2.102510] evm: security.SMACK64TRANSMUTE (disabled) [ 2.105868] evm: security.SMACK64MMAP (disabled) [ 2.109070] evm: security.apparmor (disabled) [ 2.112199] evm: security.ima [ 2.114924] evm: security.capability [ 2.117828] evm: HMAC attrs: 0x1 [ 2.266531] Running certificate verification RSA selftest [ 2.270509] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 2.277635] Running certificate verification ECDSA selftest [ 2.282449] Loaded X.509 cert 'Certificate verification ECDSA self-testing key: 2900bcea1deb7bc8479a84a23d758efdfdd2b2d3' [ 2.305334] clk: Disabling unused clocks [ 2.310413] Freeing unused decrypted memory: 2028K [ 2.314513] Freeing unused kernel image (initmem) memory: 4060K [ 2.318088] Write protecting the kernel read-only data: 30720k [ 2.321948] Freeing unused kernel image (rodata/data gap) memory: 664K [ 2.375264] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 2.378981] x86/mm: Checking user space page tables [ 2.430256] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 2.433962] Run /init as init process [ 2.436883] with arguments: [ 2.436887] /init [ 2.436890] with environment: [ 2.436892] HOME=/ [ 2.436893] TERM=linux [ 2.436895] BOOT_IMAGE=(hd0,gpt3)/boot/ostree/rhcos-fa3028af2416c8a48a9fc8ad94cb16943b8b00a80ec6eff250e0837db5acadba/vmlinuz-5.14.0-570.125.1.el9_6.x86_64 [ 2.436898] ostree=/ostree/boot.0/rhcos/fa3028af2416c8a48a9fc8ad94cb16943b8b00a80ec6eff250e0837db5acadba/0 [ 2.436900] boot=UUID=d5bbad84-da2d-4a74-9d03-e483c5975593 [ 2.444201] systemd[1]: systemd 252-51.el9_6.4 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 2.462473] systemd[1]: Detected virtualization amazon. [ 2.465847] systemd[1]: Detected architecture x86-64. [ 2.469219] systemd[1]: Running in initrd. [ 2.474161] systemd[1]: No hostname configured, using default hostname. [ 2.477984] systemd[1]: Hostname set to . [ 2.481353] systemd[1]: Initializing machine ID from VM UUID. [ 2.570939] systemd[1]: Queued start job for default target Initrd Default Target. [ 2.589807] systemd[1]: Created slice Slice /system/rdma-load-modules. [ 2.594858] systemd[1]: Started Forward Password Requests to Clevis Directory Watch. [ 2.602072] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ 2.609443] systemd[1]: Reached target Local Encrypted Volumes (Pre). [ 2.614269] systemd[1]: Reached target Local Encrypted Volumes. [ 2.618909] systemd[1]: Reached target Ignition Subsequent Boot Disk Setup. [ 2.624010] systemd[1]: Reached target Subsequent (Not Ignition) boot complete. [ 2.631066] systemd[1]: Reached target Initrd /usr File System. [ 2.635696] systemd[1]: Reached target Path Units. [ 2.639849] systemd[1]: Reached target Slice Units. [ 2.644024] systemd[1]: Reached target Swaps. [ 2.647966] systemd[1]: Reached target Timer Units. [ 2.652247] systemd[1]: Listening on D-Bus System Message Bus Socket. [ 2.657139] systemd[1]: Listening on Open-iSCSI iscsid Socket. [ 2.661780] systemd[1]: Listening on Open-iSCSI iscsiuio Socket. [ 2.666547] systemd[1]: Listening on Journal Socket (/dev/log). [ 2.671285] systemd[1]: Listening on Journal Socket. [ 2.675619] systemd[1]: Listening on udev Control Socket. [ 2.680205] systemd[1]: Listening on udev Kernel Socket. [ 2.684675] systemd[1]: Reached target Socket Units. [ 2.689010] systemd[1]: Check That Initrd Matches Kernel was skipped because of an unmet condition check (ConditionPathIsDirectory=!/usr/lib/modules/5.14.0-570.125.1.el9_6.x86_64). [ 2.707534] systemd[1]: Starting CoreOS: Touch /run/agetty.reload... [ 2.713081] systemd[1]: Starting Create List of Static Device Nodes... [ 2.718636] systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... [ 2.726771] systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... [ 2.734880] systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... [ 2.736165] input: ImPS/2 Generic Wheel Mouse as /devices/platform/i8042/serio1/input/input4 [ 2.748344] systemd[1]: Finish FIPS mode setup was skipped because of an unmet condition check (ConditionKernelCommandLine=fips=1). [ 2.768516] systemd[1]: Starting Journal Service... [ 2.774102] systemd[1]: Starting Load Kernel Modules... [ 2.779178] systemd[1]: Starting Create System Users... [ 2.784533] systemd[1]: Starting Setup Virtual Console... [ 2.790967] systemd[1]: Finished CoreOS: Touch /run/agetty.reload. [ 2.795424] systemd-modules-load[359]: Inserted module 'ib_ipoib' [ 2.799944] fuse: init (API version 7.37) [ 2.803061] systemd-modules-load[368]: Inserted module 'fuse' [ 2.803103] systemd-modules-load[368]: Module 'msr' is built in [ 2.806264] systemd-modules-load[359]: Inserted module 'ib_umad' [ 2.816310] Loading iSCSI transport class v2.0-870. [ 2.829440] iscsi: registered transport (iser) [ 2.830758] systemd-modules-load[360]: Inserted module 'ib_iser' [ 2.864129] Rounding down aligned max_sectors from 4294967295 to 4294967288 [ 2.864176] db_root: cannot open: /etc/target [ 2.900874] systemd-modules-load[360]: Inserted module 'ib_isert' [ 2.908119] systemd-modules-load[360]: Inserted module 'ib_srpt' [ 2.954149] systemd-modules-load[360]: Inserted module 'ib_uverbs' [ 2.954487] systemd[1]: Started Journal Service. [ 2.962295] systemd-modules-load[360]: Inserted module 'rdma_ucm' [ 2.967091] systemd[1]: Finished Create List of Static Device Nodes. [ 2.970777] systemd[1]: Finished Load RDMA modules from /etc/rdma/modules/infiniband.conf. [ 2.979733] systemd[1]: Finished Load RDMA modules from /etc/rdma/modules/roce.conf. [ 2.986947] systemd[1]: Finished Load Kernel Modules. [ 2.991280] systemd[1]: Finished Setup Virtual Console. [ 2.995590] systemd[1]: dracut ask for additional cmdline parameters was skipped because no trigger condition checks were met. [ 3.021727] systemd[1]: Starting dracut cmdline hook... [ 3.025785] systemd[1]: Starting Apply Kernel Variables... [ 3.035749] systemd-sysusers[370]: Creating group 'root' with GID 991. [ 3.039735] dracut-cmdline[381]: dracut-9.6.20260630-0 (Plow) dracut-057-89.git20250311.el9_6 [ 3.045941] dracut-cmdline[381]: Using kernel command line parameters: BOOT_IMAGE=(hd0,gpt3)/boot/ostree/rhcos-fa3028af2416c8a48a9fc8ad94cb16943b8b00a80ec6eff250e0837db5acadba/vmlinuz-5.14.0-570.125.1.el9_6.x86_64 rw ostree=/ostree/boot.0/rhcos/fa3028af2416c8a48a9fc8ad94cb16943b8b00a80ec6eff250e0837db5acadba/0 ignition.platform.id=aws console=tty0 console=ttyS0,115200n8 root=UUID=c0db8a3e-936d-4a00-8937-48466aace162 rw rootflags=prjquota boot=UUID=d5bbad84-da2d-4a74-9d03-e483c5975593 systemd.unified_cgroup_hierarchy=1 cgroup_no_v1=all [ 3.072091] systemd[1]: Finished Create System Users. [ 3.076038] systemd[1]: Finished Apply Kernel Variables. [ 3.079891] systemd[1]: Starting Create Static Device Nodes in /dev... [ 3.083851] systemd[1]: Starting Create Volatile Files and Directories... [ 3.083965] RPC: Registered named UNIX socket transport module. [ 3.091415] RPC: Registered udp transport module. [ 3.094623] RPC: Registered tcp transport module. [ 3.097844] RPC: Registered tcp-with-tls transport module. [ 3.100121] systemd[1]: Finished Create Static Device Nodes in /dev. [ 3.101488] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 3.119334] systemd[1]: Finished Create Volatile Files and Directories. [ 3.137217] iscsi: registered transport (tcp) [ 3.140898] RPC: Registered rdma transport module. [ 3.144146] RPC: Registered rdma backchannel transport module. [ 3.147768] systemd-modules-load[360]: Inserted module 'rpcrdma' [ 3.151633] systemd[1]: Finished Load RDMA modules from /etc/rdma/modules/rdma.conf. [ 3.158158] systemd[1]: Reached target Preparation for Network. [ 3.166825] Warning: Deprecated Driver is detected: qla4xxx will not be maintained in a future major release and may be disabled [ 3.179308] iscsi: registered transport (qla4xxx) [ 3.182529] QLogic iSCSI HBA Driver [ 3.193768] libcxgbi:libcxgbi_init_module: Chelsio iSCSI driver library libcxgbi v0.9.1-ko (Apr. 2015) [ 3.256634] Chelsio T4-T6 iSCSI Driver cxgb4i v0.9.5-ko (Apr. 2015) [ 3.260354] iscsi: registered transport (cxgb4i) [ 3.272372] Warning: Deprecated Driver is detected: cnic will not be maintained in a future major release and may be disabled [ 3.280719] cnic: QLogic cnicDriver v2.5.22 (July 20, 2015) [ 3.288967] Warning: Deprecated Driver is detected: bnx2i will not be maintained in a future major release and may be disabled [ 3.297121] QLogic NetXtreme II iSCSI Driver bnx2i v2.7.10.1 (Jul 16, 2014) [ 3.301025] iscsi: registered transport (bnx2i) [ 3.315316] iscsi: registered transport (be2iscsi) [ 3.318562] In beiscsi_module_init, tt=00000000ee14de9a [ 3.505112] systemd[1]: Finished dracut cmdline hook. [ 3.524638] systemd[1]: Starting dracut pre-udev hook... [ 3.557849] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 3.565088] device-mapper: uevent: version 1.0.3 [ 3.568445] device-mapper: ioctl: 4.48.1-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev [ 3.595305] systemd[1]: Finished dracut pre-udev hook. [ 3.609678] systemd[1]: Starting Rule-based Manager for Device Events and Files... [ 3.628288] systemd-udevd[574]: Using default interface naming scheme 'rhel-9.0'. [ 3.643155] systemd[1]: Started Rule-based Manager for Device Events and Files. [ 3.650194] systemd[1]: Starting dracut pre-trigger hook... [ 3.660445] dracut-pre-trigger[583]: rd.md=0: removing MD RAID activation [ 3.684279] systemd[1]: Finished dracut pre-trigger hook. [ 3.702609] systemd[1]: Starting Coldplug All udev Devices... [ 3.771665] systemd[1]: sys-module-fuse.device: Failed to enqueue SYSTEMD_WANTS= job, ignoring: Unit sys-fs-fuse-connections.mount not found. [ 3.779838] systemd[1]: Finished Coldplug All udev Devices. [ 3.890291] systemd[1]: nm-initrd.service was skipped because of an unmet condition check (ConditionPathExists=/run/NetworkManager/initrd/neednet). [ 3.898147] systemd[1]: Reached target Network. [ 3.898190] systemd[1]: nm-wait-online-initrd.service was skipped because of an unmet condition check (ConditionPathExists=/run/NetworkManager/initrd/neednet). [ 3.916153] ena 0000:00:05.0: ENA device version: 0.10 [ 3.916162] ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1 [ 3.918169] systemd[1]: Starting dracut initqueue hook... [ 3.922328] ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem febf4000, mac addr 02:8b:58:4a:16:c3 [ 3.926447] ena 0000:00:05.0 ens5: renamed from eth0 [ 3.938234] nvme nvme0: pci function 0000:00:04.0 [ 3.938616] ACPI: \_SB_.LNKD: Enabled at IRQ 11 [ 3.943105] Key type psk registered [ 3.945245] nvme nvme0: 2/0/0 default/read/poll queues [ 3.949657] nvme0n1: p1 p2 p3 p4 [ 4.086759] systemd[1]: Starting Wait for udev To Complete Device Initialization... [ 4.092998] systemd[1]: Finished dracut initqueue hook. [ 4.106620] systemd[1]: Found device Amazon Elastic Block Store root. [ 4.117659] systemd[1]: Reached target Initrd Root Device. [ 4.121491] systemd[1]: Reached target Preparation for Remote File Systems. [ 4.125716] systemd[1]: Reached target Remote Encrypted Volumes. [ 4.129612] systemd[1]: Reached target Remote File Systems. [ 4.145729] systemd[1]: Starting dracut pre-mount hook... [ 4.149633] udevadm[686]: systemd-udev-settle.service is deprecated. Please fix multipathd-configure.service, multipathd.service not to pull it in. [ 4.157164] systemd[1]: Finished Wait for udev To Complete Device Initialization. [ 4.163297] systemd[1]: Finished dracut pre-mount hook. [ 4.167000] systemd[1]: Device-Mapper Multipath Default Configuration was skipped because of an unmet condition check (ConditionKernelCommandLine=rd.multipath=default). [ 4.177093] systemd[1]: Device-Mapper Multipath Device Controller was skipped because of an unmet condition check (ConditionPathExists=/etc/multipath.conf). [ 4.184963] systemd[1]: Reached target Preparation for Local File Systems. [ 4.189078] systemd[1]: Reached target Local File Systems. [ 4.192843] systemd[1]: Reached target System Initialization. [ 4.196743] systemd[1]: Reached target Basic System. [ 4.200623] systemd[1]: Persist Osmet Files (ISO) was skipped because of an unmet condition check (ConditionKernelCommandLine=coreos.liveiso). [ 4.208007] systemd[1]: Acquire Live PXE rootfs Image was skipped because of an unmet condition check (ConditionPathExists=/run/ostree-live). [ 4.215467] systemd-fsck[702]: /usr/sbin/fsck.xfs: XFS file system. [ 4.219355] systemd[1]: Persist Osmet Files (PXE) was skipped because of an unmet condition check (ConditionPathExists=/run/ostree-live). [ 4.226659] systemd[1]: Starting File System Check on /dev/disk/by-uuid/c0db8a3e-936d-4a00-8937-48466aace162... [ 4.233486] systemd[1]: Finished File System Check on /dev/disk/by-uuid/c0db8a3e-936d-4a00-8937-48466aace162. [ 4.240030] systemd[1]: Mounting /sysroot... [ 4.568860] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 4.577396] XFS (nvme0n1p4): Mounting V5 Filesystem c0db8a3e-936d-4a00-8937-48466aace162 [ 4.844006] XFS (nvme0n1p4): Ending clean mount [ 4.910170] systemd[1]: Mounted /sysroot. [ 4.923620] systemd[1]: Starting OSTree Prepare OS/... [ 4.934057] ostree-prepare-root[716]: Resolved OSTree target to: /sysroot/ostree/deploy/rhcos/deploy/eff59cb47c9f2e13bbb240104f42665a30efeffc547f90503e263629dfc1187f.1 [ 4.943759] ostree-prepare-root[716]: sysroot.readonly configuration value: 1 (fs writable: 1) [ 4.955112] loop: module loaded [ 4.958365] loop0: detected capacity change from 0 to 11928 [ 4.962360] erofs: (device loop0): mounted with root inode @ nid 36. [ 4.982831] overlayfs: using the lowest 1 of 2 lowerdirs as data layers [ 4.986703] ostree-prepare-root[716]: composefs: mounted successfully (verity=false) [ 4.992623] systemd[1]: run-ostree-.private-cfsroot\x2dlower.mount: Deactivated successfully. [ 4.998961] systemd[1]: Finished OSTree Prepare OS/. [ 5.002448] systemd[1]: Reached target Initrd Root File System. [ 5.006081] systemd[1]: CoreOS Propagate Multipath Configuration was skipped because of an unmet condition check (ConditionKernelCommandLine=rd.multipath=default). [ 5.025653] systemd[1]: Starting Mountpoints Configured in the Real Root... [ 5.038342] systemd[1]: initrd-parse-etc.service: Deactivated successfully. [ 5.042278] systemd[1]: Finished Mountpoints Configured in the Real Root. [ 5.046523] systemd[1]: Reached target Initrd File Systems. [ 5.050131] systemd[1]: Reached target Initrd Default Target. [ 5.063579] systemd[1]: Starting dracut mount hook... [ 5.076695] systemd[1]: Finished dracut mount hook. [ 5.080698] systemd[1]: Starting dracut pre-pivot and cleanup hook... [ 5.092947] systemd[1]: sysroot.tmp.mount: Deactivated successfully. [ 5.096841] dracut-pre-pivot[743]: 4.113297 | /etc/multipath.conf does not exist, blacklisting all devices. [ 5.105842] dracut-pre-pivot[743]: 4.113313 | You can run "/sbin/mpathconf --enable" to create [ 5.120795] dracut-pre-pivot[743]: 4.113316 | /etc/multipath.conf. See man mpathconf(8) for more details [ 5.127630] dracut-pre-pivot[743]: 4.115243 | DM multipath kernel driver not loaded [ 5.135114] systemd[1]: Finished dracut pre-pivot and cleanup hook. [ 5.138962] systemd[1]: Workaround dracut FIPS unmounting /boot was skipped because of an unmet condition check (ConditionPathExists=/run/ostree-live). [ 5.146805] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... [ 5.150896] systemd[1]: Stopped target Network. [ 5.154313] systemd[1]: Stopped target Preparation for Network. [ 5.158114] systemd[1]: Stopped target Remote Encrypted Volumes. [ 5.161950] systemd[1]: Stopped target Timer Units. [ 5.165303] systemd[1]: dbus.socket: Deactivated successfully. [ 5.169060] systemd[1]: Closed D-Bus System Message Bus Socket. [ 5.172653] systemd[1]: Unmount Live /var if Persistent /var Is Configured was skipped because of an unmet condition check (ConditionPathExists=/run/ostree-live). [ 5.182421] systemd[1]: dracut-pre-pivot.service: Deactivated successfully. [ 5.186465] systemd[1]: Stopped dracut pre-pivot and cleanup hook. [ 5.190435] systemd[1]: Stopped target Initrd Default Target. [ 5.194022] systemd[1]: Stopped target Basic System. [ 5.197599] systemd[1]: Stopped target Subsequent (Not Ignition) boot complete. [ 5.203425] systemd[1]: Stopped target Ignition Subsequent Boot Disk Setup. [ 5.207479] systemd[1]: Stopped target Initrd Root Device. [ 5.211163] systemd[1]: Stopped target Initrd /usr File System. [ 5.214931] systemd[1]: Stopped target Path Units. [ 5.218412] systemd[1]: Stopped target Remote File Systems. [ 5.222142] systemd[1]: Stopped target Preparation for Remote File Systems. [ 5.226059] systemd[1]: Stopped target Slice Units. [ 5.229521] systemd[1]: Stopped target Socket Units. [ 5.233033] systemd[1]: Stopped target System Initialization. [ 5.236760] systemd[1]: Stopped target Local File Systems. [ 5.240426] systemd[1]: Stopped target Preparation for Local File Systems. [ 5.244526] systemd[1]: Stopped target Swaps. [ 5.247792] systemd[1]: iscsid.socket: Deactivated successfully. [ 5.251568] systemd[1]: Closed Open-iSCSI iscsid Socket. [ 5.255151] systemd[1]: iscsiuio.socket: Deactivated successfully. [ 5.259012] systemd[1]: Closed Open-iSCSI iscsiuio Socket. [ 5.262493] systemd[1]: coreos-touch-run-agetty.service: Deactivated successfully. [ 5.268554] systemd[1]: Stopped CoreOS: Touch /run/agetty.reload. [ 5.272402] systemd[1]: dracut-mount.service: Deactivated successfully. [ 5.276339] systemd[1]: Stopped dracut mount hook. [ 5.279799] systemd[1]: dracut-pre-mount.service: Deactivated successfully. [ 5.283673] systemd[1]: Stopped dracut pre-mount hook. [ 5.287227] systemd[1]: Stopped target Local Encrypted Volumes. [ 5.290808] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. [ 5.296865] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. [ 5.302916] systemd[1]: Stopped target Local Encrypted Volumes (Pre). [ 5.306872] systemd[1]: clevis-luks-askpass.path: Deactivated successfully. [ 5.310808] systemd[1]: Stopped Forward Password Requests to Clevis Directory Watch. [ 5.316859] systemd[1]: dracut-initqueue.service: Deactivated successfully. [ 5.320959] systemd[1]: Stopped dracut initqueue hook. [ 5.324342] systemd[1]: Acquire Live PXE rootfs Image was skipped because of an unmet condition check (ConditionPathExists=/run/ostree-live). [ 5.331717] systemd[1]: rdma-load-modules@infiniband.service: Deactivated successfully. [ 5.337654] systemd[1]: Stopped Load RDMA modules from /etc/rdma/modules/infiniband.conf. [ 5.343647] systemd[1]: rdma-load-modules@rdma.service: Deactivated successfully. [ 5.349607] systemd[1]: Stopped Load RDMA modules from /etc/rdma/modules/rdma.conf. [ 5.355632] systemd[1]: rdma-load-modules@roce.service: Deactivated successfully. [ 5.361433] systemd[1]: Stopped Load RDMA modules from /etc/rdma/modules/roce.conf. [ 5.367262] systemd[1]: systemd-sysctl.service: Deactivated successfully. [ 5.371314] systemd[1]: Stopped Apply Kernel Variables. [ 5.374710] systemd[1]: systemd-modules-load.service: Deactivated successfully. [ 5.380622] systemd[1]: Stopped Load Kernel Modules. [ 5.384168] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. [ 5.384212] systemd[1]: Stopped Create Volatile Files and Directories. [ 5.384252] systemd[1]: systemd-udev-settle.service: Deactivated successfully. [ 5.384292] systemd[1]: Stopped Wait for udev To Complete Device Initialization. [ 5.384333] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. [ 5.384372] systemd[1]: Stopped Coldplug All udev Devices. [ 5.384430] systemd[1]: dracut-pre-trigger.service: Deactivated successfully. [ 5.384459] systemd[1]: Stopped dracut pre-trigger hook. [ 5.384506] systemd[1]: Stopping Rule-based Manager for Device Events and Files... [ 5.531280] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. [ 5.537252] systemd[1]: Stopped Setup Virtual Console. [ 5.543010] systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dsetup.service.mount: Deactivated successfully. [ 5.549673] systemd[1]: run-credentials-systemd\x2dsysctl.service.mount: Deactivated successfully. [ 5.556280] systemd[1]: systemd-udevd.service: Deactivated successfully. [ 5.560314] systemd[1]: Stopped Rule-based Manager for Device Events and Files. [ 5.566309] systemd[1]: systemd-udevd.service: Consumed 1.014s CPU time. [ 5.570344] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. [ 5.576326] systemd[1]: Closed udev Control Socket. [ 5.579646] systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. [ 5.585424] systemd[1]: Closed udev Kernel Socket. [ 5.588727] systemd[1]: dracut-pre-udev.service: Deactivated successfully. [ 5.592549] systemd[1]: Stopped dracut pre-udev hook. [ 5.595920] systemd[1]: dracut-cmdline.service: Deactivated successfully. [ 5.599742] systemd[1]: Stopped dracut cmdline hook. [ 5.608727] systemd[1]: Starting Cleanup udev Database... [ 5.612431] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. [ 5.618749] systemd[1]: Stopped Create Static Device Nodes in /dev. [ 5.622552] systemd[1]: kmod-static-nodes.service: Deactivated successfully. [ 5.626813] systemd[1]: Stopped Create List of Static Device Nodes. [ 5.630546] systemd[1]: systemd-sysusers.service: Deactivated successfully. [ 5.634721] systemd[1]: Stopped Create System Users. [ 5.638051] systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dsetup\x2ddev.service.mount: Deactivated successfully. [ 5.644979] systemd[1]: run-credentials-systemd\x2dsysusers.service.mount: Deactivated successfully. [ 5.651600] systemd[1]: initrd-cleanup.service: Deactivated successfully. [ 5.655629] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. [ 5.659439] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. [ 5.665576] systemd[1]: Finished Cleanup udev Database. [ 5.669048] systemd[1]: Reached target Switch Root. [ 5.672365] systemd[1]: Starting Switch Root... [ 5.675571] systemd[1]: Switching root. [ 5.689327] systemd-journald[363]: Received SIGTERM from PID 1 (systemd). [ 5.867175] audit: type=1404 audit(1783370091.811:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295 enabled=1 old-enabled=1 lsm=selinux res=1 [ 5.920400] SELinux: policy capability network_peer_controls=1 [ 5.923994] SELinux: policy capability open_perms=1 [ 5.927264] SELinux: policy capability extended_socket_class=1 [ 5.930794] SELinux: policy capability always_check_network=0 [ 5.934293] SELinux: policy capability cgroup_seclabel=1 [ 5.937689] SELinux: policy capability nnp_nosuid_transition=1 [ 5.941239] SELinux: policy capability genfs_seclabel_symlinks=1 [ 5.981575] audit: type=1403 audit(1783370091.926:3): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 5.984487] systemd[1]: Successfully loaded SELinux policy in 118.472ms. [ 6.035877] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 29.102ms. [ 6.050066] systemd[1]: systemd 252-51.el9_6.4 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 6.068294] systemd[1]: Detected virtualization amazon. [ 6.071657] systemd[1]: Detected architecture x86-64. [ 6.116881] systemd-rc-local-generator[772]: /etc/rc.d/rc.local is not marked executable, skipping. [ 6.122869] zram_generator::config[777]: No configuration found. [ 6.230903] Skipping bootloader-migrate-generator: sysroot.bootloader is set [ 6.703898] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 6.707967] systemd[1]: Stopped Switch Root. [ 6.712613] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 6.719207] systemd[1]: Created slice Slice /system/getty. [ 6.724009] systemd[1]: Created slice Slice /system/modprobe. [ 6.728897] systemd[1]: Created slice Slice /system/serial-getty. [ 6.733906] systemd[1]: Created slice Slice /system/sshd-keygen. [ 6.738983] systemd[1]: Created slice Slice /system/systemd-fsck. [ 6.744035] systemd[1]: Created slice User and Session Slice. [ 6.748824] systemd[1]: Started Forward Password Requests to Clevis Directory Watch. [ 6.756219] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ 6.763628] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 6.771207] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 6.779113] systemd[1]: Reached target Synchronize afterburn-sshkeys@.service template instances. [ 6.786826] systemd[1]: Reached target Target for bootc status changes on boot. [ 6.793855] systemd[1]: Reached target Local Encrypted Volumes (Pre). [ 6.798726] systemd[1]: Reached target Local Encrypted Volumes. [ 6.803421] systemd[1]: Stopped target Switch Root. [ 6.807596] systemd[1]: Stopped target Initrd File Systems. [ 6.812110] systemd[1]: Stopped target Initrd Root File System. [ 6.816752] systemd[1]: Reached target Local Integrity Protected Volumes. [ 6.821838] systemd[1]: Reached target Host and Network Name Lookups. [ 6.826745] systemd[1]: Reached target Remote Encrypted Volumes. [ 6.831534] systemd[1]: Reached target Remote File Systems. [ 6.836110] systemd[1]: Reached target Slice Units. [ 6.840277] systemd[1]: Reached target Swaps. [ 6.844214] systemd[1]: Reached target System Time Set. [ 6.848529] systemd[1]: Reached target Local Verity Protected Volumes. [ 6.854027] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 6.860476] systemd[1]: Listening on LVM2 poll daemon socket. [ 6.865101] systemd[1]: multipathd control socket was skipped because of an unmet condition check (ConditionPathExists=/etc/multipath.conf). [ 6.885087] systemd[1]: Listening on RPCbind Server Activation Socket. [ 6.890064] systemd[1]: Reached target RPC Port Mapper. [ 6.898055] systemd[1]: Listening on Process Core Dump Socket. [ 6.902723] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 6.909553] systemd[1]: Listening on udev Control Socket. [ 6.914243] systemd[1]: Listening on udev Kernel Socket. [ 6.927487] systemd[1]: Mounting Huge Pages File System... [ 6.932942] systemd[1]: Mounting POSIX Message Queue File System... [ 6.938682] systemd[1]: Mounting Kernel Debug File System... [ 6.944095] systemd[1]: Mounting Kernel Trace File System... [ 6.949607] systemd[1]: Mounting Temporary Directory /tmp... [ 6.955239] systemd[1]: Starting CoreOS: Set printk To Level 4 (warn)... [ 6.960187] systemd[1]: Ignition (delete config) was skipped because of an unmet condition check (ConditionFirstBoot=true). [ 6.969125] systemd[1]: Starting Create List of Static Device Nodes... [ 6.974950] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 6.984116] systemd[1]: Starting Load Kernel Module configfs... [ 6.989829] systemd[1]: Starting Load Kernel Module drm... [ 6.995304] systemd[1]: Starting Load Kernel Module efi_pstore... [ 7.001192] systemd[1]: Starting Load Kernel Module fuse... [ 7.005759] systemd[1]: ostree-prepare-root.service: Deactivated successfully. [ 7.011571] systemd[1]: Stopped OSTree Prepare OS/. [ 7.015946] systemd[1]: systemd-fsck-root.service: Deactivated successfully. [ 7.019835] systemd[1]: Stopped File System Check on Root Device. [ 7.024618] systemd[1]: Stopped Journal Service. [ 7.041590] systemd[1]: Starting Journal Service... [ 7.047588] systemd[1]: Starting Load Kernel Modules... [ 7.053034] systemd[1]: Starting Generate network units from Kernel command line... [ 7.060654] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 7.064248] Warning: Unmaintained driver is detected: ip_tables [ 7.072664] systemd[1]: Starting Remount Root and Kernel File Systems... [ 7.080416] ACPI: bus type drm_connector registered [ 7.081016] systemd[1]: Starting Coldplug All udev Devices... [ 7.090070] systemd[1]: Started Journal Service. [ 7.953284] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 7.955805] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0xb100, revision 255 [ 7.984924] parport_pc 00:03: reported by Plug and Play ACPI [ 8.013821] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 8.016611] ppdev: user-space parallel port driver [ 8.199591] systemd-journald[831]: Received client request to flush runtime journal. [ 8.360308] EXT4-fs (nvme0n1p3): mounted filesystem d5bbad84-da2d-4a74-9d03-e483c5975593 ro with ordered data mode. Quota mode: none. [ 9.720330] openvswitch: Open vSwitch switching datapath [ 12.080257] ovs-system: entered promiscuous mode [ 12.082263] Timeout policy base is empty [ 12.100796] ena 0000:00:05.0 ens5: entered promiscuous mode [ 12.383308] ena 0000:00:05.0 ens5: left promiscuous mode [ 12.385279] ovs-system: left promiscuous mode [ 12.397535] ovs-system: entered promiscuous mode [ 12.398234] No such timeout policy "ovs_test_tp" [ 12.399518] ena 0000:00:05.0 ens5: entered promiscuous mode [ 13.033335] br-ex: entered promiscuous mode [ 13.813774] evm: overlay not supported [ 15.685575] Warning: Unmaintained driver is detected: nft_compat [ 37.839549] br-int: entered promiscuous mode [ 45.672356] genev_sys_6081: entered promiscuous mode [ 46.362987] ovn-k8s-mp0: entered promiscuous mode [ 50.943184] 3f3aca6942f9605: entered promiscuous mode [ 67.738719] 06a7b1219136eb2: entered promiscuous mode [ 67.958207] 993fc2736a199c0: entered promiscuous mode [ 71.562647] 3ed023515e24c72: entered promiscuous mode [ 72.018272] 3c3d4682c9c9240: entered promiscuous mode [ 81.613419] d570ed49fb5c249: entered promiscuous mode [ 81.929025] ecc0beaa8f5f987: entered promiscuous mode [ 99.640518] 0c00976e366b8e4: entered promiscuous mode [ 100.845356] 3cecb6a98222087: entered promiscuous mode [ 101.048527] 7cb4983aee59f4d: entered promiscuous mode [ 103.914858] e641650f1cf988e: entered promiscuous mode [ 107.627032] 0cfa6262f4352cc: entered promiscuous mode [ 114.821932] 0e144947136a66f: entered promiscuous mode [ 117.794291] af14ec00edb57d3: entered promiscuous mode [ 120.463934] e94125b2806e6f9: entered promiscuous mode [ 121.037502] f4b4588bee615f8: entered promiscuous mode [ 121.102711] 37826f0f59dd644: entered promiscuous mode [ 145.539928] 3c415915ee397e8: entered promiscuous mode [ 161.423677] 0cfa6262f4352cc: left promiscuous mode [ 198.384312] 463c9651f529c00: entered promiscuous mode [ 259.362859] 8b57d28fd5239da: entered promiscuous mode [ 286.061489] 8b57d28fd5239da: left promiscuous mode [ 298.309015] 2ac9e3e281fdf4f: entered promiscuous mode [ 365.134887] 19b3905fdb40f8b: entered promiscuous mode [ 365.710978] 9bdefa9daa60c9a: entered promiscuous mode [ 402.467542] 63dd7eafa004c02: entered promiscuous mode [ 415.595697] 63dd7eafa004c02: left promiscuous mode [ 445.793989] e9a461d0a573a4e: entered promiscuous mode [ 451.756529] e9a461d0a573a4e: left promiscuous mode [ 480.122484] 9f808bb8f669aaa: entered promiscuous mode [ 487.784904] 0577e09dff5da14: entered promiscuous mode [ 487.883893] d042a389f7e4b5e: entered promiscuous mode [ 487.989208] 5e75862f203a622: entered promiscuous mode [ 488.089932] 137addd591e201d: entered promiscuous mode [ 491.975448] 137addd591e201d: left promiscuous mode [ 491.994244] 5e75862f203a622: left promiscuous mode [ 492.986057] d042a389f7e4b5e: left promiscuous mode [ 493.006293] 0577e09dff5da14: left promiscuous mode [ 498.796138] 9f5798aa1730d59: entered promiscuous mode [ 501.811133] 318731da2e2884d: entered promiscuous mode [ 505.965681] 9d422de1b9a3a34: entered promiscuous mode [ 508.867801] 8ffe8f4ef24a7b6: entered promiscuous mode [ 515.754329] fd39f0fa16cb488: entered promiscuous mode [ 559.033514] 96c9676efc3d821: entered promiscuous mode [ 560.014500] db6b89b7326bc90: entered promiscuous mode [ 560.295722] 9b749b8a2502891: entered promiscuous mode [ 567.523761] db6b89b7326bc90: left promiscuous mode [ 574.842402] 96c9676efc3d821: left promiscuous mode [ 585.397494] 49e09b88b9990b6: entered promiscuous mode [ 586.675433] 9b749b8a2502891: left promiscuous mode [ 591.081853] 9bdefa9daa60c9a: left promiscuous mode [ 591.372184] 0e9e59593350188: entered promiscuous mode [ 634.938504] e5f2f4ba4abbdf6: entered promiscuous mode [ 635.527770] 1ee4843712f9edb: entered promiscuous mode [ 651.113598] 9e51b105b0740c2: entered promiscuous mode [ 729.302023] 9e51b105b0740c2: left promiscuous mode [ 744.345415] 070a9844c94ae1a: entered promiscuous mode [ 755.266521] 5c243621f22ba28: entered promiscuous mode [ 755.829550] 4f3f9df12cbd180: entered promiscuous mode [ 825.597430] 03d6dec8271aa7b: entered promiscuous mode [ 851.919335] 4f3f9df12cbd180: left promiscuous mode [ 871.199550] 5c243621f22ba28: left promiscuous mode [ 881.838846] 7b540f8639b30ab: entered promiscuous mode [ 914.902542] 7b540f8639b30ab: left promiscuous mode [ 947.419557] d86c6bb94f9846a: entered promiscuous mode [ 1006.124968] 03d6dec8271aa7b: left promiscuous mode [ 1023.072276] 9abcaedb3a2adb9: entered promiscuous mode [ 1033.683826] ffbe6f9a53b8df2: entered promiscuous mode [ 1103.376005] 9abcaedb3a2adb9: left promiscuous mode [ 1105.459866] d86c6bb94f9846a: left promiscuous mode [ 1138.559104] 1e36cda11d085e8: entered promiscuous mode [ 1171.016436] ffbe6f9a53b8df2: left promiscuous mode [ 1176.741072] a20a03f906f4b79: entered promiscuous mode [ 1202.873964] 4626dd09d5f59bd: entered promiscuous mode [ 1272.748621] a20a03f906f4b79: left promiscuous mode [ 1278.766707] 1e36cda11d085e8: left promiscuous mode [ 1323.348299] 95e9568db6f8bdf: entered promiscuous mode [ 1349.523428] wrk:worker_0 invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 1349.523441] CPU: 2 PID: 15656 Comm: wrk:worker_0 Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 1349.523444] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 1349.523445] Call Trace: [ 1349.523448] [ 1349.523452] dump_stack_lvl+0x34/0x48 [ 1349.523458] dump_header+0x4a/0x213 [ 1349.523462] oom_kill_process.cold+0xb/0x10 [ 1349.523465] out_of_memory+0xef/0x2c0 [ 1349.523470] mem_cgroup_out_of_memory+0x131/0x150 [ 1349.523476] try_charge_memcg+0x742/0x800 [ 1349.523479] ? alloc_pages_mpol+0x93/0x1e0 [ 1349.523484] __mem_cgroup_charge+0x3e/0xb0 [ 1349.523487] do_anonymous_page+0x7d/0x3e0 [ 1349.523492] __handle_mm_fault+0x2fe/0x650 [ 1349.523494] ? nohz_balancer_kick+0x31/0x240 [ 1349.523499] handle_mm_fault+0xe9/0x250 [ 1349.523501] do_user_addr_fault+0x154/0x620 [ 1349.523506] exc_page_fault+0x62/0x150 [ 1349.523510] asm_exc_page_fault+0x22/0x30 [ 1349.523515] RIP: 0033:0x209b1494feed [ 1349.523518] Code: 1f d3 ef 83 f7 02 41 d1 e1 41 2b f9 83 c7 47 4c 8b cb 83 ff 3f 44 0f 42 cf 41 8b f9 44 8b cf 41 c1 e1 04 41 8d 89 b0 65 20 00 <43> 89 4c 20 04 41 81 c1 b8 65 20 00 43 8b 0c 08 43 89 4c 20 08 47 [ 1349.523520] RSP: 002b:00007f296294b3c8 EFLAGS: 00010202 [ 1349.523523] RAX: 0000000000000003 RBX: 000000000000003f RCX: 0000000000206830 [ 1349.523524] RDX: 0000000000000028 RSI: 00000000106e0fec RDI: 0000000000000028 [ 1349.523525] RBP: 00007f296294b418 R08: 00007f2094000000 R09: 0000000000000280 [ 1349.523527] R10: 0000000000000000 R11: 00000000106e0fe0 R12: 00000000106e0ffc [ 1349.523528] R13: 000052447bd4a080 R14: 0000000000206830 R15: 0000000000000008 [ 1349.523532] [ 1349.523542] memory: usage 1048576kB, limit 1048576kB, failcnt 110 [ 1349.523543] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 1349.523545] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 1349.523572] anon 1069109248 [ 1349.523578] file 126976 [ 1349.523580] kernel 4505600 [ 1349.523582] kernel_stack 491520 [ 1349.523584] pagetables 2998272 [ 1349.523586] sec_pagetables 0 [ 1349.523588] percpu 58440 [ 1349.523590] sock 0 [ 1349.523591] vmalloc 36864 [ 1349.523593] shmem 118784 [ 1349.523596] zswap 0 [ 1349.523598] zswapped 0 [ 1349.523600] file_mapped 0 [ 1349.523602] file_dirty 0 [ 1349.523604] file_writeback 4096 [ 1349.523606] swapcached 0 [ 1349.523608] anon_thp 211812352 [ 1349.523609] file_thp 0 [ 1349.523611] shmem_thp 0 [ 1349.523612] inactive_anon 176128 [ 1349.523613] active_anon 1069019136 [ 1349.523614] inactive_file 8192 [ 1349.523615] active_file 0 [ 1349.523620] unevictable 0 [ 1349.523622] slab_reclaimable 122376 [ 1349.523625] slab_unreclaimable 574968 [ 1349.523626] slab 697344 [ 1349.523631] workingset_refault_anon 0 [ 1349.523633] workingset_refault_file 0 [ 1349.523637] workingset_activate_anon 0 [ 1349.523640] workingset_activate_file 0 [ 1349.523644] workingset_restore_anon 0 [ 1349.523646] workingset_restore_file 0 [ 1349.523653] workingset_nodereclaim 0 [ 1349.523656] pgscan 44 [ 1349.523658] pgsteal 19 [ 1349.523659] pgscan_kswapd 0 [ 1349.523665] pgscan_direct 44 [ 1349.523666] pgscan_khugepaged 0 [ 1349.523671] pgsteal_kswapd 0 [ 1349.523676] pgsteal_direct 19 [ 1349.523678] pgsteal_khugepaged 0 [ 1349.523680] pgfault 434573 [ 1349.523706] pgmajfault 0 [ 1349.523712] pgrefill 56 [ 1349.523713] pgactivate 0 [ 1349.523718] pgdeactivate 0 [ 1349.523723] pglazyfree 0 [ 1349.523728] pglazyfreed 0 [ 1349.523733] zswpin 0 [ 1349.523734] zswpout 0 [ 1349.523739] zswpwb 0 [ 1349.523742] thp_fault_alloc 251 [ 1349.523743] thp_collapse_alloc 0 [ 1349.523750] thp_swpout 0 [ 1349.523755] thp_swpout_fallback 0 [ 1349.523760] Tasks state (memory values in pages): [ 1349.523765] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 1349.523769] [ 15584] 0 15584 2048 480 57344 0 -1000 conmon [ 1349.523781] [ 15588] 1000319999 15588 462557 12533 274432 0 996 pilot-agent [ 1349.523786] [ 15610] 1000319999 15610 9903798 269868 2842624 0 996 envoy [ 1349.523794] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-2f068bd56567e2c311987dec49318f1aae94721ebc31038b46bcb24f1bcf3ea7.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-2f068bd56567e2c311987dec49318f1aae94721ebc31038b46bcb24f1bcf3ea7.scope,task=envoy,pid=15610,uid=1000319999 [ 1349.523883] Memory cgroup out of memory: Killed process 15610 (envoy) total-vm:39615192kB, anon-rss:1019312kB, file-rss:60160kB, shmem-rss:0kB, UID:1000319999 pgtables:2776kB oom_score_adj:996 [ 1349.529047] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-2f068bd56567e2c311987dec49318f1aae94721ebc31038b46bcb24f1bcf3ea7.scope are going to be killed due to memory.oom.group set [ 1349.529108] Memory cgroup out of memory: Killed process 15588 (pilot-agent) total-vm:1850228kB, anon-rss:24020kB, file-rss:26112kB, shmem-rss:0kB, UID:1000319999 pgtables:268kB oom_score_adj:996 [ 1349.534120] Memory cgroup out of memory: Killed process 15656 (wrk:worker_0) total-vm:39615192kB, anon-rss:1019312kB, file-rss:60160kB, shmem-rss:0kB, UID:1000319999 pgtables:2776kB oom_score_adj:996 [ 1353.410106] 4626dd09d5f59bd: left promiscuous mode [ 1395.729058] wrk:worker_0 invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 1395.729073] CPU: 2 PID: 21256 Comm: wrk:worker_0 Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 1395.729077] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 1395.729079] Call Trace: [ 1395.729082] [ 1395.729087] dump_stack_lvl+0x34/0x48 [ 1395.729094] dump_header+0x4a/0x213 [ 1395.729099] oom_kill_process.cold+0xb/0x10 [ 1395.729102] out_of_memory+0xef/0x2c0 [ 1395.729109] mem_cgroup_out_of_memory+0x131/0x150 [ 1395.729115] try_charge_memcg+0x742/0x800 [ 1395.729119] ? alloc_pages_mpol+0x93/0x1e0 [ 1395.729126] __mem_cgroup_charge+0x3e/0xb0 [ 1395.729130] do_anonymous_page+0x7d/0x3e0 [ 1395.729134] __handle_mm_fault+0x2fe/0x650 [ 1395.729138] handle_mm_fault+0xe9/0x250 [ 1395.729141] do_user_addr_fault+0x154/0x620 [ 1395.729146] exc_page_fault+0x62/0x150 [ 1395.729151] asm_exc_page_fault+0x22/0x30 [ 1395.729155] RIP: 0033:0x3a4c77473874 [ 1395.729158] Code: e9 06 00 00 00 45 8b 0c 08 8b f1 41 8d 7f 18 0f 1f 80 00 00 00 00 44 3b cf 0f 82 1e 01 00 00 41 8d 3c 37 45 2b cf 45 8d 59 f8 <45> 89 5c 38 08 44 8d 67 08 41 83 e1 fc 41 83 e9 08 45 01 e1 41 83 [ 1395.729160] RSP: 002b:00007f7ccadeb370 EFLAGS: 00010202 [ 1395.729162] RAX: 000000000000000f RBX: 000000000000003f RCX: 000000000f349fc8 [ 1395.729164] RDX: 0000000000000026 RSI: 000000000f349fcc RDI: 000000000f34a14c [ 1395.729165] RBP: 00007f7ccadeb3c0 R08: 00007f73fc000000 R09: 0000000000005ea4 [ 1395.729167] R10: 0000000000000000 R11: 0000000000005e9c R12: 000000000f349fac [ 1395.729168] R13: 000013c1be33e080 R14: 0000000000206810 R15: 0000000000000180 [ 1395.729171] [ 1395.729195] memory: usage 1048576kB, limit 1048576kB, failcnt 300 [ 1395.729198] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 1395.729199] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 1395.729214] anon 1069060096 [ 1395.729220] file 122880 [ 1395.729222] kernel 4558848 [ 1395.729228] kernel_stack 475136 [ 1395.729229] pagetables 3067904 [ 1395.729231] sec_pagetables 0 [ 1395.729236] percpu 58440 [ 1395.729238] sock 0 [ 1395.729243] vmalloc 36864 [ 1395.729245] shmem 118784 [ 1395.729251] zswap 0 [ 1395.729253] zswapped 0 [ 1395.729257] file_mapped 0 [ 1395.729259] file_dirty 0 [ 1395.729264] file_writeback 4096 [ 1395.729266] swapcached 0 [ 1395.729272] anon_thp 260046848 [ 1395.729279] file_thp 0 [ 1395.729281] shmem_thp 0 [ 1395.729286] inactive_anon 98304 [ 1395.729289] active_anon 1069027328 [ 1395.729295] inactive_file 4096 [ 1395.729297] active_file 0 [ 1395.729303] unevictable 0 [ 1395.729304] slab_reclaimable 127504 [ 1395.729310] slab_unreclaimable 566072 [ 1395.729312] slab 693576 [ 1395.729318] workingset_refault_anon 0 [ 1395.729324] workingset_refault_file 0 [ 1395.729330] workingset_activate_anon 0 [ 1395.729336] workingset_activate_file 0 [ 1395.729339] workingset_restore_anon 0 [ 1395.729345] workingset_restore_file 0 [ 1395.729348] workingset_nodereclaim 0 [ 1395.729353] pgscan 70 [ 1395.729355] pgsteal 27 [ 1395.729360] pgscan_kswapd 0 [ 1395.729361] pgscan_direct 70 [ 1395.729367] pgscan_khugepaged 0 [ 1395.729368] pgsteal_kswapd 0 [ 1395.729370] pgsteal_direct 27 [ 1395.729374] pgsteal_khugepaged 0 [ 1395.729376] pgfault 706356 [ 1395.729380] pgmajfault 0 [ 1395.729382] pgrefill 82 [ 1395.729387] pgactivate 0 [ 1395.729389] pgdeactivate 0 [ 1395.729394] pglazyfree 0 [ 1395.729396] pglazyfreed 0 [ 1395.729402] zswpin 0 [ 1395.729404] zswpout 0 [ 1395.729410] zswpwb 0 [ 1395.729411] thp_fault_alloc 539 [ 1395.729420] thp_collapse_alloc 0 [ 1395.729425] thp_swpout 0 [ 1395.729428] thp_swpout_fallback 0 [ 1395.729433] Tasks state (memory values in pages): [ 1395.729441] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 1395.729449] [ 21196] 0 21196 2048 480 53248 0 -1000 conmon [ 1395.729459] [ 21198] 1000319999 21198 462621 12709 270336 0 996 pilot-agent [ 1395.729468] [ 21208] 1000319999 21208 18814833 269507 2924544 0 996 envoy [ 1395.729475] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-5ccd8f2f255c9d7706d751dadb4a6c85858ab3cc154e7aa71e957fea96088b5f.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-5ccd8f2f255c9d7706d751dadb4a6c85858ab3cc154e7aa71e957fea96088b5f.scope,task=envoy,pid=21208,uid=1000319999 [ 1395.729561] Memory cgroup out of memory: Killed process 21208 (envoy) total-vm:75259332kB, anon-rss:1018380kB, file-rss:59648kB, shmem-rss:0kB, UID:1000319999 pgtables:2856kB oom_score_adj:996 [ 1395.734770] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-5ccd8f2f255c9d7706d751dadb4a6c85858ab3cc154e7aa71e957fea96088b5f.scope are going to be killed due to memory.oom.group set [ 1395.734863] Memory cgroup out of memory: Killed process 21198 (pilot-agent) total-vm:1850484kB, anon-rss:24596kB, file-rss:26240kB, shmem-rss:0kB, UID:1000319999 pgtables:264kB oom_score_adj:996 [ 1395.745230] Memory cgroup out of memory: Killed process 21256 (wrk:worker_0) total-vm:75259332kB, anon-rss:1018380kB, file-rss:59648kB, shmem-rss:0kB, UID:1000319999 pgtables:2856kB oom_score_adj:996 [ 1458.259777] 95e9568db6f8bdf: left promiscuous mode [ 1484.662078] 911b18c7889c054: entered promiscuous mode [ 1521.310609] wrk:worker_0 invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 1521.310620] CPU: 7 PID: 21639 Comm: wrk:worker_0 Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 1521.310623] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 1521.310624] Call Trace: [ 1521.310627] [ 1521.310631] dump_stack_lvl+0x34/0x48 [ 1521.310637] dump_header+0x4a/0x213 [ 1521.310641] oom_kill_process.cold+0xb/0x10 [ 1521.310643] out_of_memory+0xef/0x2c0 [ 1521.310649] mem_cgroup_out_of_memory+0x131/0x150 [ 1521.310654] try_charge_memcg+0x742/0x800 [ 1521.310658] ? alloc_pages_mpol+0x93/0x1e0 [ 1521.310663] __mem_cgroup_charge+0x3e/0xb0 [ 1521.310666] do_anonymous_page+0x7d/0x3e0 [ 1521.310670] __handle_mm_fault+0x2fe/0x650 [ 1521.310674] handle_mm_fault+0xe9/0x250 [ 1521.310676] do_user_addr_fault+0x154/0x620 [ 1521.310682] exc_page_fault+0x62/0x150 [ 1521.310686] asm_exc_page_fault+0x22/0x30 [ 1521.310690] RIP: 0033:0x3adbe84e5774 [ 1521.310693] Code: e9 06 00 00 00 45 8b 0c 08 8b f1 41 8d 7f 18 0f 1f 80 00 00 00 00 44 3b cf 0f 82 1e 01 00 00 41 8d 3c 37 45 2b cf 45 8d 59 f8 <45> 89 5c 38 08 44 8d 67 08 41 83 e1 fc 41 83 e9 08 45 01 e1 41 83 [ 1521.310695] RSP: 002b:00007ef9b230b3c8 EFLAGS: 00010206 [ 1521.310697] RAX: 0000000000000073 RBX: 000000000000003f RCX: 000000001066cff0 [ 1521.310699] RDX: 0000000000000023 RSI: 000000001066cffc RDI: 000000001066d00c [ 1521.310700] RBP: 00007ef9b230b418 R08: 00007eece4000000 R09: 0000000000002fe4 [ 1521.310701] R10: 0000000000000000 R11: 0000000000002fdc R12: 000000001066cfdc [ 1521.310703] R13: 0000304cbc216080 R14: 00000000002067e0 R15: 0000000000000010 [ 1521.310706] [ 1521.310716] memory: usage 1048576kB, limit 1048576kB, failcnt 472 [ 1521.310719] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 1521.310721] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 1521.310846] anon 1069133824 [ 1521.310852] file 118784 [ 1521.310855] kernel 4489216 [ 1521.310857] kernel_stack 491520 [ 1521.310860] pagetables 2998272 [ 1521.310862] sec_pagetables 0 [ 1521.310865] percpu 58440 [ 1521.310867] sock 0 [ 1521.310870] vmalloc 36864 [ 1521.310872] shmem 118784 [ 1521.310874] zswap 0 [ 1521.310877] zswapped 0 [ 1521.310879] file_mapped 0 [ 1521.310882] file_dirty 0 [ 1521.310884] file_writeback 0 [ 1521.310886] swapcached 0 [ 1521.310889] anon_thp 216006656 [ 1521.310891] file_thp 0 [ 1521.310893] shmem_thp 0 [ 1521.310895] inactive_anon 0 [ 1521.310898] active_anon 1069228032 [ 1521.310900] inactive_file 0 [ 1521.310902] active_file 0 [ 1521.310904] unevictable 0 [ 1521.310906] slab_reclaimable 113664 [ 1521.310908] slab_unreclaimable 569728 [ 1521.310910] slab 683392 [ 1521.310913] workingset_refault_anon 0 [ 1521.310915] workingset_refault_file 0 [ 1521.310917] workingset_activate_anon 0 [ 1521.310919] workingset_activate_file 0 [ 1521.310922] workingset_restore_anon 0 [ 1521.310924] workingset_restore_file 0 [ 1521.310926] workingset_nodereclaim 0 [ 1521.310929] pgscan 81 [ 1521.310931] pgsteal 38 [ 1521.310933] pgscan_kswapd 0 [ 1521.310935] pgscan_direct 81 [ 1521.310938] pgscan_khugepaged 0 [ 1521.310940] pgsteal_kswapd 0 [ 1521.310942] pgsteal_direct 38 [ 1521.310945] pgsteal_khugepaged 0 [ 1521.310947] pgfault 1077669 [ 1521.310949] pgmajfault 0 [ 1521.310952] pgrefill 95 [ 1521.310954] pgactivate 0 [ 1521.310956] pgdeactivate 0 [ 1521.310959] pglazyfree 0 [ 1521.310961] pglazyfreed 0 [ 1521.310964] zswpin 0 [ 1521.310966] zswpout 0 [ 1521.310969] zswpwb 0 [ 1521.310971] thp_fault_alloc 794 [ 1521.310973] thp_collapse_alloc 0 [ 1521.310975] thp_swpout 0 [ 1521.310977] thp_swpout_fallback 0 [ 1521.310980] Tasks state (memory values in pages): [ 1521.310982] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 1521.310986] [ 21560] 0 21560 2048 480 57344 0 -1000 conmon [ 1521.310993] [ 21562] 1000319999 21562 462621 12436 266240 0 996 pilot-agent [ 1521.311000] [ 21573] 1000319999 21573 9903733 269903 2850816 0 996 envoy [ 1521.311005] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-4938f8dd2c5a03951b4e87533f49e6e7a6ac7b34ed4ca1010e3b884860664e33.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-4938f8dd2c5a03951b4e87533f49e6e7a6ac7b34ed4ca1010e3b884860664e33.scope,task=envoy,pid=21573,uid=1000319999 [ 1521.311087] Memory cgroup out of memory: Killed process 21573 (envoy) total-vm:39614932kB, anon-rss:1020092kB, file-rss:59520kB, shmem-rss:0kB, UID:1000319999 pgtables:2784kB oom_score_adj:996 [ 1521.321473] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-4938f8dd2c5a03951b4e87533f49e6e7a6ac7b34ed4ca1010e3b884860664e33.scope are going to be killed due to memory.oom.group set [ 1521.321531] Memory cgroup out of memory: Killed process 21562 (pilot-agent) total-vm:1850484kB, anon-rss:23120kB, file-rss:26624kB, shmem-rss:0kB, UID:1000319999 pgtables:260kB oom_score_adj:996 [ 1521.331898] Memory cgroup out of memory: Killed process 21639 (wrk:worker_0) total-vm:39614932kB, anon-rss:1020092kB, file-rss:59520kB, shmem-rss:0kB, UID:1000319999 pgtables:2784kB oom_score_adj:996 [ 1591.826898] 911b18c7889c054: left promiscuous mode [ 1601.431802] pci 0000:00:1f.0: [1d0f:8061] type 00 class 0x010802 PCIe Endpoint [ 1601.432151] pci 0000:00:1f.0: BAR 0 [mem 0x00000000-0x00003fff] [ 1601.432879] pci 0000:00:1f.0: BAR 0 [mem 0xc0000000-0xc0003fff]: assigned [ 1601.433173] nvme nvme1: pci function 0000:00:1f.0 [ 1601.433193] nvme 0000:00:1f.0: enabling device (0000 -> 0002) [ 1601.434780] ACPI: \_SB_.LNKC: Enabled at IRQ 10 [ 1601.439576] nvme nvme1: 2/0/0 default/read/poll queues [ 1609.973465] EXT4-fs (nvme1n1): mounted filesystem 269fb6cd-b1aa-4c00-bb51-f8c1c65ecc2d r/w with ordered data mode. Quota mode: none. [ 1610.311719] 3f99988dcf58048: entered promiscuous mode [ 1618.949658] 3f99988dcf58048: left promiscuous mode [ 1619.384239] EXT4-fs (nvme1n1): unmounting filesystem 269fb6cd-b1aa-4c00-bb51-f8c1c65ecc2d. [ 1644.804718] 36872212eb59775: entered promiscuous mode [ 1645.673387] pci 0000:00:1f.0: [1d0f:8061] type 00 class 0x010802 PCIe Endpoint [ 1645.673863] pci 0000:00:1f.0: BAR 0 [mem 0x00000000-0x00003fff] [ 1645.675212] pci 0000:00:1f.0: BAR 0 [mem 0xc0000000-0xc0003fff]: assigned [ 1645.675742] nvme nvme1: pci function 0000:00:1f.0 [ 1645.675776] nvme 0000:00:1f.0: enabling device (0000 -> 0002) [ 1645.682604] nvme nvme1: 2/0/0 default/read/poll queues [ 1650.544856] EXT4-fs (nvme1n1): mounted filesystem 269fb6cd-b1aa-4c00-bb51-f8c1c65ecc2d r/w with ordered data mode. Quota mode: none. [ 1650.763548] c4764abd1eba0f0: entered promiscuous mode [ 1775.385661] 36872212eb59775: left promiscuous mode [ 1790.819596] c4764abd1eba0f0: left promiscuous mode [ 1791.142455] EXT4-fs (nvme1n1): unmounting filesystem 269fb6cd-b1aa-4c00-bb51-f8c1c65ecc2d. [ 1801.526862] pci 0000:00:1f.0: [1d0f:8061] type 00 class 0x010802 PCIe Endpoint [ 1801.527183] pci 0000:00:1f.0: BAR 0 [mem 0x00000000-0x00003fff] [ 1801.527959] pci 0000:00:1f.0: BAR 0 [mem 0xc0000000-0xc0003fff]: assigned [ 1801.528108] nvme nvme1: pci function 0000:00:1f.0 [ 1801.528140] nvme 0000:00:1f.0: enabling device (0000 -> 0002) [ 1801.534665] nvme nvme1: 2/0/0 default/read/poll queues [ 1803.991829] EXT4-fs (nvme1n1): mounted filesystem 269fb6cd-b1aa-4c00-bb51-f8c1c65ecc2d r/w with ordered data mode. Quota mode: none. [ 1804.411806] da4bdc622dac91f: entered promiscuous mode [ 1804.432872] daa2262a2645e92: entered promiscuous mode [ 1853.452210] 09cf798507ebd47: entered promiscuous mode [ 2014.848529] daa2262a2645e92: left promiscuous mode [ 2014.974535] da4bdc622dac91f: left promiscuous mode [ 2015.275767] EXT4-fs (nvme1n1): unmounting filesystem 269fb6cd-b1aa-4c00-bb51-f8c1c65ecc2d. [ 2029.414279] pci 0000:00:1f.0: [1d0f:8061] type 00 class 0x010802 PCIe Endpoint [ 2029.414615] pci 0000:00:1f.0: BAR 0 [mem 0x00000000-0x00003fff] [ 2029.415461] pci 0000:00:1f.0: BAR 0 [mem 0xc0000000-0xc0003fff]: assigned [ 2029.415656] nvme nvme1: pci function 0000:00:1f.0 [ 2029.415681] nvme 0000:00:1f.0: enabling device (0000 -> 0002) [ 2029.422597] nvme nvme1: 2/0/0 default/read/poll queues [ 2030.464125] EXT4-fs (nvme1n1): mounted filesystem 269fb6cd-b1aa-4c00-bb51-f8c1c65ecc2d r/w with ordered data mode. Quota mode: none. [ 2030.659031] 9304c38fd690012: entered promiscuous mode [ 2030.727647] e5474f874bd81cd: entered promiscuous mode [ 2034.397205] 09cf798507ebd47: left promiscuous mode [ 2046.259235] 60452a3349a5f2f: entered promiscuous mode [ 2237.091245] 60452a3349a5f2f: left promiscuous mode [ 2243.088299] 9304c38fd690012: left promiscuous mode [ 2249.476178] 7eb0304618d30c2: entered promiscuous mode [ 2259.778167] e5474f874bd81cd: left promiscuous mode [ 2260.116171] EXT4-fs (nvme1n1): unmounting filesystem 269fb6cd-b1aa-4c00-bb51-f8c1c65ecc2d. [ 2271.566172] 1320b07a9af58c7: entered promiscuous mode [ 2422.657307] 7eb0304618d30c2: left promiscuous mode [ 2428.812500] 1320b07a9af58c7: left promiscuous mode [ 2459.815842] 75e3f5e044ab15e: entered promiscuous mode [ 2459.842941] 07f6cd25f5ea99b: entered promiscuous mode [ 2482.893943] c1364855a889ce6: entered promiscuous mode [ 2690.045606] 07f6cd25f5ea99b: left promiscuous mode [ 2690.155681] 75e3f5e044ab15e: left promiscuous mode [ 2691.199742] c1364855a889ce6: left promiscuous mode [ 2703.530314] c71ae939a1e3d06: entered promiscuous mode [ 2712.134607] 7faa85665d8c716: entered promiscuous mode [ 2712.183448] 45bfc66c7c3682f: entered promiscuous mode [ 2730.840285] envoy invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 2730.840298] CPU: 2 PID: 22647 Comm: envoy Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 2730.840301] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 2730.840302] Call Trace: [ 2730.840305] [ 2730.840308] dump_stack_lvl+0x34/0x48 [ 2730.840314] dump_header+0x4a/0x213 [ 2730.840318] oom_kill_process.cold+0xb/0x10 [ 2730.840321] out_of_memory+0xef/0x2c0 [ 2730.840326] mem_cgroup_out_of_memory+0x131/0x150 [ 2730.840331] try_charge_memcg+0x742/0x800 [ 2730.840335] ? alloc_pages_mpol+0x93/0x1e0 [ 2730.840340] __mem_cgroup_charge+0x3e/0xb0 [ 2730.840343] do_anonymous_page+0x7d/0x3e0 [ 2730.840347] __handle_mm_fault+0x2fe/0x650 [ 2730.840351] handle_mm_fault+0xe9/0x250 [ 2730.840354] do_user_addr_fault+0x154/0x620 [ 2730.840359] exc_page_fault+0x62/0x150 [ 2730.840364] asm_exc_page_fault+0x22/0x30 [ 2730.840368] RIP: 0033:0x18a1847351f4 [ 2730.840371] Code: e9 06 00 00 00 45 8b 0c 08 8b f1 41 8d 7f 18 0f 1f 80 00 00 00 00 44 3b cf 0f 82 1e 01 00 00 41 8d 3c 37 45 2b cf 45 8d 59 f8 <45> 89 5c 38 08 44 8d 67 08 41 83 e1 fc 41 83 e9 08 45 01 e1 41 83 [ 2730.840374] RSP: 002b:00007ffde21d84c0 EFLAGS: 00010202 [ 2730.840376] RAX: 0000000000000017 RBX: 000000000000003f RCX: 00000000002f8ff0 [ 2730.840378] RDX: 0000000000000026 RSI: 00000000002f8ffc RDI: 00000000002f9010 [ 2730.840379] RBP: 00007ffde21d8510 R08: 00007f0cbc000000 R09: 0000000000006fe0 [ 2730.840380] R10: 0000000000000000 R11: 0000000000006fd8 R12: 00000000002f8fdc [ 2730.840382] R13: 00007042fe38e080 R14: 0000000000206810 R15: 0000000000000014 [ 2730.840385] [ 2730.840396] memory: usage 1048576kB, limit 1048576kB, failcnt 582 [ 2730.840399] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 2730.840401] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 2730.840541] anon 1069096960 [ 2730.840547] file 126976 [ 2730.840549] kernel 4517888 [ 2730.840550] kernel_stack 491520 [ 2730.840551] pagetables 3031040 [ 2730.840552] sec_pagetables 0 [ 2730.840554] percpu 58440 [ 2730.840559] sock 0 [ 2730.840561] vmalloc 36864 [ 2730.840562] shmem 118784 [ 2730.840564] zswap 0 [ 2730.840568] zswapped 0 [ 2730.840569] file_mapped 0 [ 2730.840572] file_dirty 0 [ 2730.840575] file_writeback 8192 [ 2730.840577] swapcached 0 [ 2730.840578] anon_thp 174063616 [ 2730.840580] file_thp 0 [ 2730.840584] shmem_thp 0 [ 2730.840585] inactive_anon 49152 [ 2730.840586] active_anon 1069166592 [ 2730.840587] inactive_file 8192 [ 2730.840588] active_file 0 [ 2730.840590] unevictable 0 [ 2730.840593] slab_reclaimable 119496 [ 2730.840595] slab_unreclaimable 569264 [ 2730.840596] slab 688760 [ 2730.840598] workingset_refault_anon 0 [ 2730.840602] workingset_refault_file 0 [ 2730.840604] workingset_activate_anon 0 [ 2730.840605] workingset_activate_file 0 [ 2730.840606] workingset_restore_anon 0 [ 2730.840610] workingset_restore_file 0 [ 2730.840612] workingset_nodereclaim 0 [ 2730.840613] pgscan 95 [ 2730.840615] pgsteal 52 [ 2730.840618] pgscan_kswapd 0 [ 2730.840620] pgscan_direct 95 [ 2730.840621] pgscan_khugepaged 0 [ 2730.840623] pgsteal_kswapd 0 [ 2730.840627] pgsteal_direct 52 [ 2730.840629] pgsteal_khugepaged 0 [ 2730.840630] pgfault 1664712 [ 2730.840630] pgmajfault 0 [ 2730.840632] pgrefill 133 [ 2730.840636] pgactivate 0 [ 2730.840638] pgdeactivate 0 [ 2730.840639] pglazyfree 0 [ 2730.840643] pglazyfreed 0 [ 2730.840645] zswpin 0 [ 2730.840647] zswpout 0 [ 2730.840651] zswpwb 0 [ 2730.840653] thp_fault_alloc 1337 [ 2730.840655] thp_collapse_alloc 0 [ 2730.840659] thp_swpout 0 [ 2730.840661] thp_swpout_fallback 0 [ 2730.840663] Tasks state (memory values in pages): [ 2730.840667] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 2730.840671] [ 22633] 0 22633 2048 480 57344 0 -1000 conmon [ 2730.840678] [ 22635] 1000319999 22635 462557 13493 282624 0 996 pilot-agent [ 2730.840686] [ 22647] 1000319999 22647 12131284 268867 2838528 0 996 envoy [ 2730.840691] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-60e96a4c0c77e7a20a8252f135790aaadaf49e8b997d1902594ce4aa12b7894f.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-60e96a4c0c77e7a20a8252f135790aaadaf49e8b997d1902594ce4aa12b7894f.scope,task=envoy,pid=22647,uid=1000319999 [ 2730.840766] Memory cgroup out of memory: Killed process 22647 (envoy) total-vm:48525136kB, anon-rss:1015692kB, file-rss:59776kB, shmem-rss:0kB, UID:1000319999 pgtables:2772kB oom_score_adj:996 [ 2730.850935] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-60e96a4c0c77e7a20a8252f135790aaadaf49e8b997d1902594ce4aa12b7894f.scope are going to be killed due to memory.oom.group set [ 2730.850978] Memory cgroup out of memory: Killed process 22635 (pilot-agent) total-vm:1850228kB, anon-rss:27476kB, file-rss:26496kB, shmem-rss:0kB, UID:1000319999 pgtables:276kB oom_score_adj:996 [ 2730.861223] Memory cgroup out of memory: Killed process 22647 (envoy) total-vm:48525136kB, anon-rss:1015692kB, file-rss:59776kB, shmem-rss:0kB, UID:1000319999 pgtables:2772kB oom_score_adj:996 [ 2760.652622] envoy invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 2760.652635] CPU: 4 PID: 33522 Comm: envoy Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 2760.652639] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 2760.652641] Call Trace: [ 2760.652645] [ 2760.652650] dump_stack_lvl+0x34/0x48 [ 2760.652657] dump_header+0x4a/0x213 [ 2760.652663] oom_kill_process.cold+0xb/0x10 [ 2760.652666] out_of_memory+0xef/0x2c0 [ 2760.652673] mem_cgroup_out_of_memory+0x131/0x150 [ 2760.652680] try_charge_memcg+0x742/0x800 [ 2760.652684] ? alloc_pages_mpol+0x93/0x1e0 [ 2760.652690] __mem_cgroup_charge+0x3e/0xb0 [ 2760.652694] do_anonymous_page+0x7d/0x3e0 [ 2760.652700] __handle_mm_fault+0x2fe/0x650 [ 2760.652706] handle_mm_fault+0xe9/0x250 [ 2760.652709] do_user_addr_fault+0x154/0x620 [ 2760.652716] exc_page_fault+0x62/0x150 [ 2760.652722] asm_exc_page_fault+0x22/0x30 [ 2760.652727] RIP: 0033:0x3e8b9fdaa6f4 [ 2760.652731] Code: ff 44 8b e0 44 8b 9d 50 ff ff ff 45 8d 7b 01 8b 9d 70 ff ff ff 8d 4b 3c 45 6b db 3c 44 8b 75 b8 45 03 de 48 8b bd 28 ff ff ff <4a> 89 7c 1a 34 44 8b 85 58 ff ff ff 46 89 44 1a 30 4c 8b 85 20 ff [ 2760.652734] RSP: 002b:00007ffe6feff0f0 EFLAGS: 00010202 [ 2760.652738] RAX: 0000000000000003 RBX: 000000000022af1c RCX: 000000000022af58 [ 2760.652740] RDX: 00007f1424000000 RSI: 00002c2fcc9036d1 RDI: 0000001700299b90 [ 2760.652742] RBP: 00007ffe6feff1d0 R08: 0000000080000000 R09: 0000000000000122 [ 2760.652745] R10: 0000000000000000 R11: 00000000002e6fdc R12: 0000000000000004 [ 2760.652746] R13: 000010c97b738080 R14: 00000000002e2ef0 R15: 0000000000000116 [ 2760.652751] [ 2760.652769] memory: usage 1048576kB, limit 1048576kB, failcnt 705 [ 2760.652774] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 2760.652778] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 2760.652803] anon 1069064192 [ 2760.652806] file 122880 [ 2760.652808] kernel 4554752 [ 2760.652811] kernel_stack 475136 [ 2760.652813] pagetables 3072000 [ 2760.652815] sec_pagetables 0 [ 2760.652817] percpu 58440 [ 2760.652819] sock 0 [ 2760.652821] vmalloc 36864 [ 2760.652824] shmem 118784 [ 2760.652826] zswap 0 [ 2760.652829] zswapped 0 [ 2760.652832] file_mapped 0 [ 2760.652835] file_dirty 0 [ 2760.652837] file_writeback 4096 [ 2760.652839] swapcached 0 [ 2760.652841] anon_thp 255852544 [ 2760.652843] file_thp 0 [ 2760.652845] shmem_thp 0 [ 2760.652847] inactive_anon 98304 [ 2760.652849] active_anon 1069051904 [ 2760.652851] inactive_file 4096 [ 2760.652853] active_file 0 [ 2760.652855] unevictable 0 [ 2760.652858] slab_reclaimable 123952 [ 2760.652860] slab_unreclaimable 575888 [ 2760.652862] slab 699840 [ 2760.652864] workingset_refault_anon 0 [ 2760.652867] workingset_refault_file 0 [ 2760.652869] workingset_activate_anon 0 [ 2760.652871] workingset_activate_file 0 [ 2760.652873] workingset_restore_anon 0 [ 2760.652876] workingset_restore_file 0 [ 2760.652878] workingset_nodereclaim 0 [ 2760.652880] pgscan 103 [ 2760.652882] pgsteal 60 [ 2760.652885] pgscan_kswapd 0 [ 2760.652887] pgscan_direct 103 [ 2760.652889] pgscan_khugepaged 0 [ 2760.652891] pgsteal_kswapd 0 [ 2760.652893] pgsteal_direct 60 [ 2760.652896] pgsteal_khugepaged 0 [ 2760.652898] pgfault 1937724 [ 2760.652900] pgmajfault 0 [ 2760.652902] pgrefill 158 [ 2760.652905] pgactivate 0 [ 2760.652907] pgdeactivate 0 [ 2760.652909] pglazyfree 0 [ 2760.652911] pglazyfreed 0 [ 2760.652913] zswpin 0 [ 2760.652916] zswpout 0 [ 2760.652918] zswpwb 0 [ 2760.652920] thp_fault_alloc 1611 [ 2760.652922] thp_collapse_alloc 0 [ 2760.652924] thp_swpout 0 [ 2760.652926] thp_swpout_fallback 0 [ 2760.652928] Tasks state (memory values in pages): [ 2760.652930] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 2760.652934] [ 33496] 0 33496 2048 480 53248 0 -1000 conmon [ 2760.652941] [ 33498] 1000319999 33498 462557 12892 270336 0 996 pilot-agent [ 2760.652947] [ 33522] 1000319999 33522 21043093 269228 2916352 0 996 envoy [ 2760.652951] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-f6571f24946e64b1425957f047a69fb7045d88864f7b99aefe2fb0137559bbf2.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-f6571f24946e64b1425957f047a69fb7045d88864f7b99aefe2fb0137559bbf2.scope,task=envoy,pid=33522,uid=1000319999 [ 2760.653036] Memory cgroup out of memory: Killed process 33522 (envoy) total-vm:84172372kB, anon-rss:1017648kB, file-rss:59264kB, shmem-rss:0kB, UID:1000319999 pgtables:2848kB oom_score_adj:996 [ 2760.664098] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-f6571f24946e64b1425957f047a69fb7045d88864f7b99aefe2fb0137559bbf2.scope are going to be killed due to memory.oom.group set [ 2760.664169] Memory cgroup out of memory: Killed process 33498 (pilot-agent) total-vm:1850228kB, anon-rss:25328kB, file-rss:26240kB, shmem-rss:0kB, UID:1000319999 pgtables:264kB oom_score_adj:996 [ 2760.675148] Memory cgroup out of memory: Killed process 33522 (envoy) total-vm:84172372kB, anon-rss:1017648kB, file-rss:59264kB, shmem-rss:0kB, UID:1000319999 pgtables:2848kB oom_score_adj:996 [ 2809.037368] envoy invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 2809.037381] CPU: 7 PID: 33976 Comm: envoy Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 2809.037385] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 2809.037387] Call Trace: [ 2809.037390] [ 2809.037395] dump_stack_lvl+0x34/0x48 [ 2809.037401] dump_header+0x4a/0x213 [ 2809.037406] oom_kill_process.cold+0xb/0x10 [ 2809.037410] out_of_memory+0xef/0x2c0 [ 2809.037416] mem_cgroup_out_of_memory+0x131/0x150 [ 2809.037422] try_charge_memcg+0x742/0x800 [ 2809.037426] ? alloc_pages_mpol+0x93/0x1e0 [ 2809.037430] __mem_cgroup_charge+0x3e/0xb0 [ 2809.037434] do_anonymous_page+0x7d/0x3e0 [ 2809.037440] __handle_mm_fault+0x2fe/0x650 [ 2809.037445] handle_mm_fault+0xe9/0x250 [ 2809.037448] do_user_addr_fault+0x154/0x620 [ 2809.037454] exc_page_fault+0x62/0x150 [ 2809.037459] asm_exc_page_fault+0x22/0x30 [ 2809.037464] RIP: 0033:0x96bd8311174 [ 2809.037468] Code: e9 06 00 00 00 45 8b 0c 08 8b f1 41 8d 7f 18 0f 1f 80 00 00 00 00 44 3b cf 0f 82 1e 01 00 00 41 8d 3c 37 45 2b cf 45 8d 59 f8 <45> 89 5c 38 08 44 8d 67 08 41 83 e1 fc 41 83 e9 08 45 01 e1 41 83 [ 2809.037470] RSP: 002b:00007ffca9855d88 EFLAGS: 00010206 [ 2809.037474] RAX: 0000000000000001 RBX: 000000000000003f RCX: 00000000002bfff0 [ 2809.037476] RDX: 0000000000000028 RSI: 00000000002bfffc RDI: 00000000002c001c [ 2809.037478] RBP: 00007ffca9855dd8 R08: 00007ef890000000 R09: 000000000000ffd4 [ 2809.037479] R10: 0000022ae645ee88 R11: 000000000000ffcc R12: 00000000002bffcc [ 2809.037481] R13: 000052a07e33e080 R14: 0000000000206830 R15: 0000000000000020 [ 2809.037486] [ 2809.037500] memory: usage 1048576kB, limit 1048576kB, failcnt 833 [ 2809.037502] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 2809.037504] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 2809.037530] anon 1069039616 [ 2809.037534] file 126976 [ 2809.037535] kernel 4571136 [ 2809.037537] kernel_stack 475136 [ 2809.037539] pagetables 3059712 [ 2809.037540] sec_pagetables 0 [ 2809.037542] percpu 58440 [ 2809.037543] sock 4096 [ 2809.037544] vmalloc 36864 [ 2809.037546] shmem 118784 [ 2809.037547] zswap 0 [ 2809.037549] zswapped 0 [ 2809.037550] file_mapped 0 [ 2809.037552] file_dirty 0 [ 2809.037555] file_writeback 8192 [ 2809.037557] swapcached 0 [ 2809.037559] anon_thp 245366784 [ 2809.037561] file_thp 0 [ 2809.037563] shmem_thp 0 [ 2809.037565] inactive_anon 139264 [ 2809.037567] active_anon 1068994560 [ 2809.037569] inactive_file 8192 [ 2809.037571] active_file 0 [ 2809.037573] unevictable 0 [ 2809.037575] slab_reclaimable 120744 [ 2809.037577] slab_unreclaimable 583312 [ 2809.037579] slab 704056 [ 2809.037581] workingset_refault_anon 0 [ 2809.037583] workingset_refault_file 0 [ 2809.037585] workingset_activate_anon 0 [ 2809.037588] workingset_activate_file 0 [ 2809.037589] workingset_restore_anon 0 [ 2809.037591] workingset_restore_file 0 [ 2809.037592] workingset_nodereclaim 0 [ 2809.037594] pgscan 109 [ 2809.037595] pgsteal 66 [ 2809.037596] pgscan_kswapd 0 [ 2809.037598] pgscan_direct 109 [ 2809.037599] pgscan_khugepaged 0 [ 2809.037600] pgsteal_kswapd 0 [ 2809.037601] pgsteal_direct 66 [ 2809.037603] pgsteal_khugepaged 0 [ 2809.037604] pgfault 2215517 [ 2809.037613] pgmajfault 0 [ 2809.037617] pgrefill 199 [ 2809.037619] pgactivate 0 [ 2809.037620] pgdeactivate 0 [ 2809.037625] pglazyfree 0 [ 2809.037627] pglazyfreed 0 [ 2809.037628] zswpin 0 [ 2809.037632] zswpout 0 [ 2809.037634] zswpwb 0 [ 2809.037637] thp_fault_alloc 1860 [ 2809.037642] thp_collapse_alloc 0 [ 2809.037678] thp_swpout 0 [ 2809.037682] thp_swpout_fallback 0 [ 2809.037685] Tasks state (memory values in pages): [ 2809.037686] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 2809.037695] [ 33954] 0 33954 2048 480 53248 0 -1000 conmon [ 2809.037702] [ 33956] 1000319999 33956 462557 13263 266240 0 996 pilot-agent [ 2809.037710] [ 33976] 1000319999 33976 21043090 268925 2924544 0 996 envoy [ 2809.037717] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-ea9d301a181b03866c20c69cf8babf07ff16a11f30943629a6027470194f9b23.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-ea9d301a181b03866c20c69cf8babf07ff16a11f30943629a6027470194f9b23.scope,task=envoy,pid=33976,uid=1000319999 [ 2809.037824] Memory cgroup out of memory: Killed process 33976 (envoy) total-vm:84172360kB, anon-rss:1016180kB, file-rss:59520kB, shmem-rss:0kB, UID:1000319999 pgtables:2856kB oom_score_adj:996 [ 2809.048499] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-ea9d301a181b03866c20c69cf8babf07ff16a11f30943629a6027470194f9b23.scope are going to be killed due to memory.oom.group set [ 2809.048604] Memory cgroup out of memory: Killed process 33956 (pilot-agent) total-vm:1850228kB, anon-rss:26812kB, file-rss:26240kB, shmem-rss:0kB, UID:1000319999 pgtables:260kB oom_score_adj:996 [ 2809.059251] Memory cgroup out of memory: Killed process 33976 (envoy) total-vm:84172360kB, anon-rss:1016180kB, file-rss:59520kB, shmem-rss:0kB, UID:1000319999 pgtables:2856kB oom_score_adj:996 [ 2858.741828] envoy invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 2858.741840] CPU: 2 PID: 34477 Comm: envoy Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 2858.741843] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 2858.741844] Call Trace: [ 2858.741847] [ 2858.741851] dump_stack_lvl+0x34/0x48 [ 2858.741856] dump_header+0x4a/0x213 [ 2858.741861] oom_kill_process.cold+0xb/0x10 [ 2858.741863] out_of_memory+0xef/0x2c0 [ 2858.741868] mem_cgroup_out_of_memory+0x131/0x150 [ 2858.741874] try_charge_memcg+0x742/0x800 [ 2858.741878] ? alloc_pages_mpol+0x93/0x1e0 [ 2858.741883] __mem_cgroup_charge+0x3e/0xb0 [ 2858.741886] do_anonymous_page+0x7d/0x3e0 [ 2858.741890] __handle_mm_fault+0x2fe/0x650 [ 2858.741894] handle_mm_fault+0xe9/0x250 [ 2858.741897] do_user_addr_fault+0x154/0x620 [ 2858.741902] exc_page_fault+0x62/0x150 [ 2858.741906] asm_exc_page_fault+0x22/0x30 [ 2858.741910] RIP: 0033:0x1d868a658734 [ 2858.741913] Code: e9 06 00 00 00 45 8b 0c 08 8b f1 41 8d 7f 18 0f 1f 80 00 00 00 00 44 3b cf 0f 82 1e 01 00 00 41 8d 3c 37 45 2b cf 45 8d 59 f8 <45> 89 5c 38 08 44 8d 67 08 41 83 e1 fc 41 83 e9 08 45 01 e1 41 83 [ 2858.741915] RSP: 002b:00007ffcf5667490 EFLAGS: 00010216 [ 2858.741917] RAX: 000000000000001f RBX: 000000000000003f RCX: 000000000051ac84 [ 2858.741919] RDX: 0000000000000025 RSI: 000000000051ac8c RDI: 000000000051b268 [ 2858.741920] RBP: 00007ffcf56674e0 R08: 00007f0bcc000000 R09: 0000000000004d88 [ 2858.741922] R10: 0000000000000000 R11: 0000000000004d80 R12: 000000000051ac5c [ 2858.741923] R13: 000012e9faa92080 R14: 0000000000206800 R15: 00000000000005dc [ 2858.741928] [ 2858.741942] memory: usage 1048576kB, limit 1048576kB, failcnt 934 [ 2858.741948] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 2858.741951] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 2858.741976] anon 1069027328 [ 2858.741983] file 126976 [ 2858.741985] kernel 4583424 [ 2858.741987] kernel_stack 475136 [ 2858.741988] pagetables 3076096 [ 2858.741990] sec_pagetables 0 [ 2858.741992] percpu 58440 [ 2858.741994] sock 4096 [ 2858.741996] vmalloc 36864 [ 2858.741997] shmem 118784 [ 2858.741998] zswap 0 [ 2858.741999] zswapped 0 [ 2858.742000] file_mapped 0 [ 2858.742001] file_dirty 0 [ 2858.742002] file_writeback 8192 [ 2858.742007] swapcached 0 [ 2858.742009] anon_thp 257949696 [ 2858.742010] file_thp 0 [ 2858.742012] shmem_thp 0 [ 2858.742016] inactive_anon 135168 [ 2858.742017] active_anon 1069010944 [ 2858.742019] inactive_file 8192 [ 2858.742023] active_file 0 [ 2858.742025] unevictable 0 [ 2858.742027] slab_reclaimable 121624 [ 2858.742028] slab_unreclaimable 572584 [ 2858.742029] slab 694208 [ 2858.742033] workingset_refault_anon 0 [ 2858.742035] workingset_refault_file 0 [ 2858.742039] workingset_activate_anon 0 [ 2858.742041] workingset_activate_file 0 [ 2858.742045] workingset_restore_anon 0 [ 2858.742047] workingset_restore_file 0 [ 2858.742049] workingset_nodereclaim 0 [ 2858.742051] pgscan 116 [ 2858.742055] pgsteal 73 [ 2858.742056] pgscan_kswapd 0 [ 2858.742058] pgscan_direct 116 [ 2858.742059] pgscan_khugepaged 0 [ 2858.742060] pgsteal_kswapd 0 [ 2858.742061] pgsteal_direct 73 [ 2858.742062] pgsteal_khugepaged 0 [ 2858.742063] pgfault 2490942 [ 2858.742064] pgmajfault 0 [ 2858.742065] pgrefill 227 [ 2858.742066] pgactivate 0 [ 2858.742067] pgdeactivate 0 [ 2858.742068] pglazyfree 0 [ 2858.742069] pglazyfreed 0 [ 2858.742070] zswpin 0 [ 2858.742071] zswpout 0 [ 2858.742072] zswpwb 0 [ 2858.742073] thp_fault_alloc 2117 [ 2858.742074] thp_collapse_alloc 0 [ 2858.742079] thp_swpout 0 [ 2858.742082] thp_swpout_fallback 0 [ 2858.742086] Tasks state (memory values in pages): [ 2858.742089] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 2858.742092] [ 34463] 0 34463 2048 480 57344 0 -1000 conmon [ 2858.742100] [ 34465] 1000319999 34465 462557 12382 270336 0 996 pilot-agent [ 2858.742108] [ 34477] 1000319999 34477 21043090 269955 2945024 0 996 envoy [ 2858.742132] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-6f6ee4162174af7ff724d7ca7f2370531ae4fa618844193d63de35a67a5dcbc1.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-6f6ee4162174af7ff724d7ca7f2370531ae4fa618844193d63de35a67a5dcbc1.scope,task=envoy,pid=34477,uid=1000319999 [ 2858.742219] Memory cgroup out of memory: Killed process 34477 (envoy) total-vm:84172360kB, anon-rss:1020172kB, file-rss:59648kB, shmem-rss:0kB, UID:1000319999 pgtables:2876kB oom_score_adj:996 [ 2858.752717] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-6f6ee4162174af7ff724d7ca7f2370531ae4fa618844193d63de35a67a5dcbc1.scope are going to be killed due to memory.oom.group set [ 2858.752778] Memory cgroup out of memory: Killed process 34465 (pilot-agent) total-vm:1850228kB, anon-rss:23416kB, file-rss:26112kB, shmem-rss:0kB, UID:1000319999 pgtables:264kB oom_score_adj:996 [ 2858.763013] Memory cgroup out of memory: Killed process 34477 (envoy) total-vm:84172360kB, anon-rss:1020172kB, file-rss:59648kB, shmem-rss:0kB, UID:1000319999 pgtables:2876kB oom_score_adj:996 [ 2926.231732] envoy invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 2926.231743] CPU: 1 PID: 34980 Comm: envoy Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 2926.231747] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 2926.231748] Call Trace: [ 2926.231751] [ 2926.231754] dump_stack_lvl+0x34/0x48 [ 2926.231760] dump_header+0x4a/0x213 [ 2926.231764] oom_kill_process.cold+0xb/0x10 [ 2926.231767] out_of_memory+0xef/0x2c0 [ 2926.231772] mem_cgroup_out_of_memory+0x131/0x150 [ 2926.231784] try_charge_memcg+0x742/0x800 [ 2926.231789] ? alloc_pages_mpol+0x93/0x1e0 [ 2926.231793] __mem_cgroup_charge+0x3e/0xb0 [ 2926.231796] do_anonymous_page+0x7d/0x3e0 [ 2926.231801] __handle_mm_fault+0x2fe/0x650 [ 2926.231805] handle_mm_fault+0xe9/0x250 [ 2926.231808] do_user_addr_fault+0x154/0x620 [ 2926.231813] exc_page_fault+0x62/0x150 [ 2926.231818] asm_exc_page_fault+0x22/0x30 [ 2926.231821] RIP: 0033:0x1bca6f16e874 [ 2926.231824] Code: ff 44 8b e0 44 8b 9d 50 ff ff ff 45 8d 7b 01 8b 9d 70 ff ff ff 8d 4b 3c 45 6b db 3c 44 8b 75 b8 45 03 de 48 8b bd 28 ff ff ff <4a> 89 7c 1a 34 44 8b 85 58 ff ff ff 46 89 44 1a 30 4c 8b 85 20 ff [ 2926.231826] RSP: 002b:00007ffe4fdf5120 EFLAGS: 00010202 [ 2926.231828] RAX: 0000000000000003 RBX: 00000000002b76b8 RCX: 00000000002b76f4 [ 2926.231830] RDX: 00007f9474000000 RSI: 00000f2005b836d1 RDI: 0000000c0047c640 [ 2926.231831] RBP: 00007ffe4fdf5200 R08: 0000000080000000 R09: 0000000080000000 [ 2926.231833] R10: 0000000000000000 R11: 000000000048aff8 R12: 0000000000000004 [ 2926.231834] R13: 000070af3ab56080 R14: 0000000000489360 R15: 000000000000007b [ 2926.231837] [ 2926.231847] memory: usage 1048576kB, limit 1048576kB, failcnt 1021 [ 2926.231850] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 2926.231856] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 2926.231960] anon 1068978176 [ 2926.231971] file 126976 [ 2926.231977] kernel 4632576 [ 2926.231980] kernel_stack 491520 [ 2926.231982] pagetables 3084288 [ 2926.231984] sec_pagetables 0 [ 2926.231987] percpu 58440 [ 2926.231989] sock 4096 [ 2926.231995] vmalloc 36864 [ 2926.231997] shmem 118784 [ 2926.232001] zswap 0 [ 2926.232003] zswapped 0 [ 2926.232006] file_mapped 0 [ 2926.232007] file_dirty 0 [ 2926.232013] file_writeback 8192 [ 2926.232015] swapcached 0 [ 2926.232017] anon_thp 251658240 [ 2926.232023] file_thp 0 [ 2926.232026] shmem_thp 0 [ 2926.232028] inactive_anon 0 [ 2926.232029] active_anon 1069096960 [ 2926.232030] inactive_file 8192 [ 2926.232034] active_file 0 [ 2926.232037] unevictable 0 [ 2926.232041] slab_reclaimable 127248 [ 2926.232043] slab_unreclaimable 592704 [ 2926.232047] slab 719952 [ 2926.232049] workingset_refault_anon 0 [ 2926.232054] workingset_refault_file 0 [ 2926.232056] workingset_activate_anon 0 [ 2926.232058] workingset_activate_file 0 [ 2926.232062] workingset_restore_anon 0 [ 2926.232064] workingset_restore_file 0 [ 2926.232068] workingset_nodereclaim 0 [ 2926.232070] pgscan 124 [ 2926.232072] pgsteal 81 [ 2926.232076] pgscan_kswapd 0 [ 2926.232077] pgscan_direct 124 [ 2926.232081] pgscan_khugepaged 0 [ 2926.232083] pgsteal_kswapd 0 [ 2926.232088] pgsteal_direct 81 [ 2926.232089] pgsteal_khugepaged 0 [ 2926.232093] pgfault 2769319 [ 2926.232095] pgmajfault 0 [ 2926.232100] pgrefill 276 [ 2926.232101] pgactivate 0 [ 2926.232105] pgdeactivate 0 [ 2926.232108] pglazyfree 0 [ 2926.232112] pglazyfreed 0 [ 2926.232114] zswpin 0 [ 2926.232115] zswpout 0 [ 2926.232116] zswpwb 0 [ 2926.232120] thp_fault_alloc 2358 [ 2926.232121] thp_collapse_alloc 0 [ 2926.232122] thp_swpout 0 [ 2926.232123] thp_swpout_fallback 0 [ 2926.232124] Tasks state (memory values in pages): [ 2926.232128] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 2926.232131] [ 34967] 0 34967 2048 480 53248 0 -1000 conmon [ 2926.232139] [ 34969] 1000319999 34969 462557 12059 270336 0 996 pilot-agent [ 2926.232144] [ 34980] 1000319999 34980 21045139 270147 2949120 0 996 envoy [ 2926.232150] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-3de3289c8d81718a7c3800f675d069be5baae55d77890c9f90d47f2d1b96ff7e.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-3de3289c8d81718a7c3800f675d069be5baae55d77890c9f90d47f2d1b96ff7e.scope,task=envoy,pid=34980,uid=1000319999 [ 2926.232237] Memory cgroup out of memory: Killed process 34980 (envoy) total-vm:84180556kB, anon-rss:1020684kB, file-rss:59904kB, shmem-rss:0kB, UID:1000319999 pgtables:2880kB oom_score_adj:996 [ 2926.242746] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-3de3289c8d81718a7c3800f675d069be5baae55d77890c9f90d47f2d1b96ff7e.scope are going to be killed due to memory.oom.group set [ 2926.242800] Memory cgroup out of memory: Killed process 34969 (pilot-agent) total-vm:1850228kB, anon-rss:22124kB, file-rss:26112kB, shmem-rss:0kB, UID:1000319999 pgtables:264kB oom_score_adj:996 [ 2926.253235] Memory cgroup out of memory: Killed process 34980 (envoy) total-vm:84180556kB, anon-rss:1020684kB, file-rss:59904kB, shmem-rss:0kB, UID:1000319999 pgtables:2880kB oom_score_adj:996 [ 3041.991448] wrk:worker_1 invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 3041.991462] CPU: 1 PID: 35770 Comm: wrk:worker_1 Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 3041.991466] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 3041.991468] Call Trace: [ 3041.991471] [ 3041.991476] dump_stack_lvl+0x34/0x48 [ 3041.991482] dump_header+0x4a/0x213 [ 3041.991487] oom_kill_process.cold+0xb/0x10 [ 3041.991490] out_of_memory+0xef/0x2c0 [ 3041.991496] mem_cgroup_out_of_memory+0x131/0x150 [ 3041.991503] try_charge_memcg+0x742/0x800 [ 3041.991507] ? alloc_pages_mpol+0x93/0x1e0 [ 3041.991512] __mem_cgroup_charge+0x3e/0xb0 [ 3041.991516] do_anonymous_page+0x7d/0x3e0 [ 3041.991521] __handle_mm_fault+0x2fe/0x650 [ 3041.991523] ? nohz_balancer_kick+0x31/0x240 [ 3041.991528] handle_mm_fault+0xe9/0x250 [ 3041.991531] do_user_addr_fault+0x154/0x620 [ 3041.991538] exc_page_fault+0x62/0x150 [ 3041.991542] asm_exc_page_fault+0x22/0x30 [ 3041.991547] RIP: 0033:0x30d9dc5d45b4 [ 3041.991550] Code: e9 06 00 00 00 45 8b 0c 08 8b f1 41 8d 7f 18 0f 1f 80 00 00 00 00 44 3b cf 0f 82 1e 01 00 00 41 8d 3c 37 45 2b cf 45 8d 59 f8 <45> 89 5c 38 08 44 8d 67 08 41 83 e1 fc 41 83 e9 08 45 01 e1 41 83 [ 3041.991552] RSP: 002b:00007f0fe562a2f8 EFLAGS: 00010202 [ 3041.991555] RAX: 0000000000000001 RBX: 000000000000003f RCX: 000000000f2b0fec [ 3041.991557] RDX: 0000000000000028 RSI: 000000000f2b0fec RDI: 000000000f2b0ffc [ 3041.991559] RBP: 00007f0fe562a348 R08: 00007f0714000000 R09: 000000000000eff4 [ 3041.991561] R10: 0000000000000000 R11: 000000000000efec R12: 0000000000000010 [ 3041.991563] R13: 0000719af9a7e080 R14: 0000000000206830 R15: 0000000000000010 [ 3041.991568] [ 3041.991580] memory: usage 1048576kB, limit 1048576kB, failcnt 1216 [ 3041.991583] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 3041.991584] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 3041.991604] anon 1069060096 [ 3041.991611] file 122880 [ 3041.991612] kernel 4558848 [ 3041.991614] kernel_stack 475136 [ 3041.991615] pagetables 3055616 [ 3041.991618] sec_pagetables 0 [ 3041.991619] percpu 58440 [ 3041.991624] sock 0 [ 3041.991626] vmalloc 36864 [ 3041.991631] shmem 118784 [ 3041.991633] zswap 0 [ 3041.991634] zswapped 0 [ 3041.991636] file_mapped 0 [ 3041.991638] file_dirty 0 [ 3041.991640] file_writeback 4096 [ 3041.991642] swapcached 0 [ 3041.991644] anon_thp 260046848 [ 3041.991645] file_thp 0 [ 3041.991646] shmem_thp 0 [ 3041.991652] inactive_anon 49152 [ 3041.991654] active_anon 1069137920 [ 3041.991658] inactive_file 4096 [ 3041.991660] active_file 0 [ 3041.991664] unevictable 0 [ 3041.991665] slab_reclaimable 121624 [ 3041.991670] slab_unreclaimable 569176 [ 3041.991671] slab 690800 [ 3041.991675] workingset_refault_anon 0 [ 3041.991677] workingset_refault_file 0 [ 3041.991681] workingset_activate_anon 0 [ 3041.991683] workingset_activate_file 0 [ 3041.991685] workingset_restore_anon 0 [ 3041.991687] workingset_restore_file 0 [ 3041.991689] workingset_nodereclaim 0 [ 3041.991692] pgscan 132 [ 3041.991693] pgsteal 89 [ 3041.991695] pgscan_kswapd 0 [ 3041.991699] pgscan_direct 132 [ 3041.991701] pgscan_khugepaged 0 [ 3041.991706] pgsteal_kswapd 0 [ 3041.991711] pgsteal_direct 89 [ 3041.991713] pgsteal_khugepaged 0 [ 3041.991715] pgfault 3042090 [ 3041.991717] pgmajfault 0 [ 3041.991720] pgrefill 328 [ 3041.991721] pgactivate 0 [ 3041.991722] pgdeactivate 0 [ 3041.991727] pglazyfree 0 [ 3041.991732] pglazyfreed 0 [ 3041.991737] zswpin 0 [ 3041.991742] zswpout 0 [ 3041.991745] zswpwb 0 [ 3041.991747] thp_fault_alloc 2631 [ 3041.991750] thp_collapse_alloc 0 [ 3041.991752] thp_swpout 0 [ 3041.991754] thp_swpout_fallback 0 [ 3041.991757] Tasks state (memory values in pages): [ 3041.991759] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 3041.991766] [ 35696] 0 35696 2048 480 53248 0 -1000 conmon [ 3041.991773] [ 35698] 1000319999 35698 462573 13645 278528 0 996 pilot-agent [ 3041.991781] [ 35709] 1000319999 35709 18814802 268506 2912256 0 996 envoy [ 3041.991788] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-02d355766d21fe0ce3a71c4fde6976a82c60c2193fdcdd553c12ed9472591653.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-02d355766d21fe0ce3a71c4fde6976a82c60c2193fdcdd553c12ed9472591653.scope,task=envoy,pid=35709,uid=1000319999 [ 3041.991875] Memory cgroup out of memory: Killed process 35709 (envoy) total-vm:75259208kB, anon-rss:1014760kB, file-rss:59264kB, shmem-rss:0kB, UID:1000319999 pgtables:2844kB oom_score_adj:996 [ 3042.002340] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-02d355766d21fe0ce3a71c4fde6976a82c60c2193fdcdd553c12ed9472591653.scope are going to be killed due to memory.oom.group set [ 3042.002447] Memory cgroup out of memory: Killed process 35698 (pilot-agent) total-vm:1850292kB, anon-rss:28468kB, file-rss:26112kB, shmem-rss:0kB, UID:1000319999 pgtables:272kB oom_score_adj:996 [ 3042.012958] Memory cgroup out of memory: Killed process 35770 (wrk:worker_1) total-vm:75259208kB, anon-rss:1014760kB, file-rss:59264kB, shmem-rss:0kB, UID:1000319999 pgtables:2844kB oom_score_adj:996 [ 3230.314499] envoy invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 3230.314511] CPU: 5 PID: 36745 Comm: envoy Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 3230.314514] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 3230.314516] Call Trace: [ 3230.314518] [ 3230.314522] dump_stack_lvl+0x34/0x48 [ 3230.314528] dump_header+0x4a/0x213 [ 3230.314532] oom_kill_process.cold+0xb/0x10 [ 3230.314534] out_of_memory+0xef/0x2c0 [ 3230.314540] mem_cgroup_out_of_memory+0x131/0x150 [ 3230.314545] try_charge_memcg+0x742/0x800 [ 3230.314549] ? alloc_pages_mpol+0x93/0x1e0 [ 3230.314554] __mem_cgroup_charge+0x3e/0xb0 [ 3230.314558] do_anonymous_page+0x7d/0x3e0 [ 3230.314562] __handle_mm_fault+0x2fe/0x650 [ 3230.314566] handle_mm_fault+0xe9/0x250 [ 3230.314568] do_user_addr_fault+0x154/0x620 [ 3230.314573] exc_page_fault+0x62/0x150 [ 3230.314578] asm_exc_page_fault+0x22/0x30 [ 3230.314582] RIP: 0033:0x2d09646fd06d [ 3230.314584] Code: 1f d3 ef 83 f7 02 41 d1 e1 41 2b f9 83 c7 47 4c 8b cb 83 ff 3f 44 0f 42 cf 41 8b f9 44 8b cf 41 c1 e1 04 41 8d 89 b0 65 20 00 <43> 89 4c 20 04 41 81 c1 b8 65 20 00 43 8b 0c 08 43 89 4c 20 08 47 [ 3230.314586] RSP: 002b:00007ffd7e222f78 EFLAGS: 00010202 [ 3230.314589] RAX: 0000000000000001 RBX: 000000000000003f RCX: 0000000000206830 [ 3230.314590] RDX: 0000000000000028 RSI: 0000000000310fec RDI: 0000000000000028 [ 3230.314592] RBP: 00007ffd7e222fc8 R08: 00007fbfb4000000 R09: 0000000000000280 [ 3230.314593] R10: 0000000000000000 R11: 0000000000310fe0 R12: 0000000000310ffc [ 3230.314594] R13: 0000408bbfe14080 R14: 0000000000206830 R15: 0000000000000008 [ 3230.314598] [ 3230.314607] memory: usage 1048576kB, limit 1048576kB, failcnt 1351 [ 3230.314609] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 3230.314614] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 3230.314688] anon 1068994560 [ 3230.314692] file 122880 [ 3230.314694] kernel 4620288 [ 3230.314695] kernel_stack 491520 [ 3230.314696] pagetables 3100672 [ 3230.314697] sec_pagetables 0 [ 3230.314698] percpu 58440 [ 3230.314699] sock 4096 [ 3230.314700] vmalloc 36864 [ 3230.314703] shmem 118784 [ 3230.314705] zswap 0 [ 3230.314707] zswapped 0 [ 3230.314707] file_mapped 0 [ 3230.314711] file_dirty 0 [ 3230.314713] file_writeback 4096 [ 3230.314715] swapcached 0 [ 3230.314717] anon_thp 251658240 [ 3230.314719] file_thp 0 [ 3230.314720] shmem_thp 0 [ 3230.314722] inactive_anon 192512 [ 3230.314723] active_anon 1068851200 [ 3230.314726] inactive_file 0 [ 3230.314727] active_file 4096 [ 3230.314729] unevictable 0 [ 3230.314731] slab_reclaimable 122792 [ 3230.314733] slab_unreclaimable 585296 [ 3230.314735] slab 708088 [ 3230.314738] workingset_refault_anon 0 [ 3230.314740] workingset_refault_file 0 [ 3230.314743] workingset_activate_anon 0 [ 3230.314746] workingset_activate_file 0 [ 3230.314748] workingset_restore_anon 0 [ 3230.314750] workingset_restore_file 0 [ 3230.314751] workingset_nodereclaim 0 [ 3230.314756] pgscan 144 [ 3230.314759] pgsteal 96 [ 3230.314761] pgscan_kswapd 0 [ 3230.314764] pgscan_direct 144 [ 3230.314766] pgscan_khugepaged 0 [ 3230.314768] pgsteal_kswapd 0 [ 3230.314770] pgsteal_direct 96 [ 3230.314773] pgsteal_khugepaged 0 [ 3230.314776] pgfault 3316330 [ 3230.314778] pgmajfault 0 [ 3230.314779] pgrefill 370 [ 3230.314781] pgactivate 0 [ 3230.314784] pgdeactivate 0 [ 3230.314787] pglazyfree 0 [ 3230.314789] pglazyfreed 0 [ 3230.314791] zswpin 0 [ 3230.314793] zswpout 0 [ 3230.314796] zswpwb 0 [ 3230.314798] thp_fault_alloc 2905 [ 3230.314800] thp_collapse_alloc 0 [ 3230.314803] thp_swpout 0 [ 3230.314805] thp_swpout_fallback 0 [ 3230.314808] Tasks state (memory values in pages): [ 3230.314811] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 3230.314817] [ 36733] 0 36733 2048 480 57344 0 -1000 conmon [ 3230.314827] [ 36735] 1000319999 36735 462557 12945 274432 0 996 pilot-agent [ 3230.314835] [ 36745] 1000319999 36745 21045139 269233 2945024 0 996 envoy [ 3230.314841] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-8dfa53b74a50decf7cc46fae4be6f9be9e21e5bf0364a75eb86ec3a720aff49d.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-8dfa53b74a50decf7cc46fae4be6f9be9e21e5bf0364a75eb86ec3a720aff49d.scope,task=envoy,pid=36745,uid=1000319999 [ 3230.314931] Memory cgroup out of memory: Killed process 36745 (envoy) total-vm:84180556kB, anon-rss:1017284kB, file-rss:59648kB, shmem-rss:0kB, UID:1000319999 pgtables:2876kB oom_score_adj:996 [ 3230.325354] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-8dfa53b74a50decf7cc46fae4be6f9be9e21e5bf0364a75eb86ec3a720aff49d.scope are going to be killed due to memory.oom.group set [ 3230.325401] Memory cgroup out of memory: Killed process 36735 (pilot-agent) total-vm:1850228kB, anon-rss:25668kB, file-rss:26112kB, shmem-rss:0kB, UID:1000319999 pgtables:268kB oom_score_adj:996 [ 3230.335874] Memory cgroup out of memory: Killed process 36745 (envoy) total-vm:84180556kB, anon-rss:1017284kB, file-rss:59648kB, shmem-rss:0kB, UID:1000319999 pgtables:2876kB oom_score_adj:996 [ 3615.273672] c71ae939a1e3d06: left promiscuous mode [ 3630.027318] 299d3e66b7e1cca: entered promiscuous mode [ 3654.314412] envoy invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 3654.314442] CPU: 2 PID: 38465 Comm: envoy Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 3654.314445] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 3654.314447] Call Trace: [ 3654.314449] [ 3654.314453] dump_stack_lvl+0x34/0x48 [ 3654.314459] dump_header+0x4a/0x213 [ 3654.314462] oom_kill_process.cold+0xb/0x10 [ 3654.314465] out_of_memory+0xef/0x2c0 [ 3654.314471] mem_cgroup_out_of_memory+0x131/0x150 [ 3654.314476] try_charge_memcg+0x742/0x800 [ 3654.314480] ? alloc_pages_mpol+0x93/0x1e0 [ 3654.314484] __mem_cgroup_charge+0x3e/0xb0 [ 3654.314488] do_anonymous_page+0x7d/0x3e0 [ 3654.314492] __handle_mm_fault+0x2fe/0x650 [ 3654.314496] handle_mm_fault+0xe9/0x250 [ 3654.314498] do_user_addr_fault+0x154/0x620 [ 3654.314504] exc_page_fault+0x62/0x150 [ 3654.314508] asm_exc_page_fault+0x22/0x30 [ 3654.314512] RIP: 0033:0x8d0570df5b4 [ 3654.314514] Code: ff 44 8b e0 44 8b 9d 50 ff ff ff 45 8d 7b 01 8b 9d 70 ff ff ff 8d 4b 3c 45 6b db 3c 44 8b 75 b8 45 03 de 48 8b bd 28 ff ff ff <4a> 89 7c 1a 34 44 8b 85 58 ff ff ff 46 89 44 1a 30 4c 8b 85 20 ff [ 3654.314516] RSP: 002b:00007ffdc37a8240 EFLAGS: 00010206 [ 3654.314519] RAX: 0000000000000003 RBX: 000000000027ca88 RCX: 000000000027cac4 [ 3654.314520] RDX: 00007f9097810000 RSI: 000019f1913836d1 RDI: 0000000000000000 [ 3654.314522] RBP: 00007ffdc37a8320 R08: 0000000080000000 R09: 0000000080000000 [ 3654.314523] R10: 0000000000000000 R11: 00000000004d1fe8 R12: 0000000000000004 [ 3654.314524] R13: 000051ad7ea7e080 R14: 00000000004c5f40 R15: 0000000000000337 [ 3654.314528] [ 3654.314538] memory: usage 1048576kB, limit 1048576kB, failcnt 1476 [ 3654.314541] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 3654.314543] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 3654.314567] anon 1069105152 [ 3654.314574] file 122880 [ 3654.314576] kernel 4509696 [ 3654.314578] kernel_stack 491520 [ 3654.314580] pagetables 3006464 [ 3654.314582] sec_pagetables 0 [ 3654.314583] percpu 58440 [ 3654.314587] sock 4096 [ 3654.314590] vmalloc 36864 [ 3654.314592] shmem 118784 [ 3654.314595] zswap 0 [ 3654.314596] zswapped 0 [ 3654.314598] file_mapped 0 [ 3654.314600] file_dirty 0 [ 3654.314602] file_writeback 4096 [ 3654.314604] swapcached 0 [ 3654.314606] anon_thp 207618048 [ 3654.314609] file_thp 0 [ 3654.314610] shmem_thp 0 [ 3654.314612] inactive_anon 49152 [ 3654.314613] active_anon 1069174784 [ 3654.314615] inactive_file 4096 [ 3654.314618] active_file 0 [ 3654.314620] unevictable 0 [ 3654.314622] slab_reclaimable 122576 [ 3654.314624] slab_unreclaimable 578056 [ 3654.314627] slab 700632 [ 3654.314630] workingset_refault_anon 0 [ 3654.314633] workingset_refault_file 0 [ 3654.314635] workingset_activate_anon 0 [ 3654.314638] workingset_activate_file 0 [ 3654.314640] workingset_restore_anon 0 [ 3654.314643] workingset_restore_file 0 [ 3654.314645] workingset_nodereclaim 0 [ 3654.314648] pgscan 153 [ 3654.314650] pgsteal 105 [ 3654.314653] pgscan_kswapd 0 [ 3654.314656] pgscan_direct 153 [ 3654.314658] pgscan_khugepaged 0 [ 3654.314661] pgsteal_kswapd 0 [ 3654.314663] pgsteal_direct 105 [ 3654.314665] pgsteal_khugepaged 0 [ 3654.314666] pgfault 3618904 [ 3654.314668] pgmajfault 0 [ 3654.314672] pgrefill 377 [ 3654.314674] pgactivate 0 [ 3654.314676] pgdeactivate 0 [ 3654.314679] pglazyfree 0 [ 3654.314682] pglazyfreed 0 [ 3654.314684] zswpin 0 [ 3654.314687] zswpout 0 [ 3654.314688] zswpwb 0 [ 3654.314691] thp_fault_alloc 3128 [ 3654.314694] thp_collapse_alloc 0 [ 3654.314696] thp_swpout 0 [ 3654.314698] thp_swpout_fallback 0 [ 3654.314701] Tasks state (memory values in pages): [ 3654.314703] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 3654.314707] [ 38452] 0 38452 2048 480 53248 0 -1000 conmon [ 3654.314718] [ 38454] 1000319999 38454 462557 11971 262144 0 996 pilot-agent [ 3654.314725] [ 38465] 1000319999 38465 12131987 270365 2854912 0 996 envoy [ 3654.314731] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-4319d73a6ff8c624a273bc11e0133ec64c23905e07d9ca8b92da2c9d900ee44f.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-4319d73a6ff8c624a273bc11e0133ec64c23905e07d9ca8b92da2c9d900ee44f.scope,task=envoy,pid=38465,uid=1000319999 [ 3654.314804] Memory cgroup out of memory: Killed process 38465 (envoy) total-vm:48527948kB, anon-rss:1021940kB, file-rss:59520kB, shmem-rss:0kB, UID:1000319999 pgtables:2788kB oom_score_adj:996 [ 3654.325284] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-4319d73a6ff8c624a273bc11e0133ec64c23905e07d9ca8b92da2c9d900ee44f.scope are going to be killed due to memory.oom.group set [ 3654.325400] Memory cgroup out of memory: Killed process 38454 (pilot-agent) total-vm:1850228kB, anon-rss:21388kB, file-rss:26496kB, shmem-rss:0kB, UID:1000319999 pgtables:256kB oom_score_adj:996 [ 3654.335772] Memory cgroup out of memory: Killed process 38465 (envoy) total-vm:48527948kB, anon-rss:1021940kB, file-rss:59520kB, shmem-rss:0kB, UID:1000319999 pgtables:2788kB oom_score_adj:996 [ 3981.608596] envoy invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 3981.608609] CPU: 3 PID: 41129 Comm: envoy Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 3981.608612] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 3981.608613] Call Trace: [ 3981.608616] [ 3981.608620] dump_stack_lvl+0x34/0x48 [ 3981.608628] dump_header+0x4a/0x213 [ 3981.608633] oom_kill_process.cold+0xb/0x10 [ 3981.608638] out_of_memory+0xef/0x2c0 [ 3981.608644] mem_cgroup_out_of_memory+0x131/0x150 [ 3981.608651] try_charge_memcg+0x742/0x800 [ 3981.608655] ? alloc_pages_mpol+0x93/0x1e0 [ 3981.608660] __mem_cgroup_charge+0x3e/0xb0 [ 3981.608664] do_anonymous_page+0x7d/0x3e0 [ 3981.608668] __handle_mm_fault+0x2fe/0x650 [ 3981.608671] handle_mm_fault+0xe9/0x250 [ 3981.608674] do_user_addr_fault+0x154/0x620 [ 3981.608679] exc_page_fault+0x62/0x150 [ 3981.608684] asm_exc_page_fault+0x22/0x30 [ 3981.608687] RIP: 0033:0x25b718d5189a [ 3981.608690] Code: 5d a0 8b 45 98 44 8b 7d 90 44 8b 65 88 45 8b 4c 3e 04 41 6b f8 3c 41 03 f9 4f 8b 4c 1e 40 4d 89 0c 3e 44 8d 4f 38 47 8b 24 26 <47> 89 24 0e 44 8d 67 30 4f 8b 3c 3e 4f 89 3c 26 44 8d 67 28 44 8b [ 3981.608692] RSP: 002b:00007ffcd18a6358 EFLAGS: 00010202 [ 3981.608695] RAX: 00000000000ff998 RBX: 00000000000ff990 RCX: 00000000000ff980 [ 3981.608697] RDX: 00000000000ff988 RSI: 00000000000ff978 RDI: 000000000022fff8 [ 3981.608698] RBP: 00007ffcd18a63d0 R08: 000000000000026e R09: 0000000000230030 [ 3981.608699] R10: 000025b718e63ba8 R11: 00000000000ff930 R12: 0000000000000012 [ 3981.608700] R13: 000071f2bb66c080 R14: 00007fe768000000 R15: 00000000000ff9a0 [ 3981.608704] [ 3981.608715] memory: usage 1048576kB, limit 1048576kB, failcnt 1614 [ 3981.608721] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 3981.608724] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 3981.608747] anon 1069019136 [ 3981.608753] file 126976 [ 3981.608756] kernel 4591616 [ 3981.608758] kernel_stack 475136 [ 3981.608760] pagetables 3088384 [ 3981.608762] sec_pagetables 0 [ 3981.608764] percpu 58440 [ 3981.608765] sock 4096 [ 3981.608768] vmalloc 36864 [ 3981.608769] shmem 118784 [ 3981.608771] zswap 0 [ 3981.608773] zswapped 0 [ 3981.608774] file_mapped 0 [ 3981.608776] file_dirty 0 [ 3981.608778] file_writeback 8192 [ 3981.608781] swapcached 0 [ 3981.608783] anon_thp 253755392 [ 3981.608786] file_thp 0 [ 3981.608788] shmem_thp 0 [ 3981.608790] inactive_anon 126976 [ 3981.608792] active_anon 1068957696 [ 3981.608816] inactive_file 8192 [ 3981.608825] active_file 0 [ 3981.608826] unevictable 0 [ 3981.608829] slab_reclaimable 126296 [ 3981.608833] slab_unreclaimable 580848 [ 3981.608835] slab 707144 [ 3981.608837] workingset_refault_anon 0 [ 3981.608838] workingset_refault_file 0 [ 3981.608841] workingset_activate_anon 0 [ 3981.608845] workingset_activate_file 0 [ 3981.608848] workingset_restore_anon 0 [ 3981.608852] workingset_restore_file 0 [ 3981.608854] workingset_nodereclaim 0 [ 3981.608855] pgscan 162 [ 3981.608859] pgsteal 112 [ 3981.608864] pgscan_kswapd 0 [ 3981.608866] pgscan_direct 162 [ 3981.608867] pgscan_khugepaged 0 [ 3981.608871] pgsteal_kswapd 0 [ 3981.608873] pgsteal_direct 112 [ 3981.608875] pgsteal_khugepaged 0 [ 3981.608877] pgfault 3893207 [ 3981.608880] pgmajfault 0 [ 3981.608882] pgrefill 428 [ 3981.608884] pgactivate 0 [ 3981.608886] pgdeactivate 0 [ 3981.608887] pglazyfree 0 [ 3981.608889] pglazyfreed 0 [ 3981.608890] zswpin 0 [ 3981.608893] zswpout 0 [ 3981.608895] zswpwb 0 [ 3981.608897] thp_fault_alloc 3391 [ 3981.608899] thp_collapse_alloc 0 [ 3981.608902] thp_swpout 0 [ 3981.608907] thp_swpout_fallback 0 [ 3981.608909] Tasks state (memory values in pages): [ 3981.608911] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 3981.608914] [ 41116] 0 41116 2048 480 57344 0 -1000 conmon [ 3981.608922] [ 41118] 1000319999 41118 444124 13282 270336 0 996 pilot-agent [ 3981.608928] [ 41129] 1000319999 41129 21045139 268918 2940928 0 996 envoy [ 3981.608932] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-12cdce1034697c8bf895e76f66a4efe24769d99d3add4e8666ad269185585bb6.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-12cdce1034697c8bf895e76f66a4efe24769d99d3add4e8666ad269185585bb6.scope,task=envoy,pid=41129,uid=1000319999 [ 3981.609016] Memory cgroup out of memory: Killed process 41129 (envoy) total-vm:84180556kB, anon-rss:1015896kB, file-rss:59776kB, shmem-rss:0kB, UID:1000319999 pgtables:2872kB oom_score_adj:996 [ 3981.619690] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-12cdce1034697c8bf895e76f66a4efe24769d99d3add4e8666ad269185585bb6.scope are going to be killed due to memory.oom.group set [ 3981.619744] Memory cgroup out of memory: Killed process 41118 (pilot-agent) total-vm:1776496kB, anon-rss:27144kB, file-rss:25984kB, shmem-rss:0kB, UID:1000319999 pgtables:264kB oom_score_adj:996 [ 3981.629974] Memory cgroup out of memory: Killed process 41129 (envoy) total-vm:84180556kB, anon-rss:1015896kB, file-rss:59776kB, shmem-rss:0kB, UID:1000319999 pgtables:2872kB oom_score_adj:996 [ 3993.784201] 45bfc66c7c3682f: left promiscuous mode [ 3993.962877] 7faa85665d8c716: left promiscuous mode [ 4017.576138] 3cf1e80cbb3104b: entered promiscuous mode [ 4017.602010] e259eca8dd145e6: entered promiscuous mode [ 4212.957759] e259eca8dd145e6: left promiscuous mode [ 4213.069939] 3cf1e80cbb3104b: left promiscuous mode [ 4227.115786] b95b6bf1967aee3: entered promiscuous mode [ 4321.102642] wrk:worker_0 invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=996 [ 4321.102655] CPU: 2 PID: 43962 Comm: wrk:worker_0 Not tainted 5.14.0-570.125.1.el9_6.x86_64 #1 [ 4321.102658] Hardware name: Amazon EC2 m5.2xlarge/, BIOS 1.0 10/16/2017 [ 4321.102660] Call Trace: [ 4321.102662] [ 4321.102666] dump_stack_lvl+0x34/0x48 [ 4321.102672] dump_header+0x4a/0x213 [ 4321.102676] oom_kill_process.cold+0xb/0x10 [ 4321.102679] out_of_memory+0xef/0x2c0 [ 4321.102684] mem_cgroup_out_of_memory+0x131/0x150 [ 4321.102690] try_charge_memcg+0x742/0x800 [ 4321.102693] ? alloc_pages_mpol+0x93/0x1e0 [ 4321.102698] __mem_cgroup_charge+0x3e/0xb0 [ 4321.102701] do_anonymous_page+0x7d/0x3e0 [ 4321.102706] __handle_mm_fault+0x2fe/0x650 [ 4321.102709] handle_mm_fault+0xe9/0x250 [ 4321.102712] do_user_addr_fault+0x154/0x620 [ 4321.102717] exc_page_fault+0x62/0x150 [ 4321.102722] asm_exc_page_fault+0x22/0x30 [ 4321.102726] RIP: 0033:0x263c7bb161b4 [ 4321.102728] Code: ff 44 8b e0 44 8b 9d 50 ff ff ff 45 8d 7b 01 8b 9d 70 ff ff ff 8d 4b 3c 45 6b db 3c 44 8b 75 b8 45 03 de 48 8b bd 28 ff ff ff <4a> 89 7c 1a 34 44 8b 85 58 ff ff ff 46 89 44 1a 30 4c 8b 85 20 ff [ 4321.102730] RSP: 002b:00007fc4989ab428 EFLAGS: 00010202 [ 4321.102733] RAX: 0000000000000003 RBX: 000000000f305ef8 RCX: 000000000f305f34 [ 4321.102734] RDX: 00007fbbc8000000 RSI: 000004be793c36d1 RDI: 000000170f40f060 [ 4321.102736] RBP: 00007fc4989ab508 R08: 0000000000000017 R09: 0000000080000000 [ 4321.102737] R10: 0000000000000000 R11: 000000000f3fffc8 R12: 0000000000000004 [ 4321.102738] R13: 000011c0fb9e0080 R14: 000000000f3fc9e0 R15: 00000000000000e7 [ 4321.102742] [ 4321.102753] memory: usage 1048576kB, limit 1048576kB, failcnt 1793 [ 4321.102755] swap: usage 0kB, limit 9007199254740988kB, failcnt 0 [ 4321.102757] Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice: [ 4321.102842] anon 1069047808 [ 4321.102848] file 126976 [ 4321.102850] kernel 4567040 [ 4321.102852] kernel_stack 475136 [ 4321.102854] pagetables 3072000 [ 4321.102855] sec_pagetables 0 [ 4321.102859] percpu 58440 [ 4321.102861] sock 0 [ 4321.102863] vmalloc 36864 [ 4321.102864] shmem 118784 [ 4321.102869] zswap 0 [ 4321.102871] zswapped 0 [ 4321.102875] file_mapped 0 [ 4321.102878] file_dirty 0 [ 4321.102882] file_writeback 8192 [ 4321.102884] swapcached 0 [ 4321.102886] anon_thp 253755392 [ 4321.102890] file_thp 0 [ 4321.102891] shmem_thp 0 [ 4321.102894] inactive_anon 147456 [ 4321.102898] active_anon 1069019136 [ 4321.102900] inactive_file 8192 [ 4321.102902] active_file 0 [ 4321.102904] unevictable 0 [ 4321.102905] slab_reclaimable 121480 [ 4321.102907] slab_unreclaimable 569632 [ 4321.102916] slab 691112 [ 4321.102918] workingset_refault_anon 0 [ 4321.102920] workingset_refault_file 0 [ 4321.102922] workingset_activate_anon 0 [ 4321.102927] workingset_activate_file 0 [ 4321.102928] workingset_restore_anon 0 [ 4321.102934] workingset_restore_file 0 [ 4321.102936] workingset_nodereclaim 0 [ 4321.102941] pgscan 170 [ 4321.102942] pgsteal 119 [ 4321.102947] pgscan_kswapd 0 [ 4321.102948] pgscan_direct 170 [ 4321.102953] pgscan_khugepaged 0 [ 4321.102954] pgsteal_kswapd 0 [ 4321.102958] pgsteal_direct 119 [ 4321.102959] pgsteal_khugepaged 0 [ 4321.102962] pgfault 4167298 [ 4321.102965] pgmajfault 0 [ 4321.102967] pgrefill 581 [ 4321.102971] pgactivate 0 [ 4321.102973] pgdeactivate 0 [ 4321.102977] pglazyfree 0 [ 4321.102979] pglazyfreed 0 [ 4321.102981] zswpin 0 [ 4321.102983] zswpout 0 [ 4321.102985] zswpwb 0 [ 4321.102986] thp_fault_alloc 3653 [ 4321.102987] thp_collapse_alloc 0 [ 4321.102992] thp_swpout 0 [ 4321.102995] thp_swpout_fallback 0 [ 4321.102999] Tasks state (memory values in pages): [ 4321.103001] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 4321.103007] [ 43880] 0 43880 2048 512 57344 0 -1000 conmon [ 4321.103017] [ 43882] 1000319999 43882 462621 13280 270336 0 996 pilot-agent [ 4321.103027] [ 43893] 1000319999 43893 18814801 268813 2928640 0 996 envoy [ 4321.103034] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=crio-5b40a9ce541df2334bcf9ecfefbe6ef89fbbf64257eb9ad801003ee3e3421904.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-5b40a9ce541df2334bcf9ecfefbe6ef89fbbf64257eb9ad801003ee3e3421904.scope,task=envoy,pid=43893,uid=1000319999 [ 4321.103132] Memory cgroup out of memory: Killed process 43893 (envoy) total-vm:75259204kB, anon-rss:1016628kB, file-rss:58624kB, shmem-rss:0kB, UID:1000319999 pgtables:2860kB oom_score_adj:996 [ 4321.113939] Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3aa62_0935_48f7_a93d_8d21917d35a5.slice/crio-5b40a9ce541df2334bcf9ecfefbe6ef89fbbf64257eb9ad801003ee3e3421904.scope are going to be killed due to memory.oom.group set [ 4321.114003] Memory cgroup out of memory: Killed process 43882 (pilot-agent) total-vm:1850484kB, anon-rss:26624kB, file-rss:26496kB, shmem-rss:0kB, UID:1000319999 pgtables:264kB oom_score_adj:996 [ 4321.124277] Memory cgroup out of memory: Killed process 43962 (wrk:worker_0) total-vm:75259204kB, anon-rss:1016628kB, file-rss:58624kB, shmem-rss:0kB, UID:1000319999 pgtables:2860kB oom_score_adj:996 [ 4641.872197] 299d3e66b7e1cca: left promiscuous mode [ 4669.212874] 81a035286a32809: entered promiscuous mode [ 4737.417957] b95b6bf1967aee3: left promiscuous mode [ 4759.298687] c229862e802935d: entered promiscuous mode [ 4759.361165] caffbb34ddc274f: entered promiscuous mode [ 4810.106973] 81a035286a32809: left promiscuous mode [ 4858.333931] ba99531eebc8a04: entered promiscuous mode [ 4980.589716] 0a60efcd0e0dee6: entered promiscuous mode [ 4995.873606] ba99531eebc8a04: left promiscuous mode [ 5020.757315] c229862e802935d: left promiscuous mode [ 5037.463792] caffbb34ddc274f: left promiscuous mode [ 5054.636646] 15db0a5f0283b5f: entered promiscuous mode [ 5059.186051] 0a60efcd0e0dee6: left promiscuous mode [ 5071.408238] afdad971d047ff2: entered promiscuous mode [ 5087.581789] 15db0a5f0283b5f: left promiscuous mode [ 5129.788325] afdad971d047ff2: left promiscuous mode [ 5136.133315] 70951370ea35873: entered promiscuous mode [ 5136.418807] 802841e26d6bf7c: entered promiscuous mode [ 5169.887311] 802841e26d6bf7c: left promiscuous mode [ 5184.893233] 70951370ea35873: left promiscuous mode [ 5192.523603] 0601bab86b1dbc4: entered promiscuous mode [ 5211.495536] 19b3905fdb40f8b: left promiscuous mode [ 5242.723908] 0601bab86b1dbc4: left promiscuous mode [ 5268.621738] 6e9ff1718552f30: entered promiscuous mode [ 5269.103222] 8077c7b24a53109: entered promiscuous mode [ 5283.093821] 38fe633d28440cc: entered promiscuous mode [ 5314.974452] 8077c7b24a53109: left promiscuous mode [ 5316.393698] 38fe633d28440cc: left promiscuous mode [ 5329.988903] 6e9ff1718552f30: left promiscuous mode [ 5341.851679] ed6e18d8338da37: entered promiscuous mode [ 5342.228805] 8f49e062e56575e: entered promiscuous mode [ 5348.957342] aef49de59527206: entered promiscuous mode [ 5382.457923] aef49de59527206: left promiscuous mode [ 6561.157931] 62fd5c98a5e5feb: entered promiscuous mode