Jul 24 14:54:05.021636 ip-10-0-129-232 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 14:54:05.021647 ip-10-0-129-232 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 14:54:05.021654 ip-10-0-129-232 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 14:54:05.021907 ip-10-0-129-232 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 14:54:15.270783 ip-10-0-129-232 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 14:54:15.270799 ip-10-0-129-232 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a51cf518e5854e58999113305dc3b0b8 --
Jul 24 14:56:09.808995 ip-10-0-129-232 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 14:56:10.234910 ip-10-0-129-232 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:56:10.234910 ip-10-0-129-232 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 14:56:10.234910 ip-10-0-129-232 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:56:10.234910 ip-10-0-129-232 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 14:56:10.234910 ip-10-0-129-232 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:56:10.237502 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.237371    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 14:56:10.241388 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241366    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:56:10.241388 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241387    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:56:10.241388 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241391    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241394    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241397    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241400    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241403    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241406    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241409    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241411    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241414    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241416    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241420    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241423    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241425    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241428    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241431    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241433    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241436    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241439    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241453    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241456    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:56:10.241487 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241459    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241461    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241464    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241467    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241471    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241473    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241476    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241478    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241481    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241484    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241486    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241489    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241492    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241495    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241498    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241500    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241503    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241506    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241509    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241511    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:56:10.242002 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241514    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241516    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241519    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241525    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241529    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241532    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241535    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241538    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241541    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241543    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241546    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241549    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241552    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241554    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241558    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241561    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241564    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241566    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241570    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:56:10.242658 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241574    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241577    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241580    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241583    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241586    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241589    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241592    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241594    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241597    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241600    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241602    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241605    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241609    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241613    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241616    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241618    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241621    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241624    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241627    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241629    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:56:10.243222 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241632    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241635    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241652    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241655    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241657    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241660    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241663    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241667    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241670    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241673    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241675    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241678    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241681    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241683    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241686    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241689    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241691    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.241695    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242456    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242464    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:56:10.243807 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242467    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242470    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242475    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242479    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242483    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242486    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242489    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242492    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242495    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242498    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242503    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242505    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242508    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242511    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242514    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242517    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242520    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242523    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242526    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242529    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:56:10.244363 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242551    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242554    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242557    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242559    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242562    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242565    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242567    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242570    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242573    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242576    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242579    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242581    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242584    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242586    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242588    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242591    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242593    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242596    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242598    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242601    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:56:10.244960 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242603    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242605    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242608    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242614    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242617    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242620    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242622    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242625    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242627    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242630    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242632    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242635    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242654    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242659    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242663    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242666    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242669    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242673    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242676    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:56:10.245547 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242678    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242681    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242684    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242686    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242689    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242691    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242694    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242696    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242699    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242702    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242704    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242706    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242709    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242712    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242714    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242716    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242719    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242722    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242725    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:56:10.246127 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242728    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242732    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242735    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242738    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242743    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242746    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242749    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242756    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242759    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242761    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242764    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242767    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242770    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242773    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242775    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242778    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242780    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242783    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.242785    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243219    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:56:10.246696 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243226    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243230    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243235    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243238    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243242    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243245    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243248    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243252    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243255    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243258    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243261    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243264    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243267    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243269    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243272    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243275    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243279    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243283    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243286    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:56:10.247352 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243288    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243291    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243294    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243296    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243299    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243301    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243304    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243307    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243309    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243312    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243314    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243317    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243319    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243322    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243325    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243327    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243330    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243333    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243336    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:56:10.247866 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243338    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243341    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243343    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243346    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243348    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243351    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243354    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243356    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243359    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243362    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243368    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243371    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243373    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243376    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243380    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243383    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243386    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243389    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243392    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:56:10.248344 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243395    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243398    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243401    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243404    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243407    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243409    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243412    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243415    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243417    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243420    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243422    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243425    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243427    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243430    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243433    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243435    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243438    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243440    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243443    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243446    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243448    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:56:10.248899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243451    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243453    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243458    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243461    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243463    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243466    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243468    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243472    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243476    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243479    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243482    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243484    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243487    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243490    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243492    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243495    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243497    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243500    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243502    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:56:10.249418 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.243505    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243586    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243606    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243617    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243623    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243628    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243633    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243650    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243655    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243659    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243662    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243665    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243669    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243673    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243676    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243682    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243685    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243688    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243691    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243696    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243699    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243702    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243705    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243709    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 14:56:10.249918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243713    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243717    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243720    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243723    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243727    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243730    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243733    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243736    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243739    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243744    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243747    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243750    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243753    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243756    2582 flags.go:64] FLAG: --enable-server="true"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243759    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243764    2582 flags.go:64] FLAG: --event-burst="100"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243767    2582 flags.go:64] FLAG: --event-qps="50"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243770    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243774    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243777    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243781    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243785    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243788    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243794    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243797    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 14:56:10.250531 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243800    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243803    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243806    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243809    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243813    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243816    2582 flags.go:64] FLAG: --feature-gates=""
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243820    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243823    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243826    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243830    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243833    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243836    2582 flags.go:64] FLAG: --help="false"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243839    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243842    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243845    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243848    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243852    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243855    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243858    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243861    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243864    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243867    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243870    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243873    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 14:56:10.251289 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243876    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243878    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243881    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243884    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243887    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243891    2582 flags.go:64] FLAG: --lock-file=""
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243896    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243899    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243902    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243908    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243911    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243914    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243917    2582 flags.go:64] FLAG: --logging-format="text"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243920    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243924    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243927    2582 flags.go:64] FLAG: --manifest-url=""
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243930    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243935    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243938    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243943    2582 flags.go:64] FLAG: --max-pods="110"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243946    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243949    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243952    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243955    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243958    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 14:56:10.252351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243961    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243964    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243972    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243975    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243978    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243981    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243984    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243991    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243994    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.243997    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244000    2582 flags.go:64] FLAG: --port="10250"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244004    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244007    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09cf1e88c3ab73267"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244011    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244016    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244020    2582 flags.go:64] FLAG: --register-node="true"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244022    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244026    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244029    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244032    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244035    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244039    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244042    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244045    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244048    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 14:56:10.253461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244051    2582 flags.go:64] FLAG: --runonce="false"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244054    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244057    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244060    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244063    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244066    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244069    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244072    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244076    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244078    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244082    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244085    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244088    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244091    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244094    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244096    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244102    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244105    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244108    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244112    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244115    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244120    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244124    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244127    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244130    2582 flags.go:64] FLAG: --v="2"
Jul 24 14:56:10.254234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244135    2582 flags.go:64] FLAG: --version="false"
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244140    2582 flags.go:64] FLAG: --vmodule=""
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244144    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.244147    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244279    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244283    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244287    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244289    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244292    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244294    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244297    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244299    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244303    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244305    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244307    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244310    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244313    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244315    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244318    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244320    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:56:10.254932 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244323    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244325    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244328    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244330    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244333    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244336    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244338    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244341    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244345    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244348    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244351    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244353    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244356    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244359    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244361    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244364    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244367    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244370    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244373    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244376    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:56:10.255435 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244378    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244381    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244384    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244387    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244391    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244394    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244397    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244400    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244402    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244405    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244408    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244411    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244414    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244416    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244418    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244421    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244423    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244426    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244429    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244432    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:56:10.255962 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244436    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244438    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244442    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244444    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244448    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244452    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244454    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244458    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244460    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244463    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244465    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244468    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244470    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244473    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244476    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244478    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244481    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244483    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244486    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:56:10.256470 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244488    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244491    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244493    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244496    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244498    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244501    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244503    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244506    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244508    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244511    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244513    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244515    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244519    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244522    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244527    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244531    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244534    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244537    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244540    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:56:10.256966 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244542    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244546    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244548    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244551    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.244553    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.245221    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.254221    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.254241    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.255141    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.255149    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255225    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255233    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255238    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255243    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:56:10.257450 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255247    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255250    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255254    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255257    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255260    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255263    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255266    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255269    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255272    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255275    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255278    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255280    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255283    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255286    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255288    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255291    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255294    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255296    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255299    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255302    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:56:10.257830 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255305    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255307    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255310    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255312    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255316    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255319    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255321    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255324    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255327    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255330    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255333    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255337    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255340    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255343    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255346    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255349    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255352    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255354    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255357    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255359    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:56:10.258335 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255362    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255365    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255367    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255370    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255373    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255375    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255378    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255381    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255383    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255387    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255390    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255393    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255395    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255398    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255401    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255404    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255406    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255409    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255412    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255414    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:56:10.258921 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255417    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255419    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255422    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255425    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255427    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255429    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255432    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255434    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255437    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255439    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255442    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255445    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255447    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255450    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255453    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255456    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255459    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255462    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255464    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:56:10.259423 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255467    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255470    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255473    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255475    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255478    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255481    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255483    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255486    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255488    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255492    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255495    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255498    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255500    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255502    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255505    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:56:10.259927 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255508    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.255513    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255633    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255655    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255660    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255663    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255665    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255668    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255671    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255673    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255677    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255680    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255682    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255685    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:56:10.260302 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255688    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255691    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255694    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255697    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255699    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255703    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255706    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255708    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255711    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255713    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255716    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255718    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255721    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255724    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255727    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255729    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255731    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255734    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255738    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255742    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:56:10.260687 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255745    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255748    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255751    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255754    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255756    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255759    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255762    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255764    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255767    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255769    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255772    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255774    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255777    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255781    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255783    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255786    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255789    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255792    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255794    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255796    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:56:10.261181 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255799    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255801    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255804    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255807    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255809    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255813    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255816    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255819    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255822    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255825    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255828    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255831    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255834    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255837    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255839    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255842    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255844    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255847    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255849    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:56:10.261702 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255852    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255854    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255857    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255860    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255862    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255865    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255867    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255871    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255873    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255876    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255879    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255881    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255884    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255886    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255889    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255892    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255895    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255897    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255900    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255903    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:56:10.262184 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255907    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255910    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255912    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255915    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255917    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255920    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255922    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:10.255925    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.255930    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.256072    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.260024    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.261556    2582 server.go:1019] "Starting client certificate rotation"
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.261724    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 14:56:10.262701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.261764    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 14:56:10.264586 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.264566    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 14:56:10.267857 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.267831    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 14:56:10.275867 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.275841    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 24 14:56:10.278280 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.278259    2582 log.go:25] "Validated CRI v1 image API"
Jul 24 14:56:10.279203 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.279183    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 14:56:10.282428 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.282401    2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7c1bdb52-48e2-447b-af87-d37640f588ce:/dev/nvme0n1p3 d15a2e51-1e75-4de9-8093-72c826de26b6:/dev/nvme0n1p4]
Jul 24 14:56:10.282519 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.282426    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 14:56:10.287470 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.287335    2582 manager.go:216] Machine: {Timestamp:2026-07-24 14:56:10.286793596 +0000 UTC m=+0.354113421 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117269 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e1be9edf2910740aba903dc35d0b5 SystemUUID:ec2e1be9-edf2-9107-40ab-a903dc35d0b5 BootID:a51cf518-e585-4e58-9991-13305dc3b0b8 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ca:bb:b9:92:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ca:bb:b9:92:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:7f:da:32:33:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 14:56:10.287470 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.287451    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 14:56:10.287693 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.287571    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 14:56:10.289888 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.289857    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 14:56:10.290402 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.289889    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 14:56:10.291603 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.291584    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 14:56:10.291688 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.291662    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 14:56:10.291688 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.291677    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 14:56:10.291688 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.291687    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 14:56:10.292317 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.292305    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 14:56:10.293928 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.293916    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 14:56:10.296852 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.296838    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 14:56:10.298413 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.297213    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 14:56:10.298413 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.297267    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 14:56:10.298413 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.297283    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 14:56:10.298413 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.297312    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 14:56:10.298413 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.297325    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 24 14:56:10.298413 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.297339    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 14:56:10.298413 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.297878    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 14:56:10.298413 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.297902    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 14:56:10.301520 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.301500    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 14:56:10.303065 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303045    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 14:56:10.303159 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303084    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 14:56:10.303876 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303861    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 14:56:10.303942 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303882    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 14:56:10.303942 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303891    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 14:56:10.303942 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303899    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 14:56:10.303942 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303912    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 14:56:10.303942 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303922    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 14:56:10.303942 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303933    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 14:56:10.303942 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303941    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 14:56:10.304194 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303951    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 14:56:10.304194 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303959    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 14:56:10.304194 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303974    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 14:56:10.304194 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.303982    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 14:56:10.305161 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.305148    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 14:56:10.305230 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.305164    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 14:56:10.308718 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.308700    2582 server.go:1268] "Started kubelet"
Jul 24 14:56:10.308836 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.308787    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 14:56:10.308877 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.308863    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 14:56:10.309552 ip-10-0-129-232 systemd[1]: Started Kubernetes Kubelet.
Jul 24 14:56:10.310218 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.310160    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 14:56:10.310838 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.310812    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 14:56:10.310958 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.310927    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:56:10.311039 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.310971    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:56:10.311096 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.311046    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:56:10.311905 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.311889    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 14:56:10.314836 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.314807    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 14:56:10.317657 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.316616    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-232.ec2.internal.18c5419d1913cf0d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-232.ec2.internal,UID:ip-10-0-129-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-232.ec2.internal,},FirstTimestamp:2026-07-24 14:56:10.308669197 +0000 UTC m=+0.375989002,LastTimestamp:2026-07-24 14:56:10.308669197 +0000 UTC m=+0.375989002,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-232.ec2.internal,}"
Jul 24 14:56:10.317784 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.317768    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 14:56:10.317784 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.317778    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 14:56:10.318027 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.317996    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:10.318432 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.318413    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 14:56:10.318432 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.318435    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 14:56:10.318564 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.318413    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 14:56:10.318564 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.318555    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 14:56:10.318668 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.318564    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 14:56:10.318722 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.318668    2582 factory.go:55] Registering systemd factory
Jul 24 14:56:10.318722 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.318684    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 24 14:56:10.318827 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.318809    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4c4vw"
Jul 24 14:56:10.318943 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.318928    2582 factory.go:153] Registering CRI-O factory
Jul 24 14:56:10.319004 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.318946    2582 factory.go:223] Registration of the crio container factory successfully
Jul 24 14:56:10.319049 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.319004    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 14:56:10.319049 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.319040    2582 factory.go:103] Registering Raw factory
Jul 24 14:56:10.319151 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.319069    2582 manager.go:1196] Started watching for new ooms in manager
Jul 24 14:56:10.319771 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.319755    2582 manager.go:349] Starting recovery of all containers
Jul 24 14:56:10.321435 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.321403    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 14:56:10.321531 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.321483    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:56:10.328061 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.327851    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4c4vw"
Jul 24 14:56:10.329173 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.329131    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 14:56:10.330450 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.330429    2582 manager.go:354] Recovery completed
Jul 24 14:56:10.336001 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.335861    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:56:10.337884 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.337867    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:56:10.337937 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.337900    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:56:10.337937 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.337911    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:56:10.338476 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.338462    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 14:56:10.338476 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.338475    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 14:56:10.338596 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.338481    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:56:10.338596 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.338493    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 14:56:10.339235 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.339221    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:56:10.339286 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.339251    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:56:10.339286 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.339263    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:56:10.339773 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.339759    2582 policy_none.go:49] "None policy: Start"
Jul 24 14:56:10.339827 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.339780    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 14:56:10.339827 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.339795    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 14:56:10.340394 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.340316    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-232.ec2.internal.18c5419d1ad1a002  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-232.ec2.internal,UID:ip-10-0-129-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-232.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-232.ec2.internal,},FirstTimestamp:2026-07-24 14:56:10.33788621 +0000 UTC m=+0.405206015,LastTimestamp:2026-07-24 14:56:10.33788621 +0000 UTC m=+0.405206015,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-232.ec2.internal,}"
Jul 24 14:56:10.341216 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.341205    2582 policy_none.go:47] "Start"
Jul 24 14:56:10.381427 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.381401    2582 manager.go:337] "Starting Device Plugin manager"
Jul 24 14:56:10.381561 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.381446    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 14:56:10.381561 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.381459    2582 server.go:87] "Starting device plugin registration server"
Jul 24 14:56:10.381809 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.381794    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 14:56:10.381876 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.381811    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 14:56:10.381929 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.381901    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 14:56:10.381997 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.381981    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 14:56:10.381997 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.381995    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 14:56:10.382620 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.382599    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 14:56:10.382787 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.382669    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:10.461181 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.461145    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 14:56:10.462337 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.461192    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 14:56:10.462337 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.461221    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 14:56:10.462337 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.461255    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 14:56:10.463918 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.463893    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:56:10.482958 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.482917    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:56:10.483916 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.483900    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:56:10.484029 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.483929    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:56:10.484029 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.483939    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:56:10.484029 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.483962    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.492671 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.492611    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.492671 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.492633    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-232.ec2.internal\": node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:10.511061 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.511033    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:10.561790 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.561762    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal"]
Jul 24 14:56:10.561884 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.561843    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:56:10.563489 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.563471    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:56:10.563586 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.563505    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:56:10.563586 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.563516    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:56:10.564976 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.564962    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:56:10.565077 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.565063    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.565113 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.565105    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:56:10.565756 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.565741    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:56:10.565829 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.565755    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:56:10.565829 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.565772    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:56:10.565829 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.565780    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:56:10.565829 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.565786    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:56:10.565829 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.565795    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:56:10.567131 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.567114    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.567224 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.567139    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:56:10.567856 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.567842    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:56:10.567921 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.567870    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:56:10.567921 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.567883    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:56:10.582289 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.582264    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-232.ec2.internal\" not found" node="ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.586788 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.586769    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-232.ec2.internal\" not found" node="ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.611612 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.611578    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:10.620446 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.620420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95de36e8260460990badb66cc001e3dd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-232.ec2.internal\" (UID: \"95de36e8260460990badb66cc001e3dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.620524 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.620451    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/736183371619f980a6fc917422b9ff89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"736183371619f980a6fc917422b9ff89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.620524 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.620469    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/736183371619f980a6fc917422b9ff89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"736183371619f980a6fc917422b9ff89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.712372 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.712329    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:10.720845 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.720828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/736183371619f980a6fc917422b9ff89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"736183371619f980a6fc917422b9ff89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.720926 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.720855    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/736183371619f980a6fc917422b9ff89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"736183371619f980a6fc917422b9ff89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.720926 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.720873    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95de36e8260460990badb66cc001e3dd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-232.ec2.internal\" (UID: \"95de36e8260460990badb66cc001e3dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.720990 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.720925    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/736183371619f980a6fc917422b9ff89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"736183371619f980a6fc917422b9ff89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.720990 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.720925    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/736183371619f980a6fc917422b9ff89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"736183371619f980a6fc917422b9ff89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.720990 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.720964    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95de36e8260460990badb66cc001e3dd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-232.ec2.internal\" (UID: \"95de36e8260460990badb66cc001e3dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.813413 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.813312    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:10.884903 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.884871    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.890701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:10.890635    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:10.914151 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:10.914117    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:12.543100 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:12.543070    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:12.643592 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:12.643560    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:12.744229 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:12.744183    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:12.789665 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:12.789633    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 14:56:12.790178 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:12.789829    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 14:56:12.844303 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:12.844273    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:12.849704 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:12.849685    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:56:12.864885 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:12.864838    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 14:51:11 +0000 UTC" deadline="2028-04-17 11:12:12.843325454 +0000 UTC"
Jul 24 14:56:12.865012 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:12.864889    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15188h15m59.978446788s"
Jul 24 14:56:12.945311 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:12.945223    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:13.045634 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:13.045600    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:13.145846 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:13.145813    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found"
Jul 24 14:56:13.146049 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.145870    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:56:13.161546 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:13.161507    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95de36e8260460990badb66cc001e3dd.slice/crio-669bfb6ece1032bfa93e3549681c8d0af10f79463f14be57f2f9c3035f773cd0 WatchSource:0}: Error finding container 669bfb6ece1032bfa93e3549681c8d0af10f79463f14be57f2f9c3035f773cd0: Status 404 returned error can't find the container with id 669bfb6ece1032bfa93e3549681c8d0af10f79463f14be57f2f9c3035f773cd0
Jul 24 14:56:13.166015 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.165977    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:56:13.213246 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.213158    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:56:13.246949 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.246914    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:13.259209 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.259183    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 14:56:13.260360 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.260344    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal"
Jul 24 14:56:13.269906 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.269875    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 14:56:13.319852 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:13.319825    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736183371619f980a6fc917422b9ff89.slice/crio-8c9967a4749c967c818ce9b304d52c874694f8f1cafe3fce9ae500d7652de2db WatchSource:0}: Error finding container 8c9967a4749c967c818ce9b304d52c874694f8f1cafe3fce9ae500d7652de2db: Status 404 returned error can't find the container with id 8c9967a4749c967c818ce9b304d52c874694f8f1cafe3fce9ae500d7652de2db
Jul 24 14:56:13.827185 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.827137    2582 apiserver.go:52] "Watching apiserver"
Jul 24 14:56:13.844882 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.844848    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 14:56:13.848749 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.848719    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 14:56:13.848954 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.848921    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal","openshift-multus/multus-additional-cni-plugins-5gc4d","openshift-network-diagnostics/network-check-target-vp7sh","openshift-network-operator/iptables-alerter-8jx5s","openshift-ovn-kubernetes/ovnkube-node-l2lgp","kube-system/global-pull-secret-syncer-wq2p6","kube-system/konnectivity-agent-s4jmb","kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jr6r8","openshift-dns/node-resolver-xcg42","openshift-image-registry/node-ca-fsl22","openshift-multus/multus-k2pbn","openshift-multus/network-metrics-daemon-7rgzv"]
Jul 24 14:56:13.850805 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.850781    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:13.850926 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:13.850855    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:13.852079 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.852053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.853427 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.853313    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:13.854748 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.854730    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:13.854859 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:13.854788    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:13.854931 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.854915    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 14:56:13.855046 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.854926    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 14:56:13.855046 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.854935    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rt8j5\""
Jul 24 14:56:13.855046 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.854920    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 14:56:13.855046 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.854923    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 14:56:13.856075 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.855631    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 14:56:13.856075 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.855643    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 14:56:13.856075 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.855861    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:13.856270 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.855865    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d6qhj\""
Jul 24 14:56:13.857783 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.857764    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.858351 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.858334    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ml8nh\""
Jul 24 14:56:13.858456 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.858365    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:56:13.858748 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.858617    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 14:56:13.858748 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.858655    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 14:56:13.860104 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.860085    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 14:56:13.860798 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.860742    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:13.860887 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:13.860808    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:13.861345 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.861327    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 14:56:13.861607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.861591    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 14:56:13.861784 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.861768    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 14:56:13.862009 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.861975    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 14:56:13.862165 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.862146    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:13.862232 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.862187    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 14:56:13.862290 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.862262    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 14:56:13.862346 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.862321    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d85jv\""
Jul 24 14:56:13.863243 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.863224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:13.864704 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.864682    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4l2hg\""
Jul 24 14:56:13.864810 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.864739    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.864868 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.864856    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 14:56:13.865333 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.865317    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 14:56:13.865493 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.865448    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 14:56:13.865581 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.865452    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 14:56:13.865887 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.865870    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 14:56:13.866032 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.866016    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ptph8\""
Jul 24 14:56:13.866667 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.866646    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:13.867842 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.867824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:13.873399 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.873372    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-27c2d\""
Jul 24 14:56:13.873505 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.873444    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:56:13.873566 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.873510    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 14:56:13.873566 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.873446    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 14:56:13.873768 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.873753    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 14:56:13.873913 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.873898    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 14:56:13.874435 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.874418    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 14:56:13.874514 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.874482    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 14:56:13.874803 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.874786    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wffbf\""
Jul 24 14:56:13.876312 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.875484    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mns5z\""
Jul 24 14:56:13.896533 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.896506    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mpjv8"
Jul 24 14:56:13.906582 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.906560    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mpjv8"
Jul 24 14:56:13.948316 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.948286    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 14:56:13.956954 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.956925    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-sysctl-d\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.956954 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.956957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-hostroot\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.957207 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957000    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:13.957207 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957017    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-sys-fs\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:13.957207 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-cni-bin\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.957207 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:13.957207 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-sysconfig\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.957207 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-run-k8s-cni-cncf-io\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.957207 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/151f5944-a3d6-4da6-967d-2c2da733dc45-iptables-alerter-script\") pod \"iptables-alerter-8jx5s\" (UID: \"151f5944-a3d6-4da6-967d-2c2da733dc45\") " pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:13.957207 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957140    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7fc088b-d5f9-49d9-a005-ed791c26fe23-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:13.957207 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-kubelet\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.957207 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-slash\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb49j\" (UniqueName: \"kubernetes.io/projected/f573763f-5ff2-443d-9579-5d12994e4102-kube-api-access-sb49j\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-sysctl-conf\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-registration-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957266    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13e209b0-eb31-4565-85bb-72d7e64ae65d-konnectivity-ca\") pod \"konnectivity-agent-s4jmb\" (UID: \"13e209b0-eb31-4565-85bb-72d7e64ae65d\") " pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957282    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8ada920-febe-4ebd-a2a0-37bd8ab680b2-hosts-file\") pod \"node-resolver-xcg42\" (UID: \"b8ada920-febe-4ebd-a2a0-37bd8ab680b2\") " pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-var-lib-cni-multus\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-run-netns\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-var-lib-cni-bin\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7fkt\" (UniqueName: \"kubernetes.io/projected/df7f9a86-0587-44f0-a26c-87ab18c04b9a-kube-api-access-g7fkt\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7fc088b-d5f9-49d9-a005-ed791c26fe23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llbhn\" (UniqueName: \"kubernetes.io/projected/e7fc088b-d5f9-49d9-a005-ed791c26fe23-kube-api-access-llbhn\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957433    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-systemd-units\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-ovn-node-metrics-cert\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-etc-kubernetes\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.957607 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/130b3016-7f8a-4094-a80a-f613ffaaace8-serviceca\") pod \"node-ca-fsl22\" (UID: \"130b3016-7f8a-4094-a80a-f613ffaaace8\") " pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-var-lib-kubelet\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957570    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-system-cni-dir\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/289d6496-931c-4581-9bc3-3565b7138fd0-cni-binary-copy\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-device-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957643    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957659    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-etc-openvswitch\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-ovnkube-config\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnltp\" (UniqueName: \"kubernetes.io/projected/151f5944-a3d6-4da6-967d-2c2da733dc45-kube-api-access-xnltp\") pod \"iptables-alerter-8jx5s\" (UID: \"151f5944-a3d6-4da6-967d-2c2da733dc45\") " pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-multus-cni-dir\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957867    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-os-release\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957902    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-var-lib-openvswitch\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-run-ovn\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957955    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-host\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.957994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/289d6496-931c-4581-9bc3-3565b7138fd0-multus-daemon-config\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/151f5944-a3d6-4da6-967d-2c2da733dc45-host-slash\") pod \"iptables-alerter-8jx5s\" (UID: \"151f5944-a3d6-4da6-967d-2c2da733dc45\") " pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:13.958205 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-run\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958067    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7fc088b-d5f9-49d9-a005-ed791c26fe23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-run-netns\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0408899-9538-4e53-9468-4884c85bbb69-etc-tuned\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx4wd\" (UniqueName: \"kubernetes.io/projected/b8ada920-febe-4ebd-a2a0-37bd8ab680b2-kube-api-access-qx4wd\") pod \"node-resolver-xcg42\" (UID: \"b8ada920-febe-4ebd-a2a0-37bd8ab680b2\") " pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-run-systemd\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958200    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0408899-9538-4e53-9468-4884c85bbb69-tmp\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/130b3016-7f8a-4094-a80a-f613ffaaace8-host\") pod \"node-ca-fsl22\" (UID: \"130b3016-7f8a-4094-a80a-f613ffaaace8\") " pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87446c40-4dc9-42d2-a645-d9ecb5f7696e-kubelet-config\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-socket-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958312    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ada920-febe-4ebd-a2a0-37bd8ab680b2-tmp-dir\") pod \"node-resolver-xcg42\" (UID: \"b8ada920-febe-4ebd-a2a0-37bd8ab680b2\") " pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-cnibin\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958371    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-multus-socket-dir-parent\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-multus-conf-dir\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958441    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-node-log\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-var-lib-kubelet\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:13.958786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-run-openvswitch\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-log-socket\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958527    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-os-release\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-system-cni-dir\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-cnibin\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv4f8\" (UniqueName: \"kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8\") pod \"network-check-target-vp7sh\" (UID: \"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a\") " pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958651    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kld68\" (UniqueName: \"kubernetes.io/projected/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-kube-api-access-kld68\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-lib-modules\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-etc-selinux\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-env-overrides\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-ovnkube-script-lib\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-systemd\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-sys\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwvd2\" (UniqueName: \"kubernetes.io/projected/a0408899-9538-4e53-9468-4884c85bbb69-kube-api-access-pwvd2\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13e209b0-eb31-4565-85bb-72d7e64ae65d-agent-certs\") pod \"konnectivity-agent-s4jmb\" (UID: \"13e209b0-eb31-4565-85bb-72d7e64ae65d\") " pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:13.959503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dhzl\" (UniqueName: \"kubernetes.io/projected/130b3016-7f8a-4094-a80a-f613ffaaace8-kube-api-access-4dhzl\") pod \"node-ca-fsl22\" (UID: \"130b3016-7f8a-4094-a80a-f613ffaaace8\") " pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:13.960138 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87446c40-4dc9-42d2-a645-d9ecb5f7696e-dbus\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:13.960138 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-kubernetes\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.960138 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.958961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-run-multus-certs\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.960138 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.959008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc99l\" (UniqueName: \"kubernetes.io/projected/289d6496-931c-4581-9bc3-3565b7138fd0-kube-api-access-bc99l\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:13.960138 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.959049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-cni-netd\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:13.960138 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.959075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-modprobe-d\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:13.988643 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.988617    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:56:13.994293 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.994197    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" event={"ID":"95de36e8260460990badb66cc001e3dd","Type":"ContainerStarted","Data":"669bfb6ece1032bfa93e3549681c8d0af10f79463f14be57f2f9c3035f773cd0"}
Jul 24 14:56:13.995615 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:13.995585    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" event={"ID":"736183371619f980a6fc917422b9ff89","Type":"ContainerStarted","Data":"8c9967a4749c967c818ce9b304d52c874694f8f1cafe3fce9ae500d7652de2db"}
Jul 24 14:56:14.059457 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-etc-selinux\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.059457 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059455    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-env-overrides\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-ovnkube-script-lib\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-systemd\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-sys\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwvd2\" (UniqueName: \"kubernetes.io/projected/a0408899-9538-4e53-9468-4884c85bbb69-kube-api-access-pwvd2\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13e209b0-eb31-4565-85bb-72d7e64ae65d-agent-certs\") pod \"konnectivity-agent-s4jmb\" (UID: \"13e209b0-eb31-4565-85bb-72d7e64ae65d\") " pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059621    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dhzl\" (UniqueName: \"kubernetes.io/projected/130b3016-7f8a-4094-a80a-f613ffaaace8-kube-api-access-4dhzl\") pod \"node-ca-fsl22\" (UID: \"130b3016-7f8a-4094-a80a-f613ffaaace8\") " pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87446c40-4dc9-42d2-a645-d9ecb5f7696e-dbus\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-kubernetes\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-run-multus-certs\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc99l\" (UniqueName: \"kubernetes.io/projected/289d6496-931c-4581-9bc3-3565b7138fd0-kube-api-access-bc99l\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.059711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-cni-netd\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-modprobe-d\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-sysctl-d\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-hostroot\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-sys-fs\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-cni-bin\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-sysconfig\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-run-k8s-cni-cncf-io\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/151f5944-a3d6-4da6-967d-2c2da733dc45-iptables-alerter-script\") pod \"iptables-alerter-8jx5s\" (UID: \"151f5944-a3d6-4da6-967d-2c2da733dc45\") " pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059912    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7fc088b-d5f9-49d9-a005-ed791c26fe23-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-kubelet\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-slash\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.059974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb49j\" (UniqueName: \"kubernetes.io/projected/f573763f-5ff2-443d-9579-5d12994e4102-kube-api-access-sb49j\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-sysctl-conf\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-registration-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.060265 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13e209b0-eb31-4565-85bb-72d7e64ae65d-konnectivity-ca\") pod \"konnectivity-agent-s4jmb\" (UID: \"13e209b0-eb31-4565-85bb-72d7e64ae65d\") " pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8ada920-febe-4ebd-a2a0-37bd8ab680b2-hosts-file\") pod \"node-resolver-xcg42\" (UID: \"b8ada920-febe-4ebd-a2a0-37bd8ab680b2\") " pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-var-lib-cni-multus\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-run-netns\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-var-lib-cni-bin\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7fkt\" (UniqueName: \"kubernetes.io/projected/df7f9a86-0587-44f0-a26c-87ab18c04b9a-kube-api-access-g7fkt\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7fc088b-d5f9-49d9-a005-ed791c26fe23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llbhn\" (UniqueName: \"kubernetes.io/projected/e7fc088b-d5f9-49d9-a005-ed791c26fe23-kube-api-access-llbhn\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-systemd-units\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-ovn-node-metrics-cert\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-etc-kubernetes\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/130b3016-7f8a-4094-a80a-f613ffaaace8-serviceca\") pod \"node-ca-fsl22\" (UID: \"130b3016-7f8a-4094-a80a-f613ffaaace8\") " pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-var-lib-kubelet\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-system-cni-dir\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060425    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-cni-bin\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/289d6496-931c-4581-9bc3-3565b7138fd0-cni-binary-copy\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.060914 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-device-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-etc-openvswitch\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-ovnkube-config\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnltp\" (UniqueName: \"kubernetes.io/projected/151f5944-a3d6-4da6-967d-2c2da733dc45-kube-api-access-xnltp\") pod \"iptables-alerter-8jx5s\" (UID: \"151f5944-a3d6-4da6-967d-2c2da733dc45\") " pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-multus-cni-dir\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-os-release\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060675    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-var-lib-openvswitch\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-run-ovn\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-host\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/289d6496-931c-4581-9bc3-3565b7138fd0-multus-daemon-config\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/151f5944-a3d6-4da6-967d-2c2da733dc45-host-slash\") pod \"iptables-alerter-8jx5s\" (UID: \"151f5944-a3d6-4da6-967d-2c2da733dc45\") " pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-run\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7fc088b-d5f9-49d9-a005-ed791c26fe23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-run-netns\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0408899-9538-4e53-9468-4884c85bbb69-etc-tuned\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx4wd\" (UniqueName: \"kubernetes.io/projected/b8ada920-febe-4ebd-a2a0-37bd8ab680b2-kube-api-access-qx4wd\") pod \"node-resolver-xcg42\" (UID: \"b8ada920-febe-4ebd-a2a0-37bd8ab680b2\") " pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:14.061701 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-run-systemd\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060882    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0408899-9538-4e53-9468-4884c85bbb69-tmp\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/130b3016-7f8a-4094-a80a-f613ffaaace8-host\") pod \"node-ca-fsl22\" (UID: \"130b3016-7f8a-4094-a80a-f613ffaaace8\") " pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87446c40-4dc9-42d2-a645-d9ecb5f7696e-kubelet-config\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.060959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-socket-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ada920-febe-4ebd-a2a0-37bd8ab680b2-tmp-dir\") pod \"node-resolver-xcg42\" (UID: \"b8ada920-febe-4ebd-a2a0-37bd8ab680b2\") " pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-cnibin\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/289d6496-931c-4581-9bc3-3565b7138fd0-cni-binary-copy\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-multus-socket-dir-parent\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-multus-conf-dir\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-node-log\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061170    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-etc-selinux\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-var-lib-kubelet\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061207    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-multus-socket-dir-parent\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061235    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-run-openvswitch\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-log-socket\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.062521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-os-release\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-system-cni-dir\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-cnibin\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4f8\" (UniqueName: \"kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8\") pod \"network-check-target-vp7sh\" (UID: \"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a\") " pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kld68\" (UniqueName: \"kubernetes.io/projected/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-kube-api-access-kld68\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061447    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-lib-modules\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061638    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-lib-modules\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061690    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-ovnkube-script-lib\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.061740    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-sys\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.061815    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs podName:f573763f-5ff2-443d-9579-5d12994e4102 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:14.561794924 +0000 UTC m=+3.100774321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs") pod "network-metrics-daemon-7rgzv" (UID: "f573763f-5ff2-443d-9579-5d12994e4102") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061862    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-sysconfig\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-run-k8s-cni-cncf-io\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.062376    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.062459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/151f5944-a3d6-4da6-967d-2c2da733dc45-iptables-alerter-script\") pod \"iptables-alerter-8jx5s\" (UID: \"151f5944-a3d6-4da6-967d-2c2da733dc45\") " pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.062975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7fc088b-d5f9-49d9-a005-ed791c26fe23-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.063052    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-kubelet\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.063223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.063120    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-slash\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.064066 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.063487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-sysctl-conf\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.064066 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.063555    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-registration-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.064066 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87446c40-4dc9-42d2-a645-d9ecb5f7696e-dbus\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:14.064066 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064038    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13e209b0-eb31-4565-85bb-72d7e64ae65d-konnectivity-ca\") pod \"konnectivity-agent-s4jmb\" (UID: \"13e209b0-eb31-4565-85bb-72d7e64ae65d\") " pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:14.064261 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-kubernetes\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.064261 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064115    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-var-lib-cni-multus\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.064261 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064121    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-run-multus-certs\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.064261 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064160    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-run-netns\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.064261 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064202    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8ada920-febe-4ebd-a2a0-37bd8ab680b2-hosts-file\") pod \"node-resolver-xcg42\" (UID: \"b8ada920-febe-4ebd-a2a0-37bd8ab680b2\") " pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:14.064261 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064249    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-var-lib-cni-bin\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.064540 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064378    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-cni-netd\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.064540 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-modprobe-d\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.064637 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064564    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-sysctl-d\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.064637 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-hostroot\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.064737 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064659    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.064737 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064711    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-sys-fs\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.064839 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064742    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7fc088b-d5f9-49d9-a005-ed791c26fe23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.064839 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064753    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-device-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.064839 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.064832    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:14.065011 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.064887    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret podName:87446c40-4dc9-42d2-a645-d9ecb5f7696e nodeName:}" failed. No retries permitted until 2026-07-24 14:56:14.564869016 +0000 UTC m=+3.103848429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret") pod "global-pull-secret-syncer-wq2p6" (UID: "87446c40-4dc9-42d2-a645-d9ecb5f7696e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:14.065011 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.064927    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-etc-openvswitch\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.065124 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065070    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-systemd-units\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.065180 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-var-lib-openvswitch\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.065233 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065217    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-os-release\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.065285 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.061741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-etc-systemd\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.065285 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065267    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-run-ovn\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.065388 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065300    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.065388 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/151f5944-a3d6-4da6-967d-2c2da733dc45-host-slash\") pod \"iptables-alerter-8jx5s\" (UID: \"151f5944-a3d6-4da6-967d-2c2da733dc45\") " pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:14.065481 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065383    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-os-release\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.065481 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065409    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-run\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.065481 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065420    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-multus-cni-dir\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.065481 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065452    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-ovnkube-config\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.065481 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-env-overrides\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065492    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-system-cni-dir\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-log-socket\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-cnibin\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065550    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-multus-conf-dir\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065562    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7fc088b-d5f9-49d9-a005-ed791c26fe23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-host\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-etc-kubernetes\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0408899-9538-4e53-9468-4884c85bbb69-var-lib-kubelet\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065662    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/130b3016-7f8a-4094-a80a-f613ffaaace8-host\") pod \"node-ca-fsl22\" (UID: \"130b3016-7f8a-4094-a80a-f613ffaaace8\") " pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065663    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-system-cni-dir\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.065716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065713    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87446c40-4dc9-42d2-a645-d9ecb5f7696e-kubelet-config\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:14.066296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065802    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df7f9a86-0587-44f0-a26c-87ab18c04b9a-socket-dir\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.066296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065847    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/289d6496-931c-4581-9bc3-3565b7138fd0-multus-daemon-config\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.066296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-host-var-lib-kubelet\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.066296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-node-log\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.066296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.065964    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/130b3016-7f8a-4094-a80a-f613ffaaace8-serviceca\") pod \"node-ca-fsl22\" (UID: \"130b3016-7f8a-4094-a80a-f613ffaaace8\") " pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:14.066296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.066036    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/289d6496-931c-4581-9bc3-3565b7138fd0-cnibin\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.066296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.066077    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-run-openvswitch\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.066296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.066090    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ada920-febe-4ebd-a2a0-37bd8ab680b2-tmp-dir\") pod \"node-resolver-xcg42\" (UID: \"b8ada920-febe-4ebd-a2a0-37bd8ab680b2\") " pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:14.066296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.066173    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-run-systemd\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.066703 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.066315    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-host-run-netns\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.066703 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.066593    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7fc088b-d5f9-49d9-a005-ed791c26fe23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.068027 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.068001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13e209b0-eb31-4565-85bb-72d7e64ae65d-agent-certs\") pod \"konnectivity-agent-s4jmb\" (UID: \"13e209b0-eb31-4565-85bb-72d7e64ae65d\") " pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:14.069183 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.069157    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0408899-9538-4e53-9468-4884c85bbb69-etc-tuned\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.069293 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.069190    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-ovn-node-metrics-cert\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.069362 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.069340    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0408899-9538-4e53-9468-4884c85bbb69-tmp\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.071447 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.071418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwvd2\" (UniqueName: \"kubernetes.io/projected/a0408899-9538-4e53-9468-4884c85bbb69-kube-api-access-pwvd2\") pod \"tuned-jr6r8\" (UID: \"a0408899-9538-4e53-9468-4884c85bbb69\") " pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.074030 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.074005    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb49j\" (UniqueName: \"kubernetes.io/projected/f573763f-5ff2-443d-9579-5d12994e4102-kube-api-access-sb49j\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:14.075656 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.074645    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:56:14.075656 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.074673    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:56:14.075656 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.074703    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dv4f8 for pod openshift-network-diagnostics/network-check-target-vp7sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:14.075656 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.074766    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8 podName:c71b3b5f-caa3-4d88-b280-17d8c7d9c14a nodeName:}" failed. No retries permitted until 2026-07-24 14:56:14.574747594 +0000 UTC m=+3.113726988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dv4f8" (UniqueName: "kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8") pod "network-check-target-vp7sh" (UID: "c71b3b5f-caa3-4d88-b280-17d8c7d9c14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:14.075656 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.074828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dhzl\" (UniqueName: \"kubernetes.io/projected/130b3016-7f8a-4094-a80a-f613ffaaace8-kube-api-access-4dhzl\") pod \"node-ca-fsl22\" (UID: \"130b3016-7f8a-4094-a80a-f613ffaaace8\") " pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:14.077346 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.077273    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc99l\" (UniqueName: \"kubernetes.io/projected/289d6496-931c-4581-9bc3-3565b7138fd0-kube-api-access-bc99l\") pod \"multus-k2pbn\" (UID: \"289d6496-931c-4581-9bc3-3565b7138fd0\") " pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.079790 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.079753    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llbhn\" (UniqueName: \"kubernetes.io/projected/e7fc088b-d5f9-49d9-a005-ed791c26fe23-kube-api-access-llbhn\") pod \"multus-additional-cni-plugins-5gc4d\" (UID: \"e7fc088b-d5f9-49d9-a005-ed791c26fe23\") " pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.083777 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.083748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnltp\" (UniqueName: \"kubernetes.io/projected/151f5944-a3d6-4da6-967d-2c2da733dc45-kube-api-access-xnltp\") pod \"iptables-alerter-8jx5s\" (UID: \"151f5944-a3d6-4da6-967d-2c2da733dc45\") " pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:14.083911 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.083778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7fkt\" (UniqueName: \"kubernetes.io/projected/df7f9a86-0587-44f0-a26c-87ab18c04b9a-kube-api-access-g7fkt\") pod \"aws-ebs-csi-driver-node-gktsb\" (UID: \"df7f9a86-0587-44f0-a26c-87ab18c04b9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.083911 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.083780    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kld68\" (UniqueName: \"kubernetes.io/projected/9d3ae5e2-fd86-4efd-99df-ceb14a5c870b-kube-api-access-kld68\") pod \"ovnkube-node-l2lgp\" (UID: \"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.086138 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.086084    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx4wd\" (UniqueName: \"kubernetes.io/projected/b8ada920-febe-4ebd-a2a0-37bd8ab680b2-kube-api-access-qx4wd\") pod \"node-resolver-xcg42\" (UID: \"b8ada920-febe-4ebd-a2a0-37bd8ab680b2\") " pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:14.165857 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.165816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k2pbn"
Jul 24 14:56:14.174891 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.174853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5gc4d"
Jul 24 14:56:14.187055 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.187019    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8jx5s"
Jul 24 14:56:14.194436 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.194407    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:14.202390 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.202363    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb"
Jul 24 14:56:14.210423 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.210390    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:14.218631 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.218601    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jr6r8"
Jul 24 14:56:14.225620 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.225590    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xcg42"
Jul 24 14:56:14.232404 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.232380    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fsl22"
Jul 24 14:56:14.566547 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.566508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:14.566728 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.566576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:14.566728 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.566713    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:14.566851 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.566769    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret podName:87446c40-4dc9-42d2-a645-d9ecb5f7696e nodeName:}" failed. No retries permitted until 2026-07-24 14:56:15.566755201 +0000 UTC m=+4.105734591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret") pod "global-pull-secret-syncer-wq2p6" (UID: "87446c40-4dc9-42d2-a645-d9ecb5f7696e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:14.567108 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.567090    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:14.567163 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.567154    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs podName:f573763f-5ff2-443d-9579-5d12994e4102 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:15.5671365 +0000 UTC m=+4.106115891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs") pod "network-metrics-daemon-7rgzv" (UID: "f573763f-5ff2-443d-9579-5d12994e4102") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:14.667693 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.667593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4f8\" (UniqueName: \"kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8\") pod \"network-check-target-vp7sh\" (UID: \"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a\") " pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:14.667879 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.667803    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:56:14.667879 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.667834    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:56:14.667879 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.667846    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dv4f8 for pod openshift-network-diagnostics/network-check-target-vp7sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:14.668090 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.667911    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8 podName:c71b3b5f-caa3-4d88-b280-17d8c7d9c14a nodeName:}" failed. No retries permitted until 2026-07-24 14:56:15.667890678 +0000 UTC m=+4.206870071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dv4f8" (UniqueName: "kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8") pod "network-check-target-vp7sh" (UID: "c71b3b5f-caa3-4d88-b280-17d8c7d9c14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:14.908792 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.908729    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:51:13 +0000 UTC" deadline="2028-03-09 02:15:43.942562607 +0000 UTC"
Jul 24 14:56:14.908792 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.908786    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14243h19m29.033781706s"
Jul 24 14:56:14.990697 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:14.990613    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:14.990869 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:14.990743    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:15.157507 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:15.157344    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0408899_9538_4e53_9468_4884c85bbb69.slice/crio-412ddaec881b755ce484eab27440a0e94df2a7933dc89233f95fcfbee38ad093 WatchSource:0}: Error finding container 412ddaec881b755ce484eab27440a0e94df2a7933dc89233f95fcfbee38ad093: Status 404 returned error can't find the container with id 412ddaec881b755ce484eab27440a0e94df2a7933dc89233f95fcfbee38ad093
Jul 24 14:56:15.159899 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:15.159808    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ada920_febe_4ebd_a2a0_37bd8ab680b2.slice/crio-5294414e446c052332909eca6a6008c1314fddba75c2a1b41a427da452ebc2e6 WatchSource:0}: Error finding container 5294414e446c052332909eca6a6008c1314fddba75c2a1b41a427da452ebc2e6: Status 404 returned error can't find the container with id 5294414e446c052332909eca6a6008c1314fddba75c2a1b41a427da452ebc2e6
Jul 24 14:56:15.162640 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:15.162616    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e209b0_eb31_4565_85bb_72d7e64ae65d.slice/crio-d46526eab923db3c6b0fa95b6d81c039e46d028c90b778b47f233de03291de1f WatchSource:0}: Error finding container d46526eab923db3c6b0fa95b6d81c039e46d028c90b778b47f233de03291de1f: Status 404 returned error can't find the container with id d46526eab923db3c6b0fa95b6d81c039e46d028c90b778b47f233de03291de1f
Jul 24 14:56:15.165106 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:15.165074    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf7f9a86_0587_44f0_a26c_87ab18c04b9a.slice/crio-7128fcbc3215dc753b1e70f04903a5e47096a0a82509d0883574b763b75b9fb8 WatchSource:0}: Error finding container 7128fcbc3215dc753b1e70f04903a5e47096a0a82509d0883574b763b75b9fb8: Status 404 returned error can't find the container with id 7128fcbc3215dc753b1e70f04903a5e47096a0a82509d0883574b763b75b9fb8
Jul 24 14:56:15.167641 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:15.167133    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130b3016_7f8a_4094_a80a_f613ffaaace8.slice/crio-7d4577b368a9aa0f52ff1626e56c9ddfd2cab047a3011ecb8fe3060827cfe02f WatchSource:0}: Error finding container 7d4577b368a9aa0f52ff1626e56c9ddfd2cab047a3011ecb8fe3060827cfe02f: Status 404 returned error can't find the container with id 7d4577b368a9aa0f52ff1626e56c9ddfd2cab047a3011ecb8fe3060827cfe02f
Jul 24 14:56:15.574488 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:15.574217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:15.574639 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:15.574486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:15.574639 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:15.574428    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:15.574639 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:15.574622    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:15.574789 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:15.574638    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs podName:f573763f-5ff2-443d-9579-5d12994e4102 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:17.574616674 +0000 UTC m=+6.113596068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs") pod "network-metrics-daemon-7rgzv" (UID: "f573763f-5ff2-443d-9579-5d12994e4102") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:15.574789 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:15.574671    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret podName:87446c40-4dc9-42d2-a645-d9ecb5f7696e nodeName:}" failed. No retries permitted until 2026-07-24 14:56:17.574654956 +0000 UTC m=+6.113634350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret") pod "global-pull-secret-syncer-wq2p6" (UID: "87446c40-4dc9-42d2-a645-d9ecb5f7696e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:15.675040 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:15.674943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4f8\" (UniqueName: \"kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8\") pod \"network-check-target-vp7sh\" (UID: \"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a\") " pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:15.675237 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:15.675156    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:56:15.675237 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:15.675182    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:56:15.675237 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:15.675195    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dv4f8 for pod openshift-network-diagnostics/network-check-target-vp7sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:15.675401 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:15.675266    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8 podName:c71b3b5f-caa3-4d88-b280-17d8c7d9c14a nodeName:}" failed. No retries permitted until 2026-07-24 14:56:17.675243439 +0000 UTC m=+6.214222852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dv4f8" (UniqueName: "kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8") pod "network-check-target-vp7sh" (UID: "c71b3b5f-caa3-4d88-b280-17d8c7d9c14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:15.909795 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:15.909727    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:51:13 +0000 UTC" deadline="2028-04-27 12:28:55.545851678 +0000 UTC"
Jul 24 14:56:15.909795 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:15.909792    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15429h32m39.636063881s"
Jul 24 14:56:15.992344 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:15.992317    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:15.992516 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:15.992446    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:15.992854 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:15.992834    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:15.992960 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:15.992942    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:16.033400 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.033303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s4jmb" event={"ID":"13e209b0-eb31-4565-85bb-72d7e64ae65d","Type":"ContainerStarted","Data":"d46526eab923db3c6b0fa95b6d81c039e46d028c90b778b47f233de03291de1f"}
Jul 24 14:56:16.036602 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.035106    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xcg42" event={"ID":"b8ada920-febe-4ebd-a2a0-37bd8ab680b2","Type":"ContainerStarted","Data":"5294414e446c052332909eca6a6008c1314fddba75c2a1b41a427da452ebc2e6"}
Jul 24 14:56:16.040282 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.040255    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" event={"ID":"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b","Type":"ContainerStarted","Data":"92634bb19479b4ddbac48ba8ba4624ec53faf8ed8da6533076c8f62874684c48"}
Jul 24 14:56:16.044748 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.044714    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gc4d" event={"ID":"e7fc088b-d5f9-49d9-a005-ed791c26fe23","Type":"ContainerStarted","Data":"44d2b217dd80678a9e7b12566d0ff0a4db2d66a288b4a207ce8f9140f87f7422"}
Jul 24 14:56:16.046899 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.046869    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k2pbn" event={"ID":"289d6496-931c-4581-9bc3-3565b7138fd0","Type":"ContainerStarted","Data":"4b10c3edee6f74b63baf23a199128d50b886d5c154437a895c78abe4f8f5124e"}
Jul 24 14:56:16.052846 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.052812    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fsl22" event={"ID":"130b3016-7f8a-4094-a80a-f613ffaaace8","Type":"ContainerStarted","Data":"7d4577b368a9aa0f52ff1626e56c9ddfd2cab047a3011ecb8fe3060827cfe02f"}
Jul 24 14:56:16.056095 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.056019    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jr6r8" event={"ID":"a0408899-9538-4e53-9468-4884c85bbb69","Type":"ContainerStarted","Data":"412ddaec881b755ce484eab27440a0e94df2a7933dc89233f95fcfbee38ad093"}
Jul 24 14:56:16.059052 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.058963    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8jx5s" event={"ID":"151f5944-a3d6-4da6-967d-2c2da733dc45","Type":"ContainerStarted","Data":"2a66c18268f7eb29dc07227021b8ba1a0ba98f24b16a89890bcff75af5628940"}
Jul 24 14:56:16.063147 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.062727    2582 generic.go:356] "Generic (PLEG): container finished" podID="736183371619f980a6fc917422b9ff89" containerID="037931745de6613f6972533489a6f4773ae47990346d3a1b7c3ccade8a6b2bfa" exitCode=0
Jul 24 14:56:16.063147 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.062820    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" event={"ID":"736183371619f980a6fc917422b9ff89","Type":"ContainerDied","Data":"037931745de6613f6972533489a6f4773ae47990346d3a1b7c3ccade8a6b2bfa"}
Jul 24 14:56:16.071837 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.071686    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" event={"ID":"95de36e8260460990badb66cc001e3dd","Type":"ContainerStarted","Data":"4d72ef9d727b06c98f8627118a8f5a734c0c44d7cd3697547ee46e28d787b154"}
Jul 24 14:56:16.082467 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.082433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb" event={"ID":"df7f9a86-0587-44f0-a26c-87ab18c04b9a","Type":"ContainerStarted","Data":"7128fcbc3215dc753b1e70f04903a5e47096a0a82509d0883574b763b75b9fb8"}
Jul 24 14:56:16.990193 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:16.990160    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:16.990665 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:16.990286    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:17.114174 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:17.114041    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" event={"ID":"736183371619f980a6fc917422b9ff89","Type":"ContainerStarted","Data":"cda66d8a3d6ea3e73c383d2199ef29a36a611e08620dda8fed0afe869816f026"}
Jul 24 14:56:17.131975 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:17.131915    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" podStartSLOduration=4.13189667 podStartE2EDuration="4.13189667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:16.097444757 +0000 UTC m=+4.636424171" watchObservedRunningTime="2026-07-24 14:56:17.13189667 +0000 UTC m=+5.670876082"
Jul 24 14:56:17.594101 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:17.594059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:17.594305 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:17.594126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:17.594305 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:17.594261    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:17.594423 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:17.594329    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret podName:87446c40-4dc9-42d2-a645-d9ecb5f7696e nodeName:}" failed. No retries permitted until 2026-07-24 14:56:21.594309125 +0000 UTC m=+10.133288522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret") pod "global-pull-secret-syncer-wq2p6" (UID: "87446c40-4dc9-42d2-a645-d9ecb5f7696e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:17.594748 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:17.594718    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:17.594833 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:17.594776    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs podName:f573763f-5ff2-443d-9579-5d12994e4102 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:21.594760877 +0000 UTC m=+10.133740271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs") pod "network-metrics-daemon-7rgzv" (UID: "f573763f-5ff2-443d-9579-5d12994e4102") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:17.694796 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:17.694748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4f8\" (UniqueName: \"kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8\") pod \"network-check-target-vp7sh\" (UID: \"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a\") " pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:17.695035 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:17.694943    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:56:17.695035 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:17.694969    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:56:17.695035 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:17.694999    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dv4f8 for pod openshift-network-diagnostics/network-check-target-vp7sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:17.695207 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:17.695060    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8 podName:c71b3b5f-caa3-4d88-b280-17d8c7d9c14a nodeName:}" failed. No retries permitted until 2026-07-24 14:56:21.695040872 +0000 UTC m=+10.234020266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dv4f8" (UniqueName: "kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8") pod "network-check-target-vp7sh" (UID: "c71b3b5f-caa3-4d88-b280-17d8c7d9c14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:17.991229 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:17.991193    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:17.991720 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:17.991350    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:17.991798 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:17.991759    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:17.991885 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:17.991861    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:18.990397 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:18.990362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:18.990573 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:18.990503    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:19.989995 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:19.989896    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:19.989995 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:19.989910    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:19.990383 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:19.990056    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:19.990383 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:19.990203    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:20.990604 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:20.990567    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:20.991037 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:20.990690    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:21.629335 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:21.629075    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:21.629335 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:21.629173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:21.629335 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:21.629210    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:21.629335 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:21.629259    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:21.629335 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:21.629278    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret podName:87446c40-4dc9-42d2-a645-d9ecb5f7696e nodeName:}" failed. No retries permitted until 2026-07-24 14:56:29.629258425 +0000 UTC m=+18.168237833 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret") pod "global-pull-secret-syncer-wq2p6" (UID: "87446c40-4dc9-42d2-a645-d9ecb5f7696e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:21.629335 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:21.629296    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs podName:f573763f-5ff2-443d-9579-5d12994e4102 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:29.629284277 +0000 UTC m=+18.168263682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs") pod "network-metrics-daemon-7rgzv" (UID: "f573763f-5ff2-443d-9579-5d12994e4102") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:21.730485 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:21.730451    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4f8\" (UniqueName: \"kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8\") pod \"network-check-target-vp7sh\" (UID: \"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a\") " pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:21.730684 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:21.730637    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:56:21.730684 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:21.730661    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:56:21.730684 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:21.730673    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dv4f8 for pod openshift-network-diagnostics/network-check-target-vp7sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:21.730835 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:21.730741    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8 podName:c71b3b5f-caa3-4d88-b280-17d8c7d9c14a nodeName:}" failed. No retries permitted until 2026-07-24 14:56:29.730721596 +0000 UTC m=+18.269701011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dv4f8" (UniqueName: "kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8") pod "network-check-target-vp7sh" (UID: "c71b3b5f-caa3-4d88-b280-17d8c7d9c14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:21.991460 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:21.991423    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:21.991934 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:21.991556    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:21.991934 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:21.991906    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:21.992078 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:21.992028    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:22.991315 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:22.990839    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:22.991315 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:22.990970    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:23.991153 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:23.991108    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:23.991328 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:23.991157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:23.991328 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:23.991268    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:23.991453 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:23.991395    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:24.990124 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:24.990087    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:24.990628 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:24.990213    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:25.989940 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:25.989906    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:25.990149 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:25.989951    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:25.990149 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:25.990065    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:25.990528 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:25.990193    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:26.990817 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:26.990784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:26.991290 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:26.990901    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:27.990476 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:27.990441    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:27.990634 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:27.990573    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:27.990872 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:27.990441    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:27.991278 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:27.990941    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:28.989881 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:28.989845    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:28.990101 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:28.989971    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:29.695518 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:29.695380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:29.695518 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:29.695431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:29.696138 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:29.695534    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:29.696138 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:29.695596    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret podName:87446c40-4dc9-42d2-a645-d9ecb5f7696e nodeName:}" failed. No retries permitted until 2026-07-24 14:56:45.695579484 +0000 UTC m=+34.234558897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret") pod "global-pull-secret-syncer-wq2p6" (UID: "87446c40-4dc9-42d2-a645-d9ecb5f7696e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:56:29.696138 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:29.695914    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:29.696138 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:29.695952    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs podName:f573763f-5ff2-443d-9579-5d12994e4102 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:45.695941267 +0000 UTC m=+34.234920658 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs") pod "network-metrics-daemon-7rgzv" (UID: "f573763f-5ff2-443d-9579-5d12994e4102") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:56:29.796600 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:29.796419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4f8\" (UniqueName: \"kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8\") pod \"network-check-target-vp7sh\" (UID: \"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a\") " pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:29.796739 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:29.796717    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:56:29.796739 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:29.796737    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:56:29.796813 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:29.796747    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dv4f8 for pod openshift-network-diagnostics/network-check-target-vp7sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:29.796813 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:29.796799    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8 podName:c71b3b5f-caa3-4d88-b280-17d8c7d9c14a nodeName:}" failed. No retries permitted until 2026-07-24 14:56:45.7967815 +0000 UTC m=+34.335760890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dv4f8" (UniqueName: "kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8") pod "network-check-target-vp7sh" (UID: "c71b3b5f-caa3-4d88-b280-17d8c7d9c14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:56:29.990344 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:29.990321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:29.990477 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:29.990321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:29.990477 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:29.990440    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:29.990581 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:29.990506    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:30.143253 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.143055    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb" event={"ID":"df7f9a86-0587-44f0-a26c-87ab18c04b9a","Type":"ContainerStarted","Data":"7cc9b2550a7ca283d0e574a272391dd5c66f75fc3424794580d6f36bd1d11eb3"}
Jul 24 14:56:30.144765 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.144732    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s4jmb" event={"ID":"13e209b0-eb31-4565-85bb-72d7e64ae65d","Type":"ContainerStarted","Data":"87d1421dccd8230598d72eda7cfa614ea899a88b896291abe5f6e9824312c63b"}
Jul 24 14:56:30.146658 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.146632    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xcg42" event={"ID":"b8ada920-febe-4ebd-a2a0-37bd8ab680b2","Type":"ContainerStarted","Data":"68aaba0375556b09a01b2c7bb52c8ec5b9a0e0032d674e9bf2e1c9930aeaa062"}
Jul 24 14:56:30.152724 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.152704    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 14:56:30.153101 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.153080    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d3ae5e2-fd86-4efd-99df-ceb14a5c870b" containerID="83d50437087df6b59fcedc21a333e77bd4b0fab5f918323b3e240873baacd172" exitCode=1
Jul 24 14:56:30.153220 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.153144    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" event={"ID":"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b","Type":"ContainerStarted","Data":"a9e440455946d062f3b81f9ccecbc4ee73642ed3362b73bee3b1c11fd1c1de1f"}
Jul 24 14:56:30.153281 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.153226    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" event={"ID":"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b","Type":"ContainerStarted","Data":"85d56190a05523fc1284fe9c3c87dc116ac38efd1066345c42dcdf4e61acbb0d"}
Jul 24 14:56:30.153339 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.153279    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" event={"ID":"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b","Type":"ContainerStarted","Data":"162176161cb3bbdd5767aaa4f73c17d0b9a16d50aba84c7fee3ae4732c4f4b6d"}
Jul 24 14:56:30.153339 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.153330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" event={"ID":"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b","Type":"ContainerDied","Data":"83d50437087df6b59fcedc21a333e77bd4b0fab5f918323b3e240873baacd172"}
Jul 24 14:56:30.153439 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.153381    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" event={"ID":"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b","Type":"ContainerStarted","Data":"6dae0bb0a2e96469e08ed135f396d58de3d5f7a0c27c80ef7be82af1e462942e"}
Jul 24 14:56:30.154731 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.154709    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7fc088b-d5f9-49d9-a005-ed791c26fe23" containerID="1cc3b5d9af0e9c021209bb2bbaae9227510ee4c6fe423344e6ce97ba103c0e15" exitCode=0
Jul 24 14:56:30.154824 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.154801    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gc4d" event={"ID":"e7fc088b-d5f9-49d9-a005-ed791c26fe23","Type":"ContainerDied","Data":"1cc3b5d9af0e9c021209bb2bbaae9227510ee4c6fe423344e6ce97ba103c0e15"}
Jul 24 14:56:30.156561 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.156515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fsl22" event={"ID":"130b3016-7f8a-4094-a80a-f613ffaaace8","Type":"ContainerStarted","Data":"63e766794fe8835d317b4e9790c8130123bafe34d2ee1162e8c147bebfdb4232"}
Jul 24 14:56:30.158130 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.158105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jr6r8" event={"ID":"a0408899-9538-4e53-9468-4884c85bbb69","Type":"ContainerStarted","Data":"aa06f7bb6ff2a0f11cdf41d0eaaf57a09945f7aeed01915574b13808f90c2ab8"}
Jul 24 14:56:30.165467 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.165418    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" podStartSLOduration=17.165404197 podStartE2EDuration="17.165404197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:17.132385435 +0000 UTC m=+5.671364849" watchObservedRunningTime="2026-07-24 14:56:30.165404197 +0000 UTC m=+18.704383607"
Jul 24 14:56:30.188431 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.188379    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s4jmb" podStartSLOduration=4.109313843 podStartE2EDuration="18.188362416s" totalImagesPullingTime="14.079048573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:30.165119625 +0000 UTC m=+18.704099067" watchObservedRunningTime="2026-07-24 14:56:30.188362416 +0000 UTC m=+18.727341828"
Jul 24 14:56:30.204316 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.204268    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jr6r8" podStartSLOduration=3.782602402 podStartE2EDuration="18.204251038s" totalImagesPullingTime="14.421648636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:30.187897665 +0000 UTC m=+18.726877077" watchObservedRunningTime="2026-07-24 14:56:30.204251038 +0000 UTC m=+18.743230445"
Jul 24 14:56:30.204473 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.204391    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xcg42" podStartSLOduration=3.8133649419999998 podStartE2EDuration="18.20438595s" totalImagesPullingTime="14.391021008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:30.204379969 +0000 UTC m=+18.743359382" watchObservedRunningTime="2026-07-24 14:56:30.20438595 +0000 UTC m=+18.743365363"
Jul 24 14:56:30.284360 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.284306    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fsl22" podStartSLOduration=3.902305967 podStartE2EDuration="18.284288841s" totalImagesPullingTime="14.381982874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:30.238854401 +0000 UTC m=+18.777833814" watchObservedRunningTime="2026-07-24 14:56:30.284288841 +0000 UTC m=+18.823268253"
Jul 24 14:56:30.990167 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:30.990115    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:30.990969 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:30.990243    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:31.161843 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:31.161806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8jx5s" event={"ID":"151f5944-a3d6-4da6-967d-2c2da733dc45","Type":"ContainerStarted","Data":"79e673bdc857a22d9e378d94d2c011e4d676c79e705e6f35c13e3b0f9ac95c42"}
Jul 24 14:56:31.165123 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:31.165095    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 14:56:31.166143 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:31.166121    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" event={"ID":"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b","Type":"ContainerStarted","Data":"563a160153a8aa06987d7462f62e6dbd9e6b0750db45ef8310a29fdc4b51f97a"}
Jul 24 14:56:31.180480 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:31.180433    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8jx5s" podStartSLOduration=4.785703895 podStartE2EDuration="19.180416365s" totalImagesPullingTime="14.39471247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:31.180260881 +0000 UTC m=+19.719240318" watchObservedRunningTime="2026-07-24 14:56:31.180416365 +0000 UTC m=+19.719395777"
Jul 24 14:56:31.290768 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:31.290742    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 14:56:31.923739 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:31.923616    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T14:56:31.290760552Z","UUID":"9ae51a5b-992e-4fca-9dd5-13fb2ed92764","Handler":null,"Name":"","Endpoint":""}
Jul 24 14:56:31.926091 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:31.926061    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 14:56:31.926264 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:31.926131    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 14:56:31.991809 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:31.991773    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:31.992312 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:31.992285    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:31.992423 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:31.992393    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:31.992873 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:31.992582    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:32.024919 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:32.024879    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:32.025565 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:32.025544    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:32.170552 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:32.170462    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb" event={"ID":"df7f9a86-0587-44f0-a26c-87ab18c04b9a","Type":"ContainerStarted","Data":"6127d9c3af1f093156b27df9e17d40de33c301325ff4db78408a292a55e4e409"}
Jul 24 14:56:32.990708 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:32.990668    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:32.990908 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:32.990791    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:33.174947 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:33.174910    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb" event={"ID":"df7f9a86-0587-44f0-a26c-87ab18c04b9a","Type":"ContainerStarted","Data":"05be8165a22331549976817a0f04d8fccfaa655a267f63fd534a07c02a0e5a74"}
Jul 24 14:56:33.177894 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:33.177873    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 14:56:33.178230 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:33.178207    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" event={"ID":"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b","Type":"ContainerStarted","Data":"c1b03adba8f87092a741d3e2547ceef891b218ce7c41aedf47b89c2d5661b8cc"}
Jul 24 14:56:33.178278 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:33.178244    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 14:56:33.195073 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:33.195020    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gktsb" podStartSLOduration=4.101754772 podStartE2EDuration="21.195004567s" totalImagesPullingTime="17.093249795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:33.194798322 +0000 UTC m=+21.733777746" watchObservedRunningTime="2026-07-24 14:56:33.195004567 +0000 UTC m=+21.733983972"
Jul 24 14:56:33.990052 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:33.990006    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:33.990369 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:33.990156    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:33.990484 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:33.990012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:33.990605 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:33.990581    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:34.990516 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:34.990439    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:34.991017 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:34.990571    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:35.990035 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:35.989974    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:35.990035 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:35.990014    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:35.990294 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:35.990144    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:35.990294 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:35.990273    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:36.189582 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:36.189553    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 14:56:36.190349 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:36.189950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" event={"ID":"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b","Type":"ContainerStarted","Data":"2c070309560a1c84606cee6062cd06387490e771e903eacb5136b2549b9c4e56"}
Jul 24 14:56:36.190400 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:36.190347    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:36.190470 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:36.190418    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:36.190470 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:36.190423    2582 scope.go:117] "RemoveContainer" containerID="83d50437087df6b59fcedc21a333e77bd4b0fab5f918323b3e240873baacd172"
Jul 24 14:56:36.192391 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:36.192362    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7fc088b-d5f9-49d9-a005-ed791c26fe23" containerID="2ab74ef35423ce65cfa9e295ce66436ee820d97a979c342438ac017576102017" exitCode=0
Jul 24 14:56:36.192503 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:36.192424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gc4d" event={"ID":"e7fc088b-d5f9-49d9-a005-ed791c26fe23","Type":"ContainerDied","Data":"2ab74ef35423ce65cfa9e295ce66436ee820d97a979c342438ac017576102017"}
Jul 24 14:56:36.208346 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:36.208324    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:36.990871 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:36.990665    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:36.991083 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:36.990994    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:37.202705 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.200059    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 14:56:37.202705 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.200510    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" event={"ID":"9d3ae5e2-fd86-4efd-99df-ceb14a5c870b","Type":"ContainerStarted","Data":"fdbe777c86d8a2573055fd10b8f30d6dcc37ed384398415258ab3cf28c7ba2fe"}
Jul 24 14:56:37.202705 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.202150    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:37.228009 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.224237    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:56:37.235244 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.235198    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp" podStartSLOduration=10.749842443 podStartE2EDuration="25.235182052s" totalImagesPullingTime="14.485339609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:37.23395327 +0000 UTC m=+25.772932702" watchObservedRunningTime="2026-07-24 14:56:37.235182052 +0000 UTC m=+25.774161464"
Jul 24 14:56:37.566285 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.566187    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wq2p6"]
Jul 24 14:56:37.566446 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.566339    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:37.566446 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:37.566436    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:37.570509 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.569736    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vp7sh"]
Jul 24 14:56:37.570509 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.569887    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:37.570509 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:37.570015    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:37.570729 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.570520    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7rgzv"]
Jul 24 14:56:37.570729 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:37.570639    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:37.570793 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:37.570756    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:38.204953 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:38.204913    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7fc088b-d5f9-49d9-a005-ed791c26fe23" containerID="a2c0428cb57169d037f0a4c1de32fb59510e8eb62c247dbaf901ffa9e60e9fdf" exitCode=0
Jul 24 14:56:38.205535 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:38.205008    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gc4d" event={"ID":"e7fc088b-d5f9-49d9-a005-ed791c26fe23","Type":"ContainerDied","Data":"a2c0428cb57169d037f0a4c1de32fb59510e8eb62c247dbaf901ffa9e60e9fdf"}
Jul 24 14:56:38.990282 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:38.990240    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:38.990282 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:38.990288    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:38.990527 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:38.990388    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:38.990580 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:38.990537    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:39.991051 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:39.990458    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:39.991051 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:39.990599    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:40.222716 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:40.222677    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:40.222908 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:40.222847    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 14:56:40.223566 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:40.223541    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s4jmb"
Jul 24 14:56:40.989852 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:40.989808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:40.990065 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:40.989814    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:40.990065 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:40.989941    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:40.990065 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:40.990044    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:41.993884 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:41.993710    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:41.994406 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:41.993955    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq2p6" podUID="87446c40-4dc9-42d2-a645-d9ecb5f7696e"
Jul 24 14:56:42.220051 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:42.219939    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7fc088b-d5f9-49d9-a005-ed791c26fe23" containerID="1bde8f5b929225d92c50fdb52fa98041ad924c913b1643e081214076b916f291" exitCode=0
Jul 24 14:56:42.220051 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:42.220016    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gc4d" event={"ID":"e7fc088b-d5f9-49d9-a005-ed791c26fe23","Type":"ContainerDied","Data":"1bde8f5b929225d92c50fdb52fa98041ad924c913b1643e081214076b916f291"}
Jul 24 14:56:42.221427 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:42.221396    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k2pbn" event={"ID":"289d6496-931c-4581-9bc3-3565b7138fd0","Type":"ContainerStarted","Data":"f555814a8281fffa2b6f4d6f6c35fffe8b27099bd47820accd83987ce9d5918f"}
Jul 24 14:56:42.264783 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:42.264727    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k2pbn" podStartSLOduration=3.790694856 podStartE2EDuration="30.264709486s" totalImagesPullingTime="26.47401463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:42.264522554 +0000 UTC m=+30.803501990" watchObservedRunningTime="2026-07-24 14:56:42.264709486 +0000 UTC m=+30.803688933"
Jul 24 14:56:42.990469 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:42.990436    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:42.990677 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:42.990436    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:42.990677 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:42.990559    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vp7sh" podUID="c71b3b5f-caa3-4d88-b280-17d8c7d9c14a"
Jul 24 14:56:42.990677 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:42.990626    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rgzv" podUID="f573763f-5ff2-443d-9579-5d12994e4102"
Jul 24 14:56:43.279064 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.278500    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeReady"
Jul 24 14:56:43.279064 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.278667    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 14:56:43.327570 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.327539    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-788b9c9975-mlbqd"]
Jul 24 14:56:43.329759 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.329727    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.332418 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.332364    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 14:56:43.332853 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.332833    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-czcf5\""
Jul 24 14:56:43.332974 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.332835    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 14:56:43.338465 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.338386    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 14:56:43.344103 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.344077    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 14:56:43.359838 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.359807    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-788b9c9975-mlbqd"]
Jul 24 14:56:43.360559 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.360531    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5c7s2"]
Jul 24 14:56:43.363711 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.363687    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pjnb6"]
Jul 24 14:56:43.363855 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.363821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5c7s2"
Jul 24 14:56:43.368123 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.366565    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.368123 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.366649    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 14:56:43.368123 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.366959    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 14:56:43.368123 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.367293    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 14:56:43.368123 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.367401    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-55njp\""
Jul 24 14:56:43.370178 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.369719    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 14:56:43.370178 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.369948    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bc4wp\""
Jul 24 14:56:43.371177 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.371158    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 14:56:43.379337 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.379310    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5c7s2"]
Jul 24 14:56:43.386808 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.385938    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pjnb6"]
Jul 24 14:56:43.396449 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.396414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-bound-sa-token\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.396612 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.396460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-installation-pull-secrets\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.396612 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.396535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-image-registry-private-configuration\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.396612 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.396571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9136e2a6-49bf-459c-8435-329dfb7817e5-ca-trust-extracted\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.396612 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.396602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.396799 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.396617    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-trusted-ca\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.396799 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.396641    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xndmz\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-kube-api-access-xndmz\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.396799 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.396679    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-certificates\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.497062 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-image-registry-private-configuration\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.497062 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9136e2a6-49bf-459c-8435-329dfb7817e5-ca-trust-extracted\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.497296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497089    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.497296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-trusted-ca\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.497296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.497296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497153    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xndmz\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-kube-api-access-xndmz\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.497296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-certificates\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.497296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497199    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-config-volume\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.497296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-tmp-dir\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.497296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmcls\" (UniqueName: \"kubernetes.io/projected/a214c28f-faf2-4a9c-b631-84bc7182090e-kube-api-access-xmcls\") pod \"ingress-canary-5c7s2\" (UID: \"a214c28f-faf2-4a9c-b631-84bc7182090e\") " pod="openshift-ingress-canary/ingress-canary-5c7s2"
Jul 24 14:56:43.497296 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a214c28f-faf2-4a9c-b631-84bc7182090e-cert\") pod \"ingress-canary-5c7s2\" (UID: \"a214c28f-faf2-4a9c-b631-84bc7182090e\") " pod="openshift-ingress-canary/ingress-canary-5c7s2"
Jul 24 14:56:43.497769 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497318    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-bound-sa-token\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.497769 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-installation-pull-secrets\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.497769 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.497366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w65dp\" (UniqueName: \"kubernetes.io/projected/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-kube-api-access-w65dp\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.498449 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.498422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9136e2a6-49bf-459c-8435-329dfb7817e5-ca-trust-extracted\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.498876 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.498856    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-certificates\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.499001 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:43.498963    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 14:56:43.499057 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:43.499005    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788b9c9975-mlbqd: secret "image-registry-tls" not found
Jul 24 14:56:43.499102 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:43.499071    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls podName:9136e2a6-49bf-459c-8435-329dfb7817e5 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:43.999051934 +0000 UTC m=+32.538031329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls") pod "image-registry-788b9c9975-mlbqd" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5") : secret "image-registry-tls" not found
Jul 24 14:56:43.499343 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.499318    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-trusted-ca\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.502781 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.502758    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-installation-pull-secrets\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.502897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.502762    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-image-registry-private-configuration\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.509742 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.509712    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xndmz\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-kube-api-access-xndmz\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.510837 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.510813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-bound-sa-token\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:43.598042 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.597938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-config-volume\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.598042 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.598007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-tmp-dir\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.598269 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.598073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmcls\" (UniqueName: \"kubernetes.io/projected/a214c28f-faf2-4a9c-b631-84bc7182090e-kube-api-access-xmcls\") pod \"ingress-canary-5c7s2\" (UID: \"a214c28f-faf2-4a9c-b631-84bc7182090e\") " pod="openshift-ingress-canary/ingress-canary-5c7s2"
Jul 24 14:56:43.598269 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.598099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a214c28f-faf2-4a9c-b631-84bc7182090e-cert\") pod \"ingress-canary-5c7s2\" (UID: \"a214c28f-faf2-4a9c-b631-84bc7182090e\") " pod="openshift-ingress-canary/ingress-canary-5c7s2"
Jul 24 14:56:43.598269 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.598152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w65dp\" (UniqueName: \"kubernetes.io/projected/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-kube-api-access-w65dp\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.598269 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.598201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.598466 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:43.598312    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 14:56:43.598466 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.598373    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-tmp-dir\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.598466 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:43.598387    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls podName:4df14a47-9e83-4ac2-9e20-a0687dbe3e23 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:44.098366768 +0000 UTC m=+32.637346158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls") pod "dns-default-pjnb6" (UID: "4df14a47-9e83-4ac2-9e20-a0687dbe3e23") : secret "dns-default-metrics-tls" not found
Jul 24 14:56:43.598727 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.598706    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-config-volume\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.601129 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.601107    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a214c28f-faf2-4a9c-b631-84bc7182090e-cert\") pod \"ingress-canary-5c7s2\" (UID: \"a214c28f-faf2-4a9c-b631-84bc7182090e\") " pod="openshift-ingress-canary/ingress-canary-5c7s2"
Jul 24 14:56:43.611056 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.611025    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmcls\" (UniqueName: \"kubernetes.io/projected/a214c28f-faf2-4a9c-b631-84bc7182090e-kube-api-access-xmcls\") pod \"ingress-canary-5c7s2\" (UID: \"a214c28f-faf2-4a9c-b631-84bc7182090e\") " pod="openshift-ingress-canary/ingress-canary-5c7s2"
Jul 24 14:56:43.611193 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.611171    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w65dp\" (UniqueName: \"kubernetes.io/projected/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-kube-api-access-w65dp\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:43.678639 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.678602    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5c7s2"
Jul 24 14:56:43.872028 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.871722    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5c7s2"]
Jul 24 14:56:43.875324 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:43.875275    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda214c28f_faf2_4a9c_b631_84bc7182090e.slice/crio-2d423867498101fd462eda6cea8a69791abb4e0dfbffd1ef9f86482e5d8822cf WatchSource:0}: Error finding container 2d423867498101fd462eda6cea8a69791abb4e0dfbffd1ef9f86482e5d8822cf: Status 404 returned error can't find the container with id 2d423867498101fd462eda6cea8a69791abb4e0dfbffd1ef9f86482e5d8822cf
Jul 24 14:56:43.990723 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.990682    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:43.993579 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:43.993556    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 14:56:44.002202 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:44.002169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:44.002346 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:44.002332    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 14:56:44.002392 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:44.002349    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788b9c9975-mlbqd: secret "image-registry-tls" not found
Jul 24 14:56:44.002433 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:44.002416    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls podName:9136e2a6-49bf-459c-8435-329dfb7817e5 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:45.002387787 +0000 UTC m=+33.541367178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls") pod "image-registry-788b9c9975-mlbqd" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5") : secret "image-registry-tls" not found
Jul 24 14:56:44.103489 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:44.103456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:44.103686 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:44.103610    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 14:56:44.103686 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:44.103675    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls podName:4df14a47-9e83-4ac2-9e20-a0687dbe3e23 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:45.103661597 +0000 UTC m=+33.642641009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls") pod "dns-default-pjnb6" (UID: "4df14a47-9e83-4ac2-9e20-a0687dbe3e23") : secret "dns-default-metrics-tls" not found
Jul 24 14:56:44.228640 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:44.228601    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5c7s2" event={"ID":"a214c28f-faf2-4a9c-b631-84bc7182090e","Type":"ContainerStarted","Data":"2d423867498101fd462eda6cea8a69791abb4e0dfbffd1ef9f86482e5d8822cf"}
Jul 24 14:56:44.990295 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:44.990248    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:44.990878 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:44.990719    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:44.995322 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:44.994974    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j76t9\""
Jul 24 14:56:44.995322 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:44.995084    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 14:56:44.995322 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:44.994974    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 14:56:44.995322 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:44.995211    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 14:56:44.995643 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:44.995481    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5tbx2\""
Jul 24 14:56:45.011887 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:45.011854    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:45.012080 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:45.012038    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 14:56:45.012080 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:45.012057    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788b9c9975-mlbqd: secret "image-registry-tls" not found
Jul 24 14:56:45.012207 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:45.012126    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls podName:9136e2a6-49bf-459c-8435-329dfb7817e5 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:47.012104637 +0000 UTC m=+35.551084029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls") pod "image-registry-788b9c9975-mlbqd" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5") : secret "image-registry-tls" not found
Jul 24 14:56:45.113245 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:45.113210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:45.113563 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:45.113388    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 14:56:45.113563 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:45.113455    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls podName:4df14a47-9e83-4ac2-9e20-a0687dbe3e23 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:47.113436657 +0000 UTC m=+35.652416074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls") pod "dns-default-pjnb6" (UID: "4df14a47-9e83-4ac2-9e20-a0687dbe3e23") : secret "dns-default-metrics-tls" not found
Jul 24 14:56:45.716383 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:45.716324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:56:45.716704 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:45.716414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:45.716704 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:45.716494    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 14:56:45.716704 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:45.716556    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs podName:f573763f-5ff2-443d-9579-5d12994e4102 nodeName:}" failed. No retries permitted until 2026-07-24 14:57:17.716541656 +0000 UTC m=+66.255521047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs") pod "network-metrics-daemon-7rgzv" (UID: "f573763f-5ff2-443d-9579-5d12994e4102") : secret "metrics-daemon-secret" not found
Jul 24 14:56:45.725611 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:45.725584    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87446c40-4dc9-42d2-a645-d9ecb5f7696e-original-pull-secret\") pod \"global-pull-secret-syncer-wq2p6\" (UID: \"87446c40-4dc9-42d2-a645-d9ecb5f7696e\") " pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:45.802763 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:45.802725    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq2p6"
Jul 24 14:56:45.817189 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:45.817140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4f8\" (UniqueName: \"kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8\") pod \"network-check-target-vp7sh\" (UID: \"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a\") " pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:45.820166 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:45.820134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv4f8\" (UniqueName: \"kubernetes.io/projected/c71b3b5f-caa3-4d88-b280-17d8c7d9c14a-kube-api-access-dv4f8\") pod \"network-check-target-vp7sh\" (UID: \"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a\") " pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:45.912758 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:45.912705    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:47.029601 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:47.029556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:47.030038 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:47.029730    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 14:56:47.030038 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:47.029757    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788b9c9975-mlbqd: secret "image-registry-tls" not found
Jul 24 14:56:47.030038 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:47.029833    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls podName:9136e2a6-49bf-459c-8435-329dfb7817e5 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:51.029814839 +0000 UTC m=+39.568794233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls") pod "image-registry-788b9c9975-mlbqd" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5") : secret "image-registry-tls" not found
Jul 24 14:56:47.130520 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:47.130471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:47.130693 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:47.130598    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 14:56:47.130693 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:47.130666    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls podName:4df14a47-9e83-4ac2-9e20-a0687dbe3e23 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:51.1306465 +0000 UTC m=+39.669625893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls") pod "dns-default-pjnb6" (UID: "4df14a47-9e83-4ac2-9e20-a0687dbe3e23") : secret "dns-default-metrics-tls" not found
Jul 24 14:56:47.817242 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:47.817208    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wq2p6"]
Jul 24 14:56:47.820959 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:47.820918    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87446c40_4dc9_42d2_a645_d9ecb5f7696e.slice/crio-5f88fd1bc4c0191b155db35a3916f9d5a4550f96521fa725c7425b70facdeda8 WatchSource:0}: Error finding container 5f88fd1bc4c0191b155db35a3916f9d5a4550f96521fa725c7425b70facdeda8: Status 404 returned error can't find the container with id 5f88fd1bc4c0191b155db35a3916f9d5a4550f96521fa725c7425b70facdeda8
Jul 24 14:56:47.839264 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:47.839239    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vp7sh"]
Jul 24 14:56:47.842943 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:47.842904    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71b3b5f_caa3_4d88_b280_17d8c7d9c14a.slice/crio-66ee4ae15470ff7fecaebf1a3fda19967f012cc83a4060e5298e86a08cfefc9f WatchSource:0}: Error finding container 66ee4ae15470ff7fecaebf1a3fda19967f012cc83a4060e5298e86a08cfefc9f: Status 404 returned error can't find the container with id 66ee4ae15470ff7fecaebf1a3fda19967f012cc83a4060e5298e86a08cfefc9f
Jul 24 14:56:48.240563 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:48.240463    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5c7s2" event={"ID":"a214c28f-faf2-4a9c-b631-84bc7182090e","Type":"ContainerStarted","Data":"f9f9831fb92583e33181ee17b2eff900f40eea805a2e9a5c460c8d0e5c7a7453"}
Jul 24 14:56:48.241764 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:48.241739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vp7sh" event={"ID":"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a","Type":"ContainerStarted","Data":"66ee4ae15470ff7fecaebf1a3fda19967f012cc83a4060e5298e86a08cfefc9f"}
Jul 24 14:56:48.244366 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:48.244343    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7fc088b-d5f9-49d9-a005-ed791c26fe23" containerID="0b6bb133e066e01899889b0108f0a32ba2a8c61e099bc31efb4d84c5536da0e0" exitCode=0
Jul 24 14:56:48.244481 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:48.244416    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gc4d" event={"ID":"e7fc088b-d5f9-49d9-a005-ed791c26fe23","Type":"ContainerDied","Data":"0b6bb133e066e01899889b0108f0a32ba2a8c61e099bc31efb4d84c5536da0e0"}
Jul 24 14:56:48.245598 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:48.245578    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wq2p6" event={"ID":"87446c40-4dc9-42d2-a645-d9ecb5f7696e","Type":"ContainerStarted","Data":"5f88fd1bc4c0191b155db35a3916f9d5a4550f96521fa725c7425b70facdeda8"}
Jul 24 14:56:48.259547 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:48.259467    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5c7s2" podStartSLOduration=1.452172634 podStartE2EDuration="5.259445187s" totalImagesPullingTime="3.807272553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:48.258589933 +0000 UTC m=+36.797569347" watchObservedRunningTime="2026-07-24 14:56:48.259445187 +0000 UTC m=+36.798424601"
Jul 24 14:56:49.253001 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:49.252939    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7fc088b-d5f9-49d9-a005-ed791c26fe23" containerID="32ef973bc5a8a7211cdb43645d94330448d0529b39d0a7ee55ee0315aebdfe7e" exitCode=0
Jul 24 14:56:49.253465 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:49.253110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gc4d" event={"ID":"e7fc088b-d5f9-49d9-a005-ed791c26fe23","Type":"ContainerDied","Data":"32ef973bc5a8a7211cdb43645d94330448d0529b39d0a7ee55ee0315aebdfe7e"}
Jul 24 14:56:50.260479 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:50.260411    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gc4d" event={"ID":"e7fc088b-d5f9-49d9-a005-ed791c26fe23","Type":"ContainerStarted","Data":"7c5911683d3497d316f5fab2866e0b5679e7b707850640210c25baa9da5aae9e"}
Jul 24 14:56:50.287687 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:50.287630    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5gc4d" podStartSLOduration=8.548435628 podStartE2EDuration="38.287613871s" totalImagesPullingTime="29.739178243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:50.28600008 +0000 UTC m=+38.824979503" watchObservedRunningTime="2026-07-24 14:56:50.287613871 +0000 UTC m=+38.826593284"
Jul 24 14:56:51.061783 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:51.061743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:51.061952 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:51.061884    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 14:56:51.061952 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:51.061897    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788b9c9975-mlbqd: secret "image-registry-tls" not found
Jul 24 14:56:51.061952 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:51.061952    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls podName:9136e2a6-49bf-459c-8435-329dfb7817e5 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:59.061936543 +0000 UTC m=+47.600915934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls") pod "image-registry-788b9c9975-mlbqd" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5") : secret "image-registry-tls" not found
Jul 24 14:56:51.162157 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:51.162123    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:51.162327 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:51.162267    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 14:56:51.162372 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:51.162332    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls podName:4df14a47-9e83-4ac2-9e20-a0687dbe3e23 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:59.162314474 +0000 UTC m=+47.701293885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls") pod "dns-default-pjnb6" (UID: "4df14a47-9e83-4ac2-9e20-a0687dbe3e23") : secret "dns-default-metrics-tls" not found
Jul 24 14:56:53.271952 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:53.271911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vp7sh" event={"ID":"c71b3b5f-caa3-4d88-b280-17d8c7d9c14a","Type":"ContainerStarted","Data":"413e7a06a571fa05b0dd4799212833dfa9ad4daf4999b8bcc148ce927fb35ac2"}
Jul 24 14:56:53.272420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:53.272030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:56:53.273461 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:53.273430    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wq2p6" event={"ID":"87446c40-4dc9-42d2-a645-d9ecb5f7696e","Type":"ContainerStarted","Data":"e4c44127c7c894d78799a488c2bc1a847665c1d3b60ea6dc62ed080366405b85"}
Jul 24 14:56:53.288936 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:53.288836    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vp7sh" podStartSLOduration=36.079155452 podStartE2EDuration="41.288819613s" totalImagesPullingTime="5.209664161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:53.28785953 +0000 UTC m=+41.826838941" watchObservedRunningTime="2026-07-24 14:56:53.288819613 +0000 UTC m=+41.827799004"
Jul 24 14:56:53.303457 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:53.303401    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wq2p6" podStartSLOduration=36.060684987 podStartE2EDuration="41.303383177s" totalImagesPullingTime="5.24269819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:53.303076487 +0000 UTC m=+41.842055925" watchObservedRunningTime="2026-07-24 14:56:53.303383177 +0000 UTC m=+41.842362589"
Jul 24 14:56:54.869030 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.868976    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kx928"]
Jul 24 14:56:54.892656 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.892626    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kx928"]
Jul 24 14:56:54.892790 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.892747    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:54.895336 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.895309    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 14:56:54.895499 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.895437    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-psqz4\""
Jul 24 14:56:54.895499 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.895456    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 14:56:54.896346 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.896327    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 14:56:54.896436 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.896369    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 14:56:54.991115 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.991083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:54.991115 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.991127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:54.991361 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.991166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgjsx\" (UniqueName: \"kubernetes.io/projected/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-api-access-fgjsx\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:54.991361 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.991199    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39cfe828-5333-48dd-bc1a-a776139d98aa-crio-socket\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:54.991361 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:54.991221    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39cfe828-5333-48dd-bc1a-a776139d98aa-data-volume\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.091688 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.091647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.091688 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.091688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.091897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.091726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjsx\" (UniqueName: \"kubernetes.io/projected/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-api-access-fgjsx\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.091897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.091761    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39cfe828-5333-48dd-bc1a-a776139d98aa-crio-socket\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.091897 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:55.091776    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 14:56:55.091897 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:55.091828    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 14:56:55.091897 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:55.091858    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm podName:39cfe828-5333-48dd-bc1a-a776139d98aa nodeName:}" failed. No retries permitted until 2026-07-24 14:56:55.591837485 +0000 UTC m=+44.130816878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kx928" (UID: "39cfe828-5333-48dd-bc1a-a776139d98aa") : configmap "kube-rbac-proxy" not found
Jul 24 14:56:55.091897 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:55.091881    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls podName:39cfe828-5333-48dd-bc1a-a776139d98aa nodeName:}" failed. No retries permitted until 2026-07-24 14:56:55.591866745 +0000 UTC m=+44.130846156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kx928" (UID: "39cfe828-5333-48dd-bc1a-a776139d98aa") : secret "insights-runtime-extractor-tls" not found
Jul 24 14:56:55.091897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.091782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39cfe828-5333-48dd-bc1a-a776139d98aa-data-volume\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.092172 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.092046    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39cfe828-5333-48dd-bc1a-a776139d98aa-crio-socket\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.092172 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.092110    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39cfe828-5333-48dd-bc1a-a776139d98aa-data-volume\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.101256 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.101227    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgjsx\" (UniqueName: \"kubernetes.io/projected/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-api-access-fgjsx\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.498805 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.498769    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8"]
Jul 24 14:56:55.500902 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.500883    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8"
Jul 24 14:56:55.503501 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.503482    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-24c28\""
Jul 24 14:56:55.503634 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.503538    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 24 14:56:55.503999 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.503964    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 24 14:56:55.516706 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.516676    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8"]
Jul 24 14:56:55.596412 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.596375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.596412 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.596418    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:55.596655 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.596494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jw97\" (UniqueName: \"kubernetes.io/projected/b28f0838-519d-4130-b8a6-b37cc2e32791-kube-api-access-6jw97\") pod \"migrator-6865c9967-t9kk8\" (UID: \"b28f0838-519d-4130-b8a6-b37cc2e32791\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8"
Jul 24 14:56:55.596655 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:55.596508    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 14:56:55.596655 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:55.596570    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm podName:39cfe828-5333-48dd-bc1a-a776139d98aa nodeName:}" failed. No retries permitted until 2026-07-24 14:56:56.596553825 +0000 UTC m=+45.135533215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kx928" (UID: "39cfe828-5333-48dd-bc1a-a776139d98aa") : configmap "kube-rbac-proxy" not found
Jul 24 14:56:55.596655 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:55.596609    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 14:56:55.596804 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:55.596673    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls podName:39cfe828-5333-48dd-bc1a-a776139d98aa nodeName:}" failed. No retries permitted until 2026-07-24 14:56:56.59665774 +0000 UTC m=+45.135637136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kx928" (UID: "39cfe828-5333-48dd-bc1a-a776139d98aa") : secret "insights-runtime-extractor-tls" not found
Jul 24 14:56:55.697491 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.697449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jw97\" (UniqueName: \"kubernetes.io/projected/b28f0838-519d-4130-b8a6-b37cc2e32791-kube-api-access-6jw97\") pod \"migrator-6865c9967-t9kk8\" (UID: \"b28f0838-519d-4130-b8a6-b37cc2e32791\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8"
Jul 24 14:56:55.710585 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.710552    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jw97\" (UniqueName: \"kubernetes.io/projected/b28f0838-519d-4130-b8a6-b37cc2e32791-kube-api-access-6jw97\") pod \"migrator-6865c9967-t9kk8\" (UID: \"b28f0838-519d-4130-b8a6-b37cc2e32791\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8"
Jul 24 14:56:55.810326 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.810224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8"
Jul 24 14:56:55.942558 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:55.942516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8"]
Jul 24 14:56:55.945305 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:55.945277    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28f0838_519d_4130_b8a6_b37cc2e32791.slice/crio-6a2ec0c0e032d50dada9b595a10d5dd63ab1c959ce120697703b0bf4e61f473c WatchSource:0}: Error finding container 6a2ec0c0e032d50dada9b595a10d5dd63ab1c959ce120697703b0bf4e61f473c: Status 404 returned error can't find the container with id 6a2ec0c0e032d50dada9b595a10d5dd63ab1c959ce120697703b0bf4e61f473c
Jul 24 14:56:56.281103 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.281054    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8" event={"ID":"b28f0838-519d-4130-b8a6-b37cc2e32791","Type":"ContainerStarted","Data":"6a2ec0c0e032d50dada9b595a10d5dd63ab1c959ce120697703b0bf4e61f473c"}
Jul 24 14:56:56.462009 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.461950    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-v6fh9"]
Jul 24 14:56:56.464472 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.464455    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.468149 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.468123    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 24 14:56:56.468285 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.468124    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 24 14:56:56.469268 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.469248    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dz9wk\""
Jul 24 14:56:56.469387 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.469298    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 24 14:56:56.469387 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.469326    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 24 14:56:56.482452 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.482418    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-v6fh9"]
Jul 24 14:56:56.605892 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.605792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:56.605892 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.605834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:56.605892 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.605860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c5ee8b2c-f48a-48eb-a349-d06fc067b20a-signing-cabundle\") pod \"service-ca-658d7b7c78-v6fh9\" (UID: \"c5ee8b2c-f48a-48eb-a349-d06fc067b20a\") " pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.605892 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.605896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c5ee8b2c-f48a-48eb-a349-d06fc067b20a-signing-key\") pod \"service-ca-658d7b7c78-v6fh9\" (UID: \"c5ee8b2c-f48a-48eb-a349-d06fc067b20a\") " pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.606231 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:56.605927    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 14:56:56.606231 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:56.605974    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 14:56:56.606231 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:56.606030    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm podName:39cfe828-5333-48dd-bc1a-a776139d98aa nodeName:}" failed. No retries permitted until 2026-07-24 14:56:58.60601087 +0000 UTC m=+47.144990264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kx928" (UID: "39cfe828-5333-48dd-bc1a-a776139d98aa") : configmap "kube-rbac-proxy" not found
Jul 24 14:56:56.606231 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.606051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptfb5\" (UniqueName: \"kubernetes.io/projected/c5ee8b2c-f48a-48eb-a349-d06fc067b20a-kube-api-access-ptfb5\") pod \"service-ca-658d7b7c78-v6fh9\" (UID: \"c5ee8b2c-f48a-48eb-a349-d06fc067b20a\") " pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.606231 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:56.606065    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls podName:39cfe828-5333-48dd-bc1a-a776139d98aa nodeName:}" failed. No retries permitted until 2026-07-24 14:56:58.606048377 +0000 UTC m=+47.145027806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kx928" (UID: "39cfe828-5333-48dd-bc1a-a776139d98aa") : secret "insights-runtime-extractor-tls" not found
Jul 24 14:56:56.645028 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.645002    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xcg42_b8ada920-febe-4ebd-a2a0-37bd8ab680b2/dns-node-resolver/0.log"
Jul 24 14:56:56.706601 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.706567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c5ee8b2c-f48a-48eb-a349-d06fc067b20a-signing-key\") pod \"service-ca-658d7b7c78-v6fh9\" (UID: \"c5ee8b2c-f48a-48eb-a349-d06fc067b20a\") " pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.706808 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.706639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptfb5\" (UniqueName: \"kubernetes.io/projected/c5ee8b2c-f48a-48eb-a349-d06fc067b20a-kube-api-access-ptfb5\") pod \"service-ca-658d7b7c78-v6fh9\" (UID: \"c5ee8b2c-f48a-48eb-a349-d06fc067b20a\") " pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.706808 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.706711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c5ee8b2c-f48a-48eb-a349-d06fc067b20a-signing-cabundle\") pod \"service-ca-658d7b7c78-v6fh9\" (UID: \"c5ee8b2c-f48a-48eb-a349-d06fc067b20a\") " pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.707478 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.707451    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c5ee8b2c-f48a-48eb-a349-d06fc067b20a-signing-cabundle\") pod \"service-ca-658d7b7c78-v6fh9\" (UID: \"c5ee8b2c-f48a-48eb-a349-d06fc067b20a\") " pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.709694 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.709670    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c5ee8b2c-f48a-48eb-a349-d06fc067b20a-signing-key\") pod \"service-ca-658d7b7c78-v6fh9\" (UID: \"c5ee8b2c-f48a-48eb-a349-d06fc067b20a\") " pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.717031 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.716976    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptfb5\" (UniqueName: \"kubernetes.io/projected/c5ee8b2c-f48a-48eb-a349-d06fc067b20a-kube-api-access-ptfb5\") pod \"service-ca-658d7b7c78-v6fh9\" (UID: \"c5ee8b2c-f48a-48eb-a349-d06fc067b20a\") " pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.773931 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.773894    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9"
Jul 24 14:56:56.938360 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:56.938327    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-v6fh9"]
Jul 24 14:56:56.942102 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:56:56.942070    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ee8b2c_f48a_48eb_a349_d06fc067b20a.slice/crio-7937bdd408f4263745fd18f02ce7e223ee27f7e102863e80c3ee9d4a4adcc1e1 WatchSource:0}: Error finding container 7937bdd408f4263745fd18f02ce7e223ee27f7e102863e80c3ee9d4a4adcc1e1: Status 404 returned error can't find the container with id 7937bdd408f4263745fd18f02ce7e223ee27f7e102863e80c3ee9d4a4adcc1e1
Jul 24 14:56:57.242907 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:57.242883    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fsl22_130b3016-7f8a-4094-a80a-f613ffaaace8/node-ca/0.log"
Jul 24 14:56:57.284460 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:57.284434    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9" event={"ID":"c5ee8b2c-f48a-48eb-a349-d06fc067b20a","Type":"ContainerStarted","Data":"7937bdd408f4263745fd18f02ce7e223ee27f7e102863e80c3ee9d4a4adcc1e1"}
Jul 24 14:56:58.042505 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:58.042471    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5c7s2_a214c28f-faf2-4a9c-b631-84bc7182090e/serve-healthcheck-canary/0.log"
Jul 24 14:56:58.289807 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:58.289774    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8" event={"ID":"b28f0838-519d-4130-b8a6-b37cc2e32791","Type":"ContainerStarted","Data":"c91ae5c25d1bd97ba5c237884efdd3af977676bc9b5b07db818e0c419bbcb900"}
Jul 24 14:56:58.290197 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:58.289824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8" event={"ID":"b28f0838-519d-4130-b8a6-b37cc2e32791","Type":"ContainerStarted","Data":"c55347f08647d57c32d318be7d8b5df0e70c3dc73503c6eef30a9a88a31dc41f"}
Jul 24 14:56:58.312150 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:58.312043    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t9kk8" podStartSLOduration=1.99295874 podStartE2EDuration="3.312023919s" totalImagesPullingTime="1.319065179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:58.309253367 +0000 UTC m=+46.848232779" watchObservedRunningTime="2026-07-24 14:56:58.312023919 +0000 UTC m=+46.851003311"
Jul 24 14:56:58.625282 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:58.625188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:58.625282 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:58.625240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:56:58.625501 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:58.625308    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 14:56:58.625501 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:58.625356    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 14:56:58.625501 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:58.625390    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm podName:39cfe828-5333-48dd-bc1a-a776139d98aa nodeName:}" failed. No retries permitted until 2026-07-24 14:57:02.625371513 +0000 UTC m=+51.164350908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kx928" (UID: "39cfe828-5333-48dd-bc1a-a776139d98aa") : configmap "kube-rbac-proxy" not found
Jul 24 14:56:58.625501 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:58.625415    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls podName:39cfe828-5333-48dd-bc1a-a776139d98aa nodeName:}" failed. No retries permitted until 2026-07-24 14:57:02.625398929 +0000 UTC m=+51.164378320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kx928" (UID: "39cfe828-5333-48dd-bc1a-a776139d98aa") : secret "insights-runtime-extractor-tls" not found
Jul 24 14:56:59.129752 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:59.129704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:56:59.129931 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:59.129862    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 14:56:59.129931 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:59.129882    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788b9c9975-mlbqd: secret "image-registry-tls" not found
Jul 24 14:56:59.130039 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:59.129937    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls podName:9136e2a6-49bf-459c-8435-329dfb7817e5 nodeName:}" failed. No retries permitted until 2026-07-24 14:57:15.129920895 +0000 UTC m=+63.668900289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls") pod "image-registry-788b9c9975-mlbqd" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5") : secret "image-registry-tls" not found
Jul 24 14:56:59.230661 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:56:59.230620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:56:59.230824 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:59.230749    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 14:56:59.230824 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:56:59.230801    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls podName:4df14a47-9e83-4ac2-9e20-a0687dbe3e23 nodeName:}" failed. No retries permitted until 2026-07-24 14:57:15.230788301 +0000 UTC m=+63.769767696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls") pod "dns-default-pjnb6" (UID: "4df14a47-9e83-4ac2-9e20-a0687dbe3e23") : secret "dns-default-metrics-tls" not found
Jul 24 14:57:00.297703 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:00.297647    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9" event={"ID":"c5ee8b2c-f48a-48eb-a349-d06fc067b20a","Type":"ContainerStarted","Data":"7c92ac7cf7ff105f4c5f0da59e5c54dc81d3190e2f3eb2ed47286d896fd13386"}
Jul 24 14:57:02.659608 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:02.659563    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:57:02.660024 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:02.659619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:57:02.660024 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:02.659768    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 14:57:02.660024 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:02.659830    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls podName:39cfe828-5333-48dd-bc1a-a776139d98aa nodeName:}" failed. No retries permitted until 2026-07-24 14:57:10.659810661 +0000 UTC m=+59.198790058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kx928" (UID: "39cfe828-5333-48dd-bc1a-a776139d98aa") : secret "insights-runtime-extractor-tls" not found
Jul 24 14:57:02.660731 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:02.660706    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39cfe828-5333-48dd-bc1a-a776139d98aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:57:09.218651 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:09.218625    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2lgp"
Jul 24 14:57:09.249477 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:09.249418    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-v6fh9" podStartSLOduration=10.709533994 podStartE2EDuration="13.24939804s" totalImagesPullingTime="2.539864046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:00.319274126 +0000 UTC m=+48.858253539" watchObservedRunningTime="2026-07-24 14:57:09.24939804 +0000 UTC m=+57.788377453"
Jul 24 14:57:10.712135 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:10.712096    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:57:10.714692 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:10.714667    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39cfe828-5333-48dd-bc1a-a776139d98aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx928\" (UID: \"39cfe828-5333-48dd-bc1a-a776139d98aa\") " pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:57:10.801639 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:10.801584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kx928"
Jul 24 14:57:10.931439 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:10.931402    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kx928"]
Jul 24 14:57:10.934196 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:10.934169    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39cfe828_5333_48dd_bc1a_a776139d98aa.slice/crio-024a4c5aa3a95f9b307951c53525bbacb54ea161b78884995ab46f720a0a1c28 WatchSource:0}: Error finding container 024a4c5aa3a95f9b307951c53525bbacb54ea161b78884995ab46f720a0a1c28: Status 404 returned error can't find the container with id 024a4c5aa3a95f9b307951c53525bbacb54ea161b78884995ab46f720a0a1c28
Jul 24 14:57:11.334376 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:11.334332    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kx928" event={"ID":"39cfe828-5333-48dd-bc1a-a776139d98aa","Type":"ContainerStarted","Data":"024a4c5aa3a95f9b307951c53525bbacb54ea161b78884995ab46f720a0a1c28"}
Jul 24 14:57:15.145767 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:15.145724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:57:15.148161 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:15.148136    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") pod \"image-registry-788b9c9975-mlbqd\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") " pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:57:15.246694 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:15.246658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:57:15.249202 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:15.249172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df14a47-9e83-4ac2-9e20-a0687dbe3e23-metrics-tls\") pod \"dns-default-pjnb6\" (UID: \"4df14a47-9e83-4ac2-9e20-a0687dbe3e23\") " pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:57:15.445199 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:15.445111    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-czcf5\""
Jul 24 14:57:15.452791 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:15.452752    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:57:15.491363 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:15.491335    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bc4wp\""
Jul 24 14:57:15.498614 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:15.498585    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:57:16.079995 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:16.079947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pjnb6"]
Jul 24 14:57:16.084755 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:16.084720    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df14a47_9e83_4ac2_9e20_a0687dbe3e23.slice/crio-cd31240ead3600d89599da8d541b0aa7805702e516acc70a90cae1f35130a366 WatchSource:0}: Error finding container cd31240ead3600d89599da8d541b0aa7805702e516acc70a90cae1f35130a366: Status 404 returned error can't find the container with id cd31240ead3600d89599da8d541b0aa7805702e516acc70a90cae1f35130a366
Jul 24 14:57:16.096244 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:16.096209    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-788b9c9975-mlbqd"]
Jul 24 14:57:16.099641 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:16.099581    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9136e2a6_49bf_459c_8435_329dfb7817e5.slice/crio-66ea2db9156e2a92d87c36b6472a274bef70409ceb3b7c97b98c9eb7df874a6c WatchSource:0}: Error finding container 66ea2db9156e2a92d87c36b6472a274bef70409ceb3b7c97b98c9eb7df874a6c: Status 404 returned error can't find the container with id 66ea2db9156e2a92d87c36b6472a274bef70409ceb3b7c97b98c9eb7df874a6c
Jul 24 14:57:16.353659 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:16.353552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd" event={"ID":"9136e2a6-49bf-459c-8435-329dfb7817e5","Type":"ContainerStarted","Data":"06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852"}
Jul 24 14:57:16.353659 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:16.353616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd" event={"ID":"9136e2a6-49bf-459c-8435-329dfb7817e5","Type":"ContainerStarted","Data":"66ea2db9156e2a92d87c36b6472a274bef70409ceb3b7c97b98c9eb7df874a6c"}
Jul 24 14:57:16.353659 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:16.353645    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:57:16.355415 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:16.355387    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kx928" event={"ID":"39cfe828-5333-48dd-bc1a-a776139d98aa","Type":"ContainerStarted","Data":"40481f16119d326ebdc5d96ffebc01c0e395fd1961b89319ca3bb4e6c66d291e"}
Jul 24 14:57:16.356583 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:16.356561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjnb6" event={"ID":"4df14a47-9e83-4ac2-9e20-a0687dbe3e23","Type":"ContainerStarted","Data":"cd31240ead3600d89599da8d541b0aa7805702e516acc70a90cae1f35130a366"}
Jul 24 14:57:16.373463 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:16.373399    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd" podStartSLOduration=53.373380156 podStartE2EDuration="53.373380156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:16.37233125 +0000 UTC m=+64.911310675" watchObservedRunningTime="2026-07-24 14:57:16.373380156 +0000 UTC m=+64.912359568"
Jul 24 14:57:17.767707 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:17.767655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:57:17.770393 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:17.770362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f573763f-5ff2-443d-9579-5d12994e4102-metrics-certs\") pod \"network-metrics-daemon-7rgzv\" (UID: \"f573763f-5ff2-443d-9579-5d12994e4102\") " pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:57:18.008790 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:18.008761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5tbx2\""
Jul 24 14:57:18.017229 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:18.016963    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rgzv"
Jul 24 14:57:19.927920 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:19.927891    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7rgzv"]
Jul 24 14:57:19.931274 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:19.931150    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf573763f_5ff2_443d_9579_5d12994e4102.slice/crio-f98e489cc60a202d15ab046da3f6780c53e389f5c6166e77faddaa55873d2329 WatchSource:0}: Error finding container f98e489cc60a202d15ab046da3f6780c53e389f5c6166e77faddaa55873d2329: Status 404 returned error can't find the container with id f98e489cc60a202d15ab046da3f6780c53e389f5c6166e77faddaa55873d2329
Jul 24 14:57:20.299944 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.299907    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-788b9c9975-mlbqd"]
Jul 24 14:57:20.333813 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.333779    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"]
Jul 24 14:57:20.336167 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.336142    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:20.343779 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:20.343742    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-232.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-129-232.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 24 14:57:20.343934 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:20.343816    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"work-manager-hub-kubeconfig\" is forbidden: User \"system:node:ip-10-0-129-232.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-129-232.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" type="*v1.Secret"
Jul 24 14:57:20.343934 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:20.343824    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"open-cluster-management-image-pull-credentials\" is forbidden: User \"system:node:ip-10-0-129-232.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-129-232.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret"
Jul 24 14:57:20.343934 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.343861    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 14:57:20.376700 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.376663    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"]
Jul 24 14:57:20.378225 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.378195    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kx928" event={"ID":"39cfe828-5333-48dd-bc1a-a776139d98aa","Type":"ContainerStarted","Data":"a594f4d5d395360d1c57953c83a2ad00312e2157f2b5b8fa343ea68c8a8da310"}
Jul 24 14:57:20.381273 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.381242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjnb6" event={"ID":"4df14a47-9e83-4ac2-9e20-a0687dbe3e23","Type":"ContainerStarted","Data":"a49cb8ccc5f53db6de17d6f56847312ce6118541db1be5d9df132d9b7293a00f"}
Jul 24 14:57:20.381422 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.381302    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjnb6" event={"ID":"4df14a47-9e83-4ac2-9e20-a0687dbe3e23","Type":"ContainerStarted","Data":"00177816e842a8401b2c310ea922965be3dd8f75d9f78513a194f93eaba3de96"}
Jul 24 14:57:20.381422 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.381356    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:57:20.382470 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.382445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rgzv" event={"ID":"f573763f-5ff2-443d-9579-5d12994e4102","Type":"ContainerStarted","Data":"f98e489cc60a202d15ab046da3f6780c53e389f5c6166e77faddaa55873d2329"}
Jul 24 14:57:20.386779 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.386755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ef769d41-e70a-4cf0-8395-6375408e0127-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:20.386886 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.386791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef769d41-e70a-4cf0-8395-6375408e0127-tmp\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:20.386886 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.386818    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czvn7\" (UniqueName: \"kubernetes.io/projected/ef769d41-e70a-4cf0-8395-6375408e0127-kube-api-access-czvn7\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:20.465733 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.465701    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"]
Jul 24 14:57:20.472648 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.472627    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.480402 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.480349    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pjnb6" podStartSLOduration=33.779774089 podStartE2EDuration="37.48033217s" totalImagesPullingTime="3.700558081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:20.479446177 +0000 UTC m=+69.018425612" watchObservedRunningTime="2026-07-24 14:57:20.48033217 +0000 UTC m=+69.019311582"
Jul 24 14:57:20.487231 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef769d41-e70a-4cf0-8395-6375408e0127-tmp\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:20.487332 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58cff78f-7b4a-4f67-8899-9aad4b131391-ca-trust-extracted\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.487405 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58cff78f-7b4a-4f67-8899-9aad4b131391-image-registry-private-configuration\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.487453 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487413    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58cff78f-7b4a-4f67-8899-9aad4b131391-registry-tls\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.487495 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58cff78f-7b4a-4f67-8899-9aad4b131391-trusted-ca\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.487495 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58cff78f-7b4a-4f67-8899-9aad4b131391-installation-pull-secrets\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.487600 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czvn7\" (UniqueName: \"kubernetes.io/projected/ef769d41-e70a-4cf0-8395-6375408e0127-kube-api-access-czvn7\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:20.487600 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58cff78f-7b4a-4f67-8899-9aad4b131391-bound-sa-token\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.487714 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487597    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef769d41-e70a-4cf0-8395-6375408e0127-tmp\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:20.487714 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487652    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ef769d41-e70a-4cf0-8395-6375408e0127-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:20.487714 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58cff78f-7b4a-4f67-8899-9aad4b131391-registry-certificates\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.487851 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.487725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bczl\" (UniqueName: \"kubernetes.io/projected/58cff78f-7b4a-4f67-8899-9aad4b131391-kube-api-access-2bczl\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.518185 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.518154    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"]
Jul 24 14:57:20.588216 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.588115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58cff78f-7b4a-4f67-8899-9aad4b131391-registry-certificates\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.588216 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.588164    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bczl\" (UniqueName: \"kubernetes.io/projected/58cff78f-7b4a-4f67-8899-9aad4b131391-kube-api-access-2bczl\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.588216 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.588206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58cff78f-7b4a-4f67-8899-9aad4b131391-ca-trust-extracted\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.588532 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.588235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58cff78f-7b4a-4f67-8899-9aad4b131391-image-registry-private-configuration\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.588532 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.588270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58cff78f-7b4a-4f67-8899-9aad4b131391-registry-tls\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.588532 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.588300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58cff78f-7b4a-4f67-8899-9aad4b131391-trusted-ca\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.588532 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.588324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58cff78f-7b4a-4f67-8899-9aad4b131391-installation-pull-secrets\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.588532 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.588360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58cff78f-7b4a-4f67-8899-9aad4b131391-bound-sa-token\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.589017 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.588970    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58cff78f-7b4a-4f67-8899-9aad4b131391-registry-certificates\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.589218 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.589188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58cff78f-7b4a-4f67-8899-9aad4b131391-ca-trust-extracted\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.590011 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.589976    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58cff78f-7b4a-4f67-8899-9aad4b131391-trusted-ca\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.592260 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.592215    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58cff78f-7b4a-4f67-8899-9aad4b131391-image-registry-private-configuration\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.592379 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.592270    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58cff78f-7b4a-4f67-8899-9aad4b131391-installation-pull-secrets\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.593370 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.593345    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58cff78f-7b4a-4f67-8899-9aad4b131391-registry-tls\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.607116 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.607083    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bczl\" (UniqueName: \"kubernetes.io/projected/58cff78f-7b4a-4f67-8899-9aad4b131391-kube-api-access-2bczl\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.607968 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.607943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58cff78f-7b4a-4f67-8899-9aad4b131391-bound-sa-token\") pod \"image-registry-7c7fbf7fd4-66j6w\" (UID: \"58cff78f-7b4a-4f67-8899-9aad4b131391\") " pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.782200 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.782167    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:20.949794 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:20.949679    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"]
Jul 24 14:57:21.165477 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:21.165429    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cff78f_7b4a_4f67_8899_9aad4b131391.slice/crio-dd45ecddd07f1af998a761b1dc3194b532d9ec0665e02476089b9296abd14bfd WatchSource:0}: Error finding container dd45ecddd07f1af998a761b1dc3194b532d9ec0665e02476089b9296abd14bfd: Status 404 returned error can't find the container with id dd45ecddd07f1af998a761b1dc3194b532d9ec0665e02476089b9296abd14bfd
Jul 24 14:57:21.387622 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:21.387476    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w" event={"ID":"58cff78f-7b4a-4f67-8899-9aad4b131391","Type":"ContainerStarted","Data":"7e8f7447d227c6a429ea780f6f49b33f5bb0c2a3317dd50a9088bb8bc99ee6f0"}
Jul 24 14:57:21.387622 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:21.387563    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:21.387622 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:21.387583    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w" event={"ID":"58cff78f-7b4a-4f67-8899-9aad4b131391","Type":"ContainerStarted","Data":"dd45ecddd07f1af998a761b1dc3194b532d9ec0665e02476089b9296abd14bfd"}
Jul 24 14:57:21.408024 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:21.407934    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w" podStartSLOduration=1.407911341 podStartE2EDuration="1.407911341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:21.40628298 +0000 UTC m=+69.945262413" watchObservedRunningTime="2026-07-24 14:57:21.407911341 +0000 UTC m=+69.946890752"
Jul 24 14:57:21.488016 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:21.487922    2582 secret.go:189] Couldn't get secret open-cluster-management-agent-addon/work-manager-hub-kubeconfig: failed to sync secret cache: timed out waiting for the condition
Jul 24 14:57:21.488159 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:21.488040    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef769d41-e70a-4cf0-8395-6375408e0127-klusterlet-config podName:ef769d41-e70a-4cf0-8395-6375408e0127 nodeName:}" failed. No retries permitted until 2026-07-24 14:57:21.988014847 +0000 UTC m=+70.526994253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "klusterlet-config" (UniqueName: "kubernetes.io/secret/ef769d41-e70a-4cf0-8395-6375408e0127-klusterlet-config") pod "klusterlet-addon-workmgr-dd787dcdb-zrs4g" (UID: "ef769d41-e70a-4cf0-8395-6375408e0127") : failed to sync secret cache: timed out waiting for the condition
Jul 24 14:57:21.504585 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:21.504550    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 24 14:57:21.506583 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:21.506529    2582 projected.go:291] Couldn't get configMap open-cluster-management-agent-addon/openshift-service-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:57:21.506583 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:21.506554    2582 projected.go:196] Error preparing data for projected volume kube-api-access-czvn7 for pod open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g: failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:57:21.506783 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:21.506619    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef769d41-e70a-4cf0-8395-6375408e0127-kube-api-access-czvn7 podName:ef769d41-e70a-4cf0-8395-6375408e0127 nodeName:}" failed. No retries permitted until 2026-07-24 14:57:22.006598561 +0000 UTC m=+70.545577971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-czvn7" (UniqueName: "kubernetes.io/projected/ef769d41-e70a-4cf0-8395-6375408e0127-kube-api-access-czvn7") pod "klusterlet-addon-workmgr-dd787dcdb-zrs4g" (UID: "ef769d41-e70a-4cf0-8395-6375408e0127") : failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:57:21.682675 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:21.682647    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 14:57:21.836741 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:21.836711    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 14:57:22.001375 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:22.001281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ef769d41-e70a-4cf0-8395-6375408e0127-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:22.004954 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:22.004333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ef769d41-e70a-4cf0-8395-6375408e0127-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:22.102626 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:22.102589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czvn7\" (UniqueName: \"kubernetes.io/projected/ef769d41-e70a-4cf0-8395-6375408e0127-kube-api-access-czvn7\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:22.105651 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:22.105626    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czvn7\" (UniqueName: \"kubernetes.io/projected/ef769d41-e70a-4cf0-8395-6375408e0127-kube-api-access-czvn7\") pod \"klusterlet-addon-workmgr-dd787dcdb-zrs4g\" (UID: \"ef769d41-e70a-4cf0-8395-6375408e0127\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:22.145488 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:22.145445    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:22.318476 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:22.318438    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"]
Jul 24 14:57:22.322429 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:22.322399    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef769d41_e70a_4cf0_8395_6375408e0127.slice/crio-48912f2edf288970af2abdf2e40a60458c4a843e29569d3c486529e4acfcbf93 WatchSource:0}: Error finding container 48912f2edf288970af2abdf2e40a60458c4a843e29569d3c486529e4acfcbf93: Status 404 returned error can't find the container with id 48912f2edf288970af2abdf2e40a60458c4a843e29569d3c486529e4acfcbf93
Jul 24 14:57:22.393198 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:22.392912    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g" event={"ID":"ef769d41-e70a-4cf0-8395-6375408e0127","Type":"ContainerStarted","Data":"48912f2edf288970af2abdf2e40a60458c4a843e29569d3c486529e4acfcbf93"}
Jul 24 14:57:22.395198 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:22.395168    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rgzv" event={"ID":"f573763f-5ff2-443d-9579-5d12994e4102","Type":"ContainerStarted","Data":"f9e5e454ac5dd0661256674ecfe886c45550e434e89724594cd74782d9287c2c"}
Jul 24 14:57:22.395352 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:22.395221    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rgzv" event={"ID":"f573763f-5ff2-443d-9579-5d12994e4102","Type":"ContainerStarted","Data":"830673a5eadf7b010c8448b1478c6f21a1900f7be7437a30e05878065ea3b3f0"}
Jul 24 14:57:22.412785 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:22.412727    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7rgzv" podStartSLOduration=68.792078439 podStartE2EDuration="1m10.412706746s" totalImagesPullingTime="1.620628307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:22.41183116 +0000 UTC m=+70.950810574" watchObservedRunningTime="2026-07-24 14:57:22.412706746 +0000 UTC m=+70.951686158"
Jul 24 14:57:24.279124 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:24.279090    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vp7sh"
Jul 24 14:57:25.301521 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.301480    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-82sf6"]
Jul 24 14:57:25.312213 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.312183    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-82sf6"
Jul 24 14:57:25.315400 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.315379    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 14:57:25.315807 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.315684    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 14:57:25.315807 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.315684    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qvx49\""
Jul 24 14:57:25.326871 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.326844    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-82sf6"]
Jul 24 14:57:25.410202 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.410166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kx928" event={"ID":"39cfe828-5333-48dd-bc1a-a776139d98aa","Type":"ContainerStarted","Data":"3b2505f27fb54a080216e307fce23ef35d8f9dea866c8130e2933611bce507b4"}
Jul 24 14:57:25.430860 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.430803    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kx928" podStartSLOduration=17.891734834 podStartE2EDuration="31.430785184s" totalImagesPullingTime="13.53905035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:56:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:25.429916472 +0000 UTC m=+73.968895888" watchObservedRunningTime="2026-07-24 14:57:25.430785184 +0000 UTC m=+73.969764597"
Jul 24 14:57:25.432290 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.432205    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddpsh\" (UniqueName: \"kubernetes.io/projected/f60f52f9-ee88-4cc3-a632-3407d2cdc12e-kube-api-access-ddpsh\") pod \"downloads-7c97dc4555-82sf6\" (UID: \"f60f52f9-ee88-4cc3-a632-3407d2cdc12e\") " pod="openshift-console/downloads-7c97dc4555-82sf6"
Jul 24 14:57:25.533477 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.533442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddpsh\" (UniqueName: \"kubernetes.io/projected/f60f52f9-ee88-4cc3-a632-3407d2cdc12e-kube-api-access-ddpsh\") pod \"downloads-7c97dc4555-82sf6\" (UID: \"f60f52f9-ee88-4cc3-a632-3407d2cdc12e\") " pod="openshift-console/downloads-7c97dc4555-82sf6"
Jul 24 14:57:25.543316 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.543284    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddpsh\" (UniqueName: \"kubernetes.io/projected/f60f52f9-ee88-4cc3-a632-3407d2cdc12e-kube-api-access-ddpsh\") pod \"downloads-7c97dc4555-82sf6\" (UID: \"f60f52f9-ee88-4cc3-a632-3407d2cdc12e\") " pod="openshift-console/downloads-7c97dc4555-82sf6"
Jul 24 14:57:25.623814 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:25.623733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-82sf6"
Jul 24 14:57:26.453421 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:26.453394    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-82sf6"]
Jul 24 14:57:26.455499 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:26.455469    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60f52f9_ee88_4cc3_a632_3407d2cdc12e.slice/crio-8157d0c75b9ddd49e7f4e7223c2807e7a6fe39c4f65a3477de00773b87ca811d WatchSource:0}: Error finding container 8157d0c75b9ddd49e7f4e7223c2807e7a6fe39c4f65a3477de00773b87ca811d: Status 404 returned error can't find the container with id 8157d0c75b9ddd49e7f4e7223c2807e7a6fe39c4f65a3477de00773b87ca811d
Jul 24 14:57:27.419725 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:27.419690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-82sf6" event={"ID":"f60f52f9-ee88-4cc3-a632-3407d2cdc12e","Type":"ContainerStarted","Data":"8157d0c75b9ddd49e7f4e7223c2807e7a6fe39c4f65a3477de00773b87ca811d"}
Jul 24 14:57:29.429683 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:29.429636    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g" event={"ID":"ef769d41-e70a-4cf0-8395-6375408e0127","Type":"ContainerStarted","Data":"a73c8d6f77f7c9c10b6764647f965a9137460b09b6bab070af1ef70a77d703de"}
Jul 24 14:57:29.430177 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:29.429872    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:29.431993 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:29.431958    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g"
Jul 24 14:57:29.455957 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:29.455895    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd787dcdb-zrs4g" podStartSLOduration=3.355921206 podStartE2EDuration="9.45587761s" totalImagesPullingTime="6.099956404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:57:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:29.455319629 +0000 UTC m=+77.994299043" watchObservedRunningTime="2026-07-24 14:57:29.45587761 +0000 UTC m=+77.994857022"
Jul 24 14:57:30.390057 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:30.390026    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pjnb6"
Jul 24 14:57:31.853202 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.853164    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"]
Jul 24 14:57:31.860530 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.860495    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:31.863439 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.863410    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 14:57:31.864600 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.864578    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 24 14:57:31.864600 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.864550    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 24 14:57:31.864854 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.864841    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 14:57:31.864897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.864860    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mbw5c\""
Jul 24 14:57:31.864897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.864843    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 14:57:31.867666 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.867593    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"]
Jul 24 14:57:31.987336 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.987297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b74cf44f-6ca3-4948-b50b-56e5e1649c84-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:31.987501 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.987356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b74cf44f-6ca3-4948-b50b-56e5e1649c84-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:31.987501 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.987452    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl2ww\" (UniqueName: \"kubernetes.io/projected/b74cf44f-6ca3-4948-b50b-56e5e1649c84-kube-api-access-vl2ww\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:31.987501 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:31.987484    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b74cf44f-6ca3-4948-b50b-56e5e1649c84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.089832 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.089395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b74cf44f-6ca3-4948-b50b-56e5e1649c84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.089832 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.089461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b74cf44f-6ca3-4948-b50b-56e5e1649c84-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.089832 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.089500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b74cf44f-6ca3-4948-b50b-56e5e1649c84-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.089832 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.089559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl2ww\" (UniqueName: \"kubernetes.io/projected/b74cf44f-6ca3-4948-b50b-56e5e1649c84-kube-api-access-vl2ww\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.089832 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:32.089604    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 24 14:57:32.089832 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:32.089691    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b74cf44f-6ca3-4948-b50b-56e5e1649c84-prometheus-operator-tls podName:b74cf44f-6ca3-4948-b50b-56e5e1649c84 nodeName:}" failed. No retries permitted until 2026-07-24 14:57:32.589667791 +0000 UTC m=+81.128647202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b74cf44f-6ca3-4948-b50b-56e5e1649c84-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-zsbrv" (UID: "b74cf44f-6ca3-4948-b50b-56e5e1649c84") : secret "prometheus-operator-tls" not found
Jul 24 14:57:32.090459 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.090442    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b74cf44f-6ca3-4948-b50b-56e5e1649c84-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.093189 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.093014    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b74cf44f-6ca3-4948-b50b-56e5e1649c84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.101952 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.101925    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl2ww\" (UniqueName: \"kubernetes.io/projected/b74cf44f-6ca3-4948-b50b-56e5e1649c84-kube-api-access-vl2ww\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.594312 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.594267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b74cf44f-6ca3-4948-b50b-56e5e1649c84-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.597217 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.597188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b74cf44f-6ca3-4948-b50b-56e5e1649c84-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zsbrv\" (UID: \"b74cf44f-6ca3-4948-b50b-56e5e1649c84\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.772658 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.772621    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"
Jul 24 14:57:32.930085 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:32.930051    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-zsbrv"]
Jul 24 14:57:32.933869 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:32.933839    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74cf44f_6ca3_4948_b50b_56e5e1649c84.slice/crio-18b3fb070999a0dab71f71052235fa10524c0e624c1cd97e46973bffee9a9f66 WatchSource:0}: Error finding container 18b3fb070999a0dab71f71052235fa10524c0e624c1cd97e46973bffee9a9f66: Status 404 returned error can't find the container with id 18b3fb070999a0dab71f71052235fa10524c0e624c1cd97e46973bffee9a9f66
Jul 24 14:57:33.449237 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:33.449201    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv" event={"ID":"b74cf44f-6ca3-4948-b50b-56e5e1649c84","Type":"ContainerStarted","Data":"18b3fb070999a0dab71f71052235fa10524c0e624c1cd97e46973bffee9a9f66"}
Jul 24 14:57:35.459211 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:35.459174    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv" event={"ID":"b74cf44f-6ca3-4948-b50b-56e5e1649c84","Type":"ContainerStarted","Data":"02c28e9c4f9817d5e8c8d610ec965ad721b4be4a16cad20cea588b6b26feb50b"}
Jul 24 14:57:35.459675 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:35.459234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv" event={"ID":"b74cf44f-6ca3-4948-b50b-56e5e1649c84","Type":"ContainerStarted","Data":"d288bd5c145ae39a960a544ad4380ebdd1f31a3aeb4f3736099ab25aa59f5aba"}
Jul 24 14:57:35.479787 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:35.479733    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-zsbrv" podStartSLOduration=2.940689225 podStartE2EDuration="4.479714398s" totalImagesPullingTime="1.539025173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:35.478328971 +0000 UTC m=+84.017308403" watchObservedRunningTime="2026-07-24 14:57:35.479714398 +0000 UTC m=+84.018693810"
Jul 24 14:57:37.583034 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.581552    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ljj6n"]
Jul 24 14:57:37.585018 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.584331    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.590230 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.590198    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 14:57:37.590387 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.590247    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-89sm5\""
Jul 24 14:57:37.590387 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.590265    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 14:57:37.590651 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.590630    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 14:57:37.642389 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.642345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/effaebf8-c40b-45d3-a555-4a36e0129c29-sys\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.642569 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.642397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-textfile\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.642569 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.642428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.642569 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.642454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwf6q\" (UniqueName: \"kubernetes.io/projected/effaebf8-c40b-45d3-a555-4a36e0129c29-kube-api-access-jwf6q\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.642569 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.642496    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-wtmp\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.642569 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.642520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/effaebf8-c40b-45d3-a555-4a36e0129c29-metrics-client-ca\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.642569 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.642545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-tls\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.642822 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.642596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-accelerators-collector-config\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.642822 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.642623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/effaebf8-c40b-45d3-a555-4a36e0129c29-root\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.745368 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.745333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-accelerators-collector-config\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.745559 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.745386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/effaebf8-c40b-45d3-a555-4a36e0129c29-root\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.745559 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.745429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/effaebf8-c40b-45d3-a555-4a36e0129c29-sys\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.745559 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.745452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-textfile\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.745559 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.745478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.745559 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.745501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwf6q\" (UniqueName: \"kubernetes.io/projected/effaebf8-c40b-45d3-a555-4a36e0129c29-kube-api-access-jwf6q\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.745559 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.745541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-wtmp\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.745559 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.745562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/effaebf8-c40b-45d3-a555-4a36e0129c29-metrics-client-ca\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.745813 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.745586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-tls\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.745813 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:37.745722    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 14:57:37.745813 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:37.745798    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-tls podName:effaebf8-c40b-45d3-a555-4a36e0129c29 nodeName:}" failed. No retries permitted until 2026-07-24 14:57:38.245779498 +0000 UTC m=+86.784758908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-tls") pod "node-exporter-ljj6n" (UID: "effaebf8-c40b-45d3-a555-4a36e0129c29") : secret "node-exporter-tls" not found
Jul 24 14:57:37.746034 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.746013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-accelerators-collector-config\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.746504 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.746112    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/effaebf8-c40b-45d3-a555-4a36e0129c29-sys\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.746504 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.746171    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-wtmp\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.746504 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.746209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/effaebf8-c40b-45d3-a555-4a36e0129c29-root\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.746734 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.746612    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-textfile\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.746734 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.746642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/effaebf8-c40b-45d3-a555-4a36e0129c29-metrics-client-ca\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.748678 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.748657    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:37.755694 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:37.755671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwf6q\" (UniqueName: \"kubernetes.io/projected/effaebf8-c40b-45d3-a555-4a36e0129c29-kube-api-access-jwf6q\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:38.249962 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:38.249879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-tls\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:38.252921 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:38.252886    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/effaebf8-c40b-45d3-a555-4a36e0129c29-node-exporter-tls\") pod \"node-exporter-ljj6n\" (UID: \"effaebf8-c40b-45d3-a555-4a36e0129c29\") " pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:38.498817 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:38.498782    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ljj6n"
Jul 24 14:57:40.306598 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:40.306565    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:57:42.400731 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.400700    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c7fbf7fd4-66j6w"
Jul 24 14:57:42.616792 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.616748    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ccbf944c8-lkl69"]
Jul 24 14:57:42.627853 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.627818    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.631143 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.631102    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 14:57:42.631388 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.631371    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 14:57:42.631759 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.631742    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 14:57:42.631996 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.631968    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gfgt9\""
Jul 24 14:57:42.632960 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.632344    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 14:57:42.632960 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.632433    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccbf944c8-lkl69"]
Jul 24 14:57:42.632960 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.632594    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 14:57:42.639489 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.639448    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 14:57:42.790786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.790694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-oauth-serving-cert\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.790786 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.790763    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-oauth-config\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.791019 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.790817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-trusted-ca-bundle\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.791019 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.790839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-service-ca\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.791019 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.790887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-config\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.791019 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.790914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvr6w\" (UniqueName: \"kubernetes.io/projected/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-kube-api-access-zvr6w\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.791019 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.790941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-serving-cert\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.891965 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.891926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-oauth-config\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.892198 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.892011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-trusted-ca-bundle\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.892198 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.892034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-service-ca\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.892198 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.892073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-config\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.892198 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.892097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvr6w\" (UniqueName: \"kubernetes.io/projected/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-kube-api-access-zvr6w\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.892198 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.892126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-serving-cert\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.892198 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.892157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-oauth-serving-cert\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.892908 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.892879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-service-ca\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.893294 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.893248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-trusted-ca-bundle\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.893417 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.893374    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-config\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.893853 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.893829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-oauth-serving-cert\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.894935 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.894909    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-oauth-config\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.895475 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.895454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-serving-cert\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.907510 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.907474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvr6w\" (UniqueName: \"kubernetes.io/projected/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-kube-api-access-zvr6w\") pod \"console-6ccbf944c8-lkl69\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") " pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:42.945350 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:42.945312    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:43.684519 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.684147    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:57:43.758271 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.758183    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:57:43.758455 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.758330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.764241 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.763612    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 14:57:43.764241 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.763728    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 14:57:43.764241 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.763782    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 14:57:43.764241 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.763894    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 14:57:43.764241 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.763971    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 14:57:43.764241 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.764056    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 14:57:43.764241 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.764121    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 14:57:43.764241 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.764168    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 14:57:43.764241 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.764199    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-84vdabarj06ap\""
Jul 24 14:57:43.764780 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.764339    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 14:57:43.764780 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.764385    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 14:57:43.764780 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.764531    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 14:57:43.772945 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.768608    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 14:57:43.772945 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.768922    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n68dd\""
Jul 24 14:57:43.772945 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.769248    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 14:57:43.772945 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.769479    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 14:57:43.774116 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.774090    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 14:57:43.901150 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901334 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901164    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901334 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901194    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901334 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901334 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901334 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901334 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901334 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901334 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901686 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901686 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj5wv\" (UniqueName: \"kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-kube-api-access-qj5wv\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901686 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901686 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901686 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901645    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901686 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901972 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901972 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-config\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901972 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901972 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:43.901972 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:43.901841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003076 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.002958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5wv\" (UniqueName: \"kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-kube-api-access-qj5wv\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003076 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003076 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-config\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003258    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.003429 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.004085 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.004085 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003488    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.004085 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003511    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.004085 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.003541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.004295 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.004099    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.004359 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.004305    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.004793 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.004646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.005259 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.005232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.006007 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.005954    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.006268 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.006244    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.010386 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.010352    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.011397 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.010699    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.011397 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.011333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.011397 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.011333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.012664 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.012335    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.012664 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.012344    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.012664 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.012608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.012664 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.012660    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.013332 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.013301    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.013772 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.013751    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.014424 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.014403    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.016234 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.016188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj5wv\" (UniqueName: \"kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-kube-api-access-qj5wv\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.017522 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.017503    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.017685 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.017539    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-config\") pod \"prometheus-k8s-0\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:44.075852 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:44.075813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:57:45.319537 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:45.319460    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd" podUID="9136e2a6-49bf-459c-8435-329dfb7817e5" containerName="registry" containerID="cri-o://06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852" gracePeriod=30
Jul 24 14:57:45.545597 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:45.545560    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffaebf8_c40b_45d3_a555_4a36e0129c29.slice/crio-2129b30cac0ab6993500bd30088a2868e429dfd40fba465edbbb6f08e7cf17d0 WatchSource:0}: Error finding container 2129b30cac0ab6993500bd30088a2868e429dfd40fba465edbbb6f08e7cf17d0: Status 404 returned error can't find the container with id 2129b30cac0ab6993500bd30088a2868e429dfd40fba465edbbb6f08e7cf17d0
Jul 24 14:57:45.734695 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:45.734666    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:57:45.832856 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:45.832820    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d91d865_4701_4ed3_9863_55a6c4460da2.slice/crio-27e0cfc51a31f02d5dcc95ed7037b1f71386534a72ff695bc04e34c2e9ea02a5 WatchSource:0}: Error finding container 27e0cfc51a31f02d5dcc95ed7037b1f71386534a72ff695bc04e34c2e9ea02a5: Status 404 returned error can't find the container with id 27e0cfc51a31f02d5dcc95ed7037b1f71386534a72ff695bc04e34c2e9ea02a5
Jul 24 14:57:45.860132 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:45.860103    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:57:45.911525 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:45.911498    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccbf944c8-lkl69"]
Jul 24 14:57:45.915221 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:57:45.915184    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa65bcf_21a8_4d03_9d18_6b0e3d451335.slice/crio-ad3c318b2245c17c9f689d227c0e97ed6377cc612967bffd81a33252502ca0a5 WatchSource:0}: Error finding container ad3c318b2245c17c9f689d227c0e97ed6377cc612967bffd81a33252502ca0a5: Status 404 returned error can't find the container with id ad3c318b2245c17c9f689d227c0e97ed6377cc612967bffd81a33252502ca0a5
Jul 24 14:57:46.022548 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.022514    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-trusted-ca\") pod \"9136e2a6-49bf-459c-8435-329dfb7817e5\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") "
Jul 24 14:57:46.022713 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.022555    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xndmz\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-kube-api-access-xndmz\") pod \"9136e2a6-49bf-459c-8435-329dfb7817e5\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") "
Jul 24 14:57:46.022713 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.022579    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9136e2a6-49bf-459c-8435-329dfb7817e5-ca-trust-extracted\") pod \"9136e2a6-49bf-459c-8435-329dfb7817e5\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") "
Jul 24 14:57:46.022713 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.022610    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-bound-sa-token\") pod \"9136e2a6-49bf-459c-8435-329dfb7817e5\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") "
Jul 24 14:57:46.022713 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.022673    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-image-registry-private-configuration\") pod \"9136e2a6-49bf-459c-8435-329dfb7817e5\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") "
Jul 24 14:57:46.022713 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.022707    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") pod \"9136e2a6-49bf-459c-8435-329dfb7817e5\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") "
Jul 24 14:57:46.022966 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.022738    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-installation-pull-secrets\") pod \"9136e2a6-49bf-459c-8435-329dfb7817e5\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") "
Jul 24 14:57:46.022966 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.022775    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-certificates\") pod \"9136e2a6-49bf-459c-8435-329dfb7817e5\" (UID: \"9136e2a6-49bf-459c-8435-329dfb7817e5\") "
Jul 24 14:57:46.023104 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.023021    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9136e2a6-49bf-459c-8435-329dfb7817e5" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:57:46.023730 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.023688    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9136e2a6-49bf-459c-8435-329dfb7817e5" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:57:46.025218 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.025191    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9136e2a6-49bf-459c-8435-329dfb7817e5" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:57:46.025422 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.025403    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-kube-api-access-xndmz" (OuterVolumeSpecName: "kube-api-access-xndmz") pod "9136e2a6-49bf-459c-8435-329dfb7817e5" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5"). InnerVolumeSpecName "kube-api-access-xndmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:57:46.025559 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.025533    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9136e2a6-49bf-459c-8435-329dfb7817e5" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:57:46.025674 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.025652    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9136e2a6-49bf-459c-8435-329dfb7817e5" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:57:46.025965 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.025949    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9136e2a6-49bf-459c-8435-329dfb7817e5" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:57:46.033998 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.033943    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9136e2a6-49bf-459c-8435-329dfb7817e5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9136e2a6-49bf-459c-8435-329dfb7817e5" (UID: "9136e2a6-49bf-459c-8435-329dfb7817e5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:57:46.124050 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.123887    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-bound-sa-token\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:57:46.124050 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.123922    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-image-registry-private-configuration\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:57:46.124050 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.123937    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-tls\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:57:46.124050 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.123950    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9136e2a6-49bf-459c-8435-329dfb7817e5-installation-pull-secrets\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:57:46.124050 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.123967    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-registry-certificates\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:57:46.124050 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.124007    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9136e2a6-49bf-459c-8435-329dfb7817e5-trusted-ca\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:57:46.124050 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.124020    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xndmz\" (UniqueName: \"kubernetes.io/projected/9136e2a6-49bf-459c-8435-329dfb7817e5-kube-api-access-xndmz\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:57:46.124050 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.124033    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9136e2a6-49bf-459c-8435-329dfb7817e5-ca-trust-extracted\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:57:46.519696 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.519655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-82sf6" event={"ID":"f60f52f9-ee88-4cc3-a632-3407d2cdc12e","Type":"ContainerStarted","Data":"15ffdbb13e41219e0bd1895d1f25f2165a85f250f930ac6586c28b3ea4bcaf54"}
Jul 24 14:57:46.520188 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.519771    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-82sf6"
Jul 24 14:57:46.522410 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.522381    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccbf944c8-lkl69" event={"ID":"2fa65bcf-21a8-4d03-9d18-6b0e3d451335","Type":"ContainerStarted","Data":"ad3c318b2245c17c9f689d227c0e97ed6377cc612967bffd81a33252502ca0a5"}
Jul 24 14:57:46.525022 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.524473    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd"
Jul 24 14:57:46.525516 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.525216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd" event={"ID":"9136e2a6-49bf-459c-8435-329dfb7817e5","Type":"ContainerDied","Data":"06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852"}
Jul 24 14:57:46.525516 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.525283    2582 scope.go:117] "RemoveContainer" containerID="06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852"
Jul 24 14:57:46.525930 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.525720    2582 generic.go:356] "Generic (PLEG): container finished" podID="9136e2a6-49bf-459c-8435-329dfb7817e5" containerID="06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852" exitCode=0
Jul 24 14:57:46.525930 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.525837    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788b9c9975-mlbqd" event={"ID":"9136e2a6-49bf-459c-8435-329dfb7817e5","Type":"ContainerDied","Data":"66ea2db9156e2a92d87c36b6472a274bef70409ceb3b7c97b98c9eb7df874a6c"}
Jul 24 14:57:46.532283 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.532228    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-82sf6"
Jul 24 14:57:46.535336 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.535297    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ljj6n" event={"ID":"effaebf8-c40b-45d3-a555-4a36e0129c29","Type":"ContainerStarted","Data":"0bfcffec867f2154944320a8d170ded67c42eaa9eb5c108d3137af2a12b7ebbf"}
Jul 24 14:57:46.535467 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.535361    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ljj6n" event={"ID":"effaebf8-c40b-45d3-a555-4a36e0129c29","Type":"ContainerStarted","Data":"2129b30cac0ab6993500bd30088a2868e429dfd40fba465edbbb6f08e7cf17d0"}
Jul 24 14:57:46.545832 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.544642    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerStarted","Data":"27e0cfc51a31f02d5dcc95ed7037b1f71386534a72ff695bc04e34c2e9ea02a5"}
Jul 24 14:57:46.553871 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.553834    2582 scope.go:117] "RemoveContainer" containerID="06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852"
Jul 24 14:57:46.554799 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:57:46.554510    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852\": container with ID starting with 06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852 not found: ID does not exist" containerID="06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852"
Jul 24 14:57:46.554799 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.554550    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852"} err="failed to get container status \"06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852\": rpc error: code = NotFound desc = could not find container \"06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852\": container with ID starting with 06c3b0fb10052022487135a6452da73eed3a04bcdd008083a7a20cdce2c86852 not found: ID does not exist"
Jul 24 14:57:46.571066 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.571006    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-82sf6" podStartSLOduration=2.123174148 podStartE2EDuration="21.570968487s" totalImagesPullingTime="19.447794339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:46.545005025 +0000 UTC m=+95.083984453" watchObservedRunningTime="2026-07-24 14:57:46.570968487 +0000 UTC m=+95.109947901"
Jul 24 14:57:46.619439 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.619395    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-788b9c9975-mlbqd"]
Jul 24 14:57:46.623820 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:46.622994    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-788b9c9975-mlbqd"]
Jul 24 14:57:47.554814 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:47.554741    2582 generic.go:356] "Generic (PLEG): container finished" podID="effaebf8-c40b-45d3-a555-4a36e0129c29" containerID="0bfcffec867f2154944320a8d170ded67c42eaa9eb5c108d3137af2a12b7ebbf" exitCode=0
Jul 24 14:57:47.556299 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:47.555031    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ljj6n" event={"ID":"effaebf8-c40b-45d3-a555-4a36e0129c29","Type":"ContainerDied","Data":"0bfcffec867f2154944320a8d170ded67c42eaa9eb5c108d3137af2a12b7ebbf"}
Jul 24 14:57:47.999943 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:47.999898    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9136e2a6-49bf-459c-8435-329dfb7817e5" path="/var/lib/kubelet/pods/9136e2a6-49bf-459c-8435-329dfb7817e5/volumes"
Jul 24 14:57:48.427876 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:48.427529    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ccbf944c8-lkl69"]
Jul 24 14:57:48.566831 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:48.566795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ljj6n" event={"ID":"effaebf8-c40b-45d3-a555-4a36e0129c29","Type":"ContainerStarted","Data":"d8aef52fe81073611afd750770c6a659121a4c82fbb17a287e37de3b66d28901"}
Jul 24 14:57:48.567457 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:48.567437    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ljj6n" event={"ID":"effaebf8-c40b-45d3-a555-4a36e0129c29","Type":"ContainerStarted","Data":"7807904df5e4b883716716f3e9f2a7b3e07ff133e6cd84f030b0b8556d3516e5"}
Jul 24 14:57:48.571279 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:48.571247    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerID="b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940" exitCode=0
Jul 24 14:57:48.571524 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:48.571296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerDied","Data":"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"}
Jul 24 14:57:48.599568 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:48.597543    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ljj6n" podStartSLOduration=10.587966367 podStartE2EDuration="11.597521758s" totalImagesPullingTime="879.62405ms" totalInitContainerRuntime="129.931341ms" isStatefulPod=true podCreationTimestamp="2026-07-24 14:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:48.596779968 +0000 UTC m=+97.135759402" watchObservedRunningTime="2026-07-24 14:57:48.597521758 +0000 UTC m=+97.136501173"
Jul 24 14:57:51.588500 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:51.588408    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccbf944c8-lkl69" event={"ID":"2fa65bcf-21a8-4d03-9d18-6b0e3d451335","Type":"ContainerStarted","Data":"34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06"}
Jul 24 14:57:51.611294 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:51.611239    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ccbf944c8-lkl69" podStartSLOduration=4.959180392 podStartE2EDuration="9.611219164s" totalImagesPullingTime="4.652038772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:51.611194377 +0000 UTC m=+100.150173791" watchObservedRunningTime="2026-07-24 14:57:51.611219164 +0000 UTC m=+100.150198576"
Jul 24 14:57:52.945465 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:52.945422    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:57:54.604713 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:54.604626    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerStarted","Data":"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"}
Jul 24 14:57:55.612315 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:55.612271    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerStarted","Data":"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"}
Jul 24 14:57:57.622919 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:57.622888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerStarted","Data":"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"}
Jul 24 14:57:57.623322 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:57.622955    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerStarted","Data":"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"}
Jul 24 14:57:57.623322 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:57.623006    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerStarted","Data":"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"}
Jul 24 14:57:57.623322 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:57.623031    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerStarted","Data":"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"}
Jul 24 14:57:57.669865 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:57.669777    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.538456604 podStartE2EDuration="14.669755103s" totalImagesPullingTime="10.093818733s" totalInitContainerRuntime="37.479766ms" isStatefulPod=false podCreationTimestamp="2026-07-24 14:57:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:57.667450313 +0000 UTC m=+106.206429725" watchObservedRunningTime="2026-07-24 14:57:57.669755103 +0000 UTC m=+106.208734518"
Jul 24 14:57:59.076424 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:57:59.076378    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:58:16.619903 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:16.619858    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ccbf944c8-lkl69" podUID="2fa65bcf-21a8-4d03-9d18-6b0e3d451335" containerName="console" containerID="cri-o://34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06" gracePeriod=15
Jul 24 14:58:16.901263 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:16.901227    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:58:17.005894 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.005861    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-oauth-config\") pod \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") "
Jul 24 14:58:17.006103 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.005905    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-service-ca\") pod \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") "
Jul 24 14:58:17.006103 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.005942    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-serving-cert\") pod \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") "
Jul 24 14:58:17.006103 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.006062    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-trusted-ca-bundle\") pod \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") "
Jul 24 14:58:17.006103 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.006098    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-oauth-serving-cert\") pod \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") "
Jul 24 14:58:17.006339 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.006128    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvr6w\" (UniqueName: \"kubernetes.io/projected/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-kube-api-access-zvr6w\") pod \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") "
Jul 24 14:58:17.006339 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.006238    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-config\") pod \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\" (UID: \"2fa65bcf-21a8-4d03-9d18-6b0e3d451335\") "
Jul 24 14:58:17.006339 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.006322    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-service-ca" (OuterVolumeSpecName: "service-ca") pod "2fa65bcf-21a8-4d03-9d18-6b0e3d451335" (UID: "2fa65bcf-21a8-4d03-9d18-6b0e3d451335"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:58:17.006488 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.006412    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2fa65bcf-21a8-4d03-9d18-6b0e3d451335" (UID: "2fa65bcf-21a8-4d03-9d18-6b0e3d451335"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:58:17.006569 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.006524    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-service-ca\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:58:17.006569 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.006524    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2fa65bcf-21a8-4d03-9d18-6b0e3d451335" (UID: "2fa65bcf-21a8-4d03-9d18-6b0e3d451335"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:58:17.006569 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.006545    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-trusted-ca-bundle\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:58:17.006867 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.006612    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-config" (OuterVolumeSpecName: "console-config") pod "2fa65bcf-21a8-4d03-9d18-6b0e3d451335" (UID: "2fa65bcf-21a8-4d03-9d18-6b0e3d451335"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:58:17.008365 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.008334    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2fa65bcf-21a8-4d03-9d18-6b0e3d451335" (UID: "2fa65bcf-21a8-4d03-9d18-6b0e3d451335"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:58:17.008510 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.008468    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2fa65bcf-21a8-4d03-9d18-6b0e3d451335" (UID: "2fa65bcf-21a8-4d03-9d18-6b0e3d451335"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:58:17.008557 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.008508    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-kube-api-access-zvr6w" (OuterVolumeSpecName: "kube-api-access-zvr6w") pod "2fa65bcf-21a8-4d03-9d18-6b0e3d451335" (UID: "2fa65bcf-21a8-4d03-9d18-6b0e3d451335"). InnerVolumeSpecName "kube-api-access-zvr6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:58:17.107276 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.107240    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:58:17.107276 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.107271    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-oauth-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:58:17.107276 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.107281    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-console-serving-cert\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:58:17.107504 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.107290    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-oauth-serving-cert\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:58:17.107504 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.107301    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvr6w\" (UniqueName: \"kubernetes.io/projected/2fa65bcf-21a8-4d03-9d18-6b0e3d451335-kube-api-access-zvr6w\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:58:17.703075 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.703042    2582 generic.go:356] "Generic (PLEG): container finished" podID="2fa65bcf-21a8-4d03-9d18-6b0e3d451335" containerID="34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06" exitCode=0
Jul 24 14:58:17.703564 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.703100    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccbf944c8-lkl69"
Jul 24 14:58:17.703564 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.703099    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccbf944c8-lkl69" event={"ID":"2fa65bcf-21a8-4d03-9d18-6b0e3d451335","Type":"ContainerDied","Data":"34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06"}
Jul 24 14:58:17.703564 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.703163    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccbf944c8-lkl69" event={"ID":"2fa65bcf-21a8-4d03-9d18-6b0e3d451335","Type":"ContainerDied","Data":"ad3c318b2245c17c9f689d227c0e97ed6377cc612967bffd81a33252502ca0a5"}
Jul 24 14:58:17.703564 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.703189    2582 scope.go:117] "RemoveContainer" containerID="34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06"
Jul 24 14:58:17.713294 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.713268    2582 scope.go:117] "RemoveContainer" containerID="34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06"
Jul 24 14:58:17.713664 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:58:17.713632    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06\": container with ID starting with 34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06 not found: ID does not exist" containerID="34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06"
Jul 24 14:58:17.713805 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.713672    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06"} err="failed to get container status \"34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06\": rpc error: code = NotFound desc = could not find container \"34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06\": container with ID starting with 34617992dfba161062511b8a0d8bdc3677be3850807a5b2b8fea9393f8053b06 not found: ID does not exist"
Jul 24 14:58:17.728798 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.728752    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ccbf944c8-lkl69"]
Jul 24 14:58:17.733263 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.733211    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ccbf944c8-lkl69"]
Jul 24 14:58:17.997830 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:17.997400    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fa65bcf-21a8-4d03-9d18-6b0e3d451335" path="/var/lib/kubelet/pods/2fa65bcf-21a8-4d03-9d18-6b0e3d451335/volumes"
Jul 24 14:58:44.077060 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:44.077016    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:58:44.098639 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:44.098597    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:58:44.822023 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:58:44.821975    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:02.186140 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.186051    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:59:02.186712 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.186348    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="prometheus" containerID="cri-o://053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b" gracePeriod=600
Jul 24 14:59:02.186712 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.186379    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="thanos-sidecar" containerID="cri-o://445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97" gracePeriod=600
Jul 24 14:59:02.186712 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.186405    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy" containerID="cri-o://d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc" gracePeriod=600
Jul 24 14:59:02.186712 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.186431    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="config-reloader" containerID="cri-o://a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6" gracePeriod=600
Jul 24 14:59:02.186712 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.186448    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5" gracePeriod=600
Jul 24 14:59:02.186712 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.186399    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy-web" containerID="cri-o://9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734" gracePeriod=600
Jul 24 14:59:02.452421 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.452390    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:02.569032 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.568969    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-serving-certs-ca-bundle\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569224 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569049    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569295 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569254    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-config\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569358 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569312    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-grpc-tls\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569358 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569320    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:59:02.569358 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569342    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-web-config\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569511 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569376    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-thanos-prometheus-http-client-file\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569511 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-metrics-client-certs\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569511 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569450    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-0\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569511 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569481    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-db\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569511 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569507    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj5wv\" (UniqueName: \"kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-kube-api-access-qj5wv\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569754 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569547    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-tls-assets\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569754 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569580    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-tls\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569754 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569612    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-metrics-client-ca\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569754 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569640    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-2\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569754 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569675    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-trusted-ca-bundle\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569754 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569713    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.569754 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569737    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-1\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.570316 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569762    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-kubelet-serving-ca-bundle\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.570316 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569799    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-config-out\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.570316 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.569847    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-kube-rbac-proxy\") pod \"5d91d865-4701-4ed3-9863-55a6c4460da2\" (UID: \"5d91d865-4701-4ed3-9863-55a6c4460da2\") "
Jul 24 14:59:02.570316 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.570261    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.570868 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.570837    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:59:02.571371 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.571343    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:59:02.571499 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.571481    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:59:02.571839 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.571809    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:59:02.571943 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.571906    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:59:02.572241 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.572219    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:59:02.572485 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.572459    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:59:02.573697 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.573657    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-config" (OuterVolumeSpecName: "config") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:02.573921 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.573882    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:02.574150 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.574050    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:02.574150 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.574119    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:02.574316 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.574177    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:02.574717 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.574679    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:59:02.574916 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.574898    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-config-out" (OuterVolumeSpecName: "config-out") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:59:02.575148 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.575121    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:02.575239 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.575187    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:02.575285 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.575269    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-kube-api-access-qj5wv" (OuterVolumeSpecName: "kube-api-access-qj5wv") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "kube-api-access-qj5wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:59:02.575760 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.575738    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:02.584638 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.584612    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-web-config" (OuterVolumeSpecName: "web-config") pod "5d91d865-4701-4ed3-9863-55a6c4460da2" (UID: "5d91d865-4701-4ed3-9863-55a6c4460da2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:02.670662 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670625    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670662 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670653    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670662 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670666    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-config-out\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670662 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670675    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-kube-rbac-proxy\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670686    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670695    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670704    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-grpc-tls\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670713    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-web-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670720    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670730    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-metrics-client-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670738    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670748    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-db\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670755    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj5wv\" (UniqueName: \"kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-kube-api-access-qj5wv\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670763    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d91d865-4701-4ed3-9863-55a6c4460da2-tls-assets\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670773    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670782    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-configmap-metrics-client-ca\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670790    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670798    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d91d865-4701-4ed3-9863-55a6c4460da2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.670925 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.670808    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d91d865-4701-4ed3-9863-55a6c4460da2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 14:59:02.872897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.872808    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerID="dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5" exitCode=0
Jul 24 14:59:02.872897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.872833    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerID="d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc" exitCode=0
Jul 24 14:59:02.872897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.872840    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerID="9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734" exitCode=0
Jul 24 14:59:02.872897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.872846    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerID="445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97" exitCode=0
Jul 24 14:59:02.872897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.872851    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerID="a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6" exitCode=0
Jul 24 14:59:02.872897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.872856    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerID="053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b" exitCode=0
Jul 24 14:59:02.872897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.872884    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerDied","Data":"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"}
Jul 24 14:59:02.872897 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.872897    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:02.873372 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.873000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerDied","Data":"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"}
Jul 24 14:59:02.873372 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.873033    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerDied","Data":"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"}
Jul 24 14:59:02.873372 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.873058    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerDied","Data":"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"}
Jul 24 14:59:02.873372 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.873073    2582 scope.go:117] "RemoveContainer" containerID="dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"
Jul 24 14:59:02.873372 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.873083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerDied","Data":"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"}
Jul 24 14:59:02.873372 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.873108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerDied","Data":"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"}
Jul 24 14:59:02.873372 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.873134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d91d865-4701-4ed3-9863-55a6c4460da2","Type":"ContainerDied","Data":"27e0cfc51a31f02d5dcc95ed7037b1f71386534a72ff695bc04e34c2e9ea02a5"}
Jul 24 14:59:02.881708 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.881658    2582 scope.go:117] "RemoveContainer" containerID="d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"
Jul 24 14:59:02.889457 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.889436    2582 scope.go:117] "RemoveContainer" containerID="9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"
Jul 24 14:59:02.896320 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.896302    2582 scope.go:117] "RemoveContainer" containerID="445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"
Jul 24 14:59:02.903106 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.903091    2582 scope.go:117] "RemoveContainer" containerID="a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"
Jul 24 14:59:02.906533 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.906511    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:59:02.910476 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.910455    2582 scope.go:117] "RemoveContainer" containerID="053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"
Jul 24 14:59:02.912832 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.912811    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:59:02.918386 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.918371    2582 scope.go:117] "RemoveContainer" containerID="b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"
Jul 24 14:59:02.925358 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.925343    2582 scope.go:117] "RemoveContainer" containerID="dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"
Jul 24 14:59:02.925646 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:59:02.925627    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": container with ID starting with dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5 not found: ID does not exist" containerID="dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"
Jul 24 14:59:02.925709 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.925656    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"} err="failed to get container status \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": rpc error: code = NotFound desc = could not find container \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": container with ID starting with dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5 not found: ID does not exist"
Jul 24 14:59:02.925709 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.925680    2582 scope.go:117] "RemoveContainer" containerID="d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"
Jul 24 14:59:02.925908 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:59:02.925893    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": container with ID starting with d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc not found: ID does not exist" containerID="d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"
Jul 24 14:59:02.925954 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.925915    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"} err="failed to get container status \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": rpc error: code = NotFound desc = could not find container \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": container with ID starting with d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc not found: ID does not exist"
Jul 24 14:59:02.925954 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.925930    2582 scope.go:117] "RemoveContainer" containerID="9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"
Jul 24 14:59:02.926254 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:59:02.926238    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": container with ID starting with 9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734 not found: ID does not exist" containerID="9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"
Jul 24 14:59:02.926299 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.926259    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"} err="failed to get container status \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": rpc error: code = NotFound desc = could not find container \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": container with ID starting with 9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734 not found: ID does not exist"
Jul 24 14:59:02.926299 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.926276    2582 scope.go:117] "RemoveContainer" containerID="445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"
Jul 24 14:59:02.926508 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:59:02.926493    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": container with ID starting with 445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97 not found: ID does not exist" containerID="445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"
Jul 24 14:59:02.926547 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.926512    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"} err="failed to get container status \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": rpc error: code = NotFound desc = could not find container \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": container with ID starting with 445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97 not found: ID does not exist"
Jul 24 14:59:02.926547 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.926526    2582 scope.go:117] "RemoveContainer" containerID="a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"
Jul 24 14:59:02.926704 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:59:02.926685    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": container with ID starting with a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6 not found: ID does not exist" containerID="a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"
Jul 24 14:59:02.926743 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.926711    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"} err="failed to get container status \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": rpc error: code = NotFound desc = could not find container \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": container with ID starting with a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6 not found: ID does not exist"
Jul 24 14:59:02.926743 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.926730    2582 scope.go:117] "RemoveContainer" containerID="053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"
Jul 24 14:59:02.926960 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:59:02.926942    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": container with ID starting with 053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b not found: ID does not exist" containerID="053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"
Jul 24 14:59:02.927018 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.926963    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"} err="failed to get container status \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": rpc error: code = NotFound desc = could not find container \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": container with ID starting with 053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b not found: ID does not exist"
Jul 24 14:59:02.927018 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.926976    2582 scope.go:117] "RemoveContainer" containerID="b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"
Jul 24 14:59:02.927184 ip-10-0-129-232 kubenswrapper[2582]: E0724 14:59:02.927168    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": container with ID starting with b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940 not found: ID does not exist" containerID="b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"
Jul 24 14:59:02.927223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.927188    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"} err="failed to get container status \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": rpc error: code = NotFound desc = could not find container \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": container with ID starting with b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940 not found: ID does not exist"
Jul 24 14:59:02.927223 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.927200    2582 scope.go:117] "RemoveContainer" containerID="dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"
Jul 24 14:59:02.927380 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.927364    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"} err="failed to get container status \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": rpc error: code = NotFound desc = could not find container \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": container with ID starting with dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5 not found: ID does not exist"
Jul 24 14:59:02.927465 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.927381    2582 scope.go:117] "RemoveContainer" containerID="d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"
Jul 24 14:59:02.927551 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.927536    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"} err="failed to get container status \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": rpc error: code = NotFound desc = could not find container \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": container with ID starting with d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc not found: ID does not exist"
Jul 24 14:59:02.927597 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.927552    2582 scope.go:117] "RemoveContainer" containerID="9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"
Jul 24 14:59:02.927721 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.927707    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"} err="failed to get container status \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": rpc error: code = NotFound desc = could not find container \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": container with ID starting with 9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734 not found: ID does not exist"
Jul 24 14:59:02.927760 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.927721    2582 scope.go:117] "RemoveContainer" containerID="445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"
Jul 24 14:59:02.927898 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.927883    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"} err="failed to get container status \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": rpc error: code = NotFound desc = could not find container \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": container with ID starting with 445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97 not found: ID does not exist"
Jul 24 14:59:02.927946 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.927899    2582 scope.go:117] "RemoveContainer" containerID="a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"
Jul 24 14:59:02.928151 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.928136    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"} err="failed to get container status \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": rpc error: code = NotFound desc = could not find container \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": container with ID starting with a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6 not found: ID does not exist"
Jul 24 14:59:02.928214 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.928151    2582 scope.go:117] "RemoveContainer" containerID="053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"
Jul 24 14:59:02.928403 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.928384    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"} err="failed to get container status \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": rpc error: code = NotFound desc = could not find container \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": container with ID starting with 053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b not found: ID does not exist"
Jul 24 14:59:02.928475 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.928404    2582 scope.go:117] "RemoveContainer" containerID="b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"
Jul 24 14:59:02.928645 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.928626    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"} err="failed to get container status \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": rpc error: code = NotFound desc = could not find container \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": container with ID starting with b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940 not found: ID does not exist"
Jul 24 14:59:02.928688 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.928645    2582 scope.go:117] "RemoveContainer" containerID="dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"
Jul 24 14:59:02.928829 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.928812    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"} err="failed to get container status \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": rpc error: code = NotFound desc = could not find container \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": container with ID starting with dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5 not found: ID does not exist"
Jul 24 14:59:02.928880 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.928829    2582 scope.go:117] "RemoveContainer" containerID="d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"
Jul 24 14:59:02.929048 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.929025    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"} err="failed to get container status \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": rpc error: code = NotFound desc = could not find container \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": container with ID starting with d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc not found: ID does not exist"
Jul 24 14:59:02.929105 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.929049    2582 scope.go:117] "RemoveContainer" containerID="9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"
Jul 24 14:59:02.929274 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.929257    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"} err="failed to get container status \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": rpc error: code = NotFound desc = could not find container \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": container with ID starting with 9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734 not found: ID does not exist"
Jul 24 14:59:02.929274 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.929274    2582 scope.go:117] "RemoveContainer" containerID="445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"
Jul 24 14:59:02.929446 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.929427    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"} err="failed to get container status \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": rpc error: code = NotFound desc = could not find container \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": container with ID starting with 445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97 not found: ID does not exist"
Jul 24 14:59:02.929491 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.929449    2582 scope.go:117] "RemoveContainer" containerID="a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"
Jul 24 14:59:02.929647 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.929632    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"} err="failed to get container status \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": rpc error: code = NotFound desc = could not find container \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": container with ID starting with a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6 not found: ID does not exist"
Jul 24 14:59:02.929687 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.929647    2582 scope.go:117] "RemoveContainer" containerID="053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"
Jul 24 14:59:02.929864 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.929848    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"} err="failed to get container status \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": rpc error: code = NotFound desc = could not find container \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": container with ID starting with 053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b not found: ID does not exist"
Jul 24 14:59:02.929905 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.929864    2582 scope.go:117] "RemoveContainer" containerID="b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"
Jul 24 14:59:02.930108 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.930090    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"} err="failed to get container status \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": rpc error: code = NotFound desc = could not find container \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": container with ID starting with b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940 not found: ID does not exist"
Jul 24 14:59:02.930161 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.930109    2582 scope.go:117] "RemoveContainer" containerID="dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"
Jul 24 14:59:02.930363 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.930343    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"} err="failed to get container status \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": rpc error: code = NotFound desc = could not find container \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": container with ID starting with dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5 not found: ID does not exist"
Jul 24 14:59:02.930416 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.930363    2582 scope.go:117] "RemoveContainer" containerID="d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"
Jul 24 14:59:02.930585 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.930568    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"} err="failed to get container status \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": rpc error: code = NotFound desc = could not find container \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": container with ID starting with d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc not found: ID does not exist"
Jul 24 14:59:02.930643 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.930586    2582 scope.go:117] "RemoveContainer" containerID="9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"
Jul 24 14:59:02.930807 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.930789    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"} err="failed to get container status \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": rpc error: code = NotFound desc = could not find container \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": container with ID starting with 9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734 not found: ID does not exist"
Jul 24 14:59:02.930848 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.930809    2582 scope.go:117] "RemoveContainer" containerID="445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"
Jul 24 14:59:02.931009 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.930974    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"} err="failed to get container status \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": rpc error: code = NotFound desc = could not find container \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": container with ID starting with 445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97 not found: ID does not exist"
Jul 24 14:59:02.931058 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931011    2582 scope.go:117] "RemoveContainer" containerID="a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"
Jul 24 14:59:02.931217 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931203    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"} err="failed to get container status \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": rpc error: code = NotFound desc = could not find container \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": container with ID starting with a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6 not found: ID does not exist"
Jul 24 14:59:02.931262 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931217    2582 scope.go:117] "RemoveContainer" containerID="053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"
Jul 24 14:59:02.931394 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931378    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"} err="failed to get container status \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": rpc error: code = NotFound desc = could not find container \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": container with ID starting with 053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b not found: ID does not exist"
Jul 24 14:59:02.931431 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931393    2582 scope.go:117] "RemoveContainer" containerID="b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"
Jul 24 14:59:02.931568 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931555    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"} err="failed to get container status \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": rpc error: code = NotFound desc = could not find container \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": container with ID starting with b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940 not found: ID does not exist"
Jul 24 14:59:02.931610 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931569    2582 scope.go:117] "RemoveContainer" containerID="dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"
Jul 24 14:59:02.931754 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931740    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"} err="failed to get container status \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": rpc error: code = NotFound desc = could not find container \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": container with ID starting with dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5 not found: ID does not exist"
Jul 24 14:59:02.931799 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931754    2582 scope.go:117] "RemoveContainer" containerID="d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"
Jul 24 14:59:02.931942 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931927    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"} err="failed to get container status \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": rpc error: code = NotFound desc = could not find container \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": container with ID starting with d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc not found: ID does not exist"
Jul 24 14:59:02.932012 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.931944    2582 scope.go:117] "RemoveContainer" containerID="9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"
Jul 24 14:59:02.932151 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.932136    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"} err="failed to get container status \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": rpc error: code = NotFound desc = could not find container \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": container with ID starting with 9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734 not found: ID does not exist"
Jul 24 14:59:02.932197 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.932151    2582 scope.go:117] "RemoveContainer" containerID="445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"
Jul 24 14:59:02.932325 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.932309    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"} err="failed to get container status \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": rpc error: code = NotFound desc = could not find container \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": container with ID starting with 445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97 not found: ID does not exist"
Jul 24 14:59:02.932366 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.932326    2582 scope.go:117] "RemoveContainer" containerID="a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"
Jul 24 14:59:02.932510 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.932496    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"} err="failed to get container status \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": rpc error: code = NotFound desc = could not find container \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": container with ID starting with a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6 not found: ID does not exist"
Jul 24 14:59:02.932559 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.932510    2582 scope.go:117] "RemoveContainer" containerID="053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"
Jul 24 14:59:02.932694 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.932679    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"} err="failed to get container status \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": rpc error: code = NotFound desc = could not find container \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": container with ID starting with 053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b not found: ID does not exist"
Jul 24 14:59:02.932736 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.932694    2582 scope.go:117] "RemoveContainer" containerID="b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"
Jul 24 14:59:02.932868 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.932854    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"} err="failed to get container status \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": rpc error: code = NotFound desc = could not find container \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": container with ID starting with b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940 not found: ID does not exist"
Jul 24 14:59:02.932907 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.932868    2582 scope.go:117] "RemoveContainer" containerID="dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"
Jul 24 14:59:02.933054 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.933040    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5"} err="failed to get container status \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": rpc error: code = NotFound desc = could not find container \"dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5\": container with ID starting with dbb96abd13d688a695fa6433b7f5669519e8a911ef100edb0b8510a053aa91f5 not found: ID does not exist"
Jul 24 14:59:02.933104 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.933055    2582 scope.go:117] "RemoveContainer" containerID="d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"
Jul 24 14:59:02.933231 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.933215    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc"} err="failed to get container status \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": rpc error: code = NotFound desc = could not find container \"d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc\": container with ID starting with d8127b4921064ee179eb0166a1a980e552273e43ac2bb5dc084e977e0080ffbc not found: ID does not exist"
Jul 24 14:59:02.933231 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.933230    2582 scope.go:117] "RemoveContainer" containerID="9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"
Jul 24 14:59:02.933406 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.933391    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734"} err="failed to get container status \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": rpc error: code = NotFound desc = could not find container \"9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734\": container with ID starting with 9a2d3079bc19d68776094472bc082842dbd9632703b0b2d80bb119b95c5b9734 not found: ID does not exist"
Jul 24 14:59:02.933445 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.933406    2582 scope.go:117] "RemoveContainer" containerID="445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"
Jul 24 14:59:02.933649 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.933631    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97"} err="failed to get container status \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": rpc error: code = NotFound desc = could not find container \"445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97\": container with ID starting with 445f3cb55a060cf27a20f385387adcb8aabf2db8e4af304e7c5917b139c82a97 not found: ID does not exist"
Jul 24 14:59:02.933649 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.933647    2582 scope.go:117] "RemoveContainer" containerID="a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"
Jul 24 14:59:02.933834 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.933816    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6"} err="failed to get container status \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": rpc error: code = NotFound desc = could not find container \"a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6\": container with ID starting with a405be9b6ebbc64ece3ffac9a3e661a7686a90ca741b047255d96fa93f733fa6 not found: ID does not exist"
Jul 24 14:59:02.933877 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.933836    2582 scope.go:117] "RemoveContainer" containerID="053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"
Jul 24 14:59:02.934057 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.934040    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b"} err="failed to get container status \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": rpc error: code = NotFound desc = could not find container \"053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b\": container with ID starting with 053eb8c4acbd51d472d7b173149f670ba49cd67360cc713b7eeb5a2ad4b4b23b not found: ID does not exist"
Jul 24 14:59:02.934101 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.934060    2582 scope.go:117] "RemoveContainer" containerID="b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"
Jul 24 14:59:02.934267 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.934253    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940"} err="failed to get container status \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": rpc error: code = NotFound desc = could not find container \"b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940\": container with ID starting with b8102250ed67d6658bea701f334aaca7ed91107a58627ac3fdc06b0ae31fb940 not found: ID does not exist"
Jul 24 14:59:02.947588 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947562    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:59:02.947813 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947802    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9136e2a6-49bf-459c-8435-329dfb7817e5" containerName="registry"
Jul 24 14:59:02.947874 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947815    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9136e2a6-49bf-459c-8435-329dfb7817e5" containerName="registry"
Jul 24 14:59:02.947874 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947822    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa65bcf-21a8-4d03-9d18-6b0e3d451335" containerName="console"
Jul 24 14:59:02.947874 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947828    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa65bcf-21a8-4d03-9d18-6b0e3d451335" containerName="console"
Jul 24 14:59:02.947874 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947836    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="thanos-sidecar"
Jul 24 14:59:02.947874 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947841    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="thanos-sidecar"
Jul 24 14:59:02.947874 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947850    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="init-config-reloader"
Jul 24 14:59:02.947874 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947863    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="init-config-reloader"
Jul 24 14:59:02.947874 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947871    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy-thanos"
Jul 24 14:59:02.947874 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947877    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy-thanos"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947887    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="config-reloader"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947892    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="config-reloader"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947898    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy-web"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947903    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy-web"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947909    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="prometheus"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947914    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="prometheus"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947922    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947928    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947965    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa65bcf-21a8-4d03-9d18-6b0e3d451335" containerName="console"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.947972    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="config-reloader"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.948001    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.948010    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="thanos-sidecar"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.948016    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy-thanos"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.948021    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9136e2a6-49bf-459c-8435-329dfb7817e5" containerName="registry"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.948027    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="kube-rbac-proxy-web"
Jul 24 14:59:02.948179 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.948032    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" containerName="prometheus"
Jul 24 14:59:02.951731 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.951706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:02.956526 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.956507    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 14:59:02.956849 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.956829    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-84vdabarj06ap\""
Jul 24 14:59:02.957039 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.956887    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 14:59:02.957039 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.956889    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n68dd\""
Jul 24 14:59:02.957251 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.957231    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 14:59:02.957304 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.957248    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 14:59:02.957357 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.957304    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 14:59:02.957408 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.957249    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 14:59:02.957455 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.957440    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 14:59:02.957609 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.957579    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 14:59:02.957760 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.957660    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 14:59:02.957760 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.957694    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 14:59:02.957760 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.957702    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 14:59:02.957939 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.957908    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 14:59:02.964134 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.964113    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 14:59:02.965665 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.965644    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 14:59:02.965966 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.965951    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 14:59:02.980938 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:02.980910    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:59:03.073751 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.073714    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.073751 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.073756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.073974 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.073775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.073974 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.073815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.073974 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.073848    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2673a26b-158c-4054-9da2-10e5a9e9a206-config-out\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.073974 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.073870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.073974 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.073912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2673a26b-158c-4054-9da2-10e5a9e9a206-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.073974 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.073955    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.073974 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074079    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdx4c\" (UniqueName: \"kubernetes.io/projected/2673a26b-158c-4054-9da2-10e5a9e9a206-kube-api-access-fdx4c\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-web-config\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.074300 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.074278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-config\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175090 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175090 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdx4c\" (UniqueName: \"kubernetes.io/projected/2673a26b-158c-4054-9da2-10e5a9e9a206-kube-api-access-fdx4c\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-web-config\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175279    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-config\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.175420 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.176055 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2673a26b-158c-4054-9da2-10e5a9e9a206-config-out\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.176055 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.176055 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2673a26b-158c-4054-9da2-10e5a9e9a206-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.176055 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175533    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.176055 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.176055 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.175615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.176545 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.176194    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.176545 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.176384    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.176545 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.176525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.178233 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.177134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.178233 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.177795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.178233 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.178113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.178481 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.178358    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.178583 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.178560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-web-config\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.178642 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.178571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.178852 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.178824    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.179102 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.179078    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.179364 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.179298    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-config\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.179580 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.179549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.179580 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.179575    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.180543 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.180516    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.180651 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.180628    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2673a26b-158c-4054-9da2-10e5a9e9a206-config-out\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.180826 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.180812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2673a26b-158c-4054-9da2-10e5a9e9a206-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.181765 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.181746    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2673a26b-158c-4054-9da2-10e5a9e9a206-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.182506 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.182488    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2673a26b-158c-4054-9da2-10e5a9e9a206-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.187225 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.187203    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdx4c\" (UniqueName: \"kubernetes.io/projected/2673a26b-158c-4054-9da2-10e5a9e9a206-kube-api-access-fdx4c\") pod \"prometheus-k8s-0\" (UID: \"2673a26b-158c-4054-9da2-10e5a9e9a206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.261390 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.261348    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:59:03.428775 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.428715    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:59:03.431389 ip-10-0-129-232 kubenswrapper[2582]: W0724 14:59:03.431363    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2673a26b_158c_4054_9da2_10e5a9e9a206.slice/crio-a18839acf78ee74692f754838eb0cefdfe1402506ebe3254f954250dfecc50c9 WatchSource:0}: Error finding container a18839acf78ee74692f754838eb0cefdfe1402506ebe3254f954250dfecc50c9: Status 404 returned error can't find the container with id a18839acf78ee74692f754838eb0cefdfe1402506ebe3254f954250dfecc50c9
Jul 24 14:59:03.878212 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.878104    2582 generic.go:356] "Generic (PLEG): container finished" podID="2673a26b-158c-4054-9da2-10e5a9e9a206" containerID="e68fad9049aae82c6e561c6e85f1e3ccc049de31677be1df26c18cf444b6be68" exitCode=0
Jul 24 14:59:03.878378 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.878195    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2673a26b-158c-4054-9da2-10e5a9e9a206","Type":"ContainerDied","Data":"e68fad9049aae82c6e561c6e85f1e3ccc049de31677be1df26c18cf444b6be68"}
Jul 24 14:59:03.878378 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:03.878296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2673a26b-158c-4054-9da2-10e5a9e9a206","Type":"ContainerStarted","Data":"a18839acf78ee74692f754838eb0cefdfe1402506ebe3254f954250dfecc50c9"}
Jul 24 14:59:04.003805 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:04.003770    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d91d865-4701-4ed3-9863-55a6c4460da2" path="/var/lib/kubelet/pods/5d91d865-4701-4ed3-9863-55a6c4460da2/volumes"
Jul 24 14:59:04.886459 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:04.886428    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2673a26b-158c-4054-9da2-10e5a9e9a206","Type":"ContainerStarted","Data":"97c6983b6ac43e144a2752d0092663deb29e5dc772cdf6a370c95ff52e55ac87"}
Jul 24 14:59:04.886872 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:04.886492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2673a26b-158c-4054-9da2-10e5a9e9a206","Type":"ContainerStarted","Data":"69b2849df8863355381da0b991cade7461c6d6833ba26ed12a88d636fa7b810b"}
Jul 24 14:59:04.886872 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:04.886517    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2673a26b-158c-4054-9da2-10e5a9e9a206","Type":"ContainerStarted","Data":"19cfdf434f3da7db3602c6f30ddef2250687fab0f55d24381e24fc38ba27aa35"}
Jul 24 14:59:04.886872 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:04.886543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2673a26b-158c-4054-9da2-10e5a9e9a206","Type":"ContainerStarted","Data":"e25e35e8829f1d82faceb4a6626c670d152c7a1eda182401dc7aa15870864a78"}
Jul 24 14:59:04.886872 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:04.886568    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2673a26b-158c-4054-9da2-10e5a9e9a206","Type":"ContainerStarted","Data":"05051a89734aacd2ba80469edb11e6deb536935e9b4595801da6d6451732ae7d"}
Jul 24 14:59:04.886872 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:04.886592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2673a26b-158c-4054-9da2-10e5a9e9a206","Type":"ContainerStarted","Data":"403da562ce1225e804ef23ca9cbf1c742f2862472b4dc9c83730aed7a37b0d05"}
Jul 24 14:59:04.921353 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:04.921301    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.899832403 podStartE2EDuration="2.921278604s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.446201ms" isStatefulPod=false podCreationTimestamp="2026-07-24 14:59:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:59:04.919275934 +0000 UTC m=+173.458255364" watchObservedRunningTime="2026-07-24 14:59:04.921278604 +0000 UTC m=+173.460258029"
Jul 24 14:59:08.262075 ip-10-0-129-232 kubenswrapper[2582]: I0724 14:59:08.262022    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:00:03.261772 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:00:03.261740    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:00:03.277767 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:00:03.277741    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:00:04.114398 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:00:04.114371    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:01:11.862807 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:11.862776    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:01:11.865798 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:11.865774    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 15:01:11.867625 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:11.867605    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:01:23.437442 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.437405    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"]
Jul 24 15:01:23.439550 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.439534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.442967 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.442941    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 15:01:23.443145 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.443105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 15:01:23.443145 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.443027    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lmn65\""
Jul 24 15:01:23.444179 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.444162    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 15:01:23.450326 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.450304    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 15:01:23.462605 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.462583    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"]
Jul 24 15:01:23.487606 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.487576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.487606 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.487615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-manifests\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.487817 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.487638    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-tmp\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.487817 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.487773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl257\" (UniqueName: \"kubernetes.io/projected/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-kube-api-access-vl257\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.487817 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.487807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.589223 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.589185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl257\" (UniqueName: \"kubernetes.io/projected/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-kube-api-access-vl257\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.589223 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.589228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.589447 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.589328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.589447 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.589375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-manifests\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.589447 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.589398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-tmp\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.589749 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.589730    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-manifests\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.591695 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.591666    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-tmp\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.591814 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.591799    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.592023 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.591974    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.608866 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.608840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl257\" (UniqueName: \"kubernetes.io/projected/d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058-kube-api-access-vl257\") pod \"opendatahub-operator-controller-manager-7f5584866b-7qmsk\" (UID: \"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.753795 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.753703    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:23.904087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.903445    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"]
Jul 24 15:01:23.906067 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:01:23.906038    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95a1d15_a0e2_49f4_9f3b_4b51cd9f8058.slice/crio-91cf566fae5e3cb7686c9d83b752344ec01033616b8489ebcf4d29a7ec9adbb4 WatchSource:0}: Error finding container 91cf566fae5e3cb7686c9d83b752344ec01033616b8489ebcf4d29a7ec9adbb4: Status 404 returned error can't find the container with id 91cf566fae5e3cb7686c9d83b752344ec01033616b8489ebcf4d29a7ec9adbb4
Jul 24 15:01:23.907894 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:23.907877    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:01:24.385967 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:24.385928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk" event={"ID":"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058","Type":"ContainerStarted","Data":"91cf566fae5e3cb7686c9d83b752344ec01033616b8489ebcf4d29a7ec9adbb4"}
Jul 24 15:01:27.401964 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:27.401924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk" event={"ID":"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058","Type":"ContainerStarted","Data":"bfe391f10ae63ba055cdd5fc7f120bff753d17b8ebb5f8942e1dad8fa27d908f"}
Jul 24 15:01:28.407081 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:28.407042    2582 generic.go:356] "Generic (PLEG): container finished" podID="d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058" containerID="bfe391f10ae63ba055cdd5fc7f120bff753d17b8ebb5f8942e1dad8fa27d908f" exitCode=0
Jul 24 15:01:28.407081 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:28.407084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk" event={"ID":"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058","Type":"ContainerDied","Data":"bfe391f10ae63ba055cdd5fc7f120bff753d17b8ebb5f8942e1dad8fa27d908f"}
Jul 24 15:01:29.413332 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:29.413291    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk" event={"ID":"d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058","Type":"ContainerStarted","Data":"e83a6d30de2b4d1eda3933b63c4d71153a8284708c4a36a1d92bb75610bf699b"}
Jul 24 15:01:29.413828 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:29.413440    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:29.445554 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:29.445507    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk" podStartSLOduration=1.874663108 podStartE2EDuration="6.445483321s" totalImagesPullingTime="3.499644026s" totalInitContainerRuntime="1.071176187s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:01:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:01:29.441730202 +0000 UTC m=+317.980709615" watchObservedRunningTime="2026-07-24 15:01:29.445483321 +0000 UTC m=+317.984462734"
Jul 24 15:01:40.420288 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:40.420254    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f5584866b-7qmsk"
Jul 24 15:01:44.149415 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.149376    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"]
Jul 24 15:01:44.161126 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.161097    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.164102 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.164073    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jnrv5\""
Jul 24 15:01:44.165038 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.165015    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 15:01:44.165168 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.165093    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 15:01:44.165168 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.165142    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 15:01:44.165168 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.165156    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 15:01:44.165322 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.165226    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 15:01:44.167548 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.167527    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"]
Jul 24 15:01:44.265446 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.265403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/829c9afa-f2d0-49a7-abc7-5c8736d91993-manager-config\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.265645 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.265462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj84g\" (UniqueName: \"kubernetes.io/projected/829c9afa-f2d0-49a7-abc7-5c8736d91993-kube-api-access-mj84g\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.265645 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.265536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/829c9afa-f2d0-49a7-abc7-5c8736d91993-cert\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.265645 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.265595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/829c9afa-f2d0-49a7-abc7-5c8736d91993-metrics-cert\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.366847 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.366806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj84g\" (UniqueName: \"kubernetes.io/projected/829c9afa-f2d0-49a7-abc7-5c8736d91993-kube-api-access-mj84g\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.366847 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.366847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/829c9afa-f2d0-49a7-abc7-5c8736d91993-cert\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.367106 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.366887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/829c9afa-f2d0-49a7-abc7-5c8736d91993-metrics-cert\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.367106 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.366915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/829c9afa-f2d0-49a7-abc7-5c8736d91993-manager-config\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.367723 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.367688    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/829c9afa-f2d0-49a7-abc7-5c8736d91993-manager-config\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.369655 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.369630    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/829c9afa-f2d0-49a7-abc7-5c8736d91993-metrics-cert\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.369750 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.369665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/829c9afa-f2d0-49a7-abc7-5c8736d91993-cert\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.383001 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.382948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj84g\" (UniqueName: \"kubernetes.io/projected/829c9afa-f2d0-49a7-abc7-5c8736d91993-kube-api-access-mj84g\") pod \"lws-controller-manager-54d8b9c4f-j6mf6\" (UID: \"829c9afa-f2d0-49a7-abc7-5c8736d91993\") " pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.471207 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.471113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:44.622353 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:44.622314    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"]
Jul 24 15:01:44.626754 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:01:44.626724    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829c9afa_f2d0_49a7_abc7_5c8736d91993.slice/crio-1201d4b9febfc586cf1c80f6ff4f6831416c7d4f1d3d145ac19f1f9cf07d09b7 WatchSource:0}: Error finding container 1201d4b9febfc586cf1c80f6ff4f6831416c7d4f1d3d145ac19f1f9cf07d09b7: Status 404 returned error can't find the container with id 1201d4b9febfc586cf1c80f6ff4f6831416c7d4f1d3d145ac19f1f9cf07d09b7
Jul 24 15:01:45.014470 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.014433    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"]
Jul 24 15:01:45.017776 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.017749    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.020458 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.020430    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 15:01:45.020657 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.020641    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 15:01:45.020726 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.020689    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-df8m9\""
Jul 24 15:01:45.020869 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.020849    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 15:01:45.021200 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.021180    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 15:01:45.031553 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.031520    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"]
Jul 24 15:01:45.173043 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.173005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4774c15-31fd-4936-856e-65bfa0e44b18-tls-certs\") pod \"kube-auth-proxy-758f749c7-5pcrd\" (UID: \"c4774c15-31fd-4936-856e-65bfa0e44b18\") " pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.173417 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.173053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4774c15-31fd-4936-856e-65bfa0e44b18-tmp\") pod \"kube-auth-proxy-758f749c7-5pcrd\" (UID: \"c4774c15-31fd-4936-856e-65bfa0e44b18\") " pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.173417 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.173136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcjpc\" (UniqueName: \"kubernetes.io/projected/c4774c15-31fd-4936-856e-65bfa0e44b18-kube-api-access-pcjpc\") pod \"kube-auth-proxy-758f749c7-5pcrd\" (UID: \"c4774c15-31fd-4936-856e-65bfa0e44b18\") " pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.274478 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.274383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4774c15-31fd-4936-856e-65bfa0e44b18-tls-certs\") pod \"kube-auth-proxy-758f749c7-5pcrd\" (UID: \"c4774c15-31fd-4936-856e-65bfa0e44b18\") " pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.274478 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.274431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4774c15-31fd-4936-856e-65bfa0e44b18-tmp\") pod \"kube-auth-proxy-758f749c7-5pcrd\" (UID: \"c4774c15-31fd-4936-856e-65bfa0e44b18\") " pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.274478 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.274478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcjpc\" (UniqueName: \"kubernetes.io/projected/c4774c15-31fd-4936-856e-65bfa0e44b18-kube-api-access-pcjpc\") pod \"kube-auth-proxy-758f749c7-5pcrd\" (UID: \"c4774c15-31fd-4936-856e-65bfa0e44b18\") " pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.277265 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.277235    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4774c15-31fd-4936-856e-65bfa0e44b18-tmp\") pod \"kube-auth-proxy-758f749c7-5pcrd\" (UID: \"c4774c15-31fd-4936-856e-65bfa0e44b18\") " pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.278109 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.278084    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4774c15-31fd-4936-856e-65bfa0e44b18-tls-certs\") pod \"kube-auth-proxy-758f749c7-5pcrd\" (UID: \"c4774c15-31fd-4936-856e-65bfa0e44b18\") " pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.286518 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.286454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcjpc\" (UniqueName: \"kubernetes.io/projected/c4774c15-31fd-4936-856e-65bfa0e44b18-kube-api-access-pcjpc\") pod \"kube-auth-proxy-758f749c7-5pcrd\" (UID: \"c4774c15-31fd-4936-856e-65bfa0e44b18\") " pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.332022 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.331767    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"
Jul 24 15:01:45.476058 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.475971    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6" event={"ID":"829c9afa-f2d0-49a7-abc7-5c8736d91993","Type":"ContainerStarted","Data":"1201d4b9febfc586cf1c80f6ff4f6831416c7d4f1d3d145ac19f1f9cf07d09b7"}
Jul 24 15:01:45.516147 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:45.516064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-758f749c7-5pcrd"]
Jul 24 15:01:46.483216 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:46.483165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd" event={"ID":"c4774c15-31fd-4936-856e-65bfa0e44b18","Type":"ContainerStarted","Data":"77e231acfcdefedd0a620c1d78777aba869a26c192b795b71c33cc2da1c72d72"}
Jul 24 15:01:47.490197 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:47.490099    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6" event={"ID":"829c9afa-f2d0-49a7-abc7-5c8736d91993","Type":"ContainerStarted","Data":"86d1a10f913cbe0b13a78675550b7c7d53fe181547dc0eaf8fe89b2e254a6a7c"}
Jul 24 15:01:47.490609 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:47.490214    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:01:47.523096 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:47.523034    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6" podStartSLOduration=0.919919508 podStartE2EDuration="3.523011279s" totalImagesPullingTime="2.603091771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:01:47.51933845 +0000 UTC m=+336.058317863" watchObservedRunningTime="2026-07-24 15:01:47.523011279 +0000 UTC m=+336.061990692"
Jul 24 15:01:49.501056 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:49.501024    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd" event={"ID":"c4774c15-31fd-4936-856e-65bfa0e44b18","Type":"ContainerStarted","Data":"a8bc1cdbed16a8604a760ce02e0685aae6b7c053e2713cfc0f473153c3011960"}
Jul 24 15:01:49.520572 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:49.520508    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-758f749c7-5pcrd" podStartSLOduration=2.599534567 podStartE2EDuration="5.520485295s" totalImagesPullingTime="2.920950728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:01:49.519905812 +0000 UTC m=+338.058885242" watchObservedRunningTime="2026-07-24 15:01:49.520485295 +0000 UTC m=+338.059464714"
Jul 24 15:01:58.497853 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:01:58.497823    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54d8b9c4f-j6mf6"
Jul 24 15:03:28.943486 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:28.943444    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"]
Jul 24 15:03:28.945806 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:28.945788    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:28.956602 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:28.956575    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 24 15:03:28.956602 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:28.956603    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 24 15:03:28.957496 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:28.957480    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nd7qj\""
Jul 24 15:03:28.957496 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:28.957491    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 15:03:28.957650 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:28.957550    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 15:03:28.972863 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:28.972837    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"]
Jul 24 15:03:29.025713 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.025677    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drlwl\" (UniqueName: \"kubernetes.io/projected/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-kube-api-access-drlwl\") pod \"kuadrant-console-plugin-66b5774985-dmxcn\" (UID: \"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:29.025898 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.025720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dmxcn\" (UID: \"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:29.025898 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.025801    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dmxcn\" (UID: \"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:29.126443 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.126410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dmxcn\" (UID: \"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:29.126653 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.126495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dmxcn\" (UID: \"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:29.126653 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.126534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drlwl\" (UniqueName: \"kubernetes.io/projected/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-kube-api-access-drlwl\") pod \"kuadrant-console-plugin-66b5774985-dmxcn\" (UID: \"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:29.126653 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:03:29.126552    2582 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 24 15:03:29.126653 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:03:29.126639    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-plugin-serving-cert podName:8d9f354c-c4dc-42cc-9f65-7d807ca25ba1 nodeName:}" failed. No retries permitted until 2026-07-24 15:03:29.626615346 +0000 UTC m=+438.165594747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-dmxcn" (UID: "8d9f354c-c4dc-42cc-9f65-7d807ca25ba1") : secret "plugin-serving-cert" not found
Jul 24 15:03:29.127227 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.127209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dmxcn\" (UID: \"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:29.137587 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.137563    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drlwl\" (UniqueName: \"kubernetes.io/projected/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-kube-api-access-drlwl\") pod \"kuadrant-console-plugin-66b5774985-dmxcn\" (UID: \"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:29.631830 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.631792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dmxcn\" (UID: \"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:29.634455 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.634426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d9f354c-c4dc-42cc-9f65-7d807ca25ba1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dmxcn\" (UID: \"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:29.866702 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:29.866662    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"
Jul 24 15:03:30.006784 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:30.004628    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn"]
Jul 24 15:03:30.010910 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:03:30.010883    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d9f354c_c4dc_42cc_9f65_7d807ca25ba1.slice/crio-da9ca23251b76c606bfc61c917c0dabac06dc9f575e38a960d3c9578a994bede WatchSource:0}: Error finding container da9ca23251b76c606bfc61c917c0dabac06dc9f575e38a960d3c9578a994bede: Status 404 returned error can't find the container with id da9ca23251b76c606bfc61c917c0dabac06dc9f575e38a960d3c9578a994bede
Jul 24 15:03:30.877194 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:30.877156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn" event={"ID":"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1","Type":"ContainerStarted","Data":"da9ca23251b76c606bfc61c917c0dabac06dc9f575e38a960d3c9578a994bede"}
Jul 24 15:03:41.354649 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.354556    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"]
Jul 24 15:03:41.390675 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.390643    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"]
Jul 24 15:03:41.390843 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.390784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:03:41.394646 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.394623    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sf7fs\""
Jul 24 15:03:41.544962 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.544923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nghf4\" (UID: \"fc285d8c-c61e-45d0-a857-7bae51c3e0ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:03:41.545188 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.545020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twsjk\" (UniqueName: \"kubernetes.io/projected/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-kube-api-access-twsjk\") pod \"kuadrant-operator-controller-manager-86878c769f-nghf4\" (UID: \"fc285d8c-c61e-45d0-a857-7bae51c3e0ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:03:41.646523 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.646484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nghf4\" (UID: \"fc285d8c-c61e-45d0-a857-7bae51c3e0ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:03:41.646729 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.646535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twsjk\" (UniqueName: \"kubernetes.io/projected/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-kube-api-access-twsjk\") pod \"kuadrant-operator-controller-manager-86878c769f-nghf4\" (UID: \"fc285d8c-c61e-45d0-a857-7bae51c3e0ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:03:41.646947 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.646918    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nghf4\" (UID: \"fc285d8c-c61e-45d0-a857-7bae51c3e0ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:03:41.657127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.657092    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twsjk\" (UniqueName: \"kubernetes.io/projected/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-kube-api-access-twsjk\") pod \"kuadrant-operator-controller-manager-86878c769f-nghf4\" (UID: \"fc285d8c-c61e-45d0-a857-7bae51c3e0ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:03:41.703731 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:41.703695    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:03:52.415148 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:52.415120    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"]
Jul 24 15:03:52.418300 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:03:52.418272    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc285d8c_c61e_45d0_a857_7bae51c3e0ea.slice/crio-b55a6a27db213cdb94b063822d5933824fd084ac318c391a3acbea5e288f260f WatchSource:0}: Error finding container b55a6a27db213cdb94b063822d5933824fd084ac318c391a3acbea5e288f260f: Status 404 returned error can't find the container with id b55a6a27db213cdb94b063822d5933824fd084ac318c391a3acbea5e288f260f
Jul 24 15:03:52.978756 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:52.978706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn" event={"ID":"8d9f354c-c4dc-42cc-9f65-7d807ca25ba1","Type":"ContainerStarted","Data":"e0327be572ba5fa1369eb2141a076c9146cab957f674cbac8440e69683257c90"}
Jul 24 15:03:52.980012 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:52.979962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4" event={"ID":"fc285d8c-c61e-45d0-a857-7bae51c3e0ea","Type":"ContainerStarted","Data":"b55a6a27db213cdb94b063822d5933824fd084ac318c391a3acbea5e288f260f"}
Jul 24 15:03:52.999611 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:52.999563    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmxcn" podStartSLOduration=2.681814749 podStartE2EDuration="24.999546845s" totalImagesPullingTime="22.317732096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:52.998567461 +0000 UTC m=+461.537546873" watchObservedRunningTime="2026-07-24 15:03:52.999546845 +0000 UTC m=+461.538526257"
Jul 24 15:03:58.004947 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:58.004907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4" event={"ID":"fc285d8c-c61e-45d0-a857-7bae51c3e0ea","Type":"ContainerStarted","Data":"0dd1eba6434613be7ed9ddc7760d3eafc7020535729c06b7ea40467cccb0dafc"}
Jul 24 15:03:58.005369 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:58.005031    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:03:58.028724 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:03:58.028667    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4" podStartSLOduration=12.000516305 podStartE2EDuration="17.028649996s" totalImagesPullingTime="5.028133691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:58.026721162 +0000 UTC m=+466.565700576" watchObservedRunningTime="2026-07-24 15:03:58.028649996 +0000 UTC m=+466.567629408"
Jul 24 15:04:09.013202 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:09.013162    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:04:32.174302 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:32.174263    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-n9cl6"]
Jul 24 15:04:32.227783 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:32.227698    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n9cl6"]
Jul 24 15:04:32.228016 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:32.227810    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n9cl6"
Jul 24 15:04:32.230729 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:32.230688    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hdm24\""
Jul 24 15:04:32.295843 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:32.295803    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8dsf\" (UniqueName: \"kubernetes.io/projected/a7b9ab48-64fc-4c6e-99ec-31326b5be179-kube-api-access-h8dsf\") pod \"authorino-75d556bd77-n9cl6\" (UID: \"a7b9ab48-64fc-4c6e-99ec-31326b5be179\") " pod="kuadrant-system/authorino-75d556bd77-n9cl6"
Jul 24 15:04:32.396322 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:32.396289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8dsf\" (UniqueName: \"kubernetes.io/projected/a7b9ab48-64fc-4c6e-99ec-31326b5be179-kube-api-access-h8dsf\") pod \"authorino-75d556bd77-n9cl6\" (UID: \"a7b9ab48-64fc-4c6e-99ec-31326b5be179\") " pod="kuadrant-system/authorino-75d556bd77-n9cl6"
Jul 24 15:04:32.405709 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:32.405678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8dsf\" (UniqueName: \"kubernetes.io/projected/a7b9ab48-64fc-4c6e-99ec-31326b5be179-kube-api-access-h8dsf\") pod \"authorino-75d556bd77-n9cl6\" (UID: \"a7b9ab48-64fc-4c6e-99ec-31326b5be179\") " pod="kuadrant-system/authorino-75d556bd77-n9cl6"
Jul 24 15:04:32.537006 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:32.536888    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n9cl6"
Jul 24 15:04:32.672415 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:32.672377    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n9cl6"]
Jul 24 15:04:32.675809 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:04:32.675781    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7b9ab48_64fc_4c6e_99ec_31326b5be179.slice/crio-d224c34df03cc5ee075809393d51d17ef44198dd5a5f9b8b6330b08397f77900 WatchSource:0}: Error finding container d224c34df03cc5ee075809393d51d17ef44198dd5a5f9b8b6330b08397f77900: Status 404 returned error can't find the container with id d224c34df03cc5ee075809393d51d17ef44198dd5a5f9b8b6330b08397f77900
Jul 24 15:04:33.147749 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:33.147719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n9cl6" event={"ID":"a7b9ab48-64fc-4c6e-99ec-31326b5be179","Type":"ContainerStarted","Data":"d224c34df03cc5ee075809393d51d17ef44198dd5a5f9b8b6330b08397f77900"}
Jul 24 15:04:36.163858 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:36.163821    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n9cl6" event={"ID":"a7b9ab48-64fc-4c6e-99ec-31326b5be179","Type":"ContainerStarted","Data":"b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15"}
Jul 24 15:04:36.180855 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:04:36.180805    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-n9cl6" podStartSLOduration=1.149170913 podStartE2EDuration="4.18078803s" totalImagesPullingTime="3.031617117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:36.179397846 +0000 UTC m=+504.718377260" watchObservedRunningTime="2026-07-24 15:04:36.18078803 +0000 UTC m=+504.719767443"
Jul 24 15:05:07.327444 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.327357    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gr95v"]
Jul 24 15:05:07.329895 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.329874    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gr95v"
Jul 24 15:05:07.340255 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.340225    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gr95v"]
Jul 24 15:05:07.511441 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.511398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr48r\" (UniqueName: \"kubernetes.io/projected/d6e3102e-efed-48ed-8426-d8a8e1e9e5a0-kube-api-access-mr48r\") pod \"authorino-5d4b67c446-gr95v\" (UID: \"d6e3102e-efed-48ed-8426-d8a8e1e9e5a0\") " pod="kuadrant-system/authorino-5d4b67c446-gr95v"
Jul 24 15:05:07.567039 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.567005    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gr95v"]
Jul 24 15:05:07.567292 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:05:07.567270    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mr48r], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-gr95v" podUID="d6e3102e-efed-48ed-8426-d8a8e1e9e5a0"
Jul 24 15:05:07.603536 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.603453    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7954448df6-f8rwf"]
Jul 24 15:05:07.605655 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.605635    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7954448df6-f8rwf"
Jul 24 15:05:07.608344 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.608322    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 15:05:07.611964 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.611938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr48r\" (UniqueName: \"kubernetes.io/projected/d6e3102e-efed-48ed-8426-d8a8e1e9e5a0-kube-api-access-mr48r\") pod \"authorino-5d4b67c446-gr95v\" (UID: \"d6e3102e-efed-48ed-8426-d8a8e1e9e5a0\") " pod="kuadrant-system/authorino-5d4b67c446-gr95v"
Jul 24 15:05:07.615502 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.615473    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7954448df6-f8rwf"]
Jul 24 15:05:07.624092 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.624055    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr48r\" (UniqueName: \"kubernetes.io/projected/d6e3102e-efed-48ed-8426-d8a8e1e9e5a0-kube-api-access-mr48r\") pod \"authorino-5d4b67c446-gr95v\" (UID: \"d6e3102e-efed-48ed-8426-d8a8e1e9e5a0\") " pod="kuadrant-system/authorino-5d4b67c446-gr95v"
Jul 24 15:05:07.713065 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.713022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlh7h\" (UniqueName: \"kubernetes.io/projected/a95da48d-77a8-4283-80a1-7266fc6a5819-kube-api-access-jlh7h\") pod \"authorino-7954448df6-f8rwf\" (UID: \"a95da48d-77a8-4283-80a1-7266fc6a5819\") " pod="kuadrant-system/authorino-7954448df6-f8rwf"
Jul 24 15:05:07.713241 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.713079    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a95da48d-77a8-4283-80a1-7266fc6a5819-tls-cert\") pod \"authorino-7954448df6-f8rwf\" (UID: \"a95da48d-77a8-4283-80a1-7266fc6a5819\") " pod="kuadrant-system/authorino-7954448df6-f8rwf"
Jul 24 15:05:07.814475 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.814434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlh7h\" (UniqueName: \"kubernetes.io/projected/a95da48d-77a8-4283-80a1-7266fc6a5819-kube-api-access-jlh7h\") pod \"authorino-7954448df6-f8rwf\" (UID: \"a95da48d-77a8-4283-80a1-7266fc6a5819\") " pod="kuadrant-system/authorino-7954448df6-f8rwf"
Jul 24 15:05:07.814475 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.814483    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a95da48d-77a8-4283-80a1-7266fc6a5819-tls-cert\") pod \"authorino-7954448df6-f8rwf\" (UID: \"a95da48d-77a8-4283-80a1-7266fc6a5819\") " pod="kuadrant-system/authorino-7954448df6-f8rwf"
Jul 24 15:05:07.817091 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.817067    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a95da48d-77a8-4283-80a1-7266fc6a5819-tls-cert\") pod \"authorino-7954448df6-f8rwf\" (UID: \"a95da48d-77a8-4283-80a1-7266fc6a5819\") " pod="kuadrant-system/authorino-7954448df6-f8rwf"
Jul 24 15:05:07.824530 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.824502    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlh7h\" (UniqueName: \"kubernetes.io/projected/a95da48d-77a8-4283-80a1-7266fc6a5819-kube-api-access-jlh7h\") pod \"authorino-7954448df6-f8rwf\" (UID: \"a95da48d-77a8-4283-80a1-7266fc6a5819\") " pod="kuadrant-system/authorino-7954448df6-f8rwf"
Jul 24 15:05:07.915333 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:07.915294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7954448df6-f8rwf"
Jul 24 15:05:08.057835 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:08.057809    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7954448df6-f8rwf"]
Jul 24 15:05:08.060222 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:05:08.060185    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda95da48d_77a8_4283_80a1_7266fc6a5819.slice/crio-14551791b9d4f715cbcd4cc1a186751912c65ac1f9db530d4693d60bd1b22750 WatchSource:0}: Error finding container 14551791b9d4f715cbcd4cc1a186751912c65ac1f9db530d4693d60bd1b22750: Status 404 returned error can't find the container with id 14551791b9d4f715cbcd4cc1a186751912c65ac1f9db530d4693d60bd1b22750
Jul 24 15:05:08.296959 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:08.296868    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gr95v"
Jul 24 15:05:08.296959 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:08.296885    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7954448df6-f8rwf" event={"ID":"a95da48d-77a8-4283-80a1-7266fc6a5819","Type":"ContainerStarted","Data":"14551791b9d4f715cbcd4cc1a186751912c65ac1f9db530d4693d60bd1b22750"}
Jul 24 15:05:08.303876 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:08.303855    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gr95v"
Jul 24 15:05:08.420375 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:08.420346    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr48r\" (UniqueName: \"kubernetes.io/projected/d6e3102e-efed-48ed-8426-d8a8e1e9e5a0-kube-api-access-mr48r\") pod \"d6e3102e-efed-48ed-8426-d8a8e1e9e5a0\" (UID: \"d6e3102e-efed-48ed-8426-d8a8e1e9e5a0\") "
Jul 24 15:05:08.422566 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:08.422530    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e3102e-efed-48ed-8426-d8a8e1e9e5a0-kube-api-access-mr48r" (OuterVolumeSpecName: "kube-api-access-mr48r") pod "d6e3102e-efed-48ed-8426-d8a8e1e9e5a0" (UID: "d6e3102e-efed-48ed-8426-d8a8e1e9e5a0"). InnerVolumeSpecName "kube-api-access-mr48r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:05:08.521666 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:08.521627    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr48r\" (UniqueName: \"kubernetes.io/projected/d6e3102e-efed-48ed-8426-d8a8e1e9e5a0-kube-api-access-mr48r\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:05:09.302627 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.302597    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gr95v"
Jul 24 15:05:09.302818 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.302602    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7954448df6-f8rwf" event={"ID":"a95da48d-77a8-4283-80a1-7266fc6a5819","Type":"ContainerStarted","Data":"3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84"}
Jul 24 15:05:09.326010 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.325917    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7954448df6-f8rwf" podStartSLOduration=1.971173291 podStartE2EDuration="2.325901794s" totalImagesPullingTime="354.728503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:05:09.324353494 +0000 UTC m=+537.863332908" watchObservedRunningTime="2026-07-24 15:05:09.325901794 +0000 UTC m=+537.864881206"
Jul 24 15:05:09.356007 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.355955    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gr95v"]
Jul 24 15:05:09.360590 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.360559    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n9cl6"]
Jul 24 15:05:09.360778 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.360755    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-n9cl6" podUID="a7b9ab48-64fc-4c6e-99ec-31326b5be179" containerName="authorino" containerID="cri-o://b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15" gracePeriod=30
Jul 24 15:05:09.362082 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.362058    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gr95v"]
Jul 24 15:05:09.635207 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.635171    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n9cl6"
Jul 24 15:05:09.732532 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.732495    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8dsf\" (UniqueName: \"kubernetes.io/projected/a7b9ab48-64fc-4c6e-99ec-31326b5be179-kube-api-access-h8dsf\") pod \"a7b9ab48-64fc-4c6e-99ec-31326b5be179\" (UID: \"a7b9ab48-64fc-4c6e-99ec-31326b5be179\") "
Jul 24 15:05:09.735137 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.735101    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b9ab48-64fc-4c6e-99ec-31326b5be179-kube-api-access-h8dsf" (OuterVolumeSpecName: "kube-api-access-h8dsf") pod "a7b9ab48-64fc-4c6e-99ec-31326b5be179" (UID: "a7b9ab48-64fc-4c6e-99ec-31326b5be179"). InnerVolumeSpecName "kube-api-access-h8dsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:05:09.834055 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.833977    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8dsf\" (UniqueName: \"kubernetes.io/projected/a7b9ab48-64fc-4c6e-99ec-31326b5be179-kube-api-access-h8dsf\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:05:09.995691 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:09.995655    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6e3102e-efed-48ed-8426-d8a8e1e9e5a0" path="/var/lib/kubelet/pods/d6e3102e-efed-48ed-8426-d8a8e1e9e5a0/volumes"
Jul 24 15:05:10.309650 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:10.309559    2582 generic.go:356] "Generic (PLEG): container finished" podID="a7b9ab48-64fc-4c6e-99ec-31326b5be179" containerID="b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15" exitCode=0
Jul 24 15:05:10.309650 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:10.309613    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n9cl6"
Jul 24 15:05:10.309883 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:10.309644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n9cl6" event={"ID":"a7b9ab48-64fc-4c6e-99ec-31326b5be179","Type":"ContainerDied","Data":"b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15"}
Jul 24 15:05:10.309883 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:10.309682    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n9cl6" event={"ID":"a7b9ab48-64fc-4c6e-99ec-31326b5be179","Type":"ContainerDied","Data":"d224c34df03cc5ee075809393d51d17ef44198dd5a5f9b8b6330b08397f77900"}
Jul 24 15:05:10.309883 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:10.309700    2582 scope.go:117] "RemoveContainer" containerID="b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15"
Jul 24 15:05:10.318172 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:10.318152    2582 scope.go:117] "RemoveContainer" containerID="b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15"
Jul 24 15:05:10.318480 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:05:10.318461    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15\": container with ID starting with b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15 not found: ID does not exist" containerID="b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15"
Jul 24 15:05:10.318532 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:10.318492    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15"} err="failed to get container status \"b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15\": rpc error: code = NotFound desc = could not find container \"b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15\": container with ID starting with b4248b0c016218c2ea02a97e5c643ad5ab6fc4de4ce888f9319fad93a92e9c15 not found: ID does not exist"
Jul 24 15:05:10.327002 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:10.326960    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n9cl6"]
Jul 24 15:05:10.330699 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:10.330673    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n9cl6"]
Jul 24 15:05:11.994900 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:11.994864    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7b9ab48-64fc-4c6e-99ec-31326b5be179" path="/var/lib/kubelet/pods/a7b9ab48-64fc-4c6e-99ec-31326b5be179/volumes"
Jul 24 15:05:50.688015 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.687946    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"]
Jul 24 15:05:50.688552 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.688395    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b9ab48-64fc-4c6e-99ec-31326b5be179" containerName="authorino"
Jul 24 15:05:50.688552 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.688413    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b9ab48-64fc-4c6e-99ec-31326b5be179" containerName="authorino"
Jul 24 15:05:50.688552 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.688518    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b9ab48-64fc-4c6e-99ec-31326b5be179" containerName="authorino"
Jul 24 15:05:50.690571 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.690548    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"
Jul 24 15:05:50.693833 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.693803    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 15:05:50.699940 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.699910    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"]
Jul 24 15:05:50.757872 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.757835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg7mw\" (UniqueName: \"kubernetes.io/projected/88141022-ed92-4da7-ae77-8c7e5830fd54-kube-api-access-vg7mw\") pod \"payload-pre-processing-687dbb6cf6-9mdkt\" (UID: \"88141022-ed92-4da7-ae77-8c7e5830fd54\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"
Jul 24 15:05:50.757872 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.757878    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88141022-ed92-4da7-ae77-8c7e5830fd54-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-9mdkt\" (UID: \"88141022-ed92-4da7-ae77-8c7e5830fd54\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"
Jul 24 15:05:50.858874 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.858836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg7mw\" (UniqueName: \"kubernetes.io/projected/88141022-ed92-4da7-ae77-8c7e5830fd54-kube-api-access-vg7mw\") pod \"payload-pre-processing-687dbb6cf6-9mdkt\" (UID: \"88141022-ed92-4da7-ae77-8c7e5830fd54\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"
Jul 24 15:05:50.858874 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.858878    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88141022-ed92-4da7-ae77-8c7e5830fd54-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-9mdkt\" (UID: \"88141022-ed92-4da7-ae77-8c7e5830fd54\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"
Jul 24 15:05:50.859825 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.859792    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88141022-ed92-4da7-ae77-8c7e5830fd54-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-9mdkt\" (UID: \"88141022-ed92-4da7-ae77-8c7e5830fd54\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"
Jul 24 15:05:50.869548 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:50.869507    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg7mw\" (UniqueName: \"kubernetes.io/projected/88141022-ed92-4da7-ae77-8c7e5830fd54-kube-api-access-vg7mw\") pod \"payload-pre-processing-687dbb6cf6-9mdkt\" (UID: \"88141022-ed92-4da7-ae77-8c7e5830fd54\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"
Jul 24 15:05:51.003210 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:51.003106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"
Jul 24 15:05:51.142447 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:51.142348    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"]
Jul 24 15:05:51.145337 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:05:51.145304    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88141022_ed92_4da7_ae77_8c7e5830fd54.slice/crio-eeac5ca5d4c7fac3f1e608a67c596bd8f0bd615c0d2637eed0c5700eb10ba8c3 WatchSource:0}: Error finding container eeac5ca5d4c7fac3f1e608a67c596bd8f0bd615c0d2637eed0c5700eb10ba8c3: Status 404 returned error can't find the container with id eeac5ca5d4c7fac3f1e608a67c596bd8f0bd615c0d2637eed0c5700eb10ba8c3
Jul 24 15:05:51.485147 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:51.485109    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt" event={"ID":"88141022-ed92-4da7-ae77-8c7e5830fd54","Type":"ContainerStarted","Data":"eeac5ca5d4c7fac3f1e608a67c596bd8f0bd615c0d2637eed0c5700eb10ba8c3"}
Jul 24 15:05:54.498847 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:54.498803    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt" event={"ID":"88141022-ed92-4da7-ae77-8c7e5830fd54","Type":"ContainerStarted","Data":"d71a572a0c855b5ce343a708e71888633d3c37f49f95db973ea42d8287976dc2"}
Jul 24 15:05:54.499327 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:54.498953    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"
Jul 24 15:05:54.516856 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:05:54.516795    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt" podStartSLOduration=2.155570248 podStartE2EDuration="4.516777807s" totalImagesPullingTime="2.361207559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:05:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:05:54.516454903 +0000 UTC m=+583.055434308" watchObservedRunningTime="2026-07-24 15:05:54.516777807 +0000 UTC m=+583.055757219"
Jul 24 15:06:05.508535 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:05.508503    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-9mdkt"
Jul 24 15:06:11.890076 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:11.890037    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:06:11.891177 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:11.891159    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:06:24.140576 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.140543    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"]
Jul 24 15:06:24.143758 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.143739    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.147742 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.147714    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 24 15:06:24.147909 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.147850    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.148050 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.147909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd894\" (UniqueName: \"kubernetes.io/projected/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-kube-api-access-nd894\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.148050 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.147949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.148050 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.148035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.148229 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.148053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.148229 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.148101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.148673 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.148654    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 15:06:24.148757 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.148713    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mx8dd\""
Jul 24 15:06:24.148824 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.148804    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 15:06:24.158959 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.158926    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"]
Jul 24 15:06:24.249047 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.249006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.249342 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.249072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd894\" (UniqueName: \"kubernetes.io/projected/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-kube-api-access-nd894\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.249342 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.249115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.249342 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.249140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.249342 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.249163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.249342 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.249208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.249591 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.249422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.249591 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.249471    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.249591 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.249493    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.251731 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.251707    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.251882 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.251865    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.262681 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.262656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd894\" (UniqueName: \"kubernetes.io/projected/e4182a75-1271-41e5-a8cf-dfd1ff9897c4-kube-api-access-nd894\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9fnxl\" (UID: \"e4182a75-1271-41e5-a8cf-dfd1ff9897c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.454960 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.454857    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:24.596158 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.596125    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"]
Jul 24 15:06:24.606458 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.606429    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:06:24.638645 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:24.638610    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl" event={"ID":"e4182a75-1271-41e5-a8cf-dfd1ff9897c4","Type":"ContainerStarted","Data":"305332e583746866381e32f9e6c42e57b5f65ec4aab3ae47895b8f2558ce89d7"}
Jul 24 15:06:26.650154 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:26.650118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl" event={"ID":"e4182a75-1271-41e5-a8cf-dfd1ff9897c4","Type":"ContainerStarted","Data":"c348e96949cfd1d72f59fb5d4eed384252f06a4695e768e94647e8316a8af553"}
Jul 24 15:06:26.670244 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:26.670188    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl" podStartSLOduration=1.443576631 podStartE2EDuration="2.670167006s" totalImagesPullingTime="1.226590375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:06:26.669645807 +0000 UTC m=+615.208625221" watchObservedRunningTime="2026-07-24 15:06:26.670167006 +0000 UTC m=+615.209146418"
Jul 24 15:06:34.455851 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:34.455754    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:34.455851 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:34.455826    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:34.468256 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:34.468227    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:34.696196 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:34.696166    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9fnxl"
Jul 24 15:06:39.544931 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.544894    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"]
Jul 24 15:06:39.548035 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.548012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.550671 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.550646    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 15:06:39.561815 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.561785    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"]
Jul 24 15:06:39.583322 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.583286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.583322 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.583324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt4th\" (UniqueName: \"kubernetes.io/projected/bcb41182-209d-4627-a4f5-d559cfd4920f-kube-api-access-dt4th\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.583543 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.583370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.583543 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.583453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.583543 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.583500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.583648 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.583543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb41182-209d-4627-a4f5-d559cfd4920f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.684627 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.684593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.684820 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.684637    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.684820 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.684665    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.684820 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.684693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb41182-209d-4627-a4f5-d559cfd4920f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.684820 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.684746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.684820 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.684768    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt4th\" (UniqueName: \"kubernetes.io/projected/bcb41182-209d-4627-a4f5-d559cfd4920f-kube-api-access-dt4th\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.685112 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.685081    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.685253 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.685149    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.685253 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.685174    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.687243 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.687221    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcb41182-209d-4627-a4f5-d559cfd4920f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.687483 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.687467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb41182-209d-4627-a4f5-d559cfd4920f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.694366 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.694338    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt4th\" (UniqueName: \"kubernetes.io/projected/bcb41182-209d-4627-a4f5-d559cfd4920f-kube-api-access-dt4th\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g84gg\" (UID: \"bcb41182-209d-4627-a4f5-d559cfd4920f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.858157 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.858060    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:39.997624 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:39.997596    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"]
Jul 24 15:06:39.998799 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:06:39.998767    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb41182_209d_4627_a4f5_d559cfd4920f.slice/crio-8a2d521a4932b35d3208074c0e66803b7aaba3f223a04c5665d11902bf616228 WatchSource:0}: Error finding container 8a2d521a4932b35d3208074c0e66803b7aaba3f223a04c5665d11902bf616228: Status 404 returned error can't find the container with id 8a2d521a4932b35d3208074c0e66803b7aaba3f223a04c5665d11902bf616228
Jul 24 15:06:40.709180 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:40.709140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg" event={"ID":"bcb41182-209d-4627-a4f5-d559cfd4920f","Type":"ContainerStarted","Data":"9ee512dc6f7c960a47ee0883e369367973212a56e98104ab600ce2c64b7f7e93"}
Jul 24 15:06:40.709577 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:40.709199    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg" event={"ID":"bcb41182-209d-4627-a4f5-d559cfd4920f","Type":"ContainerStarted","Data":"8a2d521a4932b35d3208074c0e66803b7aaba3f223a04c5665d11902bf616228"}
Jul 24 15:06:40.727582 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:40.727518    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg" podStartSLOduration=1.207350078 podStartE2EDuration="1.727497318s" totalImagesPullingTime="520.14724ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:06:40.726888748 +0000 UTC m=+629.265868182" watchObservedRunningTime="2026-07-24 15:06:40.727497318 +0000 UTC m=+629.266476734"
Jul 24 15:06:49.859037 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:49.858969    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:49.859498 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:49.859063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:49.871871 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:49.871833    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:50.763700 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:50.763666    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g84gg"
Jul 24 15:06:59.950017 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:59.949962    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"]
Jul 24 15:06:59.955688 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:59.955663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:06:59.958298 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:59.958276    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 15:06:59.971171 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:06:59.971142    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"]
Jul 24 15:07:00.068121 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.068087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.068309 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.068128    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkn27\" (UniqueName: \"kubernetes.io/projected/442dcffb-3d56-4d1e-a6ef-1c99133fa969-kube-api-access-rkn27\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.068309 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.068222    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.068309 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.068287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/442dcffb-3d56-4d1e-a6ef-1c99133fa969-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.068447 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.068326    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.068447 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.068341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.169738 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.169699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/442dcffb-3d56-4d1e-a6ef-1c99133fa969-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.169944 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.169755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.169944 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.169873    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.170111 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.169943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.170111 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.169977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkn27\" (UniqueName: \"kubernetes.io/projected/442dcffb-3d56-4d1e-a6ef-1c99133fa969-kube-api-access-rkn27\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.170111 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.170081    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.170271 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.170201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.170333 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.170290    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.170459 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.170439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.172367 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.172345    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/442dcffb-3d56-4d1e-a6ef-1c99133fa969-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.172694 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.172672    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/442dcffb-3d56-4d1e-a6ef-1c99133fa969-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.179696 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.179672    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkn27\" (UniqueName: \"kubernetes.io/projected/442dcffb-3d56-4d1e-a6ef-1c99133fa969-kube-api-access-rkn27\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs\" (UID: \"442dcffb-3d56-4d1e-a6ef-1c99133fa969\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.265719 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.265626    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:00.405920 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.405876    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"]
Jul 24 15:07:00.406842 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:07:00.406815    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod442dcffb_3d56_4d1e_a6ef_1c99133fa969.slice/crio-d8281003bc3f44bf939115c611760e08241b4e2d06ddda0159991f6ca0c1db24 WatchSource:0}: Error finding container d8281003bc3f44bf939115c611760e08241b4e2d06ddda0159991f6ca0c1db24: Status 404 returned error can't find the container with id d8281003bc3f44bf939115c611760e08241b4e2d06ddda0159991f6ca0c1db24
Jul 24 15:07:00.795615 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:00.795573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs" event={"ID":"442dcffb-3d56-4d1e-a6ef-1c99133fa969","Type":"ContainerStarted","Data":"d8281003bc3f44bf939115c611760e08241b4e2d06ddda0159991f6ca0c1db24"}
Jul 24 15:07:01.802460 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:01.802427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs" event={"ID":"442dcffb-3d56-4d1e-a6ef-1c99133fa969","Type":"ContainerStarted","Data":"b9e76872924e91f75e4e0363c8965a4f2cba4baea2ca925e90340454b91e6300"}
Jul 24 15:07:01.820969 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:01.820913    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs" podStartSLOduration=2.357223548 podStartE2EDuration="2.820892358s" totalImagesPullingTime="463.66881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:07:01.81972853 +0000 UTC m=+650.358707956" watchObservedRunningTime="2026-07-24 15:07:01.820892358 +0000 UTC m=+650.359871771"
Jul 24 15:07:10.266241 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:10.266191    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:10.266241 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:10.266246    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:10.279116 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:10.279080    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:10.853557 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:10.853527    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs"
Jul 24 15:07:59.365704 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:59.365666    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7954448df6-f8rwf"]
Jul 24 15:07:59.366256 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:59.365831    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7954448df6-f8rwf" podUID="a95da48d-77a8-4283-80a1-7266fc6a5819" containerName="authorino" containerID="cri-o://3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84" gracePeriod=30
Jul 24 15:07:59.629854 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:59.629786    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7954448df6-f8rwf"
Jul 24 15:07:59.811329 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:59.811297    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a95da48d-77a8-4283-80a1-7266fc6a5819-tls-cert\") pod \"a95da48d-77a8-4283-80a1-7266fc6a5819\" (UID: \"a95da48d-77a8-4283-80a1-7266fc6a5819\") "
Jul 24 15:07:59.811480 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:59.811403    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlh7h\" (UniqueName: \"kubernetes.io/projected/a95da48d-77a8-4283-80a1-7266fc6a5819-kube-api-access-jlh7h\") pod \"a95da48d-77a8-4283-80a1-7266fc6a5819\" (UID: \"a95da48d-77a8-4283-80a1-7266fc6a5819\") "
Jul 24 15:07:59.813626 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:59.813594    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95da48d-77a8-4283-80a1-7266fc6a5819-kube-api-access-jlh7h" (OuterVolumeSpecName: "kube-api-access-jlh7h") pod "a95da48d-77a8-4283-80a1-7266fc6a5819" (UID: "a95da48d-77a8-4283-80a1-7266fc6a5819"). InnerVolumeSpecName "kube-api-access-jlh7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:07:59.821584 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:59.821550    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95da48d-77a8-4283-80a1-7266fc6a5819-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a95da48d-77a8-4283-80a1-7266fc6a5819" (UID: "a95da48d-77a8-4283-80a1-7266fc6a5819"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:07:59.912701 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:59.912664    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlh7h\" (UniqueName: \"kubernetes.io/projected/a95da48d-77a8-4283-80a1-7266fc6a5819-kube-api-access-jlh7h\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:07:59.912701 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:07:59.912698    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a95da48d-77a8-4283-80a1-7266fc6a5819-tls-cert\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:08:00.058245 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:08:00.058212    2582 generic.go:356] "Generic (PLEG): container finished" podID="a95da48d-77a8-4283-80a1-7266fc6a5819" containerID="3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84" exitCode=0
Jul 24 15:08:00.058421 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:08:00.058255    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7954448df6-f8rwf"
Jul 24 15:08:00.058421 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:08:00.058293    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7954448df6-f8rwf" event={"ID":"a95da48d-77a8-4283-80a1-7266fc6a5819","Type":"ContainerDied","Data":"3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84"}
Jul 24 15:08:00.058421 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:08:00.058337    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7954448df6-f8rwf" event={"ID":"a95da48d-77a8-4283-80a1-7266fc6a5819","Type":"ContainerDied","Data":"14551791b9d4f715cbcd4cc1a186751912c65ac1f9db530d4693d60bd1b22750"}
Jul 24 15:08:00.058421 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:08:00.058354    2582 scope.go:117] "RemoveContainer" containerID="3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84"
Jul 24 15:08:00.066888 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:08:00.066869    2582 scope.go:117] "RemoveContainer" containerID="3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84"
Jul 24 15:08:00.067191 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:08:00.067173    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84\": container with ID starting with 3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84 not found: ID does not exist" containerID="3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84"
Jul 24 15:08:00.067254 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:08:00.067232    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84"} err="failed to get container status \"3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84\": rpc error: code = NotFound desc = could not find container \"3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84\": container with ID starting with 3322125b91410b7a3c372fe185b2ff9f07be4ad051f09494d9e0c17f93260f84 not found: ID does not exist"
Jul 24 15:08:00.079597 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:08:00.079569    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7954448df6-f8rwf"]
Jul 24 15:08:00.088765 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:08:00.088735    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7954448df6-f8rwf"]
Jul 24 15:08:01.995959 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:08:01.995922    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95da48d-77a8-4283-80a1-7266fc6a5819" path="/var/lib/kubelet/pods/a95da48d-77a8-4283-80a1-7266fc6a5819/volumes"
Jul 24 15:11:11.918224 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:11:11.918200    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:11:11.918723 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:11:11.918200    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:15:04.976532 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:04.973423    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"]
Jul 24 15:15:04.976532 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:04.973747    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4" podUID="fc285d8c-c61e-45d0-a857-7bae51c3e0ea" containerName="manager" containerID="cri-o://0dd1eba6434613be7ed9ddc7760d3eafc7020535729c06b7ea40467cccb0dafc" gracePeriod=10
Jul 24 15:15:07.942806 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:07.942773    2582 generic.go:356] "Generic (PLEG): container finished" podID="fc285d8c-c61e-45d0-a857-7bae51c3e0ea" containerID="0dd1eba6434613be7ed9ddc7760d3eafc7020535729c06b7ea40467cccb0dafc" exitCode=0
Jul 24 15:15:07.943222 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:07.942833    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4" event={"ID":"fc285d8c-c61e-45d0-a857-7bae51c3e0ea","Type":"ContainerDied","Data":"0dd1eba6434613be7ed9ddc7760d3eafc7020535729c06b7ea40467cccb0dafc"}
Jul 24 15:15:08.041414 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.041381    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:15:08.170713 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.170679    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-extensions-socket-volume\") pod \"fc285d8c-c61e-45d0-a857-7bae51c3e0ea\" (UID: \"fc285d8c-c61e-45d0-a857-7bae51c3e0ea\") "
Jul 24 15:15:08.170874 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.170759    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twsjk\" (UniqueName: \"kubernetes.io/projected/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-kube-api-access-twsjk\") pod \"fc285d8c-c61e-45d0-a857-7bae51c3e0ea\" (UID: \"fc285d8c-c61e-45d0-a857-7bae51c3e0ea\") "
Jul 24 15:15:08.171130 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.171104    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc285d8c-c61e-45d0-a857-7bae51c3e0ea" (UID: "fc285d8c-c61e-45d0-a857-7bae51c3e0ea"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:15:08.172949 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.172920    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-kube-api-access-twsjk" (OuterVolumeSpecName: "kube-api-access-twsjk") pod "fc285d8c-c61e-45d0-a857-7bae51c3e0ea" (UID: "fc285d8c-c61e-45d0-a857-7bae51c3e0ea"). InnerVolumeSpecName "kube-api-access-twsjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:15:08.272104 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.272069    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-extensions-socket-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:15:08.272104 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.272097    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twsjk\" (UniqueName: \"kubernetes.io/projected/fc285d8c-c61e-45d0-a857-7bae51c3e0ea-kube-api-access-twsjk\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:15:08.948791 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.948764    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"
Jul 24 15:15:08.948791 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.948773    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4" event={"ID":"fc285d8c-c61e-45d0-a857-7bae51c3e0ea","Type":"ContainerDied","Data":"b55a6a27db213cdb94b063822d5933824fd084ac318c391a3acbea5e288f260f"}
Jul 24 15:15:08.949333 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.948832    2582 scope.go:117] "RemoveContainer" containerID="0dd1eba6434613be7ed9ddc7760d3eafc7020535729c06b7ea40467cccb0dafc"
Jul 24 15:15:08.975900 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.975865    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"]
Jul 24 15:15:08.981467 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:08.981438    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nghf4"]
Jul 24 15:15:09.996025 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:15:09.995968    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc285d8c-c61e-45d0-a857-7bae51c3e0ea" path="/var/lib/kubelet/pods/fc285d8c-c61e-45d0-a857-7bae51c3e0ea/volumes"
Jul 24 15:16:06.178635 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.178605    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"]
Jul 24 15:16:06.179127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.178917    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc285d8c-c61e-45d0-a857-7bae51c3e0ea" containerName="manager"
Jul 24 15:16:06.179127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.178927    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc285d8c-c61e-45d0-a857-7bae51c3e0ea" containerName="manager"
Jul 24 15:16:06.179127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.178936    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95da48d-77a8-4283-80a1-7266fc6a5819" containerName="authorino"
Jul 24 15:16:06.179127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.178941    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95da48d-77a8-4283-80a1-7266fc6a5819" containerName="authorino"
Jul 24 15:16:06.179127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.179035    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc285d8c-c61e-45d0-a857-7bae51c3e0ea" containerName="manager"
Jul 24 15:16:06.179127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.179049    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95da48d-77a8-4283-80a1-7266fc6a5819" containerName="authorino"
Jul 24 15:16:06.181935 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.181918    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"
Jul 24 15:16:06.186613 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.186591    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sf7fs\""
Jul 24 15:16:06.221140 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.221109    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"]
Jul 24 15:16:06.248142 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.248107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8354129-b663-4300-9bdc-197a9098a1e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4zw\" (UID: \"f8354129-b663-4300-9bdc-197a9098a1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"
Jul 24 15:16:06.248318 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.248159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wwv4\" (UniqueName: \"kubernetes.io/projected/f8354129-b663-4300-9bdc-197a9098a1e6-kube-api-access-6wwv4\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4zw\" (UID: \"f8354129-b663-4300-9bdc-197a9098a1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"
Jul 24 15:16:06.349322 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.349279    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8354129-b663-4300-9bdc-197a9098a1e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4zw\" (UID: \"f8354129-b663-4300-9bdc-197a9098a1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"
Jul 24 15:16:06.349502 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.349336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wwv4\" (UniqueName: \"kubernetes.io/projected/f8354129-b663-4300-9bdc-197a9098a1e6-kube-api-access-6wwv4\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4zw\" (UID: \"f8354129-b663-4300-9bdc-197a9098a1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"
Jul 24 15:16:06.349711 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.349692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8354129-b663-4300-9bdc-197a9098a1e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4zw\" (UID: \"f8354129-b663-4300-9bdc-197a9098a1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"
Jul 24 15:16:06.360759 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.360722    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wwv4\" (UniqueName: \"kubernetes.io/projected/f8354129-b663-4300-9bdc-197a9098a1e6-kube-api-access-6wwv4\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4zw\" (UID: \"f8354129-b663-4300-9bdc-197a9098a1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"
Jul 24 15:16:06.492594 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.492502    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"
Jul 24 15:16:06.633452 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:06.633420    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"]
Jul 24 15:16:06.639234 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:16:06.639196    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8354129_b663_4300_9bdc_197a9098a1e6.slice/crio-a80695cf42209358ef0646a3f7f36abcbeae8e1a0a2b116fbe4ec8802da3057f WatchSource:0}: Error finding container a80695cf42209358ef0646a3f7f36abcbeae8e1a0a2b116fbe4ec8802da3057f: Status 404 returned error can't find the container with id a80695cf42209358ef0646a3f7f36abcbeae8e1a0a2b116fbe4ec8802da3057f
Jul 24 15:16:07.206405 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:07.206369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw" event={"ID":"f8354129-b663-4300-9bdc-197a9098a1e6","Type":"ContainerStarted","Data":"d535099db26624a24b0deb520297c20eea26a4b27e0d8ff9aa0dacacbea3109c"}
Jul 24 15:16:07.206889 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:07.206430    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw" event={"ID":"f8354129-b663-4300-9bdc-197a9098a1e6","Type":"ContainerStarted","Data":"a80695cf42209358ef0646a3f7f36abcbeae8e1a0a2b116fbe4ec8802da3057f"}
Jul 24 15:16:07.206889 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:07.206465    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"
Jul 24 15:16:07.227900 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:07.227856    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw" podStartSLOduration=1.227839256 podStartE2EDuration="1.227839256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:16:07.227243802 +0000 UTC m=+1195.766223216" watchObservedRunningTime="2026-07-24 15:16:07.227839256 +0000 UTC m=+1195.766818668"
Jul 24 15:16:11.943142 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:11.943114    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:16:11.944578 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:11.944555    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:16:18.213125 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:16:18.213091    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4zw"
Jul 24 15:18:54.359087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.359011    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"]
Jul 24 15:18:54.362123 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.362102    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.365629 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.365611    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-e226c198-kserve-self-signed-certs\""
Jul 24 15:18:54.384179 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.384150    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"]
Jul 24 15:18:54.464136 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.464083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-tmp-dir\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.464323 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.464159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-model-cache\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.464323 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.464212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-home\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.464323 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.464250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm9m6\" (UniqueName: \"kubernetes.io/projected/ef86d20e-427a-4345-9174-ca8aaee9d728-kube-api-access-vm9m6\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.464323 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.464301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-dshm\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.464456 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.464323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef86d20e-427a-4345-9174-ca8aaee9d728-tls-certs\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.565144 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.565097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-tmp-dir\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.565324 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.565158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-model-cache\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.565324 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.565191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-home\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.565324 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.565216    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm9m6\" (UniqueName: \"kubernetes.io/projected/ef86d20e-427a-4345-9174-ca8aaee9d728-kube-api-access-vm9m6\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.565324 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.565253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-dshm\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.565324 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.565274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef86d20e-427a-4345-9174-ca8aaee9d728-tls-certs\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.565595 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.565569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-tmp-dir\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.565647 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.565615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-model-cache\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.565696 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.565623    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-home\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.567770 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.567748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-dshm\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.568037 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.568021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef86d20e-427a-4345-9174-ca8aaee9d728-tls-certs\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.574438 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.574408    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm9m6\" (UniqueName: \"kubernetes.io/projected/ef86d20e-427a-4345-9174-ca8aaee9d728-kube-api-access-vm9m6\") pod \"e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") " pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.671373 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.671332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:18:54.811011 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.810967    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"]
Jul 24 15:18:54.813536 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:18:54.813508    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef86d20e_427a_4345_9174_ca8aaee9d728.slice/crio-6d09b0952eddeb1221b81bc130c2b06568ab99782d823672413f99a5ba70868f WatchSource:0}: Error finding container 6d09b0952eddeb1221b81bc130c2b06568ab99782d823672413f99a5ba70868f: Status 404 returned error can't find the container with id 6d09b0952eddeb1221b81bc130c2b06568ab99782d823672413f99a5ba70868f
Jul 24 15:18:54.946835 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.946736    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9" event={"ID":"ef86d20e-427a-4345-9174-ca8aaee9d728","Type":"ContainerStarted","Data":"c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95"}
Jul 24 15:18:54.946835 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.946775    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9" event={"ID":"ef86d20e-427a-4345-9174-ca8aaee9d728","Type":"ContainerStarted","Data":"6d09b0952eddeb1221b81bc130c2b06568ab99782d823672413f99a5ba70868f"}
Jul 24 15:18:54.965046 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:54.964961    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9" podStartSLOduration=0.964940872 podStartE2EDuration="964.940872ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:18:54.964361143 +0000 UTC m=+1363.503340556" watchObservedRunningTime="2026-07-24 15:18:54.964940872 +0000 UTC m=+1363.503920650"
Jul 24 15:18:59.952179 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:59.952139    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"]
Jul 24 15:18:59.955293 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:59.955276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:18:59.958609 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:59.958586    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-e226c198-kserve-self-signed-certs\""
Jul 24 15:18:59.969996 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:18:59.969963    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"]
Jul 24 15:19:00.118219 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.118177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-dshm\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.118219 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.118219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-tmp-dir\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.118460 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.118294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-model-cache\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.118460 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.118328    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/305aa1d3-c7f1-488c-95fb-8249fc28b210-tls-certs\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.118460 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.118394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-home\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.118460 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.118415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7762\" (UniqueName: \"kubernetes.io/projected/305aa1d3-c7f1-488c-95fb-8249fc28b210-kube-api-access-h7762\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.219604 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.219491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-dshm\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.219604 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.219537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-tmp-dir\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.219604 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.219566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-model-cache\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.219604 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.219587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/305aa1d3-c7f1-488c-95fb-8249fc28b210-tls-certs\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.219933 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.219664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-home\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.219933 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.219694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7762\" (UniqueName: \"kubernetes.io/projected/305aa1d3-c7f1-488c-95fb-8249fc28b210-kube-api-access-h7762\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.220209 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.220170    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-home\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.220350 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.220315    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-model-cache\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.220448 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.220428    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-tmp-dir\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.222112 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.222085    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-dshm\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.222656 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.222636    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/305aa1d3-c7f1-488c-95fb-8249fc28b210-tls-certs\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.229720 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.229686    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7762\" (UniqueName: \"kubernetes.io/projected/305aa1d3-c7f1-488c-95fb-8249fc28b210-kube-api-access-h7762\") pod \"e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") " pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.265499 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.265463    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:00.413449 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.413376    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"]
Jul 24 15:19:00.415770 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:19:00.415739    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod305aa1d3_c7f1_488c_95fb_8249fc28b210.slice/crio-6caeca17cd24ae42ce99cc8e590e53c25b9d4c57b859f79ee911f39dea2270b6 WatchSource:0}: Error finding container 6caeca17cd24ae42ce99cc8e590e53c25b9d4c57b859f79ee911f39dea2270b6: Status 404 returned error can't find the container with id 6caeca17cd24ae42ce99cc8e590e53c25b9d4c57b859f79ee911f39dea2270b6
Jul 24 15:19:00.975311 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.975271    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl" event={"ID":"305aa1d3-c7f1-488c-95fb-8249fc28b210","Type":"ContainerStarted","Data":"dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6"}
Jul 24 15:19:00.975311 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:00.975313    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl" event={"ID":"305aa1d3-c7f1-488c-95fb-8249fc28b210","Type":"ContainerStarted","Data":"6caeca17cd24ae42ce99cc8e590e53c25b9d4c57b859f79ee911f39dea2270b6"}
Jul 24 15:19:01.006928 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:01.006875    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl" podStartSLOduration=2.006857835 podStartE2EDuration="2.006857835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:18:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:19:01.004535008 +0000 UTC m=+1369.543514420" watchObservedRunningTime="2026-07-24 15:19:01.006857835 +0000 UTC m=+1369.545837248"
Jul 24 15:19:04.672326 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:04.672282    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:19:04.672326 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:04.672334    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:19:04.684795 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:04.684760    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:19:05.004078 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:05.004001    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:19:10.266358 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:10.266314    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:10.266358 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:10.266370    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:10.279028 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:10.278998    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:11.039611 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:11.039570    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:26.685888 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:26.685851    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"]
Jul 24 15:19:27.651404 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:27.651372    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"]
Jul 24 15:19:41.705629 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:41.705565    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9" podUID="ef86d20e-427a-4345-9174-ca8aaee9d728" containerName="main" containerID="cri-o://c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95" gracePeriod=45
Jul 24 15:19:41.957630 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:41.957567    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:19:42.110976 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.110937    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-dshm\") pod \"ef86d20e-427a-4345-9174-ca8aaee9d728\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") "
Jul 24 15:19:42.111181 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.111035    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-home\") pod \"ef86d20e-427a-4345-9174-ca8aaee9d728\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") "
Jul 24 15:19:42.111181 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.111067    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-model-cache\") pod \"ef86d20e-427a-4345-9174-ca8aaee9d728\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") "
Jul 24 15:19:42.111181 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.111087    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-tmp-dir\") pod \"ef86d20e-427a-4345-9174-ca8aaee9d728\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") "
Jul 24 15:19:42.111181 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.111157    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm9m6\" (UniqueName: \"kubernetes.io/projected/ef86d20e-427a-4345-9174-ca8aaee9d728-kube-api-access-vm9m6\") pod \"ef86d20e-427a-4345-9174-ca8aaee9d728\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") "
Jul 24 15:19:42.111181 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.111179    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef86d20e-427a-4345-9174-ca8aaee9d728-tls-certs\") pod \"ef86d20e-427a-4345-9174-ca8aaee9d728\" (UID: \"ef86d20e-427a-4345-9174-ca8aaee9d728\") "
Jul 24 15:19:42.111444 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.111340    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-home" (OuterVolumeSpecName: "home") pod "ef86d20e-427a-4345-9174-ca8aaee9d728" (UID: "ef86d20e-427a-4345-9174-ca8aaee9d728"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:19:42.111444 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.111354    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef86d20e-427a-4345-9174-ca8aaee9d728" (UID: "ef86d20e-427a-4345-9174-ca8aaee9d728"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:19:42.111444 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.111391    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef86d20e-427a-4345-9174-ca8aaee9d728" (UID: "ef86d20e-427a-4345-9174-ca8aaee9d728"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:19:42.113367 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.113338    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-dshm" (OuterVolumeSpecName: "dshm") pod "ef86d20e-427a-4345-9174-ca8aaee9d728" (UID: "ef86d20e-427a-4345-9174-ca8aaee9d728"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:19:42.113486 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.113429    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef86d20e-427a-4345-9174-ca8aaee9d728-kube-api-access-vm9m6" (OuterVolumeSpecName: "kube-api-access-vm9m6") pod "ef86d20e-427a-4345-9174-ca8aaee9d728" (UID: "ef86d20e-427a-4345-9174-ca8aaee9d728"). InnerVolumeSpecName "kube-api-access-vm9m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:19:42.113541 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.113505    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef86d20e-427a-4345-9174-ca8aaee9d728-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef86d20e-427a-4345-9174-ca8aaee9d728" (UID: "ef86d20e-427a-4345-9174-ca8aaee9d728"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:19:42.173911 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.173870    2582 generic.go:356] "Generic (PLEG): container finished" podID="ef86d20e-427a-4345-9174-ca8aaee9d728" containerID="c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95" exitCode=0
Jul 24 15:19:42.174082 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.173937    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"
Jul 24 15:19:42.174082 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.173959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9" event={"ID":"ef86d20e-427a-4345-9174-ca8aaee9d728","Type":"ContainerDied","Data":"c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95"}
Jul 24 15:19:42.174082 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.174021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9" event={"ID":"ef86d20e-427a-4345-9174-ca8aaee9d728","Type":"ContainerDied","Data":"6d09b0952eddeb1221b81bc130c2b06568ab99782d823672413f99a5ba70868f"}
Jul 24 15:19:42.174082 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.174044    2582 scope.go:117] "RemoveContainer" containerID="c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95"
Jul 24 15:19:42.183110 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.183089    2582 scope.go:117] "RemoveContainer" containerID="c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95"
Jul 24 15:19:42.183372 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:19:42.183356    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95\": container with ID starting with c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95 not found: ID does not exist" containerID="c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95"
Jul 24 15:19:42.183416 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.183379    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95"} err="failed to get container status \"c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95\": rpc error: code = NotFound desc = could not find container \"c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95\": container with ID starting with c6f08d461351109917b119615945b1aa7c2f010623bc9197ba171f3801855c95 not found: ID does not exist"
Jul 24 15:19:42.212173 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.212088    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:42.212173 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.212115    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:42.212173 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.212124    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:42.212173 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.212133    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef86d20e-427a-4345-9174-ca8aaee9d728-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:42.212173 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.212143    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm9m6\" (UniqueName: \"kubernetes.io/projected/ef86d20e-427a-4345-9174-ca8aaee9d728-kube-api-access-vm9m6\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:42.212173 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.212151    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef86d20e-427a-4345-9174-ca8aaee9d728-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:42.216863 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.216836    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"]
Jul 24 15:19:42.235292 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.235254    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-e226c198-kserve-cbc87757f-d8hp9"]
Jul 24 15:19:42.671128 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.670974    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl" podUID="305aa1d3-c7f1-488c-95fb-8249fc28b210" containerName="main" containerID="cri-o://dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6" gracePeriod=45
Jul 24 15:19:42.929332 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:42.929248    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:43.019831 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.019792    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-dshm\") pod \"305aa1d3-c7f1-488c-95fb-8249fc28b210\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") "
Jul 24 15:19:43.019831 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.019836    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/305aa1d3-c7f1-488c-95fb-8249fc28b210-tls-certs\") pod \"305aa1d3-c7f1-488c-95fb-8249fc28b210\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") "
Jul 24 15:19:43.020128 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.019886    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-home\") pod \"305aa1d3-c7f1-488c-95fb-8249fc28b210\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") "
Jul 24 15:19:43.020128 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.019940    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-tmp-dir\") pod \"305aa1d3-c7f1-488c-95fb-8249fc28b210\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") "
Jul 24 15:19:43.020128 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.019966    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-model-cache\") pod \"305aa1d3-c7f1-488c-95fb-8249fc28b210\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") "
Jul 24 15:19:43.020128 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.020032    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7762\" (UniqueName: \"kubernetes.io/projected/305aa1d3-c7f1-488c-95fb-8249fc28b210-kube-api-access-h7762\") pod \"305aa1d3-c7f1-488c-95fb-8249fc28b210\" (UID: \"305aa1d3-c7f1-488c-95fb-8249fc28b210\") "
Jul 24 15:19:43.020478 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.020435    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "305aa1d3-c7f1-488c-95fb-8249fc28b210" (UID: "305aa1d3-c7f1-488c-95fb-8249fc28b210"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:19:43.020605 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.020507    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-home" (OuterVolumeSpecName: "home") pod "305aa1d3-c7f1-488c-95fb-8249fc28b210" (UID: "305aa1d3-c7f1-488c-95fb-8249fc28b210"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:19:43.020666 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.020581    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-model-cache" (OuterVolumeSpecName: "model-cache") pod "305aa1d3-c7f1-488c-95fb-8249fc28b210" (UID: "305aa1d3-c7f1-488c-95fb-8249fc28b210"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:19:43.022259 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.022236    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/305aa1d3-c7f1-488c-95fb-8249fc28b210-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "305aa1d3-c7f1-488c-95fb-8249fc28b210" (UID: "305aa1d3-c7f1-488c-95fb-8249fc28b210"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:19:43.022361 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.022280    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-dshm" (OuterVolumeSpecName: "dshm") pod "305aa1d3-c7f1-488c-95fb-8249fc28b210" (UID: "305aa1d3-c7f1-488c-95fb-8249fc28b210"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:19:43.022361 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.022333    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/305aa1d3-c7f1-488c-95fb-8249fc28b210-kube-api-access-h7762" (OuterVolumeSpecName: "kube-api-access-h7762") pod "305aa1d3-c7f1-488c-95fb-8249fc28b210" (UID: "305aa1d3-c7f1-488c-95fb-8249fc28b210"). InnerVolumeSpecName "kube-api-access-h7762". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:19:43.121688 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.121649    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:43.121688 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.121679    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/305aa1d3-c7f1-488c-95fb-8249fc28b210-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:43.121688 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.121689    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:43.121688 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.121696    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:43.121963 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.121705    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/305aa1d3-c7f1-488c-95fb-8249fc28b210-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:43.121963 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.121713    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7762\" (UniqueName: \"kubernetes.io/projected/305aa1d3-c7f1-488c-95fb-8249fc28b210-kube-api-access-h7762\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:19:43.179501 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.179400    2582 generic.go:356] "Generic (PLEG): container finished" podID="305aa1d3-c7f1-488c-95fb-8249fc28b210" containerID="dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6" exitCode=0
Jul 24 15:19:43.179501 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.179447    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"
Jul 24 15:19:43.179501 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.179486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl" event={"ID":"305aa1d3-c7f1-488c-95fb-8249fc28b210","Type":"ContainerDied","Data":"dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6"}
Jul 24 15:19:43.179794 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.179535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl" event={"ID":"305aa1d3-c7f1-488c-95fb-8249fc28b210","Type":"ContainerDied","Data":"6caeca17cd24ae42ce99cc8e590e53c25b9d4c57b859f79ee911f39dea2270b6"}
Jul 24 15:19:43.179794 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.179556    2582 scope.go:117] "RemoveContainer" containerID="dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6"
Jul 24 15:19:43.188812 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.188794    2582 scope.go:117] "RemoveContainer" containerID="dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6"
Jul 24 15:19:43.189114 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:19:43.189090    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6\": container with ID starting with dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6 not found: ID does not exist" containerID="dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6"
Jul 24 15:19:43.189197 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.189125    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6"} err="failed to get container status \"dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6\": rpc error: code = NotFound desc = could not find container \"dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6\": container with ID starting with dc8dfe741a97574532a9bf4f1168c58e15e0bb1b28b24d5e19e740eb6ab9f9c6 not found: ID does not exist"
Jul 24 15:19:43.201860 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.201825    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"]
Jul 24 15:19:43.205285 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.205261    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-e226c198-kserve-5bfc595df5-7mzjl"]
Jul 24 15:19:43.996337 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.996304    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="305aa1d3-c7f1-488c-95fb-8249fc28b210" path="/var/lib/kubelet/pods/305aa1d3-c7f1-488c-95fb-8249fc28b210/volumes"
Jul 24 15:19:43.996728 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:19:43.996686    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef86d20e-427a-4345-9174-ca8aaee9d728" path="/var/lib/kubelet/pods/ef86d20e-427a-4345-9174-ca8aaee9d728/volumes"
Jul 24 15:21:11.968974 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:21:11.968932    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:21:11.970786 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:21:11.970766    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:23:15.534127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.534090    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"]
Jul 24 15:23:15.536026 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.534435    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef86d20e-427a-4345-9174-ca8aaee9d728" containerName="main"
Jul 24 15:23:15.536026 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.534446    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef86d20e-427a-4345-9174-ca8aaee9d728" containerName="main"
Jul 24 15:23:15.536026 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.534463    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="305aa1d3-c7f1-488c-95fb-8249fc28b210" containerName="main"
Jul 24 15:23:15.536026 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.534469    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="305aa1d3-c7f1-488c-95fb-8249fc28b210" containerName="main"
Jul 24 15:23:15.536026 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.534519    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef86d20e-427a-4345-9174-ca8aaee9d728" containerName="main"
Jul 24 15:23:15.536026 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.534529    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="305aa1d3-c7f1-488c-95fb-8249fc28b210" containerName="main"
Jul 24 15:23:15.536531 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.536515    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:15.538739 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.538719    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e35d6958-dockercfg-s6l4d\""
Jul 24 15:23:15.539124 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.539111    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e35d6958\""
Jul 24 15:23:15.549489 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.549458    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"]
Jul 24 15:23:15.562748 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.562713    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"]
Jul 24 15:23:15.565525 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.565498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:15.583770 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.583738    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"]
Jul 24 15:23:15.649926 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.649890    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b06467dd-7955-4b8a-8491-8491738ec03b-plugins-config-volume\") pod \"payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f\" (UID: \"b06467dd-7955-4b8a-8491-8491738ec03b\") " pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:15.650136 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.649955    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a15a8e95-7e39-400a-9aec-dc07d0364f76-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k\" (UID: \"a15a8e95-7e39-400a-9aec-dc07d0364f76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:15.650136 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.650031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fvd\" (UniqueName: \"kubernetes.io/projected/b06467dd-7955-4b8a-8491-8491738ec03b-kube-api-access-j9fvd\") pod \"payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f\" (UID: \"b06467dd-7955-4b8a-8491-8491738ec03b\") " pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:15.650136 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.650096    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd27w\" (UniqueName: \"kubernetes.io/projected/a15a8e95-7e39-400a-9aec-dc07d0364f76-kube-api-access-vd27w\") pod \"payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k\" (UID: \"a15a8e95-7e39-400a-9aec-dc07d0364f76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:15.751566 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.751526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd27w\" (UniqueName: \"kubernetes.io/projected/a15a8e95-7e39-400a-9aec-dc07d0364f76-kube-api-access-vd27w\") pod \"payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k\" (UID: \"a15a8e95-7e39-400a-9aec-dc07d0364f76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:15.751751 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.751577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b06467dd-7955-4b8a-8491-8491738ec03b-plugins-config-volume\") pod \"payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f\" (UID: \"b06467dd-7955-4b8a-8491-8491738ec03b\") " pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:15.751751 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.751632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a15a8e95-7e39-400a-9aec-dc07d0364f76-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k\" (UID: \"a15a8e95-7e39-400a-9aec-dc07d0364f76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:15.751751 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.751656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fvd\" (UniqueName: \"kubernetes.io/projected/b06467dd-7955-4b8a-8491-8491738ec03b-kube-api-access-j9fvd\") pod \"payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f\" (UID: \"b06467dd-7955-4b8a-8491-8491738ec03b\") " pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:15.752390 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.752370    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b06467dd-7955-4b8a-8491-8491738ec03b-plugins-config-volume\") pod \"payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f\" (UID: \"b06467dd-7955-4b8a-8491-8491738ec03b\") " pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:15.752440 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.752389    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a15a8e95-7e39-400a-9aec-dc07d0364f76-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k\" (UID: \"a15a8e95-7e39-400a-9aec-dc07d0364f76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:15.760755 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.760719    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd27w\" (UniqueName: \"kubernetes.io/projected/a15a8e95-7e39-400a-9aec-dc07d0364f76-kube-api-access-vd27w\") pod \"payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k\" (UID: \"a15a8e95-7e39-400a-9aec-dc07d0364f76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:15.760913 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.760889    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fvd\" (UniqueName: \"kubernetes.io/projected/b06467dd-7955-4b8a-8491-8491738ec03b-kube-api-access-j9fvd\") pod \"payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f\" (UID: \"b06467dd-7955-4b8a-8491-8491738ec03b\") " pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:15.847551 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.847447    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:15.876689 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:15.876650    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:16.006229 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:16.005300    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"]
Jul 24 15:23:16.006337 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:23:16.006276    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda15a8e95_7e39_400a_9aec_dc07d0364f76.slice/crio-bafb18dfc0cfcd4c4c1c26781a1ea80fda0f7c22f71f69996c3b99b1f4595169 WatchSource:0}: Error finding container bafb18dfc0cfcd4c4c1c26781a1ea80fda0f7c22f71f69996c3b99b1f4595169: Status 404 returned error can't find the container with id bafb18dfc0cfcd4c4c1c26781a1ea80fda0f7c22f71f69996c3b99b1f4595169
Jul 24 15:23:16.035264 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:16.035239    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"]
Jul 24 15:23:16.037451 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:23:16.037424    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06467dd_7955_4b8a_8491_8491738ec03b.slice/crio-1d52314e8a59e47f3a4a6ce16baf1aa2585ee323e76bf58fccc18abc96ac479e WatchSource:0}: Error finding container 1d52314e8a59e47f3a4a6ce16baf1aa2585ee323e76bf58fccc18abc96ac479e: Status 404 returned error can't find the container with id 1d52314e8a59e47f3a4a6ce16baf1aa2585ee323e76bf58fccc18abc96ac479e
Jul 24 15:23:16.106026 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:16.105906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f" event={"ID":"b06467dd-7955-4b8a-8491-8491738ec03b","Type":"ContainerStarted","Data":"f299e3150c7713c0e4dcaeb37b9022f8d1a720a05c4b0ed534cce4ec9938c69e"}
Jul 24 15:23:16.106026 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:16.105968    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f" event={"ID":"b06467dd-7955-4b8a-8491-8491738ec03b","Type":"ContainerStarted","Data":"1d52314e8a59e47f3a4a6ce16baf1aa2585ee323e76bf58fccc18abc96ac479e"}
Jul 24 15:23:16.106264 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:16.106027    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:16.108129 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:16.108095    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k" event={"ID":"a15a8e95-7e39-400a-9aec-dc07d0364f76","Type":"ContainerStarted","Data":"6c372bdba4f60da0c8d78b3183e9037f6ffc6a1e7b68f6b631d1833707a18923"}
Jul 24 15:23:16.108255 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:16.108147    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k" event={"ID":"a15a8e95-7e39-400a-9aec-dc07d0364f76","Type":"ContainerStarted","Data":"bafb18dfc0cfcd4c4c1c26781a1ea80fda0f7c22f71f69996c3b99b1f4595169"}
Jul 24 15:23:16.108255 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:16.108181    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:16.126187 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:16.126127    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f" podStartSLOduration=1.126108407 podStartE2EDuration="1.126108407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:23:16.125662712 +0000 UTC m=+1624.664642126" watchObservedRunningTime="2026-07-24 15:23:16.126108407 +0000 UTC m=+1624.665087818"
Jul 24 15:23:16.145528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:16.145469    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k" podStartSLOduration=1.145447929 podStartE2EDuration="1.145447929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:23:16.145106949 +0000 UTC m=+1624.684086382" watchObservedRunningTime="2026-07-24 15:23:16.145447929 +0000 UTC m=+1624.684427343"
Jul 24 15:23:27.115525 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:27.115494    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:27.115974 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:27.115734    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:51.012600 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.012555    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"]
Jul 24 15:23:51.013220 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.012880    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f" podUID="b06467dd-7955-4b8a-8491-8491738ec03b" containerName="payload-processing" containerID="cri-o://f299e3150c7713c0e4dcaeb37b9022f8d1a720a05c4b0ed534cce4ec9938c69e" gracePeriod=30
Jul 24 15:23:51.026556 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.026519    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"]
Jul 24 15:23:51.026864 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.026829    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k" podUID="a15a8e95-7e39-400a-9aec-dc07d0364f76" containerName="payload-pre-processing" containerID="cri-o://6c372bdba4f60da0c8d78b3183e9037f6ffc6a1e7b68f6b631d1833707a18923" gracePeriod=30
Jul 24 15:23:51.271101 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.271001    2582 generic.go:356] "Generic (PLEG): container finished" podID="b06467dd-7955-4b8a-8491-8491738ec03b" containerID="f299e3150c7713c0e4dcaeb37b9022f8d1a720a05c4b0ed534cce4ec9938c69e" exitCode=0
Jul 24 15:23:51.271101 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.271018    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f" event={"ID":"b06467dd-7955-4b8a-8491-8491738ec03b","Type":"ContainerDied","Data":"f299e3150c7713c0e4dcaeb37b9022f8d1a720a05c4b0ed534cce4ec9938c69e"}
Jul 24 15:23:51.272800 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.272774    2582 generic.go:356] "Generic (PLEG): container finished" podID="a15a8e95-7e39-400a-9aec-dc07d0364f76" containerID="6c372bdba4f60da0c8d78b3183e9037f6ffc6a1e7b68f6b631d1833707a18923" exitCode=0
Jul 24 15:23:51.272964 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.272853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k" event={"ID":"a15a8e95-7e39-400a-9aec-dc07d0364f76","Type":"ContainerDied","Data":"6c372bdba4f60da0c8d78b3183e9037f6ffc6a1e7b68f6b631d1833707a18923"}
Jul 24 15:23:51.299482 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.299461    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:51.303676 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.303653    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:51.376297 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.376258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9fvd\" (UniqueName: \"kubernetes.io/projected/b06467dd-7955-4b8a-8491-8491738ec03b-kube-api-access-j9fvd\") pod \"b06467dd-7955-4b8a-8491-8491738ec03b\" (UID: \"b06467dd-7955-4b8a-8491-8491738ec03b\") "
Jul 24 15:23:51.376297 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.376295    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd27w\" (UniqueName: \"kubernetes.io/projected/a15a8e95-7e39-400a-9aec-dc07d0364f76-kube-api-access-vd27w\") pod \"a15a8e95-7e39-400a-9aec-dc07d0364f76\" (UID: \"a15a8e95-7e39-400a-9aec-dc07d0364f76\") "
Jul 24 15:23:51.376505 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.376315    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b06467dd-7955-4b8a-8491-8491738ec03b-plugins-config-volume\") pod \"b06467dd-7955-4b8a-8491-8491738ec03b\" (UID: \"b06467dd-7955-4b8a-8491-8491738ec03b\") "
Jul 24 15:23:51.376505 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.376365    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a15a8e95-7e39-400a-9aec-dc07d0364f76-plugins-config-volume\") pod \"a15a8e95-7e39-400a-9aec-dc07d0364f76\" (UID: \"a15a8e95-7e39-400a-9aec-dc07d0364f76\") "
Jul 24 15:23:51.376770 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.376746    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06467dd-7955-4b8a-8491-8491738ec03b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b06467dd-7955-4b8a-8491-8491738ec03b" (UID: "b06467dd-7955-4b8a-8491-8491738ec03b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:23:51.376838 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.376776    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a15a8e95-7e39-400a-9aec-dc07d0364f76-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a15a8e95-7e39-400a-9aec-dc07d0364f76" (UID: "a15a8e95-7e39-400a-9aec-dc07d0364f76"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:23:51.378752 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.378726    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a15a8e95-7e39-400a-9aec-dc07d0364f76-kube-api-access-vd27w" (OuterVolumeSpecName: "kube-api-access-vd27w") pod "a15a8e95-7e39-400a-9aec-dc07d0364f76" (UID: "a15a8e95-7e39-400a-9aec-dc07d0364f76"). InnerVolumeSpecName "kube-api-access-vd27w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:23:51.378864 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.378726    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06467dd-7955-4b8a-8491-8491738ec03b-kube-api-access-j9fvd" (OuterVolumeSpecName: "kube-api-access-j9fvd") pod "b06467dd-7955-4b8a-8491-8491738ec03b" (UID: "b06467dd-7955-4b8a-8491-8491738ec03b"). InnerVolumeSpecName "kube-api-access-j9fvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:23:51.478087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.478034    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9fvd\" (UniqueName: \"kubernetes.io/projected/b06467dd-7955-4b8a-8491-8491738ec03b-kube-api-access-j9fvd\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:23:51.478087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.478079    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd27w\" (UniqueName: \"kubernetes.io/projected/a15a8e95-7e39-400a-9aec-dc07d0364f76-kube-api-access-vd27w\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:23:51.478087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.478088    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b06467dd-7955-4b8a-8491-8491738ec03b-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:23:51.478087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:51.478096    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a15a8e95-7e39-400a-9aec-dc07d0364f76-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:23:52.284875 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:52.284778    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f" event={"ID":"b06467dd-7955-4b8a-8491-8491738ec03b","Type":"ContainerDied","Data":"1d52314e8a59e47f3a4a6ce16baf1aa2585ee323e76bf58fccc18abc96ac479e"}
Jul 24 15:23:52.284875 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:52.284870    2582 scope.go:117] "RemoveContainer" containerID="f299e3150c7713c0e4dcaeb37b9022f8d1a720a05c4b0ed534cce4ec9938c69e"
Jul 24 15:23:52.285402 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:52.284794    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"
Jul 24 15:23:52.286288 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:52.286268    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"
Jul 24 15:23:52.286365 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:52.286285    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k" event={"ID":"a15a8e95-7e39-400a-9aec-dc07d0364f76","Type":"ContainerDied","Data":"bafb18dfc0cfcd4c4c1c26781a1ea80fda0f7c22f71f69996c3b99b1f4595169"}
Jul 24 15:23:52.293884 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:52.293866    2582 scope.go:117] "RemoveContainer" containerID="6c372bdba4f60da0c8d78b3183e9037f6ffc6a1e7b68f6b631d1833707a18923"
Jul 24 15:23:52.305826 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:52.305798    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"]
Jul 24 15:23:52.307693 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:52.307662    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e35d6958-669bd7c454-7h65f"]
Jul 24 15:23:52.318421 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:52.318393    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"]
Jul 24 15:23:52.323228 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:52.323199    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e35d6958-b6c49bd6d-6rr6k"]
Jul 24 15:23:53.995465 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:53.995431    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a15a8e95-7e39-400a-9aec-dc07d0364f76" path="/var/lib/kubelet/pods/a15a8e95-7e39-400a-9aec-dc07d0364f76/volumes"
Jul 24 15:23:53.995841 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:53.995798    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b06467dd-7955-4b8a-8491-8491738ec03b" path="/var/lib/kubelet/pods/b06467dd-7955-4b8a-8491-8491738ec03b/volumes"
Jul 24 15:23:59.861555 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.861518    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"]
Jul 24 15:23:59.862031 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.862016    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06467dd-7955-4b8a-8491-8491738ec03b" containerName="payload-processing"
Jul 24 15:23:59.862085 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.862035    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06467dd-7955-4b8a-8491-8491738ec03b" containerName="payload-processing"
Jul 24 15:23:59.862085 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.862071    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a15a8e95-7e39-400a-9aec-dc07d0364f76" containerName="payload-pre-processing"
Jul 24 15:23:59.862085 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.862080    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a15a8e95-7e39-400a-9aec-dc07d0364f76" containerName="payload-pre-processing"
Jul 24 15:23:59.862192 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.862151    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b06467dd-7955-4b8a-8491-8491738ec03b" containerName="payload-processing"
Jul 24 15:23:59.862192 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.862169    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a15a8e95-7e39-400a-9aec-dc07d0364f76" containerName="payload-pre-processing"
Jul 24 15:23:59.867037 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.867014    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:23:59.870089 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.870067    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-a327d057\""
Jul 24 15:23:59.874245 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.874027    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"]
Jul 24 15:23:59.892483 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.892451    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"]
Jul 24 15:23:59.895698 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.895674    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:23:59.898536 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.898511    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-a327d057-dockercfg-26jt8\""
Jul 24 15:23:59.906434 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.906406    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"]
Jul 24 15:23:59.958242 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.958201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0298e60-cd06-447b-9c4e-14e91571c74a-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg\" (UID: \"a0298e60-cd06-447b-9c4e-14e91571c74a\") " pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:23:59.958242 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.958237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2nkw\" (UniqueName: \"kubernetes.io/projected/a0298e60-cd06-447b-9c4e-14e91571c74a-kube-api-access-h2nkw\") pod \"payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg\" (UID: \"a0298e60-cd06-447b-9c4e-14e91571c74a\") " pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:23:59.958455 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.958272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmjlx\" (UniqueName: \"kubernetes.io/projected/75128e7a-c0b5-43f7-b602-74b637b66850-kube-api-access-fmjlx\") pod \"payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b\" (UID: \"75128e7a-c0b5-43f7-b602-74b637b66850\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:23:59.958455 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:23:59.958330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75128e7a-c0b5-43f7-b602-74b637b66850-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b\" (UID: \"75128e7a-c0b5-43f7-b602-74b637b66850\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:24:00.058818 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.058778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0298e60-cd06-447b-9c4e-14e91571c74a-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg\" (UID: \"a0298e60-cd06-447b-9c4e-14e91571c74a\") " pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:24:00.058818 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.058817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2nkw\" (UniqueName: \"kubernetes.io/projected/a0298e60-cd06-447b-9c4e-14e91571c74a-kube-api-access-h2nkw\") pod \"payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg\" (UID: \"a0298e60-cd06-447b-9c4e-14e91571c74a\") " pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:24:00.059155 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.058855    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmjlx\" (UniqueName: \"kubernetes.io/projected/75128e7a-c0b5-43f7-b602-74b637b66850-kube-api-access-fmjlx\") pod \"payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b\" (UID: \"75128e7a-c0b5-43f7-b602-74b637b66850\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:24:00.059155 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.058884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75128e7a-c0b5-43f7-b602-74b637b66850-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b\" (UID: \"75128e7a-c0b5-43f7-b602-74b637b66850\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:24:00.059589 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.059569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0298e60-cd06-447b-9c4e-14e91571c74a-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg\" (UID: \"a0298e60-cd06-447b-9c4e-14e91571c74a\") " pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:24:00.059680 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.059660    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75128e7a-c0b5-43f7-b602-74b637b66850-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b\" (UID: \"75128e7a-c0b5-43f7-b602-74b637b66850\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:24:00.074887 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.074855    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmjlx\" (UniqueName: \"kubernetes.io/projected/75128e7a-c0b5-43f7-b602-74b637b66850-kube-api-access-fmjlx\") pod \"payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b\" (UID: \"75128e7a-c0b5-43f7-b602-74b637b66850\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:24:00.074887 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.074877    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2nkw\" (UniqueName: \"kubernetes.io/projected/a0298e60-cd06-447b-9c4e-14e91571c74a-kube-api-access-h2nkw\") pod \"payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg\" (UID: \"a0298e60-cd06-447b-9c4e-14e91571c74a\") " pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:24:00.179209 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.179167    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:24:00.207470 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.207438    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:24:00.336263 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.336238    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"]
Jul 24 15:24:00.339031 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:24:00.338949    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75128e7a_c0b5_43f7_b602_74b637b66850.slice/crio-2bbbe534ef48135ac6dcd4f0426dcfe7fd502a7dd4e6d98592fa5c326a903e03 WatchSource:0}: Error finding container 2bbbe534ef48135ac6dcd4f0426dcfe7fd502a7dd4e6d98592fa5c326a903e03: Status 404 returned error can't find the container with id 2bbbe534ef48135ac6dcd4f0426dcfe7fd502a7dd4e6d98592fa5c326a903e03
Jul 24 15:24:00.372525 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:00.372502    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"]
Jul 24 15:24:00.378095 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:24:00.378065    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0298e60_cd06_447b_9c4e_14e91571c74a.slice/crio-c0e12f7046dff37b5bd3982036289abd23b1f041415bcc4004da974cb33e378a WatchSource:0}: Error finding container c0e12f7046dff37b5bd3982036289abd23b1f041415bcc4004da974cb33e378a: Status 404 returned error can't find the container with id c0e12f7046dff37b5bd3982036289abd23b1f041415bcc4004da974cb33e378a
Jul 24 15:24:01.330620 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:01.330582    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b" event={"ID":"75128e7a-c0b5-43f7-b602-74b637b66850","Type":"ContainerStarted","Data":"54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d"}
Jul 24 15:24:01.331073 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:01.330651    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:24:01.331073 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:01.330676    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b" event={"ID":"75128e7a-c0b5-43f7-b602-74b637b66850","Type":"ContainerStarted","Data":"2bbbe534ef48135ac6dcd4f0426dcfe7fd502a7dd4e6d98592fa5c326a903e03"}
Jul 24 15:24:01.332257 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:01.332232    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg" event={"ID":"a0298e60-cd06-447b-9c4e-14e91571c74a","Type":"ContainerStarted","Data":"d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363"}
Jul 24 15:24:01.332363 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:01.332272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg" event={"ID":"a0298e60-cd06-447b-9c4e-14e91571c74a","Type":"ContainerStarted","Data":"c0e12f7046dff37b5bd3982036289abd23b1f041415bcc4004da974cb33e378a"}
Jul 24 15:24:01.332406 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:01.332377    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:24:01.348676 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:01.348617    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b" podStartSLOduration=2.348599567 podStartE2EDuration="2.348599567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:23:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:24:01.347452898 +0000 UTC m=+1669.886432332" watchObservedRunningTime="2026-07-24 15:24:01.348599567 +0000 UTC m=+1669.887579014"
Jul 24 15:24:01.366710 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:01.366661    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg" podStartSLOduration=2.366641976 podStartE2EDuration="2.366641976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:23:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:24:01.36457787 +0000 UTC m=+1669.903557284" watchObservedRunningTime="2026-07-24 15:24:01.366641976 +0000 UTC m=+1669.905621385"
Jul 24 15:24:12.341548 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:12.341448    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:24:12.341548 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:12.341535    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:24:34.616082 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.615969    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"]
Jul 24 15:24:34.616697 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.616357    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg" podUID="a0298e60-cd06-447b-9c4e-14e91571c74a" containerName="payload-processing" containerID="cri-o://d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363" gracePeriod=30
Jul 24 15:24:34.627546 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.627516    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"]
Jul 24 15:24:34.627914 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.627883    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b" podUID="75128e7a-c0b5-43f7-b602-74b637b66850" containerName="payload-pre-processing" containerID="cri-o://54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d" gracePeriod=30
Jul 24 15:24:34.873683 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.873621    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:24:34.906128 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.906094    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:24:34.976804 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.976772    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75128e7a-c0b5-43f7-b602-74b637b66850-plugins-config-volume\") pod \"75128e7a-c0b5-43f7-b602-74b637b66850\" (UID: \"75128e7a-c0b5-43f7-b602-74b637b66850\") "
Jul 24 15:24:34.976804 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.976818    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2nkw\" (UniqueName: \"kubernetes.io/projected/a0298e60-cd06-447b-9c4e-14e91571c74a-kube-api-access-h2nkw\") pod \"a0298e60-cd06-447b-9c4e-14e91571c74a\" (UID: \"a0298e60-cd06-447b-9c4e-14e91571c74a\") "
Jul 24 15:24:34.977107 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.976861    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0298e60-cd06-447b-9c4e-14e91571c74a-plugins-config-volume\") pod \"a0298e60-cd06-447b-9c4e-14e91571c74a\" (UID: \"a0298e60-cd06-447b-9c4e-14e91571c74a\") "
Jul 24 15:24:34.977107 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.976971    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmjlx\" (UniqueName: \"kubernetes.io/projected/75128e7a-c0b5-43f7-b602-74b637b66850-kube-api-access-fmjlx\") pod \"75128e7a-c0b5-43f7-b602-74b637b66850\" (UID: \"75128e7a-c0b5-43f7-b602-74b637b66850\") "
Jul 24 15:24:34.977257 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.977233    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0298e60-cd06-447b-9c4e-14e91571c74a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a0298e60-cd06-447b-9c4e-14e91571c74a" (UID: "a0298e60-cd06-447b-9c4e-14e91571c74a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:24:34.977312 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.977269    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75128e7a-c0b5-43f7-b602-74b637b66850-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75128e7a-c0b5-43f7-b602-74b637b66850" (UID: "75128e7a-c0b5-43f7-b602-74b637b66850"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:24:34.979192 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.979161    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75128e7a-c0b5-43f7-b602-74b637b66850-kube-api-access-fmjlx" (OuterVolumeSpecName: "kube-api-access-fmjlx") pod "75128e7a-c0b5-43f7-b602-74b637b66850" (UID: "75128e7a-c0b5-43f7-b602-74b637b66850"). InnerVolumeSpecName "kube-api-access-fmjlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:24:34.979299 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:34.979194    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0298e60-cd06-447b-9c4e-14e91571c74a-kube-api-access-h2nkw" (OuterVolumeSpecName: "kube-api-access-h2nkw") pod "a0298e60-cd06-447b-9c4e-14e91571c74a" (UID: "a0298e60-cd06-447b-9c4e-14e91571c74a"). InnerVolumeSpecName "kube-api-access-h2nkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:24:35.077932 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.077896    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75128e7a-c0b5-43f7-b602-74b637b66850-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:24:35.077932 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.077925    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2nkw\" (UniqueName: \"kubernetes.io/projected/a0298e60-cd06-447b-9c4e-14e91571c74a-kube-api-access-h2nkw\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:24:35.077932 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.077936    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0298e60-cd06-447b-9c4e-14e91571c74a-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:24:35.077932 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.077946    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmjlx\" (UniqueName: \"kubernetes.io/projected/75128e7a-c0b5-43f7-b602-74b637b66850-kube-api-access-fmjlx\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:24:35.494917 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.494882    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0298e60-cd06-447b-9c4e-14e91571c74a" containerID="d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363" exitCode=0
Jul 24 15:24:35.495141 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.494925    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"
Jul 24 15:24:35.495141 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.494971    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg" event={"ID":"a0298e60-cd06-447b-9c4e-14e91571c74a","Type":"ContainerDied","Data":"d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363"}
Jul 24 15:24:35.495141 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.495047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg" event={"ID":"a0298e60-cd06-447b-9c4e-14e91571c74a","Type":"ContainerDied","Data":"c0e12f7046dff37b5bd3982036289abd23b1f041415bcc4004da974cb33e378a"}
Jul 24 15:24:35.495141 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.495078    2582 scope.go:117] "RemoveContainer" containerID="d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363"
Jul 24 15:24:35.496737 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.496713    2582 generic.go:356] "Generic (PLEG): container finished" podID="75128e7a-c0b5-43f7-b602-74b637b66850" containerID="54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d" exitCode=0
Jul 24 15:24:35.496884 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.496793    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b" event={"ID":"75128e7a-c0b5-43f7-b602-74b637b66850","Type":"ContainerDied","Data":"54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d"}
Jul 24 15:24:35.496884 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.496833    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b" event={"ID":"75128e7a-c0b5-43f7-b602-74b637b66850","Type":"ContainerDied","Data":"2bbbe534ef48135ac6dcd4f0426dcfe7fd502a7dd4e6d98592fa5c326a903e03"}
Jul 24 15:24:35.497079 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.496873    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"
Jul 24 15:24:35.505235 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.505210    2582 scope.go:117] "RemoveContainer" containerID="d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363"
Jul 24 15:24:35.505576 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:24:35.505551    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363\": container with ID starting with d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363 not found: ID does not exist" containerID="d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363"
Jul 24 15:24:35.505669 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.505588    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363"} err="failed to get container status \"d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363\": rpc error: code = NotFound desc = could not find container \"d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363\": container with ID starting with d876f3d8229ed2c3a35f95887ed8185ff82ef153243bf9845cd8a8c52bd3f363 not found: ID does not exist"
Jul 24 15:24:35.505669 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.505612    2582 scope.go:117] "RemoveContainer" containerID="54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d"
Jul 24 15:24:35.515079 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.515059    2582 scope.go:117] "RemoveContainer" containerID="54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d"
Jul 24 15:24:35.515376 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:24:35.515358    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d\": container with ID starting with 54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d not found: ID does not exist" containerID="54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d"
Jul 24 15:24:35.515432 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.515385    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d"} err="failed to get container status \"54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d\": rpc error: code = NotFound desc = could not find container \"54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d\": container with ID starting with 54f3737f55ebda72964a6804c860646c54e683a5f08315251c1748ebc632ab5d not found: ID does not exist"
Jul 24 15:24:35.523800 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.523773    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"]
Jul 24 15:24:35.530031 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.530003    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a327d057-58c44c4b57-l7kvg"]
Jul 24 15:24:35.544052 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.544020    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"]
Jul 24 15:24:35.549549 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.549523    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a327d057-5db766bbfb-zz88b"]
Jul 24 15:24:35.995729 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.995695    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75128e7a-c0b5-43f7-b602-74b637b66850" path="/var/lib/kubelet/pods/75128e7a-c0b5-43f7-b602-74b637b66850/volumes"
Jul 24 15:24:35.996129 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:35.996061    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0298e60-cd06-447b-9c4e-14e91571c74a" path="/var/lib/kubelet/pods/a0298e60-cd06-447b-9c4e-14e91571c74a/volumes"
Jul 24 15:24:42.948177 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.948145    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"]
Jul 24 15:24:42.948561 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.948466    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75128e7a-c0b5-43f7-b602-74b637b66850" containerName="payload-pre-processing"
Jul 24 15:24:42.948561 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.948476    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="75128e7a-c0b5-43f7-b602-74b637b66850" containerName="payload-pre-processing"
Jul 24 15:24:42.948561 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.948496    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0298e60-cd06-447b-9c4e-14e91571c74a" containerName="payload-processing"
Jul 24 15:24:42.948561 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.948501    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0298e60-cd06-447b-9c4e-14e91571c74a" containerName="payload-processing"
Jul 24 15:24:42.948561 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.948552    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0298e60-cd06-447b-9c4e-14e91571c74a" containerName="payload-processing"
Jul 24 15:24:42.948561 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.948561    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="75128e7a-c0b5-43f7-b602-74b637b66850" containerName="payload-pre-processing"
Jul 24 15:24:42.951358 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.951343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:24:42.954178 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.954157    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e2f4813e\""
Jul 24 15:24:42.954298 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.954157    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e2f4813e-dockercfg-2l44r\""
Jul 24 15:24:42.965975 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.965947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"]
Jul 24 15:24:42.968059 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.968034    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"]
Jul 24 15:24:42.971195 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.971176    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:24:42.978827 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:42.978803    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"]
Jul 24 15:24:43.051886 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.051844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j66mh\" (UniqueName: \"kubernetes.io/projected/56fb2482-3186-4c9c-bad5-caa2030209ef-kube-api-access-j66mh\") pod \"payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt\" (UID: \"56fb2482-3186-4c9c-bad5-caa2030209ef\") " pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:24:43.052103 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.051934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chznr\" (UniqueName: \"kubernetes.io/projected/5e07a28b-2e5f-492c-a245-52c1d513e448-kube-api-access-chznr\") pod \"payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf\" (UID: \"5e07a28b-2e5f-492c-a245-52c1d513e448\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:24:43.052103 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.051975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56fb2482-3186-4c9c-bad5-caa2030209ef-plugins-config-volume\") pod \"payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt\" (UID: \"56fb2482-3186-4c9c-bad5-caa2030209ef\") " pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:24:43.052103 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.052071    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e07a28b-2e5f-492c-a245-52c1d513e448-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf\" (UID: \"5e07a28b-2e5f-492c-a245-52c1d513e448\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:24:43.153532 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.153493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j66mh\" (UniqueName: \"kubernetes.io/projected/56fb2482-3186-4c9c-bad5-caa2030209ef-kube-api-access-j66mh\") pod \"payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt\" (UID: \"56fb2482-3186-4c9c-bad5-caa2030209ef\") " pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:24:43.153532 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.153538    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chznr\" (UniqueName: \"kubernetes.io/projected/5e07a28b-2e5f-492c-a245-52c1d513e448-kube-api-access-chznr\") pod \"payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf\" (UID: \"5e07a28b-2e5f-492c-a245-52c1d513e448\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:24:43.153797 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.153561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56fb2482-3186-4c9c-bad5-caa2030209ef-plugins-config-volume\") pod \"payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt\" (UID: \"56fb2482-3186-4c9c-bad5-caa2030209ef\") " pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:24:43.153797 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.153623    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e07a28b-2e5f-492c-a245-52c1d513e448-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf\" (UID: \"5e07a28b-2e5f-492c-a245-52c1d513e448\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:24:43.154367 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.154342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e07a28b-2e5f-492c-a245-52c1d513e448-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf\" (UID: \"5e07a28b-2e5f-492c-a245-52c1d513e448\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:24:43.154471 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.154416    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56fb2482-3186-4c9c-bad5-caa2030209ef-plugins-config-volume\") pod \"payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt\" (UID: \"56fb2482-3186-4c9c-bad5-caa2030209ef\") " pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:24:43.164310 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.164274    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j66mh\" (UniqueName: \"kubernetes.io/projected/56fb2482-3186-4c9c-bad5-caa2030209ef-kube-api-access-j66mh\") pod \"payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt\" (UID: \"56fb2482-3186-4c9c-bad5-caa2030209ef\") " pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:24:43.164636 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.164619    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chznr\" (UniqueName: \"kubernetes.io/projected/5e07a28b-2e5f-492c-a245-52c1d513e448-kube-api-access-chznr\") pod \"payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf\" (UID: \"5e07a28b-2e5f-492c-a245-52c1d513e448\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:24:43.261712 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.261613    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:24:43.284664 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.284383    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:24:43.474627 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.474595    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"]
Jul 24 15:24:43.479434 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:24:43.479407    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56fb2482_3186_4c9c_bad5_caa2030209ef.slice/crio-f6cc098f800d1ee20784168833aae76d6858583af23a228958c67da22b88954b WatchSource:0}: Error finding container f6cc098f800d1ee20784168833aae76d6858583af23a228958c67da22b88954b: Status 404 returned error can't find the container with id f6cc098f800d1ee20784168833aae76d6858583af23a228958c67da22b88954b
Jul 24 15:24:43.492032 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.492004    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"]
Jul 24 15:24:43.493339 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:24:43.493309    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e07a28b_2e5f_492c_a245_52c1d513e448.slice/crio-9fec96072e463f1086cb2c68cf502559359b5a6f2f3187b8aed599d087295d36 WatchSource:0}: Error finding container 9fec96072e463f1086cb2c68cf502559359b5a6f2f3187b8aed599d087295d36: Status 404 returned error can't find the container with id 9fec96072e463f1086cb2c68cf502559359b5a6f2f3187b8aed599d087295d36
Jul 24 15:24:43.534230 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.534198    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf" event={"ID":"5e07a28b-2e5f-492c-a245-52c1d513e448","Type":"ContainerStarted","Data":"9fec96072e463f1086cb2c68cf502559359b5a6f2f3187b8aed599d087295d36"}
Jul 24 15:24:43.535556 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:43.535530    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt" event={"ID":"56fb2482-3186-4c9c-bad5-caa2030209ef","Type":"ContainerStarted","Data":"f6cc098f800d1ee20784168833aae76d6858583af23a228958c67da22b88954b"}
Jul 24 15:24:44.542370 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:44.542329    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt" event={"ID":"56fb2482-3186-4c9c-bad5-caa2030209ef","Type":"ContainerStarted","Data":"dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3"}
Jul 24 15:24:44.542840 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:44.542481    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:24:44.544182 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:44.544153    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf" event={"ID":"5e07a28b-2e5f-492c-a245-52c1d513e448","Type":"ContainerStarted","Data":"d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded"}
Jul 24 15:24:44.544326 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:44.544300    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:24:44.561908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:44.561856    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt" podStartSLOduration=2.561840608 podStartE2EDuration="2.561840608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:24:44.56121384 +0000 UTC m=+1713.100193255" watchObservedRunningTime="2026-07-24 15:24:44.561840608 +0000 UTC m=+1713.100820021"
Jul 24 15:24:44.579378 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:44.579326    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf" podStartSLOduration=2.579308631 podStartE2EDuration="2.579308631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:24:44.57762398 +0000 UTC m=+1713.116603411" watchObservedRunningTime="2026-07-24 15:24:44.579308631 +0000 UTC m=+1713.118288045"
Jul 24 15:24:55.550948 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:55.550913    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:24:55.551475 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:24:55.551234    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:25:18.721823 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:18.721789    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"]
Jul 24 15:25:18.722309 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:18.722049    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt" podUID="56fb2482-3186-4c9c-bad5-caa2030209ef" containerName="payload-processing" containerID="cri-o://dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3" gracePeriod=30
Jul 24 15:25:18.738764 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:18.738731    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"]
Jul 24 15:25:18.739142 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:18.739107    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf" podUID="5e07a28b-2e5f-492c-a245-52c1d513e448" containerName="payload-pre-processing" containerID="cri-o://d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded" gracePeriod=30
Jul 24 15:25:18.987917 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:18.987885    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:25:19.022582 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.022556    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:25:19.081821 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.081783    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chznr\" (UniqueName: \"kubernetes.io/projected/5e07a28b-2e5f-492c-a245-52c1d513e448-kube-api-access-chznr\") pod \"5e07a28b-2e5f-492c-a245-52c1d513e448\" (UID: \"5e07a28b-2e5f-492c-a245-52c1d513e448\") "
Jul 24 15:25:19.082094 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.081859    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56fb2482-3186-4c9c-bad5-caa2030209ef-plugins-config-volume\") pod \"56fb2482-3186-4c9c-bad5-caa2030209ef\" (UID: \"56fb2482-3186-4c9c-bad5-caa2030209ef\") "
Jul 24 15:25:19.082094 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.081891    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e07a28b-2e5f-492c-a245-52c1d513e448-plugins-config-volume\") pod \"5e07a28b-2e5f-492c-a245-52c1d513e448\" (UID: \"5e07a28b-2e5f-492c-a245-52c1d513e448\") "
Jul 24 15:25:19.082094 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.081957    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j66mh\" (UniqueName: \"kubernetes.io/projected/56fb2482-3186-4c9c-bad5-caa2030209ef-kube-api-access-j66mh\") pod \"56fb2482-3186-4c9c-bad5-caa2030209ef\" (UID: \"56fb2482-3186-4c9c-bad5-caa2030209ef\") "
Jul 24 15:25:19.082331 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.082291    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56fb2482-3186-4c9c-bad5-caa2030209ef-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "56fb2482-3186-4c9c-bad5-caa2030209ef" (UID: "56fb2482-3186-4c9c-bad5-caa2030209ef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:25:19.082473 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.082335    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e07a28b-2e5f-492c-a245-52c1d513e448-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5e07a28b-2e5f-492c-a245-52c1d513e448" (UID: "5e07a28b-2e5f-492c-a245-52c1d513e448"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:25:19.084203 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.084171    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56fb2482-3186-4c9c-bad5-caa2030209ef-kube-api-access-j66mh" (OuterVolumeSpecName: "kube-api-access-j66mh") pod "56fb2482-3186-4c9c-bad5-caa2030209ef" (UID: "56fb2482-3186-4c9c-bad5-caa2030209ef"). InnerVolumeSpecName "kube-api-access-j66mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:25:19.084203 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.084175    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e07a28b-2e5f-492c-a245-52c1d513e448-kube-api-access-chznr" (OuterVolumeSpecName: "kube-api-access-chznr") pod "5e07a28b-2e5f-492c-a245-52c1d513e448" (UID: "5e07a28b-2e5f-492c-a245-52c1d513e448"). InnerVolumeSpecName "kube-api-access-chznr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:25:19.183432 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.183399    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j66mh\" (UniqueName: \"kubernetes.io/projected/56fb2482-3186-4c9c-bad5-caa2030209ef-kube-api-access-j66mh\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:25:19.183432 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.183429    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chznr\" (UniqueName: \"kubernetes.io/projected/5e07a28b-2e5f-492c-a245-52c1d513e448-kube-api-access-chznr\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:25:19.183432 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.183439    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56fb2482-3186-4c9c-bad5-caa2030209ef-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:25:19.183704 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.183448    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e07a28b-2e5f-492c-a245-52c1d513e448-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:25:19.701068 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.701036    2582 generic.go:356] "Generic (PLEG): container finished" podID="56fb2482-3186-4c9c-bad5-caa2030209ef" containerID="dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3" exitCode=0
Jul 24 15:25:19.701273 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.701103    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"
Jul 24 15:25:19.701273 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.701133    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt" event={"ID":"56fb2482-3186-4c9c-bad5-caa2030209ef","Type":"ContainerDied","Data":"dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3"}
Jul 24 15:25:19.701273 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.701230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt" event={"ID":"56fb2482-3186-4c9c-bad5-caa2030209ef","Type":"ContainerDied","Data":"f6cc098f800d1ee20784168833aae76d6858583af23a228958c67da22b88954b"}
Jul 24 15:25:19.701273 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.701261    2582 scope.go:117] "RemoveContainer" containerID="dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3"
Jul 24 15:25:19.702542 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.702519    2582 generic.go:356] "Generic (PLEG): container finished" podID="5e07a28b-2e5f-492c-a245-52c1d513e448" containerID="d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded" exitCode=0
Jul 24 15:25:19.702676 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.702559    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf" event={"ID":"5e07a28b-2e5f-492c-a245-52c1d513e448","Type":"ContainerDied","Data":"d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded"}
Jul 24 15:25:19.702676 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.702590    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"
Jul 24 15:25:19.702676 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.702595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf" event={"ID":"5e07a28b-2e5f-492c-a245-52c1d513e448","Type":"ContainerDied","Data":"9fec96072e463f1086cb2c68cf502559359b5a6f2f3187b8aed599d087295d36"}
Jul 24 15:25:19.711756 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.711736    2582 scope.go:117] "RemoveContainer" containerID="dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3"
Jul 24 15:25:19.712061 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:25:19.712040    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3\": container with ID starting with dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3 not found: ID does not exist" containerID="dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3"
Jul 24 15:25:19.712152 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.712070    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3"} err="failed to get container status \"dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3\": rpc error: code = NotFound desc = could not find container \"dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3\": container with ID starting with dd91891f56cc12ae2f244f4d48ee14a76db8823b92232a55936707902c309aa3 not found: ID does not exist"
Jul 24 15:25:19.712152 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.712089    2582 scope.go:117] "RemoveContainer" containerID="d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded"
Jul 24 15:25:19.720087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.720070    2582 scope.go:117] "RemoveContainer" containerID="d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded"
Jul 24 15:25:19.720365 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:25:19.720346    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded\": container with ID starting with d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded not found: ID does not exist" containerID="d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded"
Jul 24 15:25:19.720434 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.720372    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded"} err="failed to get container status \"d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded\": rpc error: code = NotFound desc = could not find container \"d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded\": container with ID starting with d8b9f8a478f9f2ec14061e79960a375eafa5c0e995c6b6ad8c422f56b966fded not found: ID does not exist"
Jul 24 15:25:19.726462 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.726436    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"]
Jul 24 15:25:19.731882 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.731858    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e2f4813e-6dcbff7964-z6bsf"]
Jul 24 15:25:19.742361 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.742334    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"]
Jul 24 15:25:19.746772 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.746748    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e2f4813e-64cbc8cb76-74ftt"]
Jul 24 15:25:19.995353 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.995277    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56fb2482-3186-4c9c-bad5-caa2030209ef" path="/var/lib/kubelet/pods/56fb2482-3186-4c9c-bad5-caa2030209ef/volumes"
Jul 24 15:25:19.995643 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:19.995630    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e07a28b-2e5f-492c-a245-52c1d513e448" path="/var/lib/kubelet/pods/5e07a28b-2e5f-492c-a245-52c1d513e448/volumes"
Jul 24 15:25:28.448426 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.448389    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"]
Jul 24 15:25:28.448912 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.448706    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fb2482-3186-4c9c-bad5-caa2030209ef" containerName="payload-processing"
Jul 24 15:25:28.448912 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.448716    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fb2482-3186-4c9c-bad5-caa2030209ef" containerName="payload-processing"
Jul 24 15:25:28.448912 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.448738    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e07a28b-2e5f-492c-a245-52c1d513e448" containerName="payload-pre-processing"
Jul 24 15:25:28.448912 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.448744    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e07a28b-2e5f-492c-a245-52c1d513e448" containerName="payload-pre-processing"
Jul 24 15:25:28.448912 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.448798    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fb2482-3186-4c9c-bad5-caa2030209ef" containerName="payload-processing"
Jul 24 15:25:28.448912 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.448807    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e07a28b-2e5f-492c-a245-52c1d513e448" containerName="payload-pre-processing"
Jul 24 15:25:28.453154 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.453138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:25:28.456043 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.456024    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-64206840-dockercfg-h9s98\""
Jul 24 15:25:28.456806 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.456780    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-64206840\""
Jul 24 15:25:28.466143 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.466118    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"]
Jul 24 15:25:28.480585 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.480549    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"]
Jul 24 15:25:28.483836 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.483810    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:25:28.502564 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.502537    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"]
Jul 24 15:25:28.572094 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.572064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccdb1e0f-bfa3-4876-814a-77f413f10707-plugins-config-volume\") pod \"payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh\" (UID: \"ccdb1e0f-bfa3-4876-814a-77f413f10707\") " pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:25:28.572278 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.572100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2\" (UID: \"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:25:28.572278 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.572124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l25ph\" (UniqueName: \"kubernetes.io/projected/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-kube-api-access-l25ph\") pod \"payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2\" (UID: \"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:25:28.572278 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.572232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmxg9\" (UniqueName: \"kubernetes.io/projected/ccdb1e0f-bfa3-4876-814a-77f413f10707-kube-api-access-dmxg9\") pod \"payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh\" (UID: \"ccdb1e0f-bfa3-4876-814a-77f413f10707\") " pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:25:28.673143 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.673104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmxg9\" (UniqueName: \"kubernetes.io/projected/ccdb1e0f-bfa3-4876-814a-77f413f10707-kube-api-access-dmxg9\") pod \"payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh\" (UID: \"ccdb1e0f-bfa3-4876-814a-77f413f10707\") " pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:25:28.673331 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.673157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccdb1e0f-bfa3-4876-814a-77f413f10707-plugins-config-volume\") pod \"payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh\" (UID: \"ccdb1e0f-bfa3-4876-814a-77f413f10707\") " pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:25:28.673331 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.673273    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2\" (UID: \"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:25:28.673331 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.673305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l25ph\" (UniqueName: \"kubernetes.io/projected/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-kube-api-access-l25ph\") pod \"payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2\" (UID: \"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:25:28.673960 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.673931    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccdb1e0f-bfa3-4876-814a-77f413f10707-plugins-config-volume\") pod \"payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh\" (UID: \"ccdb1e0f-bfa3-4876-814a-77f413f10707\") " pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:25:28.674092 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.673974    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2\" (UID: \"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:25:28.683506 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.683481    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmxg9\" (UniqueName: \"kubernetes.io/projected/ccdb1e0f-bfa3-4876-814a-77f413f10707-kube-api-access-dmxg9\") pod \"payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh\" (UID: \"ccdb1e0f-bfa3-4876-814a-77f413f10707\") " pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:25:28.683616 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.683481    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l25ph\" (UniqueName: \"kubernetes.io/projected/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-kube-api-access-l25ph\") pod \"payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2\" (UID: \"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:25:28.762618 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.762542    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:25:28.794542 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.794511    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:25:28.917656 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.917622    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"]
Jul 24 15:25:28.919229 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:25:28.919194    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdb1e0f_bfa3_4876_814a_77f413f10707.slice/crio-23825586dd9dea4dac1b2940da9029662850f3a34187e14d72d31e290da28ed9 WatchSource:0}: Error finding container 23825586dd9dea4dac1b2940da9029662850f3a34187e14d72d31e290da28ed9: Status 404 returned error can't find the container with id 23825586dd9dea4dac1b2940da9029662850f3a34187e14d72d31e290da28ed9
Jul 24 15:25:28.953639 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:28.953615    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"]
Jul 24 15:25:28.956185 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:25:28.956149    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633fcafb_cb6e_4c72_a3a8_b6b35fd2240a.slice/crio-596ef46abe64b817d5a494e1fff80792d981c9b4255785a5639fd0262e423bdd WatchSource:0}: Error finding container 596ef46abe64b817d5a494e1fff80792d981c9b4255785a5639fd0262e423bdd: Status 404 returned error can't find the container with id 596ef46abe64b817d5a494e1fff80792d981c9b4255785a5639fd0262e423bdd
Jul 24 15:25:29.749414 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:29.749375    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2" event={"ID":"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a","Type":"ContainerStarted","Data":"4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa"}
Jul 24 15:25:29.749906 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:29.749442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2" event={"ID":"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a","Type":"ContainerStarted","Data":"596ef46abe64b817d5a494e1fff80792d981c9b4255785a5639fd0262e423bdd"}
Jul 24 15:25:29.749906 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:29.749558    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:25:29.751035 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:29.751010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh" event={"ID":"ccdb1e0f-bfa3-4876-814a-77f413f10707","Type":"ContainerStarted","Data":"453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220"}
Jul 24 15:25:29.751155 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:29.751055    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh" event={"ID":"ccdb1e0f-bfa3-4876-814a-77f413f10707","Type":"ContainerStarted","Data":"23825586dd9dea4dac1b2940da9029662850f3a34187e14d72d31e290da28ed9"}
Jul 24 15:25:29.751155 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:29.751076    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:25:29.772735 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:29.772689    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2" podStartSLOduration=1.7726704610000001 podStartE2EDuration="1.772670461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:25:29.771571424 +0000 UTC m=+1758.310550855" watchObservedRunningTime="2026-07-24 15:25:29.772670461 +0000 UTC m=+1758.311649873"
Jul 24 15:25:29.789848 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:29.789802    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh" podStartSLOduration=1.789786227 podStartE2EDuration="1.789786227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:25:29.788684915 +0000 UTC m=+1758.327664361" watchObservedRunningTime="2026-07-24 15:25:29.789786227 +0000 UTC m=+1758.328765639"
Jul 24 15:25:40.758686 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:40.758656    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:25:40.759222 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:25:40.758721    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:26:02.828215 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:02.828123    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"]
Jul 24 15:26:02.828821 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:02.828377    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh" podUID="ccdb1e0f-bfa3-4876-814a-77f413f10707" containerName="payload-processing" containerID="cri-o://453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220" gracePeriod=30
Jul 24 15:26:02.834328 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:02.834297    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"]
Jul 24 15:26:02.834525 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:02.834504    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2" podUID="633fcafb-cb6e-4c72-a3a8-b6b35fd2240a" containerName="payload-pre-processing" containerID="cri-o://4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa" gracePeriod=30
Jul 24 15:26:03.081037 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.080957    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:26:03.110292 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.110265    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:26:03.182677 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.182643    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l25ph\" (UniqueName: \"kubernetes.io/projected/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-kube-api-access-l25ph\") pod \"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a\" (UID: \"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a\") "
Jul 24 15:26:03.182677 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.182679    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmxg9\" (UniqueName: \"kubernetes.io/projected/ccdb1e0f-bfa3-4876-814a-77f413f10707-kube-api-access-dmxg9\") pod \"ccdb1e0f-bfa3-4876-814a-77f413f10707\" (UID: \"ccdb1e0f-bfa3-4876-814a-77f413f10707\") "
Jul 24 15:26:03.182953 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.182713    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccdb1e0f-bfa3-4876-814a-77f413f10707-plugins-config-volume\") pod \"ccdb1e0f-bfa3-4876-814a-77f413f10707\" (UID: \"ccdb1e0f-bfa3-4876-814a-77f413f10707\") "
Jul 24 15:26:03.182953 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.182748    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-plugins-config-volume\") pod \"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a\" (UID: \"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a\") "
Jul 24 15:26:03.183217 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.183194    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "633fcafb-cb6e-4c72-a3a8-b6b35fd2240a" (UID: "633fcafb-cb6e-4c72-a3a8-b6b35fd2240a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:26:03.183291 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.183193    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccdb1e0f-bfa3-4876-814a-77f413f10707-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ccdb1e0f-bfa3-4876-814a-77f413f10707" (UID: "ccdb1e0f-bfa3-4876-814a-77f413f10707"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:26:03.185102 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.185083    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccdb1e0f-bfa3-4876-814a-77f413f10707-kube-api-access-dmxg9" (OuterVolumeSpecName: "kube-api-access-dmxg9") pod "ccdb1e0f-bfa3-4876-814a-77f413f10707" (UID: "ccdb1e0f-bfa3-4876-814a-77f413f10707"). InnerVolumeSpecName "kube-api-access-dmxg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:26:03.185164 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.185102    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-kube-api-access-l25ph" (OuterVolumeSpecName: "kube-api-access-l25ph") pod "633fcafb-cb6e-4c72-a3a8-b6b35fd2240a" (UID: "633fcafb-cb6e-4c72-a3a8-b6b35fd2240a"). InnerVolumeSpecName "kube-api-access-l25ph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:26:03.283676 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.283646    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l25ph\" (UniqueName: \"kubernetes.io/projected/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-kube-api-access-l25ph\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:26:03.283676 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.283672    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmxg9\" (UniqueName: \"kubernetes.io/projected/ccdb1e0f-bfa3-4876-814a-77f413f10707-kube-api-access-dmxg9\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:26:03.283676 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.283682    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccdb1e0f-bfa3-4876-814a-77f413f10707-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:26:03.283907 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.283690    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:26:03.912395 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.912357    2582 generic.go:356] "Generic (PLEG): container finished" podID="ccdb1e0f-bfa3-4876-814a-77f413f10707" containerID="453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220" exitCode=0
Jul 24 15:26:03.912395 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.912396    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"
Jul 24 15:26:03.912902 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.912436    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh" event={"ID":"ccdb1e0f-bfa3-4876-814a-77f413f10707","Type":"ContainerDied","Data":"453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220"}
Jul 24 15:26:03.912902 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.912494    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh" event={"ID":"ccdb1e0f-bfa3-4876-814a-77f413f10707","Type":"ContainerDied","Data":"23825586dd9dea4dac1b2940da9029662850f3a34187e14d72d31e290da28ed9"}
Jul 24 15:26:03.912902 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.912521    2582 scope.go:117] "RemoveContainer" containerID="453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220"
Jul 24 15:26:03.913970 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.913947    2582 generic.go:356] "Generic (PLEG): container finished" podID="633fcafb-cb6e-4c72-a3a8-b6b35fd2240a" containerID="4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa" exitCode=0
Jul 24 15:26:03.914060 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.914002    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2" event={"ID":"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a","Type":"ContainerDied","Data":"4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa"}
Jul 24 15:26:03.914060 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.914018    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"
Jul 24 15:26:03.914060 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.914036    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2" event={"ID":"633fcafb-cb6e-4c72-a3a8-b6b35fd2240a","Type":"ContainerDied","Data":"596ef46abe64b817d5a494e1fff80792d981c9b4255785a5639fd0262e423bdd"}
Jul 24 15:26:03.922271 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.922245    2582 scope.go:117] "RemoveContainer" containerID="453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220"
Jul 24 15:26:03.922600 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:26:03.922577    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220\": container with ID starting with 453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220 not found: ID does not exist" containerID="453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220"
Jul 24 15:26:03.922681 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.922612    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220"} err="failed to get container status \"453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220\": rpc error: code = NotFound desc = could not find container \"453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220\": container with ID starting with 453d9e668f2caa809a1ad07c38f0e5b68f123a2ed689ec0208a0f436bfdd0220 not found: ID does not exist"
Jul 24 15:26:03.922681 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.922635    2582 scope.go:117] "RemoveContainer" containerID="4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa"
Jul 24 15:26:03.930561 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.930546    2582 scope.go:117] "RemoveContainer" containerID="4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa"
Jul 24 15:26:03.930834 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:26:03.930816    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa\": container with ID starting with 4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa not found: ID does not exist" containerID="4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa"
Jul 24 15:26:03.930881 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.930843    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa"} err="failed to get container status \"4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa\": rpc error: code = NotFound desc = could not find container \"4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa\": container with ID starting with 4d7308f093f474130d3134a9376bde42857e2df6968bc384501d69a2a4fb3faa not found: ID does not exist"
Jul 24 15:26:03.940502 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.940475    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"]
Jul 24 15:26:03.944109 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.944085    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-64206840-7f57d8fc54-t75nh"]
Jul 24 15:26:03.954843 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.954816    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"]
Jul 24 15:26:03.958899 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.958876    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-64206840-565bffb6d-cgfd2"]
Jul 24 15:26:03.995224 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.995194    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="633fcafb-cb6e-4c72-a3a8-b6b35fd2240a" path="/var/lib/kubelet/pods/633fcafb-cb6e-4c72-a3a8-b6b35fd2240a/volumes"
Jul 24 15:26:03.995558 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:03.995545    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccdb1e0f-bfa3-4876-814a-77f413f10707" path="/var/lib/kubelet/pods/ccdb1e0f-bfa3-4876-814a-77f413f10707/volumes"
Jul 24 15:26:12.001644 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:12.001608    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:26:12.003225 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:26:12.003206    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:27:51.782504 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.782420    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"]
Jul 24 15:27:51.782971 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.782751    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccdb1e0f-bfa3-4876-814a-77f413f10707" containerName="payload-processing"
Jul 24 15:27:51.782971 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.782761    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccdb1e0f-bfa3-4876-814a-77f413f10707" containerName="payload-processing"
Jul 24 15:27:51.782971 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.782772    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="633fcafb-cb6e-4c72-a3a8-b6b35fd2240a" containerName="payload-pre-processing"
Jul 24 15:27:51.782971 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.782778    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="633fcafb-cb6e-4c72-a3a8-b6b35fd2240a" containerName="payload-pre-processing"
Jul 24 15:27:51.782971 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.782830    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="633fcafb-cb6e-4c72-a3a8-b6b35fd2240a" containerName="payload-pre-processing"
Jul 24 15:27:51.782971 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.782841    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccdb1e0f-bfa3-4876-814a-77f413f10707" containerName="payload-processing"
Jul 24 15:27:51.785594 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.785578    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:27:51.788247 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.788211    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-61f9c21e\""
Jul 24 15:27:51.801708 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.801674    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"]
Jul 24 15:27:51.807419 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.807386    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:27:51.807600 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.807430    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"]
Jul 24 15:27:51.810686 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.810657    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-61f9c21e-dockercfg-td87s\""
Jul 24 15:27:51.819194 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.819163    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"]
Jul 24 15:27:51.863194 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.863149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/416313a0-0aad-49b3-a2db-243d9d67bc9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls\" (UID: \"416313a0-0aad-49b3-a2db-243d9d67bc9a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:27:51.863194 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.863198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-plugins-config-volume\") pod \"payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9\" (UID: \"fab11b4b-e0b6-48cc-8b37-06ed63149b1e\") " pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:27:51.863412 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.863215    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t572n\" (UniqueName: \"kubernetes.io/projected/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-kube-api-access-t572n\") pod \"payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9\" (UID: \"fab11b4b-e0b6-48cc-8b37-06ed63149b1e\") " pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:27:51.863412 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.863298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl9bg\" (UniqueName: \"kubernetes.io/projected/416313a0-0aad-49b3-a2db-243d9d67bc9a-kube-api-access-xl9bg\") pod \"payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls\" (UID: \"416313a0-0aad-49b3-a2db-243d9d67bc9a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:27:51.964295 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.964255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/416313a0-0aad-49b3-a2db-243d9d67bc9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls\" (UID: \"416313a0-0aad-49b3-a2db-243d9d67bc9a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:27:51.964295 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.964301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-plugins-config-volume\") pod \"payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9\" (UID: \"fab11b4b-e0b6-48cc-8b37-06ed63149b1e\") " pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:27:51.964515 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.964323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t572n\" (UniqueName: \"kubernetes.io/projected/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-kube-api-access-t572n\") pod \"payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9\" (UID: \"fab11b4b-e0b6-48cc-8b37-06ed63149b1e\") " pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:27:51.964515 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.964382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl9bg\" (UniqueName: \"kubernetes.io/projected/416313a0-0aad-49b3-a2db-243d9d67bc9a-kube-api-access-xl9bg\") pod \"payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls\" (UID: \"416313a0-0aad-49b3-a2db-243d9d67bc9a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:27:51.965016 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.964966    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/416313a0-0aad-49b3-a2db-243d9d67bc9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls\" (UID: \"416313a0-0aad-49b3-a2db-243d9d67bc9a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:27:51.965062 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.965030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-plugins-config-volume\") pod \"payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9\" (UID: \"fab11b4b-e0b6-48cc-8b37-06ed63149b1e\") " pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:27:51.974801 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.974773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl9bg\" (UniqueName: \"kubernetes.io/projected/416313a0-0aad-49b3-a2db-243d9d67bc9a-kube-api-access-xl9bg\") pod \"payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls\" (UID: \"416313a0-0aad-49b3-a2db-243d9d67bc9a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:27:51.975218 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:51.975197    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t572n\" (UniqueName: \"kubernetes.io/projected/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-kube-api-access-t572n\") pod \"payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9\" (UID: \"fab11b4b-e0b6-48cc-8b37-06ed63149b1e\") " pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:27:52.096212 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.096105    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:27:52.122476 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.122444    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:27:52.249380 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.249351    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"]
Jul 24 15:27:52.252591 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:27:52.252558    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416313a0_0aad_49b3_a2db_243d9d67bc9a.slice/crio-7a9d6a50be02ec5e5492fcfee393b5cf09a853dff344d74531c651fb8891b806 WatchSource:0}: Error finding container 7a9d6a50be02ec5e5492fcfee393b5cf09a853dff344d74531c651fb8891b806: Status 404 returned error can't find the container with id 7a9d6a50be02ec5e5492fcfee393b5cf09a853dff344d74531c651fb8891b806
Jul 24 15:27:52.283063 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.283039    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"]
Jul 24 15:27:52.288664 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:27:52.288629    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab11b4b_e0b6_48cc_8b37_06ed63149b1e.slice/crio-4d9479d38e4766013c37b9a345f20ab6239440cc047fa035220d6111784d9340 WatchSource:0}: Error finding container 4d9479d38e4766013c37b9a345f20ab6239440cc047fa035220d6111784d9340: Status 404 returned error can't find the container with id 4d9479d38e4766013c37b9a345f20ab6239440cc047fa035220d6111784d9340
Jul 24 15:27:52.400181 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.399399    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9" event={"ID":"fab11b4b-e0b6-48cc-8b37-06ed63149b1e","Type":"ContainerStarted","Data":"e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82"}
Jul 24 15:27:52.400181 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.399460    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9" event={"ID":"fab11b4b-e0b6-48cc-8b37-06ed63149b1e","Type":"ContainerStarted","Data":"4d9479d38e4766013c37b9a345f20ab6239440cc047fa035220d6111784d9340"}
Jul 24 15:27:52.400181 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.399602    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:27:52.402159 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.402129    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls" event={"ID":"416313a0-0aad-49b3-a2db-243d9d67bc9a","Type":"ContainerStarted","Data":"1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb"}
Jul 24 15:27:52.402330 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.402185    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls" event={"ID":"416313a0-0aad-49b3-a2db-243d9d67bc9a","Type":"ContainerStarted","Data":"7a9d6a50be02ec5e5492fcfee393b5cf09a853dff344d74531c651fb8891b806"}
Jul 24 15:27:52.402330 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.402220    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:27:52.417913 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.417851    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9" podStartSLOduration=1.417833222 podStartE2EDuration="1.417833222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:27:52.416604382 +0000 UTC m=+1900.955583807" watchObservedRunningTime="2026-07-24 15:27:52.417833222 +0000 UTC m=+1900.956812636"
Jul 24 15:27:52.434166 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:27:52.434107    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls" podStartSLOduration=1.434087802 podStartE2EDuration="1.434087802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:27:52.432426275 +0000 UTC m=+1900.971405689" watchObservedRunningTime="2026-07-24 15:27:52.434087802 +0000 UTC m=+1900.973067218"
Jul 24 15:28:03.410922 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:03.410886    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:28:03.411406 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:03.411379    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:28:12.968965 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:12.968930    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"]
Jul 24 15:28:12.969429 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:12.969171    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9" podUID="fab11b4b-e0b6-48cc-8b37-06ed63149b1e" containerName="payload-processing" containerID="cri-o://e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82" gracePeriod=30
Jul 24 15:28:12.985614 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:12.985589    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"]
Jul 24 15:28:12.985861 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:12.985835    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls" podUID="416313a0-0aad-49b3-a2db-243d9d67bc9a" containerName="payload-pre-processing" containerID="cri-o://1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb" gracePeriod=30
Jul 24 15:28:13.261486 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.261463    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:28:13.264284 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.264264    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:28:13.357211 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.357168    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/416313a0-0aad-49b3-a2db-243d9d67bc9a-plugins-config-volume\") pod \"416313a0-0aad-49b3-a2db-243d9d67bc9a\" (UID: \"416313a0-0aad-49b3-a2db-243d9d67bc9a\") "
Jul 24 15:28:13.357211 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.357222    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t572n\" (UniqueName: \"kubernetes.io/projected/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-kube-api-access-t572n\") pod \"fab11b4b-e0b6-48cc-8b37-06ed63149b1e\" (UID: \"fab11b4b-e0b6-48cc-8b37-06ed63149b1e\") "
Jul 24 15:28:13.357472 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.357253    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl9bg\" (UniqueName: \"kubernetes.io/projected/416313a0-0aad-49b3-a2db-243d9d67bc9a-kube-api-access-xl9bg\") pod \"416313a0-0aad-49b3-a2db-243d9d67bc9a\" (UID: \"416313a0-0aad-49b3-a2db-243d9d67bc9a\") "
Jul 24 15:28:13.357472 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.357338    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-plugins-config-volume\") pod \"fab11b4b-e0b6-48cc-8b37-06ed63149b1e\" (UID: \"fab11b4b-e0b6-48cc-8b37-06ed63149b1e\") "
Jul 24 15:28:13.357657 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.357633    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/416313a0-0aad-49b3-a2db-243d9d67bc9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "416313a0-0aad-49b3-a2db-243d9d67bc9a" (UID: "416313a0-0aad-49b3-a2db-243d9d67bc9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:28:13.357712 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.357662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fab11b4b-e0b6-48cc-8b37-06ed63149b1e" (UID: "fab11b4b-e0b6-48cc-8b37-06ed63149b1e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:28:13.359501 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.359479    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416313a0-0aad-49b3-a2db-243d9d67bc9a-kube-api-access-xl9bg" (OuterVolumeSpecName: "kube-api-access-xl9bg") pod "416313a0-0aad-49b3-a2db-243d9d67bc9a" (UID: "416313a0-0aad-49b3-a2db-243d9d67bc9a"). InnerVolumeSpecName "kube-api-access-xl9bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:28:13.359559 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.359505    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-kube-api-access-t572n" (OuterVolumeSpecName: "kube-api-access-t572n") pod "fab11b4b-e0b6-48cc-8b37-06ed63149b1e" (UID: "fab11b4b-e0b6-48cc-8b37-06ed63149b1e"). InnerVolumeSpecName "kube-api-access-t572n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:28:13.458087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.458052    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/416313a0-0aad-49b3-a2db-243d9d67bc9a-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:28:13.458087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.458080    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t572n\" (UniqueName: \"kubernetes.io/projected/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-kube-api-access-t572n\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:28:13.458087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.458090    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl9bg\" (UniqueName: \"kubernetes.io/projected/416313a0-0aad-49b3-a2db-243d9d67bc9a-kube-api-access-xl9bg\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:28:13.458087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.458099    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab11b4b-e0b6-48cc-8b37-06ed63149b1e-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:28:13.509646 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.509556    2582 generic.go:356] "Generic (PLEG): container finished" podID="fab11b4b-e0b6-48cc-8b37-06ed63149b1e" containerID="e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82" exitCode=0
Jul 24 15:28:13.509646 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.509601    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"
Jul 24 15:28:13.509889 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.509640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9" event={"ID":"fab11b4b-e0b6-48cc-8b37-06ed63149b1e","Type":"ContainerDied","Data":"e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82"}
Jul 24 15:28:13.509889 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.509699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9" event={"ID":"fab11b4b-e0b6-48cc-8b37-06ed63149b1e","Type":"ContainerDied","Data":"4d9479d38e4766013c37b9a345f20ab6239440cc047fa035220d6111784d9340"}
Jul 24 15:28:13.509889 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.509727    2582 scope.go:117] "RemoveContainer" containerID="e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82"
Jul 24 15:28:13.510994 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.510957    2582 generic.go:356] "Generic (PLEG): container finished" podID="416313a0-0aad-49b3-a2db-243d9d67bc9a" containerID="1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb" exitCode=0
Jul 24 15:28:13.510994 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.511018    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls" event={"ID":"416313a0-0aad-49b3-a2db-243d9d67bc9a","Type":"ContainerDied","Data":"1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb"}
Jul 24 15:28:13.510994 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.511039    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"
Jul 24 15:28:13.511225 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.511068    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls" event={"ID":"416313a0-0aad-49b3-a2db-243d9d67bc9a","Type":"ContainerDied","Data":"7a9d6a50be02ec5e5492fcfee393b5cf09a853dff344d74531c651fb8891b806"}
Jul 24 15:28:13.519563 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.519541    2582 scope.go:117] "RemoveContainer" containerID="e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82"
Jul 24 15:28:13.519942 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:28:13.519911    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82\": container with ID starting with e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82 not found: ID does not exist" containerID="e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82"
Jul 24 15:28:13.520085 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.519951    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82"} err="failed to get container status \"e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82\": rpc error: code = NotFound desc = could not find container \"e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82\": container with ID starting with e7a87f4649606932f372d4286e3ca0784bae4dc6d970eb80d8283953b4220e82 not found: ID does not exist"
Jul 24 15:28:13.520085 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.519995    2582 scope.go:117] "RemoveContainer" containerID="1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb"
Jul 24 15:28:13.528187 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.528169    2582 scope.go:117] "RemoveContainer" containerID="1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb"
Jul 24 15:28:13.528510 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:28:13.528490    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb\": container with ID starting with 1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb not found: ID does not exist" containerID="1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb"
Jul 24 15:28:13.528575 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.528517    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb"} err="failed to get container status \"1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb\": rpc error: code = NotFound desc = could not find container \"1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb\": container with ID starting with 1c14573391c4dcb0d3e6f42c91b23f42b35ec9f435a9ca84a4e35e98f644cfbb not found: ID does not exist"
Jul 24 15:28:13.533403 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.533377    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"]
Jul 24 15:28:13.535943 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.535919    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61f9c21e-7bb4d58b56-72wls"]
Jul 24 15:28:13.546054 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.546028    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"]
Jul 24 15:28:13.552170 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.552145    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-61f9c21e-5648675ffd-bgtm9"]
Jul 24 15:28:13.999955 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:13.999921    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="416313a0-0aad-49b3-a2db-243d9d67bc9a" path="/var/lib/kubelet/pods/416313a0-0aad-49b3-a2db-243d9d67bc9a/volumes"
Jul 24 15:28:14.000461 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:14.000444    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fab11b4b-e0b6-48cc-8b37-06ed63149b1e" path="/var/lib/kubelet/pods/fab11b4b-e0b6-48cc-8b37-06ed63149b1e/volumes"
Jul 24 15:28:48.773257 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.773226    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"]
Jul 24 15:28:48.775618 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.773535    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416313a0-0aad-49b3-a2db-243d9d67bc9a" containerName="payload-pre-processing"
Jul 24 15:28:48.775618 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.773546    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="416313a0-0aad-49b3-a2db-243d9d67bc9a" containerName="payload-pre-processing"
Jul 24 15:28:48.775618 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.773567    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fab11b4b-e0b6-48cc-8b37-06ed63149b1e" containerName="payload-processing"
Jul 24 15:28:48.775618 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.773573    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fab11b4b-e0b6-48cc-8b37-06ed63149b1e" containerName="payload-processing"
Jul 24 15:28:48.775618 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.773624    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="416313a0-0aad-49b3-a2db-243d9d67bc9a" containerName="payload-pre-processing"
Jul 24 15:28:48.775618 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.773630    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fab11b4b-e0b6-48cc-8b37-06ed63149b1e" containerName="payload-processing"
Jul 24 15:28:48.776548 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.776532    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:28:48.779439 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.779413    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-5ad3cd4c\""
Jul 24 15:28:48.779602 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.779514    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-5ad3cd4c-dockercfg-px727\""
Jul 24 15:28:48.792308 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.792279    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"]
Jul 24 15:28:48.811200 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.811166    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"]
Jul 24 15:28:48.814727 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.814708    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:28:48.826106 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.826076    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"]
Jul 24 15:28:48.870774 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.870737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-plugins-config-volume\") pod \"payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d\" (UID: \"5a0d8dca-aabf-442f-ac47-46ae1bf2841b\") " pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:28:48.870774 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.870782    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp79p\" (UniqueName: \"kubernetes.io/projected/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-kube-api-access-bp79p\") pod \"payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d\" (UID: \"5a0d8dca-aabf-442f-ac47-46ae1bf2841b\") " pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:28:48.971977 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.971938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qhzh\" (UniqueName: \"kubernetes.io/projected/2f203690-3be1-41ed-802c-f9a53045e9e9-kube-api-access-8qhzh\") pod \"payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf\" (UID: \"2f203690-3be1-41ed-802c-f9a53045e9e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:28:48.972217 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.972010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-plugins-config-volume\") pod \"payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d\" (UID: \"5a0d8dca-aabf-442f-ac47-46ae1bf2841b\") " pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:28:48.972217 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.972041    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f203690-3be1-41ed-802c-f9a53045e9e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf\" (UID: \"2f203690-3be1-41ed-802c-f9a53045e9e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:28:48.972217 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.972072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp79p\" (UniqueName: \"kubernetes.io/projected/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-kube-api-access-bp79p\") pod \"payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d\" (UID: \"5a0d8dca-aabf-442f-ac47-46ae1bf2841b\") " pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:28:48.972751 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.972729    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-plugins-config-volume\") pod \"payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d\" (UID: \"5a0d8dca-aabf-442f-ac47-46ae1bf2841b\") " pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:28:48.988151 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:48.988120    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp79p\" (UniqueName: \"kubernetes.io/projected/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-kube-api-access-bp79p\") pod \"payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d\" (UID: \"5a0d8dca-aabf-442f-ac47-46ae1bf2841b\") " pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:28:49.073158 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.073060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qhzh\" (UniqueName: \"kubernetes.io/projected/2f203690-3be1-41ed-802c-f9a53045e9e9-kube-api-access-8qhzh\") pod \"payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf\" (UID: \"2f203690-3be1-41ed-802c-f9a53045e9e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:28:49.073158 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.073144    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f203690-3be1-41ed-802c-f9a53045e9e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf\" (UID: \"2f203690-3be1-41ed-802c-f9a53045e9e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:28:49.073818 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.073798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f203690-3be1-41ed-802c-f9a53045e9e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf\" (UID: \"2f203690-3be1-41ed-802c-f9a53045e9e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:28:49.082372 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.082350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qhzh\" (UniqueName: \"kubernetes.io/projected/2f203690-3be1-41ed-802c-f9a53045e9e9-kube-api-access-8qhzh\") pod \"payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf\" (UID: \"2f203690-3be1-41ed-802c-f9a53045e9e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:28:49.087171 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.087149    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:28:49.124317 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.124285    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:28:49.245850 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.245632    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"]
Jul 24 15:28:49.248264 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:28:49.248227    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0d8dca_aabf_442f_ac47_46ae1bf2841b.slice/crio-9311ade82b0d9e1b9dc49dc6f66b631e346eb5b3b30f687c804039baaae6e80b WatchSource:0}: Error finding container 9311ade82b0d9e1b9dc49dc6f66b631e346eb5b3b30f687c804039baaae6e80b: Status 404 returned error can't find the container with id 9311ade82b0d9e1b9dc49dc6f66b631e346eb5b3b30f687c804039baaae6e80b
Jul 24 15:28:49.291286 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.291261    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"]
Jul 24 15:28:49.301238 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:28:49.301211    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f203690_3be1_41ed_802c_f9a53045e9e9.slice/crio-55838aad958cac9bb29cabe858a212f21bc70ad9f175b98c243fe09cb9bcee17 WatchSource:0}: Error finding container 55838aad958cac9bb29cabe858a212f21bc70ad9f175b98c243fe09cb9bcee17: Status 404 returned error can't find the container with id 55838aad958cac9bb29cabe858a212f21bc70ad9f175b98c243fe09cb9bcee17
Jul 24 15:28:49.669493 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.669460    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf" event={"ID":"2f203690-3be1-41ed-802c-f9a53045e9e9","Type":"ContainerStarted","Data":"ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5"}
Jul 24 15:28:49.669706 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.669530    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf" event={"ID":"2f203690-3be1-41ed-802c-f9a53045e9e9","Type":"ContainerStarted","Data":"55838aad958cac9bb29cabe858a212f21bc70ad9f175b98c243fe09cb9bcee17"}
Jul 24 15:28:49.669706 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.669561    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:28:49.671026 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.671003    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d" event={"ID":"5a0d8dca-aabf-442f-ac47-46ae1bf2841b","Type":"ContainerStarted","Data":"636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50"}
Jul 24 15:28:49.671117 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.671049    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d" event={"ID":"5a0d8dca-aabf-442f-ac47-46ae1bf2841b","Type":"ContainerStarted","Data":"9311ade82b0d9e1b9dc49dc6f66b631e346eb5b3b30f687c804039baaae6e80b"}
Jul 24 15:28:49.671117 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.671083    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:28:49.688343 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.688295    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf" podStartSLOduration=1.688278738 podStartE2EDuration="1.688278738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:28:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:28:49.687134335 +0000 UTC m=+1958.226113749" watchObservedRunningTime="2026-07-24 15:28:49.688278738 +0000 UTC m=+1958.227258151"
Jul 24 15:28:49.706187 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:49.706127    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d" podStartSLOduration=1.706106602 podStartE2EDuration="1.706106602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:28:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:28:49.705457004 +0000 UTC m=+1958.244436416" watchObservedRunningTime="2026-07-24 15:28:49.706106602 +0000 UTC m=+1958.245086016"
Jul 24 15:28:56.423619 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.423577    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"]
Jul 24 15:28:56.427254 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.427234    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.430908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.430876    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5ad3cd4c\"/\"kube-root-ca.crt\""
Jul 24 15:28:56.431084 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.430925    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5ad3cd4c\"/\"e2e-lifecycle-model-5ad3cd4c-kserve-self-signed-certs\""
Jul 24 15:28:56.431084 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.430965    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5ad3cd4c\"/\"default-dockercfg-bc9g8\""
Jul 24 15:28:56.431191 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.431094    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5ad3cd4c\"/\"openshift-service-ca.crt\""
Jul 24 15:28:56.436893 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.436868    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"]
Jul 24 15:28:56.543356 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.543315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-home\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.543356 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.543365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpktx\" (UniqueName: \"kubernetes.io/projected/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-kube-api-access-cpktx\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.543594 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.543384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tmp-dir\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.543594 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.543477    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tls-certs\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.543594 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.543517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-model-cache\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.543733 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.543599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-dshm\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.644380 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.644344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-dshm\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.644380 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.644383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-home\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.644634 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.644410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpktx\" (UniqueName: \"kubernetes.io/projected/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-kube-api-access-cpktx\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.644634 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.644431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tmp-dir\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.644634 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.644481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tls-certs\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.644634 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.644509    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-model-cache\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.644853 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.644788    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-home\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.644853 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.644839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tmp-dir\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.644960 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.644913    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-model-cache\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.646905 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.646879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-dshm\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.647359 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.647341    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tls-certs\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.653730 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.653700    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpktx\" (UniqueName: \"kubernetes.io/projected/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-kube-api-access-cpktx\") pod \"e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") " pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.738047 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.737917    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:28:56.882528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:56.882500    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"]
Jul 24 15:28:56.884709 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:28:56.884683    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4a7e4c8_a476_4e1f_9009_9d4455c147aa.slice/crio-5f243ed83cbd4339114a323a783f49c22a90986f6a07d7efec0ddfc20fc5619c WatchSource:0}: Error finding container 5f243ed83cbd4339114a323a783f49c22a90986f6a07d7efec0ddfc20fc5619c: Status 404 returned error can't find the container with id 5f243ed83cbd4339114a323a783f49c22a90986f6a07d7efec0ddfc20fc5619c
Jul 24 15:28:57.709437 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:57.709341    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx" event={"ID":"f4a7e4c8-a476-4e1f-9009-9d4455c147aa","Type":"ContainerStarted","Data":"0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d"}
Jul 24 15:28:57.709437 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:57.709392    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx" event={"ID":"f4a7e4c8-a476-4e1f-9009-9d4455c147aa","Type":"ContainerStarted","Data":"5f243ed83cbd4339114a323a783f49c22a90986f6a07d7efec0ddfc20fc5619c"}
Jul 24 15:28:57.729801 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:28:57.729747    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx" podStartSLOduration=1.7297282699999998 podStartE2EDuration="1.72972827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:28:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:28:57.728871629 +0000 UTC m=+1966.267851076" watchObservedRunningTime="2026-07-24 15:28:57.72972827 +0000 UTC m=+1966.268707682"
Jul 24 15:29:00.677557 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:00.677526    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:29:00.677940 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:00.677597    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:29:06.738892 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:06.738797    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:29:06.738892 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:06.738865    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:29:06.752081 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:06.752054    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:29:06.764170 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:06.764143    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:29:37.551154 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.551113    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"]
Jul 24 15:29:37.551777 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.551371    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d" podUID="5a0d8dca-aabf-442f-ac47-46ae1bf2841b" containerName="payload-processing" containerID="cri-o://636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50" gracePeriod=30
Jul 24 15:29:37.560831 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.560791    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"]
Jul 24 15:29:37.561229 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.561035    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf" podUID="2f203690-3be1-41ed-802c-f9a53045e9e9" containerName="payload-pre-processing" containerID="cri-o://ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5" gracePeriod=30
Jul 24 15:29:37.814060 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.813965    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:29:37.840453 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.840425    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:29:37.892408 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.892375    2582 generic.go:356] "Generic (PLEG): container finished" podID="2f203690-3be1-41ed-802c-f9a53045e9e9" containerID="ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5" exitCode=0
Jul 24 15:29:37.892602 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.892423    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"
Jul 24 15:29:37.892602 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.892458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf" event={"ID":"2f203690-3be1-41ed-802c-f9a53045e9e9","Type":"ContainerDied","Data":"ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5"}
Jul 24 15:29:37.892602 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.892523    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf" event={"ID":"2f203690-3be1-41ed-802c-f9a53045e9e9","Type":"ContainerDied","Data":"55838aad958cac9bb29cabe858a212f21bc70ad9f175b98c243fe09cb9bcee17"}
Jul 24 15:29:37.892602 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.892559    2582 scope.go:117] "RemoveContainer" containerID="ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5"
Jul 24 15:29:37.893797 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.893780    2582 generic.go:356] "Generic (PLEG): container finished" podID="5a0d8dca-aabf-442f-ac47-46ae1bf2841b" containerID="636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50" exitCode=0
Jul 24 15:29:37.893893 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.893830    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"
Jul 24 15:29:37.893893 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.893869    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d" event={"ID":"5a0d8dca-aabf-442f-ac47-46ae1bf2841b","Type":"ContainerDied","Data":"636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50"}
Jul 24 15:29:37.893975 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.893922    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d" event={"ID":"5a0d8dca-aabf-442f-ac47-46ae1bf2841b","Type":"ContainerDied","Data":"9311ade82b0d9e1b9dc49dc6f66b631e346eb5b3b30f687c804039baaae6e80b"}
Jul 24 15:29:37.901198 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.901183    2582 scope.go:117] "RemoveContainer" containerID="ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5"
Jul 24 15:29:37.901489 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:29:37.901470    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5\": container with ID starting with ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5 not found: ID does not exist" containerID="ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5"
Jul 24 15:29:37.901573 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.901498    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5"} err="failed to get container status \"ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5\": rpc error: code = NotFound desc = could not find container \"ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5\": container with ID starting with ca576829b4361473ddcf98e950a82a1cf090a988754a6696cf7d7be78d0d84f5 not found: ID does not exist"
Jul 24 15:29:37.901573 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.901515    2582 scope.go:117] "RemoveContainer" containerID="636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50"
Jul 24 15:29:37.909916 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.909504    2582 scope.go:117] "RemoveContainer" containerID="636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50"
Jul 24 15:29:37.909916 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:29:37.909784    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50\": container with ID starting with 636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50 not found: ID does not exist" containerID="636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50"
Jul 24 15:29:37.909916 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.909807    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50"} err="failed to get container status \"636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50\": rpc error: code = NotFound desc = could not find container \"636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50\": container with ID starting with 636544d47260d05d0dda8bb3a5347af9a1c46c15a39715d04c9e84287c1fbf50 not found: ID does not exist"
Jul 24 15:29:37.927280 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.927246    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp79p\" (UniqueName: \"kubernetes.io/projected/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-kube-api-access-bp79p\") pod \"5a0d8dca-aabf-442f-ac47-46ae1bf2841b\" (UID: \"5a0d8dca-aabf-442f-ac47-46ae1bf2841b\") "
Jul 24 15:29:37.927438 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.927300    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f203690-3be1-41ed-802c-f9a53045e9e9-plugins-config-volume\") pod \"2f203690-3be1-41ed-802c-f9a53045e9e9\" (UID: \"2f203690-3be1-41ed-802c-f9a53045e9e9\") "
Jul 24 15:29:37.927438 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.927340    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qhzh\" (UniqueName: \"kubernetes.io/projected/2f203690-3be1-41ed-802c-f9a53045e9e9-kube-api-access-8qhzh\") pod \"2f203690-3be1-41ed-802c-f9a53045e9e9\" (UID: \"2f203690-3be1-41ed-802c-f9a53045e9e9\") "
Jul 24 15:29:37.927438 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.927426    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-plugins-config-volume\") pod \"5a0d8dca-aabf-442f-ac47-46ae1bf2841b\" (UID: \"5a0d8dca-aabf-442f-ac47-46ae1bf2841b\") "
Jul 24 15:29:37.927799 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.927764    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f203690-3be1-41ed-802c-f9a53045e9e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f203690-3be1-41ed-802c-f9a53045e9e9" (UID: "2f203690-3be1-41ed-802c-f9a53045e9e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:29:37.927901 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.927877    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a0d8dca-aabf-442f-ac47-46ae1bf2841b" (UID: "5a0d8dca-aabf-442f-ac47-46ae1bf2841b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:29:37.929662 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.929640    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f203690-3be1-41ed-802c-f9a53045e9e9-kube-api-access-8qhzh" (OuterVolumeSpecName: "kube-api-access-8qhzh") pod "2f203690-3be1-41ed-802c-f9a53045e9e9" (UID: "2f203690-3be1-41ed-802c-f9a53045e9e9"). InnerVolumeSpecName "kube-api-access-8qhzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:29:37.929730 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:37.929669    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-kube-api-access-bp79p" (OuterVolumeSpecName: "kube-api-access-bp79p") pod "5a0d8dca-aabf-442f-ac47-46ae1bf2841b" (UID: "5a0d8dca-aabf-442f-ac47-46ae1bf2841b"). InnerVolumeSpecName "kube-api-access-bp79p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:29:38.028826 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:38.028782    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp79p\" (UniqueName: \"kubernetes.io/projected/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-kube-api-access-bp79p\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:29:38.028826 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:38.028815    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f203690-3be1-41ed-802c-f9a53045e9e9-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:29:38.028826 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:38.028825    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qhzh\" (UniqueName: \"kubernetes.io/projected/2f203690-3be1-41ed-802c-f9a53045e9e9-kube-api-access-8qhzh\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:29:38.028826 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:38.028834    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a0d8dca-aabf-442f-ac47-46ae1bf2841b-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:29:38.210257 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:38.210218    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"]
Jul 24 15:29:38.212056 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:38.212027    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5ad3cd4c-67f5bd68d-7v4lf"]
Jul 24 15:29:38.223975 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:38.223941    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"]
Jul 24 15:29:38.229124 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:38.229097    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5ad3cd4c-795944f75d-5w74d"]
Jul 24 15:29:39.996006 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:39.995958    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f203690-3be1-41ed-802c-f9a53045e9e9" path="/var/lib/kubelet/pods/2f203690-3be1-41ed-802c-f9a53045e9e9/volumes"
Jul 24 15:29:39.996480 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:39.996326    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a0d8dca-aabf-442f-ac47-46ae1bf2841b" path="/var/lib/kubelet/pods/5a0d8dca-aabf-442f-ac47-46ae1bf2841b/volumes"
Jul 24 15:29:50.232849 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:29:50.232810    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"]
Jul 24 15:30:05.252820 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.252780    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx" podUID="f4a7e4c8-a476-4e1f-9009-9d4455c147aa" containerName="main" containerID="cri-o://0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d" gracePeriod=45
Jul 24 15:30:05.502210 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.502177    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:30:05.583735 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.583631    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpktx\" (UniqueName: \"kubernetes.io/projected/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-kube-api-access-cpktx\") pod \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") "
Jul 24 15:30:05.583735 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.583697    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-home\") pod \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") "
Jul 24 15:30:05.584008 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.583769    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-model-cache\") pod \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") "
Jul 24 15:30:05.584008 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.583807    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tmp-dir\") pod \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") "
Jul 24 15:30:05.584008 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.583834    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tls-certs\") pod \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") "
Jul 24 15:30:05.584008 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.583888    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-dshm\") pod \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\" (UID: \"f4a7e4c8-a476-4e1f-9009-9d4455c147aa\") "
Jul 24 15:30:05.584008 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.583955    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-home" (OuterVolumeSpecName: "home") pod "f4a7e4c8-a476-4e1f-9009-9d4455c147aa" (UID: "f4a7e4c8-a476-4e1f-9009-9d4455c147aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:30:05.584210 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.584044    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4a7e4c8-a476-4e1f-9009-9d4455c147aa" (UID: "f4a7e4c8-a476-4e1f-9009-9d4455c147aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:30:05.584210 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.584080    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4a7e4c8-a476-4e1f-9009-9d4455c147aa" (UID: "f4a7e4c8-a476-4e1f-9009-9d4455c147aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:30:05.584315 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.584251    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:30:05.584315 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.584265    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:30:05.584315 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.584275    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:30:05.586154 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.586115    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-dshm" (OuterVolumeSpecName: "dshm") pod "f4a7e4c8-a476-4e1f-9009-9d4455c147aa" (UID: "f4a7e4c8-a476-4e1f-9009-9d4455c147aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:30:05.586269 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.586187    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-kube-api-access-cpktx" (OuterVolumeSpecName: "kube-api-access-cpktx") pod "f4a7e4c8-a476-4e1f-9009-9d4455c147aa" (UID: "f4a7e4c8-a476-4e1f-9009-9d4455c147aa"). InnerVolumeSpecName "kube-api-access-cpktx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:30:05.586269 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.586186    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4a7e4c8-a476-4e1f-9009-9d4455c147aa" (UID: "f4a7e4c8-a476-4e1f-9009-9d4455c147aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:30:05.685715 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.685673    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpktx\" (UniqueName: \"kubernetes.io/projected/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-kube-api-access-cpktx\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:30:05.685715 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.685705    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:30:05.685715 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:05.685715    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4a7e4c8-a476-4e1f-9009-9d4455c147aa-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:30:06.019515 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:06.019484    2582 generic.go:356] "Generic (PLEG): container finished" podID="f4a7e4c8-a476-4e1f-9009-9d4455c147aa" containerID="0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d" exitCode=0
Jul 24 15:30:06.019708 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:06.019529    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"
Jul 24 15:30:06.019708 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:06.019577    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx" event={"ID":"f4a7e4c8-a476-4e1f-9009-9d4455c147aa","Type":"ContainerDied","Data":"0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d"}
Jul 24 15:30:06.019708 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:06.019621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx" event={"ID":"f4a7e4c8-a476-4e1f-9009-9d4455c147aa","Type":"ContainerDied","Data":"5f243ed83cbd4339114a323a783f49c22a90986f6a07d7efec0ddfc20fc5619c"}
Jul 24 15:30:06.019708 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:06.019643    2582 scope.go:117] "RemoveContainer" containerID="0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d"
Jul 24 15:30:06.028135 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:06.028116    2582 scope.go:117] "RemoveContainer" containerID="0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d"
Jul 24 15:30:06.028436 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:30:06.028417    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d\": container with ID starting with 0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d not found: ID does not exist" containerID="0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d"
Jul 24 15:30:06.028486 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:06.028445    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d"} err="failed to get container status \"0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d\": rpc error: code = NotFound desc = could not find container \"0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d\": container with ID starting with 0fc57a604054bb1165cb2754d5ab40a1eb514a751a60b4911328452d10837d5d not found: ID does not exist"
Jul 24 15:30:06.037097 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:06.037068    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"]
Jul 24 15:30:06.040901 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:06.040877    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5ad3cd4c/e2e-lifecycle-model-5ad3cd4c-kserve-6b7564bf5f-d7btx"]
Jul 24 15:30:07.995731 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:30:07.995693    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4a7e4c8-a476-4e1f-9009-9d4455c147aa" path="/var/lib/kubelet/pods/f4a7e4c8-a476-4e1f-9009-9d4455c147aa/volumes"
Jul 24 15:31:12.026348 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:12.026314    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:31:12.029027 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:12.029005    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:31:39.624936 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.624901    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"]
Jul 24 15:31:39.625436 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.625238    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f203690-3be1-41ed-802c-f9a53045e9e9" containerName="payload-pre-processing"
Jul 24 15:31:39.625436 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.625249    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f203690-3be1-41ed-802c-f9a53045e9e9" containerName="payload-pre-processing"
Jul 24 15:31:39.625436 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.625263    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a7e4c8-a476-4e1f-9009-9d4455c147aa" containerName="main"
Jul 24 15:31:39.625436 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.625268    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a7e4c8-a476-4e1f-9009-9d4455c147aa" containerName="main"
Jul 24 15:31:39.625436 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.625279    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0d8dca-aabf-442f-ac47-46ae1bf2841b" containerName="payload-processing"
Jul 24 15:31:39.625436 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.625285    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0d8dca-aabf-442f-ac47-46ae1bf2841b" containerName="payload-processing"
Jul 24 15:31:39.625436 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.625331    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a0d8dca-aabf-442f-ac47-46ae1bf2841b" containerName="payload-processing"
Jul 24 15:31:39.625436 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.625339    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4a7e4c8-a476-4e1f-9009-9d4455c147aa" containerName="main"
Jul 24 15:31:39.625436 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.625347    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f203690-3be1-41ed-802c-f9a53045e9e9" containerName="payload-pre-processing"
Jul 24 15:31:39.628383 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.628365    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:31:39.631581 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.631559    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-92cb39\""
Jul 24 15:31:39.631779 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.631755    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-92cb39-dockercfg-nkf9x\""
Jul 24 15:31:39.645843 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.645817    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"]
Jul 24 15:31:39.690436 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.690403    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"]
Jul 24 15:31:39.693863 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.693840    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:31:39.703180 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.703149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xklj9\" (UniqueName: \"kubernetes.io/projected/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-kube-api-access-xklj9\") pod \"payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z\" (UID: \"693f5bc2-2da4-4e1d-8462-a50dc8054e2d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:31:39.703362 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.703217    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z\" (UID: \"693f5bc2-2da4-4e1d-8462-a50dc8054e2d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:31:39.705105 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.705078    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"]
Jul 24 15:31:39.804588 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.804552    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z\" (UID: \"693f5bc2-2da4-4e1d-8462-a50dc8054e2d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:31:39.804807 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.804623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96dcb19c-231c-4305-b4b2-9394f3aad647-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz\" (UID: \"96dcb19c-231c-4305-b4b2-9394f3aad647\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:31:39.804807 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.804699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz5bq\" (UniqueName: \"kubernetes.io/projected/96dcb19c-231c-4305-b4b2-9394f3aad647-kube-api-access-jz5bq\") pod \"payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz\" (UID: \"96dcb19c-231c-4305-b4b2-9394f3aad647\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:31:39.804807 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.804728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xklj9\" (UniqueName: \"kubernetes.io/projected/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-kube-api-access-xklj9\") pod \"payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z\" (UID: \"693f5bc2-2da4-4e1d-8462-a50dc8054e2d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:31:39.805349 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.805323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z\" (UID: \"693f5bc2-2da4-4e1d-8462-a50dc8054e2d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:31:39.815531 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.815494    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xklj9\" (UniqueName: \"kubernetes.io/projected/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-kube-api-access-xklj9\") pod \"payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z\" (UID: \"693f5bc2-2da4-4e1d-8462-a50dc8054e2d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:31:39.905813 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.905767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96dcb19c-231c-4305-b4b2-9394f3aad647-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz\" (UID: \"96dcb19c-231c-4305-b4b2-9394f3aad647\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:31:39.906041 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.905837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz5bq\" (UniqueName: \"kubernetes.io/projected/96dcb19c-231c-4305-b4b2-9394f3aad647-kube-api-access-jz5bq\") pod \"payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz\" (UID: \"96dcb19c-231c-4305-b4b2-9394f3aad647\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:31:39.906592 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.906569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96dcb19c-231c-4305-b4b2-9394f3aad647-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz\" (UID: \"96dcb19c-231c-4305-b4b2-9394f3aad647\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:31:39.916350 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.916321    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz5bq\" (UniqueName: \"kubernetes.io/projected/96dcb19c-231c-4305-b4b2-9394f3aad647-kube-api-access-jz5bq\") pod \"payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz\" (UID: \"96dcb19c-231c-4305-b4b2-9394f3aad647\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:31:39.938666 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:39.938630    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:31:40.005795 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.005728    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:31:40.086647 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.086519    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"]
Jul 24 15:31:40.089561 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:31:40.089535    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693f5bc2_2da4_4e1d_8462_a50dc8054e2d.slice/crio-760a92c9ae2b1f083b940962c421c97353c852c6d57274c0df8a163d8bdd4f67 WatchSource:0}: Error finding container 760a92c9ae2b1f083b940962c421c97353c852c6d57274c0df8a163d8bdd4f67: Status 404 returned error can't find the container with id 760a92c9ae2b1f083b940962c421c97353c852c6d57274c0df8a163d8bdd4f67
Jul 24 15:31:40.157156 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.157132    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"]
Jul 24 15:31:40.159261 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:31:40.159232    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96dcb19c_231c_4305_b4b2_9394f3aad647.slice/crio-66ef791cbfcd90e47a242fa451b998be27d5249473508b98a52b74cc102f7058 WatchSource:0}: Error finding container 66ef791cbfcd90e47a242fa451b998be27d5249473508b98a52b74cc102f7058: Status 404 returned error can't find the container with id 66ef791cbfcd90e47a242fa451b998be27d5249473508b98a52b74cc102f7058
Jul 24 15:31:40.440893 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.440785    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z" event={"ID":"693f5bc2-2da4-4e1d-8462-a50dc8054e2d","Type":"ContainerStarted","Data":"dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8"}
Jul 24 15:31:40.440893 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.440845    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z" event={"ID":"693f5bc2-2da4-4e1d-8462-a50dc8054e2d","Type":"ContainerStarted","Data":"760a92c9ae2b1f083b940962c421c97353c852c6d57274c0df8a163d8bdd4f67"}
Jul 24 15:31:40.440893 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.440877    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:31:40.442362 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.442332    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz" event={"ID":"96dcb19c-231c-4305-b4b2-9394f3aad647","Type":"ContainerStarted","Data":"99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368"}
Jul 24 15:31:40.442493 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.442386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz" event={"ID":"96dcb19c-231c-4305-b4b2-9394f3aad647","Type":"ContainerStarted","Data":"66ef791cbfcd90e47a242fa451b998be27d5249473508b98a52b74cc102f7058"}
Jul 24 15:31:40.442493 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.442427    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:31:40.459397 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.459347    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z" podStartSLOduration=1.45933095 podStartE2EDuration="1.45933095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:31:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:31:40.45833803 +0000 UTC m=+2128.997317444" watchObservedRunningTime="2026-07-24 15:31:40.45933095 +0000 UTC m=+2128.998310363"
Jul 24 15:31:40.481311 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:40.479138    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz" podStartSLOduration=1.479114227 podStartE2EDuration="1.479114227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:31:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:31:40.475665381 +0000 UTC m=+2129.014644821" watchObservedRunningTime="2026-07-24 15:31:40.479114227 +0000 UTC m=+2129.018093641"
Jul 24 15:31:47.693540 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.693504    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"]
Jul 24 15:31:47.696311 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.696283    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:31:47.699242 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.699217    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-dde49b-dockercfg-c2c6k\""
Jul 24 15:31:47.699242 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.699232    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-dde49b\""
Jul 24 15:31:47.707263 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.707237    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"]
Jul 24 15:31:47.755683 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.755639    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"]
Jul 24 15:31:47.758235 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.758207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:31:47.775843 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.769774    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"]
Jul 24 15:31:47.782507 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.782477    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct6dl\" (UniqueName: \"kubernetes.io/projected/8dd32fe0-3a37-44f6-acc1-092e55b7b102-kube-api-access-ct6dl\") pod \"payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6\" (UID: \"8dd32fe0-3a37-44f6-acc1-092e55b7b102\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:31:47.782507 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.782512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd32fe0-3a37-44f6-acc1-092e55b7b102-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6\" (UID: \"8dd32fe0-3a37-44f6-acc1-092e55b7b102\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:31:47.883597 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.883531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj6tb\" (UniqueName: \"kubernetes.io/projected/efd0a506-4c0e-4067-9759-66616b4bc291-kube-api-access-hj6tb\") pod \"payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7\" (UID: \"efd0a506-4c0e-4067-9759-66616b4bc291\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:31:47.883823 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.883621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efd0a506-4c0e-4067-9759-66616b4bc291-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7\" (UID: \"efd0a506-4c0e-4067-9759-66616b4bc291\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:31:47.883823 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.883701    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct6dl\" (UniqueName: \"kubernetes.io/projected/8dd32fe0-3a37-44f6-acc1-092e55b7b102-kube-api-access-ct6dl\") pod \"payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6\" (UID: \"8dd32fe0-3a37-44f6-acc1-092e55b7b102\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:31:47.883823 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.883737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd32fe0-3a37-44f6-acc1-092e55b7b102-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6\" (UID: \"8dd32fe0-3a37-44f6-acc1-092e55b7b102\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:31:47.884497 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.884471    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd32fe0-3a37-44f6-acc1-092e55b7b102-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6\" (UID: \"8dd32fe0-3a37-44f6-acc1-092e55b7b102\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:31:47.892661 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.892631    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct6dl\" (UniqueName: \"kubernetes.io/projected/8dd32fe0-3a37-44f6-acc1-092e55b7b102-kube-api-access-ct6dl\") pod \"payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6\" (UID: \"8dd32fe0-3a37-44f6-acc1-092e55b7b102\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:31:47.985069 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.984932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj6tb\" (UniqueName: \"kubernetes.io/projected/efd0a506-4c0e-4067-9759-66616b4bc291-kube-api-access-hj6tb\") pod \"payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7\" (UID: \"efd0a506-4c0e-4067-9759-66616b4bc291\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:31:47.985069 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.985033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efd0a506-4c0e-4067-9759-66616b4bc291-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7\" (UID: \"efd0a506-4c0e-4067-9759-66616b4bc291\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:31:47.985746 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.985723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efd0a506-4c0e-4067-9759-66616b4bc291-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7\" (UID: \"efd0a506-4c0e-4067-9759-66616b4bc291\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:31:47.994555 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:47.994525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj6tb\" (UniqueName: \"kubernetes.io/projected/efd0a506-4c0e-4067-9759-66616b4bc291-kube-api-access-hj6tb\") pod \"payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7\" (UID: \"efd0a506-4c0e-4067-9759-66616b4bc291\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:31:48.009268 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.009220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:31:48.069524 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.069467    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:31:48.166816 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.166790    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"]
Jul 24 15:31:48.168735 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:31:48.168706    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd32fe0_3a37_44f6_acc1_092e55b7b102.slice/crio-1523a3a3a203de27acd42045f73e0b1ecc4e4065eeecb5e97bba4d54dc5f0055 WatchSource:0}: Error finding container 1523a3a3a203de27acd42045f73e0b1ecc4e4065eeecb5e97bba4d54dc5f0055: Status 404 returned error can't find the container with id 1523a3a3a203de27acd42045f73e0b1ecc4e4065eeecb5e97bba4d54dc5f0055
Jul 24 15:31:48.232233 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.232140    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"]
Jul 24 15:31:48.234423 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:31:48.234398    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd0a506_4c0e_4067_9759_66616b4bc291.slice/crio-e7a12a451b13aa07d75c2fd688698b8582ea61de152a6524268d55c0e402a466 WatchSource:0}: Error finding container e7a12a451b13aa07d75c2fd688698b8582ea61de152a6524268d55c0e402a466: Status 404 returned error can't find the container with id e7a12a451b13aa07d75c2fd688698b8582ea61de152a6524268d55c0e402a466
Jul 24 15:31:48.479371 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.479330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7" event={"ID":"efd0a506-4c0e-4067-9759-66616b4bc291","Type":"ContainerStarted","Data":"4f0fe71048a2db9bdbec3eb2457aa20a65e4ac3125c1a35bf78eb527753fb6bf"}
Jul 24 15:31:48.479601 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.479386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7" event={"ID":"efd0a506-4c0e-4067-9759-66616b4bc291","Type":"ContainerStarted","Data":"e7a12a451b13aa07d75c2fd688698b8582ea61de152a6524268d55c0e402a466"}
Jul 24 15:31:48.479601 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.479409    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:31:48.480958 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.480927    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6" event={"ID":"8dd32fe0-3a37-44f6-acc1-092e55b7b102","Type":"ContainerStarted","Data":"26b7eef89e80c177399e93a3336941c36c9d10d5d44cf39fd8ec7805f47bd7da"}
Jul 24 15:31:48.481112 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.480970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6" event={"ID":"8dd32fe0-3a37-44f6-acc1-092e55b7b102","Type":"ContainerStarted","Data":"1523a3a3a203de27acd42045f73e0b1ecc4e4065eeecb5e97bba4d54dc5f0055"}
Jul 24 15:31:48.481112 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.481062    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:31:48.496630 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.496516    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7" podStartSLOduration=1.496498934 podStartE2EDuration="1.496498934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:31:48.494803147 +0000 UTC m=+2137.033782579" watchObservedRunningTime="2026-07-24 15:31:48.496498934 +0000 UTC m=+2137.035478346"
Jul 24 15:31:48.512891 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:48.512821    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6" podStartSLOduration=1.512799445 podStartE2EDuration="1.512799445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:31:48.510185408 +0000 UTC m=+2137.049164847" watchObservedRunningTime="2026-07-24 15:31:48.512799445 +0000 UTC m=+2137.051778859"
Jul 24 15:31:51.448803 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:51.448744    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz" podUID="96dcb19c-231c-4305-b4b2-9394f3aad647" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.48:9004: connect: connection refused"
Jul 24 15:31:51.449225 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:51.449094    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:31:58.348954 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.348920    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"]
Jul 24 15:31:58.351743 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.351725    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.355252 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.355232    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-92cb39\"/\"kube-root-ca.crt\""
Jul 24 15:31:58.356199 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.356178    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-92cb39\"/\"openshift-service-ca.crt\""
Jul 24 15:31:58.356317 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.356232    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-92cb39\"/\"default-dockercfg-dbmhm\""
Jul 24 15:31:58.356385 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.356343    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-92cb39\"/\"test-model-92cb39-kserve-self-signed-certs\""
Jul 24 15:31:58.363330 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.363304    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"]
Jul 24 15:31:58.481740 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.481702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-home\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.481967 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.481770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-tmp-dir\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.481967 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.481795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k99z\" (UniqueName: \"kubernetes.io/projected/246abecd-d95e-4b42-b716-c2d012ab00f3-kube-api-access-6k99z\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.481967 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.481835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-model-cache\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.481967 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.481883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-dshm\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.481967 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.481915    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246abecd-d95e-4b42-b716-c2d012ab00f3-tls-certs\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.583007 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.582946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-home\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.583193 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.583033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-tmp-dir\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.583193 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.583055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k99z\" (UniqueName: \"kubernetes.io/projected/246abecd-d95e-4b42-b716-c2d012ab00f3-kube-api-access-6k99z\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.583193 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.583090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-model-cache\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.583193 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.583112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-dshm\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.583193 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.583137    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246abecd-d95e-4b42-b716-c2d012ab00f3-tls-certs\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.583550 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.583455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-home\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.583550 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.583504    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-tmp-dir\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.583550 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.583515    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-model-cache\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.585622 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.585603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-dshm\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.585897 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.585878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246abecd-d95e-4b42-b716-c2d012ab00f3-tls-certs\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.593102 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.593076    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k99z\" (UniqueName: \"kubernetes.io/projected/246abecd-d95e-4b42-b716-c2d012ab00f3-kube-api-access-6k99z\") pod \"test-model-92cb39-kserve-d496df4c7-s8tc7\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") " pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.661672 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.661636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:31:58.805831 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:58.805804    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"]
Jul 24 15:31:58.808169 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:31:58.808141    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod246abecd_d95e_4b42_b716_c2d012ab00f3.slice/crio-6d58f95e413aa54573e46aee5ff906e3a714577525dfa767b7f722e4b34d93ea WatchSource:0}: Error finding container 6d58f95e413aa54573e46aee5ff906e3a714577525dfa767b7f722e4b34d93ea: Status 404 returned error can't find the container with id 6d58f95e413aa54573e46aee5ff906e3a714577525dfa767b7f722e4b34d93ea
Jul 24 15:31:59.487549 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:59.487506    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7" podUID="efd0a506-4c0e-4067-9759-66616b4bc291" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.50:9004: connect: connection refused"
Jul 24 15:31:59.488077 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:59.487904    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:31:59.539141 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:59.539096    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7" event={"ID":"246abecd-d95e-4b42-b716-c2d012ab00f3","Type":"ContainerStarted","Data":"a0d2d5cac2203c15f0b1031d8b3e6e3429fa1694ec7e678a18ebba33cf6bc86b"}
Jul 24 15:31:59.539318 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:59.539153    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7" event={"ID":"246abecd-d95e-4b42-b716-c2d012ab00f3","Type":"ContainerStarted","Data":"6d58f95e413aa54573e46aee5ff906e3a714577525dfa767b7f722e4b34d93ea"}
Jul 24 15:31:59.560453 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:31:59.560404    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7" podStartSLOduration=1.560382172 podStartE2EDuration="1.560382172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:31:59.558796129 +0000 UTC m=+2148.097775570" watchObservedRunningTime="2026-07-24 15:31:59.560382172 +0000 UTC m=+2148.099361605"
Jul 24 15:32:01.447837 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:01.447795    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:32:08.662152 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:08.662055    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:32:08.662152 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:08.662121    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:32:08.674702 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:08.674675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:32:09.487151 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:09.487122    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:32:09.599745 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:09.599714    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:32:24.626229 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.626189    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"]
Jul 24 15:32:24.629530 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.629508    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.633417 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.633390    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dde49b\"/\"openshift-service-ca.crt\""
Jul 24 15:32:24.633417 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.633414    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dde49b\"/\"kube-root-ca.crt\""
Jul 24 15:32:24.633617 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.633398    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dde49b\"/\"test-model-dde49b-kserve-self-signed-certs\""
Jul 24 15:32:24.633617 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.633397    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dde49b\"/\"default-dockercfg-t77mf\""
Jul 24 15:32:24.640043 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.640021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"]
Jul 24 15:32:24.721467 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.721423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-home\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.721634 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.721479    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9130e934-93dd-4396-ba4c-6ddd1db94172-tls-certs\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.721634 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.721534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-tmp-dir\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.721634 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.721568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-model-cache\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.721798 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.721632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-dshm\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.721798 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.721682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2pxr\" (UniqueName: \"kubernetes.io/projected/9130e934-93dd-4396-ba4c-6ddd1db94172-kube-api-access-h2pxr\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.823197 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.823163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-dshm\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.823403 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.823214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2pxr\" (UniqueName: \"kubernetes.io/projected/9130e934-93dd-4396-ba4c-6ddd1db94172-kube-api-access-h2pxr\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.823403 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.823261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-home\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.823403 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.823287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9130e934-93dd-4396-ba4c-6ddd1db94172-tls-certs\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.823403 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.823304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-tmp-dir\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.823403 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.823329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-model-cache\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.823703 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.823678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-home\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.823703 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.823693    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-tmp-dir\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.823819 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.823737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-model-cache\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.825744 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.825712    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-dshm\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.825925 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.825903    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9130e934-93dd-4396-ba4c-6ddd1db94172-tls-certs\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.832415 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.832393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2pxr\" (UniqueName: \"kubernetes.io/projected/9130e934-93dd-4396-ba4c-6ddd1db94172-kube-api-access-h2pxr\") pod \"test-model-dde49b-kserve-597c75d9d9-grprq\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") " pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:24.939134 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:24.939095    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:25.081058 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:25.081026    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"]
Jul 24 15:32:25.083312 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:32:25.083288    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9130e934_93dd_4396_ba4c_6ddd1db94172.slice/crio-c01dd713caac47a79ef707cb6cbcdec26f7b39f1814275366f5ac58c4a3b0b64 WatchSource:0}: Error finding container c01dd713caac47a79ef707cb6cbcdec26f7b39f1814275366f5ac58c4a3b0b64: Status 404 returned error can't find the container with id c01dd713caac47a79ef707cb6cbcdec26f7b39f1814275366f5ac58c4a3b0b64
Jul 24 15:32:25.660439 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:25.660397    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq" event={"ID":"9130e934-93dd-4396-ba4c-6ddd1db94172","Type":"ContainerStarted","Data":"1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98"}
Jul 24 15:32:25.660439 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:25.660444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq" event={"ID":"9130e934-93dd-4396-ba4c-6ddd1db94172","Type":"ContainerStarted","Data":"c01dd713caac47a79ef707cb6cbcdec26f7b39f1814275366f5ac58c4a3b0b64"}
Jul 24 15:32:25.679927 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:25.679869    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq" podStartSLOduration=1.679850134 podStartE2EDuration="1.679850134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:32:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:32:25.678404338 +0000 UTC m=+2174.217383751" watchObservedRunningTime="2026-07-24 15:32:25.679850134 +0000 UTC m=+2174.218829589"
Jul 24 15:32:34.939357 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:34.939316    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:34.939357 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:34.939371    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:34.952254 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:34.952227    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:32:35.719369 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:32:35.719343    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:33:06.750116 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:06.750078    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"]
Jul 24 15:33:07.652395 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:07.652342    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"]
Jul 24 15:33:18.458946 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.458908    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"]
Jul 24 15:33:18.459468 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.459133    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z" podUID="693f5bc2-2da4-4e1d-8462-a50dc8054e2d" containerName="payload-processing" containerID="cri-o://dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8" gracePeriod=30
Jul 24 15:33:18.470909 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.470862    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"]
Jul 24 15:33:18.471753 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.471718    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz" podUID="96dcb19c-231c-4305-b4b2-9394f3aad647" containerName="payload-pre-processing" containerID="cri-o://99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368" gracePeriod=30
Jul 24 15:33:18.722348 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.722282    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:33:18.749624 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.749592    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:33:18.841930 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.841893    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-plugins-config-volume\") pod \"693f5bc2-2da4-4e1d-8462-a50dc8054e2d\" (UID: \"693f5bc2-2da4-4e1d-8462-a50dc8054e2d\") "
Jul 24 15:33:18.842139 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.841955    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96dcb19c-231c-4305-b4b2-9394f3aad647-plugins-config-volume\") pod \"96dcb19c-231c-4305-b4b2-9394f3aad647\" (UID: \"96dcb19c-231c-4305-b4b2-9394f3aad647\") "
Jul 24 15:33:18.842139 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.842025    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz5bq\" (UniqueName: \"kubernetes.io/projected/96dcb19c-231c-4305-b4b2-9394f3aad647-kube-api-access-jz5bq\") pod \"96dcb19c-231c-4305-b4b2-9394f3aad647\" (UID: \"96dcb19c-231c-4305-b4b2-9394f3aad647\") "
Jul 24 15:33:18.842139 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.842056    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xklj9\" (UniqueName: \"kubernetes.io/projected/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-kube-api-access-xklj9\") pod \"693f5bc2-2da4-4e1d-8462-a50dc8054e2d\" (UID: \"693f5bc2-2da4-4e1d-8462-a50dc8054e2d\") "
Jul 24 15:33:18.842452 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.842414    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "693f5bc2-2da4-4e1d-8462-a50dc8054e2d" (UID: "693f5bc2-2da4-4e1d-8462-a50dc8054e2d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:33:18.842452 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.842414    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96dcb19c-231c-4305-b4b2-9394f3aad647-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96dcb19c-231c-4305-b4b2-9394f3aad647" (UID: "96dcb19c-231c-4305-b4b2-9394f3aad647"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:33:18.844384 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.844357    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96dcb19c-231c-4305-b4b2-9394f3aad647-kube-api-access-jz5bq" (OuterVolumeSpecName: "kube-api-access-jz5bq") pod "96dcb19c-231c-4305-b4b2-9394f3aad647" (UID: "96dcb19c-231c-4305-b4b2-9394f3aad647"). InnerVolumeSpecName "kube-api-access-jz5bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:33:18.844480 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.844383    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-kube-api-access-xklj9" (OuterVolumeSpecName: "kube-api-access-xklj9") pod "693f5bc2-2da4-4e1d-8462-a50dc8054e2d" (UID: "693f5bc2-2da4-4e1d-8462-a50dc8054e2d"). InnerVolumeSpecName "kube-api-access-xklj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:33:18.907901 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.907868    2582 generic.go:356] "Generic (PLEG): container finished" podID="693f5bc2-2da4-4e1d-8462-a50dc8054e2d" containerID="dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8" exitCode=0
Jul 24 15:33:18.908148 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.907925    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"
Jul 24 15:33:18.908148 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.907952    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z" event={"ID":"693f5bc2-2da4-4e1d-8462-a50dc8054e2d","Type":"ContainerDied","Data":"dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8"}
Jul 24 15:33:18.908148 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.908033    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z" event={"ID":"693f5bc2-2da4-4e1d-8462-a50dc8054e2d","Type":"ContainerDied","Data":"760a92c9ae2b1f083b940962c421c97353c852c6d57274c0df8a163d8bdd4f67"}
Jul 24 15:33:18.908148 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.908052    2582 scope.go:117] "RemoveContainer" containerID="dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8"
Jul 24 15:33:18.909483 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.909455    2582 generic.go:356] "Generic (PLEG): container finished" podID="96dcb19c-231c-4305-b4b2-9394f3aad647" containerID="99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368" exitCode=0
Jul 24 15:33:18.909619 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.909492    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"
Jul 24 15:33:18.909619 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.909545    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz" event={"ID":"96dcb19c-231c-4305-b4b2-9394f3aad647","Type":"ContainerDied","Data":"99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368"}
Jul 24 15:33:18.909619 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.909590    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz" event={"ID":"96dcb19c-231c-4305-b4b2-9394f3aad647","Type":"ContainerDied","Data":"66ef791cbfcd90e47a242fa451b998be27d5249473508b98a52b74cc102f7058"}
Jul 24 15:33:18.917926 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.917906    2582 scope.go:117] "RemoveContainer" containerID="dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8"
Jul 24 15:33:18.918267 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:33:18.918243    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8\": container with ID starting with dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8 not found: ID does not exist" containerID="dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8"
Jul 24 15:33:18.918359 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.918275    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8"} err="failed to get container status \"dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8\": rpc error: code = NotFound desc = could not find container \"dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8\": container with ID starting with dd3610c4fbbac27f48e94f74c22c96c7baf20c5171f7e11a48ea80c1e5b91ad8 not found: ID does not exist"
Jul 24 15:33:18.918359 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.918292    2582 scope.go:117] "RemoveContainer" containerID="99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368"
Jul 24 15:33:18.928930 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.928912    2582 scope.go:117] "RemoveContainer" containerID="99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368"
Jul 24 15:33:18.929247 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:33:18.929226    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368\": container with ID starting with 99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368 not found: ID does not exist" containerID="99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368"
Jul 24 15:33:18.929330 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.929255    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368"} err="failed to get container status \"99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368\": rpc error: code = NotFound desc = could not find container \"99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368\": container with ID starting with 99168a7ffbe164e84b4e24245d42e1cc5a89c563c9a0f768c4f7ae3d0887f368 not found: ID does not exist"
Jul 24 15:33:18.933729 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.933705    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"]
Jul 24 15:33:18.938967 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.938941    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-92cb39-dc4985658-qll2z"]
Jul 24 15:33:18.943569 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.943534    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:18.943677 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.943574    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96dcb19c-231c-4305-b4b2-9394f3aad647-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:18.943677 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.943586    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz5bq\" (UniqueName: \"kubernetes.io/projected/96dcb19c-231c-4305-b4b2-9394f3aad647-kube-api-access-jz5bq\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:18.943677 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.943594    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xklj9\" (UniqueName: \"kubernetes.io/projected/693f5bc2-2da4-4e1d-8462-a50dc8054e2d-kube-api-access-xklj9\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:18.951141 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.951112    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"]
Jul 24 15:33:18.955304 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:18.955274    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-92cb39-5855cd4f7b-9rrtz"]
Jul 24 15:33:20.001719 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:20.001680    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="693f5bc2-2da4-4e1d-8462-a50dc8054e2d" path="/var/lib/kubelet/pods/693f5bc2-2da4-4e1d-8462-a50dc8054e2d/volumes"
Jul 24 15:33:20.002145 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:20.002050    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96dcb19c-231c-4305-b4b2-9394f3aad647" path="/var/lib/kubelet/pods/96dcb19c-231c-4305-b4b2-9394f3aad647/volumes"
Jul 24 15:33:21.770260 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:21.770198    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7" podUID="246abecd-d95e-4b42-b716-c2d012ab00f3" containerName="main" containerID="cri-o://a0d2d5cac2203c15f0b1031d8b3e6e3429fa1694ec7e678a18ebba33cf6bc86b" gracePeriod=45
Jul 24 15:33:21.928261 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:21.928227    2582 generic.go:356] "Generic (PLEG): container finished" podID="246abecd-d95e-4b42-b716-c2d012ab00f3" containerID="a0d2d5cac2203c15f0b1031d8b3e6e3429fa1694ec7e678a18ebba33cf6bc86b" exitCode=0
Jul 24 15:33:21.928443 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:21.928283    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7" event={"ID":"246abecd-d95e-4b42-b716-c2d012ab00f3","Type":"ContainerDied","Data":"a0d2d5cac2203c15f0b1031d8b3e6e3429fa1694ec7e678a18ebba33cf6bc86b"}
Jul 24 15:33:22.027199 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.027135    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:33:22.173238 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173203    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k99z\" (UniqueName: \"kubernetes.io/projected/246abecd-d95e-4b42-b716-c2d012ab00f3-kube-api-access-6k99z\") pod \"246abecd-d95e-4b42-b716-c2d012ab00f3\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") "
Jul 24 15:33:22.173422 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173276    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-model-cache\") pod \"246abecd-d95e-4b42-b716-c2d012ab00f3\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") "
Jul 24 15:33:22.173422 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173304    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-dshm\") pod \"246abecd-d95e-4b42-b716-c2d012ab00f3\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") "
Jul 24 15:33:22.173422 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173331    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246abecd-d95e-4b42-b716-c2d012ab00f3-tls-certs\") pod \"246abecd-d95e-4b42-b716-c2d012ab00f3\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") "
Jul 24 15:33:22.173422 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173373    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-home\") pod \"246abecd-d95e-4b42-b716-c2d012ab00f3\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") "
Jul 24 15:33:22.173422 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173414    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-tmp-dir\") pod \"246abecd-d95e-4b42-b716-c2d012ab00f3\" (UID: \"246abecd-d95e-4b42-b716-c2d012ab00f3\") "
Jul 24 15:33:22.173700 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173571    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "246abecd-d95e-4b42-b716-c2d012ab00f3" (UID: "246abecd-d95e-4b42-b716-c2d012ab00f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:33:22.173758 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173711    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-home" (OuterVolumeSpecName: "home") pod "246abecd-d95e-4b42-b716-c2d012ab00f3" (UID: "246abecd-d95e-4b42-b716-c2d012ab00f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:33:22.173758 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173737    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "246abecd-d95e-4b42-b716-c2d012ab00f3" (UID: "246abecd-d95e-4b42-b716-c2d012ab00f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:33:22.173866 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173846    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:22.173929 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173872    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:22.173929 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.173910    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:22.175769 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.175746    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-dshm" (OuterVolumeSpecName: "dshm") pod "246abecd-d95e-4b42-b716-c2d012ab00f3" (UID: "246abecd-d95e-4b42-b716-c2d012ab00f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:33:22.176103 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.176084    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/246abecd-d95e-4b42-b716-c2d012ab00f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "246abecd-d95e-4b42-b716-c2d012ab00f3" (UID: "246abecd-d95e-4b42-b716-c2d012ab00f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:33:22.176162 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.176128    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/246abecd-d95e-4b42-b716-c2d012ab00f3-kube-api-access-6k99z" (OuterVolumeSpecName: "kube-api-access-6k99z") pod "246abecd-d95e-4b42-b716-c2d012ab00f3" (UID: "246abecd-d95e-4b42-b716-c2d012ab00f3"). InnerVolumeSpecName "kube-api-access-6k99z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:33:22.274710 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.274674    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246abecd-d95e-4b42-b716-c2d012ab00f3-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:22.274710 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.274707    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246abecd-d95e-4b42-b716-c2d012ab00f3-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:22.274948 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.274719    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k99z\" (UniqueName: \"kubernetes.io/projected/246abecd-d95e-4b42-b716-c2d012ab00f3-kube-api-access-6k99z\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:22.672209 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.672164    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq" podUID="9130e934-93dd-4396-ba4c-6ddd1db94172" containerName="main" containerID="cri-o://1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98" gracePeriod=45
Jul 24 15:33:22.931451 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.931379    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:33:22.933219 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.933198    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"
Jul 24 15:33:22.933363 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.933235    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7" event={"ID":"246abecd-d95e-4b42-b716-c2d012ab00f3","Type":"ContainerDied","Data":"6d58f95e413aa54573e46aee5ff906e3a714577525dfa767b7f722e4b34d93ea"}
Jul 24 15:33:22.933363 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.933302    2582 scope.go:117] "RemoveContainer" containerID="a0d2d5cac2203c15f0b1031d8b3e6e3429fa1694ec7e678a18ebba33cf6bc86b"
Jul 24 15:33:22.934544 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.934524    2582 generic.go:356] "Generic (PLEG): container finished" podID="9130e934-93dd-4396-ba4c-6ddd1db94172" containerID="1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98" exitCode=0
Jul 24 15:33:22.934626 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.934554    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq" event={"ID":"9130e934-93dd-4396-ba4c-6ddd1db94172","Type":"ContainerDied","Data":"1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98"}
Jul 24 15:33:22.934626 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.934560    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"
Jul 24 15:33:22.934626 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.934580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq" event={"ID":"9130e934-93dd-4396-ba4c-6ddd1db94172","Type":"ContainerDied","Data":"c01dd713caac47a79ef707cb6cbcdec26f7b39f1814275366f5ac58c4a3b0b64"}
Jul 24 15:33:22.942718 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.942700    2582 scope.go:117] "RemoveContainer" containerID="1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98"
Jul 24 15:33:22.952821 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.952797    2582 scope.go:117] "RemoveContainer" containerID="1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98"
Jul 24 15:33:22.953199 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:33:22.953179    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98\": container with ID starting with 1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98 not found: ID does not exist" containerID="1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98"
Jul 24 15:33:22.953297 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.953211    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98"} err="failed to get container status \"1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98\": rpc error: code = NotFound desc = could not find container \"1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98\": container with ID starting with 1862dd3724559b007c8081b765439009295dbf4c1ec8e3672f72535a94253a98 not found: ID does not exist"
Jul 24 15:33:22.968967 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.968923    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"]
Jul 24 15:33:22.971512 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:22.971480    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-92cb39/test-model-92cb39-kserve-d496df4c7-s8tc7"]
Jul 24 15:33:23.082908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.082862    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-home\") pod \"9130e934-93dd-4396-ba4c-6ddd1db94172\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") "
Jul 24 15:33:23.082908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.082909    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-tmp-dir\") pod \"9130e934-93dd-4396-ba4c-6ddd1db94172\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") "
Jul 24 15:33:23.082908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.082927    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-model-cache\") pod \"9130e934-93dd-4396-ba4c-6ddd1db94172\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") "
Jul 24 15:33:23.083253 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.082958    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-dshm\") pod \"9130e934-93dd-4396-ba4c-6ddd1db94172\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") "
Jul 24 15:33:23.083253 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.083035    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9130e934-93dd-4396-ba4c-6ddd1db94172-tls-certs\") pod \"9130e934-93dd-4396-ba4c-6ddd1db94172\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") "
Jul 24 15:33:23.083253 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.083092    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2pxr\" (UniqueName: \"kubernetes.io/projected/9130e934-93dd-4396-ba4c-6ddd1db94172-kube-api-access-h2pxr\") pod \"9130e934-93dd-4396-ba4c-6ddd1db94172\" (UID: \"9130e934-93dd-4396-ba4c-6ddd1db94172\") "
Jul 24 15:33:23.083253 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.083231    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-model-cache" (OuterVolumeSpecName: "model-cache") pod "9130e934-93dd-4396-ba4c-6ddd1db94172" (UID: "9130e934-93dd-4396-ba4c-6ddd1db94172"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:33:23.083253 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.083247    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-home" (OuterVolumeSpecName: "home") pod "9130e934-93dd-4396-ba4c-6ddd1db94172" (UID: "9130e934-93dd-4396-ba4c-6ddd1db94172"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:33:23.083486 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.083263    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9130e934-93dd-4396-ba4c-6ddd1db94172" (UID: "9130e934-93dd-4396-ba4c-6ddd1db94172"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:33:23.083546 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.083487    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:23.083546 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.083508    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:23.083546 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.083521    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:23.085507 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.085483    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9130e934-93dd-4396-ba4c-6ddd1db94172-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9130e934-93dd-4396-ba4c-6ddd1db94172" (UID: "9130e934-93dd-4396-ba4c-6ddd1db94172"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:33:23.085976 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.085953    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-dshm" (OuterVolumeSpecName: "dshm") pod "9130e934-93dd-4396-ba4c-6ddd1db94172" (UID: "9130e934-93dd-4396-ba4c-6ddd1db94172"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:33:23.086090 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.085956    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9130e934-93dd-4396-ba4c-6ddd1db94172-kube-api-access-h2pxr" (OuterVolumeSpecName: "kube-api-access-h2pxr") pod "9130e934-93dd-4396-ba4c-6ddd1db94172" (UID: "9130e934-93dd-4396-ba4c-6ddd1db94172"). InnerVolumeSpecName "kube-api-access-h2pxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:33:23.184603 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.184512    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9130e934-93dd-4396-ba4c-6ddd1db94172-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:23.184603 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.184547    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9130e934-93dd-4396-ba4c-6ddd1db94172-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:23.184603 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.184559    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2pxr\" (UniqueName: \"kubernetes.io/projected/9130e934-93dd-4396-ba4c-6ddd1db94172-kube-api-access-h2pxr\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:23.260937 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.260900    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"]
Jul 24 15:33:23.268458 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.268425    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-dde49b/test-model-dde49b-kserve-597c75d9d9-grprq"]
Jul 24 15:33:23.996015 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.995964    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="246abecd-d95e-4b42-b716-c2d012ab00f3" path="/var/lib/kubelet/pods/246abecd-d95e-4b42-b716-c2d012ab00f3/volumes"
Jul 24 15:33:23.996555 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:23.996532    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9130e934-93dd-4396-ba4c-6ddd1db94172" path="/var/lib/kubelet/pods/9130e934-93dd-4396-ba4c-6ddd1db94172/volumes"
Jul 24 15:33:40.785430 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:40.785392    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"]
Jul 24 15:33:40.786071 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:40.785627    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6" podUID="8dd32fe0-3a37-44f6-acc1-092e55b7b102" containerName="payload-processing" containerID="cri-o://26b7eef89e80c177399e93a3336941c36c9d10d5d44cf39fd8ec7805f47bd7da" gracePeriod=30
Jul 24 15:33:40.798010 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:40.797942    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"]
Jul 24 15:33:40.798816 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:40.798780    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7" podUID="efd0a506-4c0e-4067-9759-66616b4bc291" containerName="payload-pre-processing" containerID="cri-o://4f0fe71048a2db9bdbec3eb2457aa20a65e4ac3125c1a35bf78eb527753fb6bf" gracePeriod=30
Jul 24 15:33:41.023221 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.023182    2582 generic.go:356] "Generic (PLEG): container finished" podID="efd0a506-4c0e-4067-9759-66616b4bc291" containerID="4f0fe71048a2db9bdbec3eb2457aa20a65e4ac3125c1a35bf78eb527753fb6bf" exitCode=0
Jul 24 15:33:41.023455 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.023274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7" event={"ID":"efd0a506-4c0e-4067-9759-66616b4bc291","Type":"ContainerDied","Data":"4f0fe71048a2db9bdbec3eb2457aa20a65e4ac3125c1a35bf78eb527753fb6bf"}
Jul 24 15:33:41.025531 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.025387    2582 generic.go:356] "Generic (PLEG): container finished" podID="8dd32fe0-3a37-44f6-acc1-092e55b7b102" containerID="26b7eef89e80c177399e93a3336941c36c9d10d5d44cf39fd8ec7805f47bd7da" exitCode=0
Jul 24 15:33:41.025531 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.025455    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6" event={"ID":"8dd32fe0-3a37-44f6-acc1-092e55b7b102","Type":"ContainerDied","Data":"26b7eef89e80c177399e93a3336941c36c9d10d5d44cf39fd8ec7805f47bd7da"}
Jul 24 15:33:41.093615 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.093316    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:33:41.098415 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.098369    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:33:41.140302 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.140267    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj6tb\" (UniqueName: \"kubernetes.io/projected/efd0a506-4c0e-4067-9759-66616b4bc291-kube-api-access-hj6tb\") pod \"efd0a506-4c0e-4067-9759-66616b4bc291\" (UID: \"efd0a506-4c0e-4067-9759-66616b4bc291\") "
Jul 24 15:33:41.140302 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.140304    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct6dl\" (UniqueName: \"kubernetes.io/projected/8dd32fe0-3a37-44f6-acc1-092e55b7b102-kube-api-access-ct6dl\") pod \"8dd32fe0-3a37-44f6-acc1-092e55b7b102\" (UID: \"8dd32fe0-3a37-44f6-acc1-092e55b7b102\") "
Jul 24 15:33:41.140518 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.140327    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efd0a506-4c0e-4067-9759-66616b4bc291-plugins-config-volume\") pod \"efd0a506-4c0e-4067-9759-66616b4bc291\" (UID: \"efd0a506-4c0e-4067-9759-66616b4bc291\") "
Jul 24 15:33:41.140518 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.140453    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd32fe0-3a37-44f6-acc1-092e55b7b102-plugins-config-volume\") pod \"8dd32fe0-3a37-44f6-acc1-092e55b7b102\" (UID: \"8dd32fe0-3a37-44f6-acc1-092e55b7b102\") "
Jul 24 15:33:41.140920 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.140856    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dd32fe0-3a37-44f6-acc1-092e55b7b102-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8dd32fe0-3a37-44f6-acc1-092e55b7b102" (UID: "8dd32fe0-3a37-44f6-acc1-092e55b7b102"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:33:41.141220 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.141006    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efd0a506-4c0e-4067-9759-66616b4bc291-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "efd0a506-4c0e-4067-9759-66616b4bc291" (UID: "efd0a506-4c0e-4067-9759-66616b4bc291"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:33:41.142741 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.142715    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dd32fe0-3a37-44f6-acc1-092e55b7b102-kube-api-access-ct6dl" (OuterVolumeSpecName: "kube-api-access-ct6dl") pod "8dd32fe0-3a37-44f6-acc1-092e55b7b102" (UID: "8dd32fe0-3a37-44f6-acc1-092e55b7b102"). InnerVolumeSpecName "kube-api-access-ct6dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:33:41.143037 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.143014    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efd0a506-4c0e-4067-9759-66616b4bc291-kube-api-access-hj6tb" (OuterVolumeSpecName: "kube-api-access-hj6tb") pod "efd0a506-4c0e-4067-9759-66616b4bc291" (UID: "efd0a506-4c0e-4067-9759-66616b4bc291"). InnerVolumeSpecName "kube-api-access-hj6tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:33:41.242169 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.242111    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj6tb\" (UniqueName: \"kubernetes.io/projected/efd0a506-4c0e-4067-9759-66616b4bc291-kube-api-access-hj6tb\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:41.242169 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.242161    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct6dl\" (UniqueName: \"kubernetes.io/projected/8dd32fe0-3a37-44f6-acc1-092e55b7b102-kube-api-access-ct6dl\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:41.242169 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.242171    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efd0a506-4c0e-4067-9759-66616b4bc291-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:41.242169 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:41.242179    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd32fe0-3a37-44f6-acc1-092e55b7b102-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:33:42.031608 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:42.031570    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"
Jul 24 15:33:42.032135 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:42.031567    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7" event={"ID":"efd0a506-4c0e-4067-9759-66616b4bc291","Type":"ContainerDied","Data":"e7a12a451b13aa07d75c2fd688698b8582ea61de152a6524268d55c0e402a466"}
Jul 24 15:33:42.032135 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:42.031709    2582 scope.go:117] "RemoveContainer" containerID="4f0fe71048a2db9bdbec3eb2457aa20a65e4ac3125c1a35bf78eb527753fb6bf"
Jul 24 15:33:42.033021 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:42.032942    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"
Jul 24 15:33:42.033021 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:42.032950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6" event={"ID":"8dd32fe0-3a37-44f6-acc1-092e55b7b102","Type":"ContainerDied","Data":"1523a3a3a203de27acd42045f73e0b1ecc4e4065eeecb5e97bba4d54dc5f0055"}
Jul 24 15:33:42.042623 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:42.042598    2582 scope.go:117] "RemoveContainer" containerID="26b7eef89e80c177399e93a3336941c36c9d10d5d44cf39fd8ec7805f47bd7da"
Jul 24 15:33:42.049265 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:42.049237    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"]
Jul 24 15:33:42.053053 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:42.053026    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dde49b-7967d85bd4-8whp6"]
Jul 24 15:33:42.069886 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:42.069848    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"]
Jul 24 15:33:42.073767 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:42.073741    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dde49b-cb7fc7fdd-4rnv7"]
Jul 24 15:33:43.996011 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:43.995960    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dd32fe0-3a37-44f6-acc1-092e55b7b102" path="/var/lib/kubelet/pods/8dd32fe0-3a37-44f6-acc1-092e55b7b102/volumes"
Jul 24 15:33:43.996520 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:43.996332    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efd0a506-4c0e-4067-9759-66616b4bc291" path="/var/lib/kubelet/pods/efd0a506-4c0e-4067-9759-66616b4bc291/volumes"
Jul 24 15:33:56.270464 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270427    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"]
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270772    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efd0a506-4c0e-4067-9759-66616b4bc291" containerName="payload-pre-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270783    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efd0a506-4c0e-4067-9759-66616b4bc291" containerName="payload-pre-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270796    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="246abecd-d95e-4b42-b716-c2d012ab00f3" containerName="main"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270807    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="246abecd-d95e-4b42-b716-c2d012ab00f3" containerName="main"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270820    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693f5bc2-2da4-4e1d-8462-a50dc8054e2d" containerName="payload-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270825    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="693f5bc2-2da4-4e1d-8462-a50dc8054e2d" containerName="payload-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270834    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9130e934-93dd-4396-ba4c-6ddd1db94172" containerName="main"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270839    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9130e934-93dd-4396-ba4c-6ddd1db94172" containerName="main"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270856    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96dcb19c-231c-4305-b4b2-9394f3aad647" containerName="payload-pre-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270861    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dcb19c-231c-4305-b4b2-9394f3aad647" containerName="payload-pre-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270868    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dd32fe0-3a37-44f6-acc1-092e55b7b102" containerName="payload-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270874    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dd32fe0-3a37-44f6-acc1-092e55b7b102" containerName="payload-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270930    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="efd0a506-4c0e-4067-9759-66616b4bc291" containerName="payload-pre-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270938    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="246abecd-d95e-4b42-b716-c2d012ab00f3" containerName="main"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270946    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="693f5bc2-2da4-4e1d-8462-a50dc8054e2d" containerName="payload-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270955    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="96dcb19c-231c-4305-b4b2-9394f3aad647" containerName="payload-pre-processing"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270965    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9130e934-93dd-4396-ba4c-6ddd1db94172" containerName="main"
Jul 24 15:33:56.272528 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.270974    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dd32fe0-3a37-44f6-acc1-092e55b7b102" containerName="payload-processing"
Jul 24 15:33:56.273574 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.273558    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:33:56.276265 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.276240    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-f97fff-dockercfg-ctsph\""
Jul 24 15:33:56.276410 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.276248    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-f97fff\""
Jul 24 15:33:56.283424 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.283393    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"]
Jul 24 15:33:56.296620 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.296587    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"]
Jul 24 15:33:56.299808 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.299787    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:33:56.310149 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.310120    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"]
Jul 24 15:33:56.373343 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.373284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pxkv\" (UniqueName: \"kubernetes.io/projected/a13a6300-76b5-46f1-869d-af82db927c67-kube-api-access-8pxkv\") pod \"payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk\" (UID: \"a13a6300-76b5-46f1-869d-af82db927c67\") " pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:33:56.373516 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.373363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hschv\" (UniqueName: \"kubernetes.io/projected/ebcca690-991a-42a4-8f25-aaad93a0ea5e-kube-api-access-hschv\") pod \"payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg\" (UID: \"ebcca690-991a-42a4-8f25-aaad93a0ea5e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:33:56.373516 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.373435    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a13a6300-76b5-46f1-869d-af82db927c67-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk\" (UID: \"a13a6300-76b5-46f1-869d-af82db927c67\") " pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:33:56.373516 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.373494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebcca690-991a-42a4-8f25-aaad93a0ea5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg\" (UID: \"ebcca690-991a-42a4-8f25-aaad93a0ea5e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:33:56.474662 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.474619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hschv\" (UniqueName: \"kubernetes.io/projected/ebcca690-991a-42a4-8f25-aaad93a0ea5e-kube-api-access-hschv\") pod \"payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg\" (UID: \"ebcca690-991a-42a4-8f25-aaad93a0ea5e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:33:56.474842 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.474702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a13a6300-76b5-46f1-869d-af82db927c67-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk\" (UID: \"a13a6300-76b5-46f1-869d-af82db927c67\") " pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:33:56.474842 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.474745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebcca690-991a-42a4-8f25-aaad93a0ea5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg\" (UID: \"ebcca690-991a-42a4-8f25-aaad93a0ea5e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:33:56.474842 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.474788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pxkv\" (UniqueName: \"kubernetes.io/projected/a13a6300-76b5-46f1-869d-af82db927c67-kube-api-access-8pxkv\") pod \"payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk\" (UID: \"a13a6300-76b5-46f1-869d-af82db927c67\") " pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:33:56.475439 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.475419    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a13a6300-76b5-46f1-869d-af82db927c67-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk\" (UID: \"a13a6300-76b5-46f1-869d-af82db927c67\") " pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:33:56.475503 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.475484    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebcca690-991a-42a4-8f25-aaad93a0ea5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg\" (UID: \"ebcca690-991a-42a4-8f25-aaad93a0ea5e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:33:56.491148 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.491119    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pxkv\" (UniqueName: \"kubernetes.io/projected/a13a6300-76b5-46f1-869d-af82db927c67-kube-api-access-8pxkv\") pod \"payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk\" (UID: \"a13a6300-76b5-46f1-869d-af82db927c67\") " pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:33:56.491148 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.491130    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hschv\" (UniqueName: \"kubernetes.io/projected/ebcca690-991a-42a4-8f25-aaad93a0ea5e-kube-api-access-hschv\") pod \"payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg\" (UID: \"ebcca690-991a-42a4-8f25-aaad93a0ea5e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:33:56.585533 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.585437    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:33:56.611472 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.611443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:33:56.765400 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.765365    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"]
Jul 24 15:33:56.767918 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:33:56.767889    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13a6300_76b5_46f1_869d_af82db927c67.slice/crio-5bd7f5bd72d258b62e849dc362ad599982a2bce12de78d036629deed68103ee2 WatchSource:0}: Error finding container 5bd7f5bd72d258b62e849dc362ad599982a2bce12de78d036629deed68103ee2: Status 404 returned error can't find the container with id 5bd7f5bd72d258b62e849dc362ad599982a2bce12de78d036629deed68103ee2
Jul 24 15:33:56.791596 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:56.791564    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"]
Jul 24 15:33:56.803699 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:33:56.803664    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcca690_991a_42a4_8f25_aaad93a0ea5e.slice/crio-9fe2724aeed75fbb19be71160d8cc913f81ad7748a5caf0ebdeb677e2be2a62f WatchSource:0}: Error finding container 9fe2724aeed75fbb19be71160d8cc913f81ad7748a5caf0ebdeb677e2be2a62f: Status 404 returned error can't find the container with id 9fe2724aeed75fbb19be71160d8cc913f81ad7748a5caf0ebdeb677e2be2a62f
Jul 24 15:33:57.106422 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:57.106301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk" event={"ID":"a13a6300-76b5-46f1-869d-af82db927c67","Type":"ContainerStarted","Data":"800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0"}
Jul 24 15:33:57.106422 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:57.106382    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:33:57.106422 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:57.106405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk" event={"ID":"a13a6300-76b5-46f1-869d-af82db927c67","Type":"ContainerStarted","Data":"5bd7f5bd72d258b62e849dc362ad599982a2bce12de78d036629deed68103ee2"}
Jul 24 15:33:57.108377 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:57.108332    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg" event={"ID":"ebcca690-991a-42a4-8f25-aaad93a0ea5e","Type":"ContainerStarted","Data":"e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8"}
Jul 24 15:33:57.108522 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:57.108405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg" event={"ID":"ebcca690-991a-42a4-8f25-aaad93a0ea5e","Type":"ContainerStarted","Data":"9fe2724aeed75fbb19be71160d8cc913f81ad7748a5caf0ebdeb677e2be2a62f"}
Jul 24 15:33:57.108522 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:57.108436    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:33:57.126745 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:57.126688    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk" podStartSLOduration=1.126669829 podStartE2EDuration="1.126669829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:33:57.124913287 +0000 UTC m=+2265.663892718" watchObservedRunningTime="2026-07-24 15:33:57.126669829 +0000 UTC m=+2265.665649241"
Jul 24 15:33:57.162759 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:33:57.162704    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg" podStartSLOduration=1.162688224 podStartE2EDuration="1.162688224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:33:57.161067242 +0000 UTC m=+2265.700046675" watchObservedRunningTime="2026-07-24 15:33:57.162688224 +0000 UTC m=+2265.701667637"
Jul 24 15:34:04.587550 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.587504    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"]
Jul 24 15:34:04.591235 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.591216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:04.594417 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.594393    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-03bf4f-dockercfg-pfc75\""
Jul 24 15:34:04.594544 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.594442    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-03bf4f\""
Jul 24 15:34:04.604131 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.604108    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"]
Jul 24 15:34:04.636712 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.636672    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"]
Jul 24 15:34:04.639919 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.639901    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:04.651556 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.651516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"]
Jul 24 15:34:04.656678 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.656647    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c255d963-79b0-412b-86d9-64f3ecc5dc6a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9\" (UID: \"c255d963-79b0-412b-86d9-64f3ecc5dc6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:04.656842 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.656701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq4pr\" (UniqueName: \"kubernetes.io/projected/c255d963-79b0-412b-86d9-64f3ecc5dc6a-kube-api-access-tq4pr\") pod \"payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9\" (UID: \"c255d963-79b0-412b-86d9-64f3ecc5dc6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:04.758178 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.758126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjxw9\" (UniqueName: \"kubernetes.io/projected/5c901af9-c5d3-4566-9796-175cb68fb10f-kube-api-access-fjxw9\") pod \"payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6\" (UID: \"5c901af9-c5d3-4566-9796-175cb68fb10f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:04.758402 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.758189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c901af9-c5d3-4566-9796-175cb68fb10f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6\" (UID: \"5c901af9-c5d3-4566-9796-175cb68fb10f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:04.758402 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.758236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c255d963-79b0-412b-86d9-64f3ecc5dc6a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9\" (UID: \"c255d963-79b0-412b-86d9-64f3ecc5dc6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:04.758402 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.758304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq4pr\" (UniqueName: \"kubernetes.io/projected/c255d963-79b0-412b-86d9-64f3ecc5dc6a-kube-api-access-tq4pr\") pod \"payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9\" (UID: \"c255d963-79b0-412b-86d9-64f3ecc5dc6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:04.758958 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.758934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c255d963-79b0-412b-86d9-64f3ecc5dc6a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9\" (UID: \"c255d963-79b0-412b-86d9-64f3ecc5dc6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:04.767197 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.767164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq4pr\" (UniqueName: \"kubernetes.io/projected/c255d963-79b0-412b-86d9-64f3ecc5dc6a-kube-api-access-tq4pr\") pod \"payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9\" (UID: \"c255d963-79b0-412b-86d9-64f3ecc5dc6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:04.859607 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.859501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjxw9\" (UniqueName: \"kubernetes.io/projected/5c901af9-c5d3-4566-9796-175cb68fb10f-kube-api-access-fjxw9\") pod \"payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6\" (UID: \"5c901af9-c5d3-4566-9796-175cb68fb10f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:04.859607 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.859559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c901af9-c5d3-4566-9796-175cb68fb10f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6\" (UID: \"5c901af9-c5d3-4566-9796-175cb68fb10f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:04.860410 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.860384    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c901af9-c5d3-4566-9796-175cb68fb10f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6\" (UID: \"5c901af9-c5d3-4566-9796-175cb68fb10f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:04.870489 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.870458    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjxw9\" (UniqueName: \"kubernetes.io/projected/5c901af9-c5d3-4566-9796-175cb68fb10f-kube-api-access-fjxw9\") pod \"payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6\" (UID: \"5c901af9-c5d3-4566-9796-175cb68fb10f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:04.902141 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.902104    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:04.951851 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:04.951804    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:05.053916 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:05.053867    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"]
Jul 24 15:34:05.056480 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:34:05.056450    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc255d963_79b0_412b_86d9_64f3ecc5dc6a.slice/crio-9fc9630524ff317a5b2a051982624704fd15d59a960dc15f42d817d68130e589 WatchSource:0}: Error finding container 9fc9630524ff317a5b2a051982624704fd15d59a960dc15f42d817d68130e589: Status 404 returned error can't find the container with id 9fc9630524ff317a5b2a051982624704fd15d59a960dc15f42d817d68130e589
Jul 24 15:34:05.107634 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:05.107603    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"]
Jul 24 15:34:05.111424 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:34:05.111399    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c901af9_c5d3_4566_9796_175cb68fb10f.slice/crio-748ab7c907778bbe26615e60728529a80ee9a04b4c31277f220c15bf0e2e8bb6 WatchSource:0}: Error finding container 748ab7c907778bbe26615e60728529a80ee9a04b4c31277f220c15bf0e2e8bb6: Status 404 returned error can't find the container with id 748ab7c907778bbe26615e60728529a80ee9a04b4c31277f220c15bf0e2e8bb6
Jul 24 15:34:05.149879 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:05.149845    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9" event={"ID":"c255d963-79b0-412b-86d9-64f3ecc5dc6a","Type":"ContainerStarted","Data":"4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c"}
Jul 24 15:34:05.150094 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:05.149907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9" event={"ID":"c255d963-79b0-412b-86d9-64f3ecc5dc6a","Type":"ContainerStarted","Data":"9fc9630524ff317a5b2a051982624704fd15d59a960dc15f42d817d68130e589"}
Jul 24 15:34:05.150094 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:05.149974    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:05.151540 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:05.151506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6" event={"ID":"5c901af9-c5d3-4566-9796-175cb68fb10f","Type":"ContainerStarted","Data":"748ab7c907778bbe26615e60728529a80ee9a04b4c31277f220c15bf0e2e8bb6"}
Jul 24 15:34:05.167134 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:05.167084    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9" podStartSLOduration=1.167065844 podStartE2EDuration="1.167065844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:34:05.166040043 +0000 UTC m=+2273.705019483" watchObservedRunningTime="2026-07-24 15:34:05.167065844 +0000 UTC m=+2273.706045256"
Jul 24 15:34:06.157218 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:06.157181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6" event={"ID":"5c901af9-c5d3-4566-9796-175cb68fb10f","Type":"ContainerStarted","Data":"71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3"}
Jul 24 15:34:06.157651 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:06.157547    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:06.176043 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:06.175992    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6" podStartSLOduration=2.175962806 podStartE2EDuration="2.175962806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:34:06.173976101 +0000 UTC m=+2274.712955541" watchObservedRunningTime="2026-07-24 15:34:06.175962806 +0000 UTC m=+2274.714942258"
Jul 24 15:34:08.116605 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:08.116571    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:34:08.117129 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:08.116654    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:34:16.159637 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:16.159596    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:17.164854 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:17.164822    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:31.912684 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:31.912634    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"]
Jul 24 15:34:31.913251 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:31.912924    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk" podUID="a13a6300-76b5-46f1-869d-af82db927c67" containerName="payload-processing" containerID="cri-o://800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0" gracePeriod=30
Jul 24 15:34:31.920121 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:31.920083    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"]
Jul 24 15:34:31.920477 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:31.920427    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg" podUID="ebcca690-991a-42a4-8f25-aaad93a0ea5e" containerName="payload-pre-processing" containerID="cri-o://e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8" gracePeriod=30
Jul 24 15:34:32.197563 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.197533    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:34:32.200607 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.200582    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:34:32.285389 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.285358    2582 generic.go:356] "Generic (PLEG): container finished" podID="a13a6300-76b5-46f1-869d-af82db927c67" containerID="800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0" exitCode=0
Jul 24 15:34:32.285603 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.285402    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"
Jul 24 15:34:32.285603 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.285442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk" event={"ID":"a13a6300-76b5-46f1-869d-af82db927c67","Type":"ContainerDied","Data":"800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0"}
Jul 24 15:34:32.285603 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.285505    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk" event={"ID":"a13a6300-76b5-46f1-869d-af82db927c67","Type":"ContainerDied","Data":"5bd7f5bd72d258b62e849dc362ad599982a2bce12de78d036629deed68103ee2"}
Jul 24 15:34:32.285603 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.285539    2582 scope.go:117] "RemoveContainer" containerID="800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0"
Jul 24 15:34:32.286668 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.286647    2582 generic.go:356] "Generic (PLEG): container finished" podID="ebcca690-991a-42a4-8f25-aaad93a0ea5e" containerID="e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8" exitCode=0
Jul 24 15:34:32.286750 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.286684    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"
Jul 24 15:34:32.286750 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.286735    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg" event={"ID":"ebcca690-991a-42a4-8f25-aaad93a0ea5e","Type":"ContainerDied","Data":"e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8"}
Jul 24 15:34:32.286857 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.286785    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg" event={"ID":"ebcca690-991a-42a4-8f25-aaad93a0ea5e","Type":"ContainerDied","Data":"9fe2724aeed75fbb19be71160d8cc913f81ad7748a5caf0ebdeb677e2be2a62f"}
Jul 24 15:34:32.293477 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.293452    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hschv\" (UniqueName: \"kubernetes.io/projected/ebcca690-991a-42a4-8f25-aaad93a0ea5e-kube-api-access-hschv\") pod \"ebcca690-991a-42a4-8f25-aaad93a0ea5e\" (UID: \"ebcca690-991a-42a4-8f25-aaad93a0ea5e\") "
Jul 24 15:34:32.293623 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.293511    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebcca690-991a-42a4-8f25-aaad93a0ea5e-plugins-config-volume\") pod \"ebcca690-991a-42a4-8f25-aaad93a0ea5e\" (UID: \"ebcca690-991a-42a4-8f25-aaad93a0ea5e\") "
Jul 24 15:34:32.293623 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.293537    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pxkv\" (UniqueName: \"kubernetes.io/projected/a13a6300-76b5-46f1-869d-af82db927c67-kube-api-access-8pxkv\") pod \"a13a6300-76b5-46f1-869d-af82db927c67\" (UID: \"a13a6300-76b5-46f1-869d-af82db927c67\") "
Jul 24 15:34:32.293623 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.293577    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a13a6300-76b5-46f1-869d-af82db927c67-plugins-config-volume\") pod \"a13a6300-76b5-46f1-869d-af82db927c67\" (UID: \"a13a6300-76b5-46f1-869d-af82db927c67\") "
Jul 24 15:34:32.293971 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.293946    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebcca690-991a-42a4-8f25-aaad93a0ea5e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ebcca690-991a-42a4-8f25-aaad93a0ea5e" (UID: "ebcca690-991a-42a4-8f25-aaad93a0ea5e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:34:32.293971 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.293968    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a13a6300-76b5-46f1-869d-af82db927c67-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a13a6300-76b5-46f1-869d-af82db927c67" (UID: "a13a6300-76b5-46f1-869d-af82db927c67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:34:32.294532 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.294507    2582 scope.go:117] "RemoveContainer" containerID="800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0"
Jul 24 15:34:32.294876 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:34:32.294855    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0\": container with ID starting with 800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0 not found: ID does not exist" containerID="800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0"
Jul 24 15:34:32.294958 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.294884    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0"} err="failed to get container status \"800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0\": rpc error: code = NotFound desc = could not find container \"800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0\": container with ID starting with 800d24597c404681707090e6b7fd3f4be1a63d5d4d2888d35d52773d66908af0 not found: ID does not exist"
Jul 24 15:34:32.294958 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.294902    2582 scope.go:117] "RemoveContainer" containerID="e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8"
Jul 24 15:34:32.296084 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.295957    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebcca690-991a-42a4-8f25-aaad93a0ea5e-kube-api-access-hschv" (OuterVolumeSpecName: "kube-api-access-hschv") pod "ebcca690-991a-42a4-8f25-aaad93a0ea5e" (UID: "ebcca690-991a-42a4-8f25-aaad93a0ea5e"). InnerVolumeSpecName "kube-api-access-hschv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:34:32.296291 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.296268    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13a6300-76b5-46f1-869d-af82db927c67-kube-api-access-8pxkv" (OuterVolumeSpecName: "kube-api-access-8pxkv") pod "a13a6300-76b5-46f1-869d-af82db927c67" (UID: "a13a6300-76b5-46f1-869d-af82db927c67"). InnerVolumeSpecName "kube-api-access-8pxkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:34:32.305329 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.305309    2582 scope.go:117] "RemoveContainer" containerID="e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8"
Jul 24 15:34:32.305671 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:34:32.305650    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8\": container with ID starting with e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8 not found: ID does not exist" containerID="e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8"
Jul 24 15:34:32.305735 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.305681    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8"} err="failed to get container status \"e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8\": rpc error: code = NotFound desc = could not find container \"e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8\": container with ID starting with e3a1e128e0222c81c6c74dc640054a131f667806b52e6e33d601452bb4d803a8 not found: ID does not exist"
Jul 24 15:34:32.394908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.394873    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebcca690-991a-42a4-8f25-aaad93a0ea5e-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:34:32.394908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.394901    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pxkv\" (UniqueName: \"kubernetes.io/projected/a13a6300-76b5-46f1-869d-af82db927c67-kube-api-access-8pxkv\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:34:32.394908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.394913    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a13a6300-76b5-46f1-869d-af82db927c67-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:34:32.395173 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.394923    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hschv\" (UniqueName: \"kubernetes.io/projected/ebcca690-991a-42a4-8f25-aaad93a0ea5e-kube-api-access-hschv\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:34:32.615388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.615346    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"]
Jul 24 15:34:32.619796 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.619764    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f97fff-557b9cc988-6dwnk"]
Jul 24 15:34:32.630255 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.630221    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"]
Jul 24 15:34:32.634334 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:32.634298    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f97fff-d78c55448-vhcmg"]
Jul 24 15:34:33.995699 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:33.995666    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a13a6300-76b5-46f1-869d-af82db927c67" path="/var/lib/kubelet/pods/a13a6300-76b5-46f1-869d-af82db927c67/volumes"
Jul 24 15:34:33.996110 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:33.996027    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebcca690-991a-42a4-8f25-aaad93a0ea5e" path="/var/lib/kubelet/pods/ebcca690-991a-42a4-8f25-aaad93a0ea5e/volumes"
Jul 24 15:34:59.037970 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.037927    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"]
Jul 24 15:34:59.038505 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.038263    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9" podUID="c255d963-79b0-412b-86d9-64f3ecc5dc6a" containerName="payload-processing" containerID="cri-o://4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c" gracePeriod=30
Jul 24 15:34:59.047639 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.047600    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"]
Jul 24 15:34:59.047944 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.047887    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6" podUID="5c901af9-c5d3-4566-9796-175cb68fb10f" containerName="payload-pre-processing" containerID="cri-o://71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3" gracePeriod=30
Jul 24 15:34:59.327408 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.327382    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:59.330602 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.330580    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:59.416200 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.416167    2582 generic.go:356] "Generic (PLEG): container finished" podID="c255d963-79b0-412b-86d9-64f3ecc5dc6a" containerID="4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c" exitCode=0
Jul 24 15:34:59.416368 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.416210    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"
Jul 24 15:34:59.416368 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.416246    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9" event={"ID":"c255d963-79b0-412b-86d9-64f3ecc5dc6a","Type":"ContainerDied","Data":"4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c"}
Jul 24 15:34:59.416368 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.416297    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9" event={"ID":"c255d963-79b0-412b-86d9-64f3ecc5dc6a","Type":"ContainerDied","Data":"9fc9630524ff317a5b2a051982624704fd15d59a960dc15f42d817d68130e589"}
Jul 24 15:34:59.416368 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.416319    2582 scope.go:117] "RemoveContainer" containerID="4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c"
Jul 24 15:34:59.417603 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.417583    2582 generic.go:356] "Generic (PLEG): container finished" podID="5c901af9-c5d3-4566-9796-175cb68fb10f" containerID="71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3" exitCode=0
Jul 24 15:34:59.417694 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.417627    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"
Jul 24 15:34:59.417694 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.417669    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6" event={"ID":"5c901af9-c5d3-4566-9796-175cb68fb10f","Type":"ContainerDied","Data":"71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3"}
Jul 24 15:34:59.417800 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.417719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6" event={"ID":"5c901af9-c5d3-4566-9796-175cb68fb10f","Type":"ContainerDied","Data":"748ab7c907778bbe26615e60728529a80ee9a04b4c31277f220c15bf0e2e8bb6"}
Jul 24 15:34:59.424591 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.424574    2582 scope.go:117] "RemoveContainer" containerID="4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c"
Jul 24 15:34:59.424869 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:34:59.424848    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c\": container with ID starting with 4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c not found: ID does not exist" containerID="4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c"
Jul 24 15:34:59.424922 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.424879    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c"} err="failed to get container status \"4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c\": rpc error: code = NotFound desc = could not find container \"4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c\": container with ID starting with 4cfcc6f7279e413f98c6d7db4b24fd690d6b1611204df7a84e456f229132bd7c not found: ID does not exist"
Jul 24 15:34:59.424922 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.424897    2582 scope.go:117] "RemoveContainer" containerID="71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3"
Jul 24 15:34:59.429151 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.429131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq4pr\" (UniqueName: \"kubernetes.io/projected/c255d963-79b0-412b-86d9-64f3ecc5dc6a-kube-api-access-tq4pr\") pod \"c255d963-79b0-412b-86d9-64f3ecc5dc6a\" (UID: \"c255d963-79b0-412b-86d9-64f3ecc5dc6a\") "
Jul 24 15:34:59.429221 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.429193    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c901af9-c5d3-4566-9796-175cb68fb10f-plugins-config-volume\") pod \"5c901af9-c5d3-4566-9796-175cb68fb10f\" (UID: \"5c901af9-c5d3-4566-9796-175cb68fb10f\") "
Jul 24 15:34:59.429268 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.429240    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjxw9\" (UniqueName: \"kubernetes.io/projected/5c901af9-c5d3-4566-9796-175cb68fb10f-kube-api-access-fjxw9\") pod \"5c901af9-c5d3-4566-9796-175cb68fb10f\" (UID: \"5c901af9-c5d3-4566-9796-175cb68fb10f\") "
Jul 24 15:34:59.429268 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.429258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c255d963-79b0-412b-86d9-64f3ecc5dc6a-plugins-config-volume\") pod \"c255d963-79b0-412b-86d9-64f3ecc5dc6a\" (UID: \"c255d963-79b0-412b-86d9-64f3ecc5dc6a\") "
Jul 24 15:34:59.429659 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.429611    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c901af9-c5d3-4566-9796-175cb68fb10f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5c901af9-c5d3-4566-9796-175cb68fb10f" (UID: "5c901af9-c5d3-4566-9796-175cb68fb10f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:34:59.429865 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.429841    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c255d963-79b0-412b-86d9-64f3ecc5dc6a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c255d963-79b0-412b-86d9-64f3ecc5dc6a" (UID: "c255d963-79b0-412b-86d9-64f3ecc5dc6a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:34:59.431492 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.431463    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c255d963-79b0-412b-86d9-64f3ecc5dc6a-kube-api-access-tq4pr" (OuterVolumeSpecName: "kube-api-access-tq4pr") pod "c255d963-79b0-412b-86d9-64f3ecc5dc6a" (UID: "c255d963-79b0-412b-86d9-64f3ecc5dc6a"). InnerVolumeSpecName "kube-api-access-tq4pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:34:59.431835 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.431813    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c901af9-c5d3-4566-9796-175cb68fb10f-kube-api-access-fjxw9" (OuterVolumeSpecName: "kube-api-access-fjxw9") pod "5c901af9-c5d3-4566-9796-175cb68fb10f" (UID: "5c901af9-c5d3-4566-9796-175cb68fb10f"). InnerVolumeSpecName "kube-api-access-fjxw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:34:59.433752 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.433735    2582 scope.go:117] "RemoveContainer" containerID="71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3"
Jul 24 15:34:59.434088 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:34:59.434071    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3\": container with ID starting with 71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3 not found: ID does not exist" containerID="71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3"
Jul 24 15:34:59.434152 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.434098    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3"} err="failed to get container status \"71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3\": rpc error: code = NotFound desc = could not find container \"71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3\": container with ID starting with 71a4f1bf85b9e215c84ac733acc571b03f1e0f3f7cdb468ad1e56f50332147a3 not found: ID does not exist"
Jul 24 15:34:59.530736 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.530700    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq4pr\" (UniqueName: \"kubernetes.io/projected/c255d963-79b0-412b-86d9-64f3ecc5dc6a-kube-api-access-tq4pr\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:34:59.530736 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.530732    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c901af9-c5d3-4566-9796-175cb68fb10f-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:34:59.530977 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.530747    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjxw9\" (UniqueName: \"kubernetes.io/projected/5c901af9-c5d3-4566-9796-175cb68fb10f-kube-api-access-fjxw9\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:34:59.530977 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.530759    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c255d963-79b0-412b-86d9-64f3ecc5dc6a-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:34:59.741330 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.741294    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"]
Jul 24 15:34:59.747117 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.747028    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03bf4f-76f99bb47b-zznx9"]
Jul 24 15:34:59.757174 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.757136    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"]
Jul 24 15:34:59.761185 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.761156    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03bf4f-76fcddd6d-pvjn6"]
Jul 24 15:34:59.995834 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.995750    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c901af9-c5d3-4566-9796-175cb68fb10f" path="/var/lib/kubelet/pods/5c901af9-c5d3-4566-9796-175cb68fb10f/volumes"
Jul 24 15:34:59.996133 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:34:59.996119    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c255d963-79b0-412b-86d9-64f3ecc5dc6a" path="/var/lib/kubelet/pods/c255d963-79b0-412b-86d9-64f3ecc5dc6a/volumes"
Jul 24 15:35:14.608214 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608168    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"]
Jul 24 15:35:14.608633 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608540    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c255d963-79b0-412b-86d9-64f3ecc5dc6a" containerName="payload-processing"
Jul 24 15:35:14.608633 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608551    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c255d963-79b0-412b-86d9-64f3ecc5dc6a" containerName="payload-processing"
Jul 24 15:35:14.608633 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608567    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c901af9-c5d3-4566-9796-175cb68fb10f" containerName="payload-pre-processing"
Jul 24 15:35:14.608633 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608576    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c901af9-c5d3-4566-9796-175cb68fb10f" containerName="payload-pre-processing"
Jul 24 15:35:14.608633 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608588    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13a6300-76b5-46f1-869d-af82db927c67" containerName="payload-processing"
Jul 24 15:35:14.608633 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608594    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13a6300-76b5-46f1-869d-af82db927c67" containerName="payload-processing"
Jul 24 15:35:14.608633 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608599    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebcca690-991a-42a4-8f25-aaad93a0ea5e" containerName="payload-pre-processing"
Jul 24 15:35:14.608633 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608604    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebcca690-991a-42a4-8f25-aaad93a0ea5e" containerName="payload-pre-processing"
Jul 24 15:35:14.608902 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608659    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebcca690-991a-42a4-8f25-aaad93a0ea5e" containerName="payload-pre-processing"
Jul 24 15:35:14.608902 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608671    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c901af9-c5d3-4566-9796-175cb68fb10f" containerName="payload-pre-processing"
Jul 24 15:35:14.608902 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608679    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c255d963-79b0-412b-86d9-64f3ecc5dc6a" containerName="payload-processing"
Jul 24 15:35:14.608902 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.608686    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a13a6300-76b5-46f1-869d-af82db927c67" containerName="payload-processing"
Jul 24 15:35:14.613269 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.613250    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:35:14.615642 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.615624    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-d419ce\""
Jul 24 15:35:14.623175 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.623148    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"]
Jul 24 15:35:14.767529 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.767485    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4fcb\" (UniqueName: \"kubernetes.io/projected/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-kube-api-access-r4fcb\") pod \"payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494\" (UID: \"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:35:14.767706 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.767555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494\" (UID: \"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:35:14.768032 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.768009    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"]
Jul 24 15:35:14.771267 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.771252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:35:14.773595 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.773578    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-d419ce-dockercfg-kzwsp\""
Jul 24 15:35:14.781803 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.781778    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"]
Jul 24 15:35:14.868296 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.868202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db33a6dd-6270-4070-8ac2-c67f811e9d95-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k\" (UID: \"db33a6dd-6270-4070-8ac2-c67f811e9d95\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:35:14.868296 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.868248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4fcb\" (UniqueName: \"kubernetes.io/projected/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-kube-api-access-r4fcb\") pod \"payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494\" (UID: \"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:35:14.868520 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.868324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p74m\" (UniqueName: \"kubernetes.io/projected/db33a6dd-6270-4070-8ac2-c67f811e9d95-kube-api-access-2p74m\") pod \"payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k\" (UID: \"db33a6dd-6270-4070-8ac2-c67f811e9d95\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:35:14.868520 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.868369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494\" (UID: \"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:35:14.869070 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.869053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494\" (UID: \"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:35:14.876742 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.876723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4fcb\" (UniqueName: \"kubernetes.io/projected/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-kube-api-access-r4fcb\") pod \"payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494\" (UID: \"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:35:14.924383 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.924346    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:35:14.969054 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.969020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db33a6dd-6270-4070-8ac2-c67f811e9d95-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k\" (UID: \"db33a6dd-6270-4070-8ac2-c67f811e9d95\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:35:14.969243 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.969073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p74m\" (UniqueName: \"kubernetes.io/projected/db33a6dd-6270-4070-8ac2-c67f811e9d95-kube-api-access-2p74m\") pod \"payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k\" (UID: \"db33a6dd-6270-4070-8ac2-c67f811e9d95\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:35:14.969734 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.969715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db33a6dd-6270-4070-8ac2-c67f811e9d95-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k\" (UID: \"db33a6dd-6270-4070-8ac2-c67f811e9d95\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:35:14.978419 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:14.978369    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p74m\" (UniqueName: \"kubernetes.io/projected/db33a6dd-6270-4070-8ac2-c67f811e9d95-kube-api-access-2p74m\") pod \"payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k\" (UID: \"db33a6dd-6270-4070-8ac2-c67f811e9d95\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:35:15.062097 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.062063    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"]
Jul 24 15:35:15.064340 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:35:15.064312    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8ff2f4_2b8f_43cd_aa57_9b0b9bb8bb68.slice/crio-a656910d73b5816bb5a639f503f1eba35c4b54b5a41d8a3fb3ec86e538d0564f WatchSource:0}: Error finding container a656910d73b5816bb5a639f503f1eba35c4b54b5a41d8a3fb3ec86e538d0564f: Status 404 returned error can't find the container with id a656910d73b5816bb5a639f503f1eba35c4b54b5a41d8a3fb3ec86e538d0564f
Jul 24 15:35:15.082803 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.082779    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:35:15.241376 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.241343    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"]
Jul 24 15:35:15.244626 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:35:15.244600    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb33a6dd_6270_4070_8ac2_c67f811e9d95.slice/crio-31b852406f58a3e14248013fabdf1a29999790f3334056b63296bcc6f13ac09c WatchSource:0}: Error finding container 31b852406f58a3e14248013fabdf1a29999790f3334056b63296bcc6f13ac09c: Status 404 returned error can't find the container with id 31b852406f58a3e14248013fabdf1a29999790f3334056b63296bcc6f13ac09c
Jul 24 15:35:15.493261 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.493220    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494" event={"ID":"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68","Type":"ContainerStarted","Data":"c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c"}
Jul 24 15:35:15.493495 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.493282    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494" event={"ID":"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68","Type":"ContainerStarted","Data":"a656910d73b5816bb5a639f503f1eba35c4b54b5a41d8a3fb3ec86e538d0564f"}
Jul 24 15:35:15.493495 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.493310    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:35:15.494606 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.494581    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k" event={"ID":"db33a6dd-6270-4070-8ac2-c67f811e9d95","Type":"ContainerStarted","Data":"58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd"}
Jul 24 15:35:15.494698 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.494624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k" event={"ID":"db33a6dd-6270-4070-8ac2-c67f811e9d95","Type":"ContainerStarted","Data":"31b852406f58a3e14248013fabdf1a29999790f3334056b63296bcc6f13ac09c"}
Jul 24 15:35:15.494698 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.494657    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:35:15.509742 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.509688    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494" podStartSLOduration=1.509671598 podStartE2EDuration="1.509671598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:35:15.508267889 +0000 UTC m=+2344.047247355" watchObservedRunningTime="2026-07-24 15:35:15.509671598 +0000 UTC m=+2344.048651011"
Jul 24 15:35:15.525092 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:15.525033    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k" podStartSLOduration=1.525016387 podStartE2EDuration="1.525016387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:35:15.524263619 +0000 UTC m=+2344.063243052" watchObservedRunningTime="2026-07-24 15:35:15.525016387 +0000 UTC m=+2344.063995797"
Jul 24 15:35:22.847957 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:22.847925    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"]
Jul 24 15:35:22.851410 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:22.851393    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:35:22.854758 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:22.854734    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-6b942c-dockercfg-xjm6x\""
Jul 24 15:35:22.855190 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:22.855167    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-6b942c\""
Jul 24 15:35:22.867182 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:22.867159    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"]
Jul 24 15:35:22.938206 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:22.938167    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"]
Jul 24 15:35:22.941586 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:22.941562    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:35:22.951398 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:22.951369    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"]
Jul 24 15:35:23.042962 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.042923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh249\" (UniqueName: \"kubernetes.io/projected/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-kube-api-access-sh249\") pod \"payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv\" (UID: \"87f1c6ab-f786-4c80-bca3-4c7277af6f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:35:23.043195 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.043010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc4c501c-4939-46b7-ba07-1d1652831f47-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5\" (UID: \"bc4c501c-4939-46b7-ba07-1d1652831f47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:35:23.043195 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.043076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkxg7\" (UniqueName: \"kubernetes.io/projected/bc4c501c-4939-46b7-ba07-1d1652831f47-kube-api-access-vkxg7\") pod \"payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5\" (UID: \"bc4c501c-4939-46b7-ba07-1d1652831f47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:35:23.043195 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.043182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv\" (UID: \"87f1c6ab-f786-4c80-bca3-4c7277af6f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:35:23.144465 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.144427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv\" (UID: \"87f1c6ab-f786-4c80-bca3-4c7277af6f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:35:23.144663 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.144497    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh249\" (UniqueName: \"kubernetes.io/projected/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-kube-api-access-sh249\") pod \"payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv\" (UID: \"87f1c6ab-f786-4c80-bca3-4c7277af6f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:35:23.144663 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.144544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc4c501c-4939-46b7-ba07-1d1652831f47-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5\" (UID: \"bc4c501c-4939-46b7-ba07-1d1652831f47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:35:23.144663 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.144582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkxg7\" (UniqueName: \"kubernetes.io/projected/bc4c501c-4939-46b7-ba07-1d1652831f47-kube-api-access-vkxg7\") pod \"payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5\" (UID: \"bc4c501c-4939-46b7-ba07-1d1652831f47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:35:23.145394 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.145366    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv\" (UID: \"87f1c6ab-f786-4c80-bca3-4c7277af6f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:35:23.145482 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.145462    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc4c501c-4939-46b7-ba07-1d1652831f47-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5\" (UID: \"bc4c501c-4939-46b7-ba07-1d1652831f47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:35:23.153172 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.153145    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkxg7\" (UniqueName: \"kubernetes.io/projected/bc4c501c-4939-46b7-ba07-1d1652831f47-kube-api-access-vkxg7\") pod \"payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5\" (UID: \"bc4c501c-4939-46b7-ba07-1d1652831f47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:35:23.153304 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.153147    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh249\" (UniqueName: \"kubernetes.io/projected/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-kube-api-access-sh249\") pod \"payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv\" (UID: \"87f1c6ab-f786-4c80-bca3-4c7277af6f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:35:23.161326 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.161302    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:35:23.260021 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.257850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:35:23.418560 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.418531    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"]
Jul 24 15:35:23.420518 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:35:23.420492    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4c501c_4939_46b7_ba07_1d1652831f47.slice/crio-8d9482da7cf366d7e79bc3f9edb95d3f1b3b07d21f5a49bbb62d9858e70b54fa WatchSource:0}: Error finding container 8d9482da7cf366d7e79bc3f9edb95d3f1b3b07d21f5a49bbb62d9858e70b54fa: Status 404 returned error can't find the container with id 8d9482da7cf366d7e79bc3f9edb95d3f1b3b07d21f5a49bbb62d9858e70b54fa
Jul 24 15:35:23.530552 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.530527    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"]
Jul 24 15:35:23.532329 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:35:23.532303    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f1c6ab_f786_4c80_bca3_4c7277af6f1a.slice/crio-c65001d5bb47271ba7e4e113d483cfa262d1516a41f1cf1c38ce7e92816db43b WatchSource:0}: Error finding container c65001d5bb47271ba7e4e113d483cfa262d1516a41f1cf1c38ce7e92816db43b: Status 404 returned error can't find the container with id c65001d5bb47271ba7e4e113d483cfa262d1516a41f1cf1c38ce7e92816db43b
Jul 24 15:35:23.534939 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.534905    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5" event={"ID":"bc4c501c-4939-46b7-ba07-1d1652831f47","Type":"ContainerStarted","Data":"aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc"}
Jul 24 15:35:23.535070 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.534972    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5" event={"ID":"bc4c501c-4939-46b7-ba07-1d1652831f47","Type":"ContainerStarted","Data":"8d9482da7cf366d7e79bc3f9edb95d3f1b3b07d21f5a49bbb62d9858e70b54fa"}
Jul 24 15:35:23.535070 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.535051    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:35:23.552112 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:23.552069    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5" podStartSLOduration=1.5520512929999999 podStartE2EDuration="1.552051293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:35:23.550257142 +0000 UTC m=+2352.089236580" watchObservedRunningTime="2026-07-24 15:35:23.552051293 +0000 UTC m=+2352.091030705"
Jul 24 15:35:24.540867 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:24.540823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv" event={"ID":"87f1c6ab-f786-4c80-bca3-4c7277af6f1a","Type":"ContainerStarted","Data":"ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31"}
Jul 24 15:35:24.541343 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:24.540880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv" event={"ID":"87f1c6ab-f786-4c80-bca3-4c7277af6f1a","Type":"ContainerStarted","Data":"c65001d5bb47271ba7e4e113d483cfa262d1516a41f1cf1c38ce7e92816db43b"}
Jul 24 15:35:24.541343 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:24.541116    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:35:24.558572 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:24.558513    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv" podStartSLOduration=2.558496147 podStartE2EDuration="2.558496147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:35:24.557136582 +0000 UTC m=+2353.096115994" watchObservedRunningTime="2026-07-24 15:35:24.558496147 +0000 UTC m=+2353.097475559"
Jul 24 15:35:26.502515 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:26.502473    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494" podUID="0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.57:9004: connect: connection refused"
Jul 24 15:35:26.503091 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:26.503071    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:35:34.543165 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:34.543134    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:35:35.549301 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:35.549274    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:35:36.501398 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:36.501363    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:35:42.743620 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.743576    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"]
Jul 24 15:35:42.747674 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.747658    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.750600 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.750574    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d419ce\"/\"kube-root-ca.crt\""
Jul 24 15:35:42.751695 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.751670    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d419ce\"/\"default-dockercfg-zh828\""
Jul 24 15:35:42.751695 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.751685    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d419ce\"/\"auth-test-model-d419ce-kserve-self-signed-certs\""
Jul 24 15:35:42.751873 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.751710    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d419ce\"/\"openshift-service-ca.crt\""
Jul 24 15:35:42.754484 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.754442    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"]
Jul 24 15:35:42.821651 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.821612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tls-certs\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.821896 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.821674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-home\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.821896 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.821716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-dshm\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.821896 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.821777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bwnm\" (UniqueName: \"kubernetes.io/projected/d538ec91-6d3c-4fb7-8895-07d957b52b4f-kube-api-access-2bwnm\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.821896 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.821838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-model-cache\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.821896 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.821861    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tmp-dir\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.923143 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.923102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tls-certs\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.923143 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.923146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-home\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.923429 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.923274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-dshm\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.923429 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.923310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwnm\" (UniqueName: \"kubernetes.io/projected/d538ec91-6d3c-4fb7-8895-07d957b52b4f-kube-api-access-2bwnm\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.923429 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.923358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-model-cache\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.923429 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.923384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tmp-dir\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.923663 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.923617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-home\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.923743 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.923727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tmp-dir\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.923854 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.923832    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-model-cache\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.925745 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.925718    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-dshm\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.925926 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.925909    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tls-certs\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:42.932171 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:42.932150    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bwnm\" (UniqueName: \"kubernetes.io/projected/d538ec91-6d3c-4fb7-8895-07d957b52b4f-kube-api-access-2bwnm\") pod \"auth-test-model-d419ce-kserve-8489bbf4dc-gx29m\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") " pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:43.058699 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:43.058611    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:43.198619 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:43.198562    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"]
Jul 24 15:35:43.201108 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:35:43.201076    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd538ec91_6d3c_4fb7_8895_07d957b52b4f.slice/crio-a09e890d85ffd4d2ae77f61f2e38f3c446ffa65b5e3e0f76fb84f63cbdf32a82 WatchSource:0}: Error finding container a09e890d85ffd4d2ae77f61f2e38f3c446ffa65b5e3e0f76fb84f63cbdf32a82: Status 404 returned error can't find the container with id a09e890d85ffd4d2ae77f61f2e38f3c446ffa65b5e3e0f76fb84f63cbdf32a82
Jul 24 15:35:43.633104 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:43.633069    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m" event={"ID":"d538ec91-6d3c-4fb7-8895-07d957b52b4f","Type":"ContainerStarted","Data":"1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800"}
Jul 24 15:35:43.633467 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:43.633116    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m" event={"ID":"d538ec91-6d3c-4fb7-8895-07d957b52b4f","Type":"ContainerStarted","Data":"a09e890d85ffd4d2ae77f61f2e38f3c446ffa65b5e3e0f76fb84f63cbdf32a82"}
Jul 24 15:35:43.651107 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:43.651039    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m" podStartSLOduration=1.651021031 podStartE2EDuration="1.651021031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:35:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:35:43.649371926 +0000 UTC m=+2372.188351341" watchObservedRunningTime="2026-07-24 15:35:43.651021031 +0000 UTC m=+2372.190000448"
Jul 24 15:35:53.059439 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:53.059397    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:53.059911 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:53.059452    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:53.072664 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:53.072630    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:35:53.694498 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:35:53.694469    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:36:05.950186 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:05.950153    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"]
Jul 24 15:36:05.954803 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:05.954778    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:05.957583 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:05.957557    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"default-dockercfg-kdmhc\""
Jul 24 15:36:05.958642 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:05.958614    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"auth-test-model-6b942c-kserve-self-signed-certs\""
Jul 24 15:36:05.958763 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:05.958624    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"kube-root-ca.crt\""
Jul 24 15:36:05.958763 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:05.958658    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"openshift-service-ca.crt\""
Jul 24 15:36:05.965341 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:05.965315    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"]
Jul 24 15:36:06.140387 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.140350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-home\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.140573 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.140399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-tmp-dir\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.140573 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.140458    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-dshm\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.140573 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.140478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbe3af15-c61b-4b53-910a-399a7086d9c9-tls-certs\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.140690 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.140569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-model-cache\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.140690 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.140599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtb9d\" (UniqueName: \"kubernetes.io/projected/cbe3af15-c61b-4b53-910a-399a7086d9c9-kube-api-access-jtb9d\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.241676 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.241574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-dshm\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.241676 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.241616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbe3af15-c61b-4b53-910a-399a7086d9c9-tls-certs\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.241902 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.241735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-model-cache\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.241902 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.241766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtb9d\" (UniqueName: \"kubernetes.io/projected/cbe3af15-c61b-4b53-910a-399a7086d9c9-kube-api-access-jtb9d\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.241902 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.241867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-home\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.242093 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.241911    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-tmp-dir\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.242189 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.242154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-model-cache\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.242330 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.242228    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-home\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.242330 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.242272    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-tmp-dir\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.244137 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.244118    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-dshm\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.244277 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.244259    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbe3af15-c61b-4b53-910a-399a7086d9c9-tls-certs\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.250713 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.250689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtb9d\" (UniqueName: \"kubernetes.io/projected/cbe3af15-c61b-4b53-910a-399a7086d9c9-kube-api-access-jtb9d\") pod \"auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") " pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.265706 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.265670    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:06.411098 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.411063    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"]
Jul 24 15:36:06.412082 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:36:06.412053    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbe3af15_c61b_4b53_910a_399a7086d9c9.slice/crio-65b77f2a3290e1ef86091687a2728bc6466fa15ed7cf3860875d50cda3217055 WatchSource:0}: Error finding container 65b77f2a3290e1ef86091687a2728bc6466fa15ed7cf3860875d50cda3217055: Status 404 returned error can't find the container with id 65b77f2a3290e1ef86091687a2728bc6466fa15ed7cf3860875d50cda3217055
Jul 24 15:36:06.744176 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.744141    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg" event={"ID":"cbe3af15-c61b-4b53-910a-399a7086d9c9","Type":"ContainerStarted","Data":"12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477"}
Jul 24 15:36:06.744357 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.744186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg" event={"ID":"cbe3af15-c61b-4b53-910a-399a7086d9c9","Type":"ContainerStarted","Data":"65b77f2a3290e1ef86091687a2728bc6466fa15ed7cf3860875d50cda3217055"}
Jul 24 15:36:06.762811 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:06.762763    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg" podStartSLOduration=1.762746004 podStartE2EDuration="1.762746004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:36:06.761028165 +0000 UTC m=+2395.300007577" watchObservedRunningTime="2026-07-24 15:36:06.762746004 +0000 UTC m=+2395.301725417"
Jul 24 15:36:12.056139 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:12.056109    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:36:12.058859 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:12.058839    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:36:16.266071 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:16.266026    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:16.266071 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:16.266079    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:16.279181 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:16.279147    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:36:16.804177 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:36:16.804147    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:38:29.921216 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:29.921174    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"]
Jul 24 15:38:30.950796 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:30.950763    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"]
Jul 24 15:38:44.940636 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:44.940570    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m" podUID="d538ec91-6d3c-4fb7-8895-07d957b52b4f" containerName="main" containerID="cri-o://1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800" gracePeriod=45
Jul 24 15:38:45.196220 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.196148    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:38:45.326428 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.326388    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-home\") pod \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") "
Jul 24 15:38:45.326428 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.326434    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tmp-dir\") pod \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") "
Jul 24 15:38:45.326674 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.326513    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-dshm\") pod \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") "
Jul 24 15:38:45.326674 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.326530    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-model-cache\") pod \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") "
Jul 24 15:38:45.326674 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.326575    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tls-certs\") pod \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") "
Jul 24 15:38:45.326674 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.326591    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bwnm\" (UniqueName: \"kubernetes.io/projected/d538ec91-6d3c-4fb7-8895-07d957b52b4f-kube-api-access-2bwnm\") pod \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\" (UID: \"d538ec91-6d3c-4fb7-8895-07d957b52b4f\") "
Jul 24 15:38:45.326892 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.326682    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-home" (OuterVolumeSpecName: "home") pod "d538ec91-6d3c-4fb7-8895-07d957b52b4f" (UID: "d538ec91-6d3c-4fb7-8895-07d957b52b4f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:38:45.326892 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.326771    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d538ec91-6d3c-4fb7-8895-07d957b52b4f" (UID: "d538ec91-6d3c-4fb7-8895-07d957b52b4f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:38:45.326892 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.326866    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:45.326892 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.326863    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-model-cache" (OuterVolumeSpecName: "model-cache") pod "d538ec91-6d3c-4fb7-8895-07d957b52b4f" (UID: "d538ec91-6d3c-4fb7-8895-07d957b52b4f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:38:45.328934 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.328905    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d538ec91-6d3c-4fb7-8895-07d957b52b4f-kube-api-access-2bwnm" (OuterVolumeSpecName: "kube-api-access-2bwnm") pod "d538ec91-6d3c-4fb7-8895-07d957b52b4f" (UID: "d538ec91-6d3c-4fb7-8895-07d957b52b4f"). InnerVolumeSpecName "kube-api-access-2bwnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:38:45.329075 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.328970    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-dshm" (OuterVolumeSpecName: "dshm") pod "d538ec91-6d3c-4fb7-8895-07d957b52b4f" (UID: "d538ec91-6d3c-4fb7-8895-07d957b52b4f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:38:45.329075 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.328970    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d538ec91-6d3c-4fb7-8895-07d957b52b4f" (UID: "d538ec91-6d3c-4fb7-8895-07d957b52b4f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:38:45.427742 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.427702    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:45.427742 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.427735    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:45.427742 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.427745    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:45.428004 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.427756    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bwnm\" (UniqueName: \"kubernetes.io/projected/d538ec91-6d3c-4fb7-8895-07d957b52b4f-kube-api-access-2bwnm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:45.428004 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.427787    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d538ec91-6d3c-4fb7-8895-07d957b52b4f-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:45.478597 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.478507    2582 generic.go:356] "Generic (PLEG): container finished" podID="d538ec91-6d3c-4fb7-8895-07d957b52b4f" containerID="1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800" exitCode=0
Jul 24 15:38:45.478597 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.478549    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"
Jul 24 15:38:45.478597 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.478583    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m" event={"ID":"d538ec91-6d3c-4fb7-8895-07d957b52b4f","Type":"ContainerDied","Data":"1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800"}
Jul 24 15:38:45.478829 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.478615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m" event={"ID":"d538ec91-6d3c-4fb7-8895-07d957b52b4f","Type":"ContainerDied","Data":"a09e890d85ffd4d2ae77f61f2e38f3c446ffa65b5e3e0f76fb84f63cbdf32a82"}
Jul 24 15:38:45.478829 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.478632    2582 scope.go:117] "RemoveContainer" containerID="1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800"
Jul 24 15:38:45.488030 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.488010    2582 scope.go:117] "RemoveContainer" containerID="1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800"
Jul 24 15:38:45.488345 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:38:45.488326    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800\": container with ID starting with 1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800 not found: ID does not exist" containerID="1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800"
Jul 24 15:38:45.488400 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.488354    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800"} err="failed to get container status \"1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800\": rpc error: code = NotFound desc = could not find container \"1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800\": container with ID starting with 1939985b357b02a2f25c1ef9d2eed119e5a0d252d3e32587a26f55d88b5fa800 not found: ID does not exist"
Jul 24 15:38:45.501527 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.501500    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"]
Jul 24 15:38:45.504920 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.504890    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/auth-test-model-d419ce-kserve-8489bbf4dc-gx29m"]
Jul 24 15:38:45.970454 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.970410    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg" podUID="cbe3af15-c61b-4b53-910a-399a7086d9c9" containerName="main" containerID="cri-o://12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477" gracePeriod=45
Jul 24 15:38:45.996286 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:45.996251    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d538ec91-6d3c-4fb7-8895-07d957b52b4f" path="/var/lib/kubelet/pods/d538ec91-6d3c-4fb7-8895-07d957b52b4f/volumes"
Jul 24 15:38:46.231349 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.231281    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:38:46.336125 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336087    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-tmp-dir\") pod \"cbe3af15-c61b-4b53-910a-399a7086d9c9\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") "
Jul 24 15:38:46.336125 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336124    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-model-cache\") pod \"cbe3af15-c61b-4b53-910a-399a7086d9c9\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") "
Jul 24 15:38:46.336347 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336175    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbe3af15-c61b-4b53-910a-399a7086d9c9-tls-certs\") pod \"cbe3af15-c61b-4b53-910a-399a7086d9c9\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") "
Jul 24 15:38:46.336347 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336209    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-dshm\") pod \"cbe3af15-c61b-4b53-910a-399a7086d9c9\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") "
Jul 24 15:38:46.336347 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336240    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-home\") pod \"cbe3af15-c61b-4b53-910a-399a7086d9c9\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") "
Jul 24 15:38:46.336347 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336269    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtb9d\" (UniqueName: \"kubernetes.io/projected/cbe3af15-c61b-4b53-910a-399a7086d9c9-kube-api-access-jtb9d\") pod \"cbe3af15-c61b-4b53-910a-399a7086d9c9\" (UID: \"cbe3af15-c61b-4b53-910a-399a7086d9c9\") "
Jul 24 15:38:46.336551 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336406    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cbe3af15-c61b-4b53-910a-399a7086d9c9" (UID: "cbe3af15-c61b-4b53-910a-399a7086d9c9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:38:46.336551 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336478    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-model-cache" (OuterVolumeSpecName: "model-cache") pod "cbe3af15-c61b-4b53-910a-399a7086d9c9" (UID: "cbe3af15-c61b-4b53-910a-399a7086d9c9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:38:46.336551 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336491    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-home" (OuterVolumeSpecName: "home") pod "cbe3af15-c61b-4b53-910a-399a7086d9c9" (UID: "cbe3af15-c61b-4b53-910a-399a7086d9c9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:38:46.336711 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336652    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:46.336711 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336672    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:46.336711 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.336686    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:46.338615 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.338592    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-dshm" (OuterVolumeSpecName: "dshm") pod "cbe3af15-c61b-4b53-910a-399a7086d9c9" (UID: "cbe3af15-c61b-4b53-910a-399a7086d9c9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:38:46.338712 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.338663    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbe3af15-c61b-4b53-910a-399a7086d9c9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cbe3af15-c61b-4b53-910a-399a7086d9c9" (UID: "cbe3af15-c61b-4b53-910a-399a7086d9c9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:38:46.338712 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.338685    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbe3af15-c61b-4b53-910a-399a7086d9c9-kube-api-access-jtb9d" (OuterVolumeSpecName: "kube-api-access-jtb9d") pod "cbe3af15-c61b-4b53-910a-399a7086d9c9" (UID: "cbe3af15-c61b-4b53-910a-399a7086d9c9"). InnerVolumeSpecName "kube-api-access-jtb9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:38:46.437604 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.437562    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtb9d\" (UniqueName: \"kubernetes.io/projected/cbe3af15-c61b-4b53-910a-399a7086d9c9-kube-api-access-jtb9d\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:46.437604 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.437597    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbe3af15-c61b-4b53-910a-399a7086d9c9-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:46.437604 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.437609    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbe3af15-c61b-4b53-910a-399a7086d9c9-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:38:46.486068 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.485963    2582 generic.go:356] "Generic (PLEG): container finished" podID="cbe3af15-c61b-4b53-910a-399a7086d9c9" containerID="12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477" exitCode=0
Jul 24 15:38:46.486068 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.486024    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"
Jul 24 15:38:46.486298 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.486061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg" event={"ID":"cbe3af15-c61b-4b53-910a-399a7086d9c9","Type":"ContainerDied","Data":"12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477"}
Jul 24 15:38:46.486298 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.486104    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg" event={"ID":"cbe3af15-c61b-4b53-910a-399a7086d9c9","Type":"ContainerDied","Data":"65b77f2a3290e1ef86091687a2728bc6466fa15ed7cf3860875d50cda3217055"}
Jul 24 15:38:46.486298 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.486122    2582 scope.go:117] "RemoveContainer" containerID="12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477"
Jul 24 15:38:46.495084 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.495066    2582 scope.go:117] "RemoveContainer" containerID="12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477"
Jul 24 15:38:46.495356 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:38:46.495333    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477\": container with ID starting with 12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477 not found: ID does not exist" containerID="12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477"
Jul 24 15:38:46.495451 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.495364    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477"} err="failed to get container status \"12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477\": rpc error: code = NotFound desc = could not find container \"12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477\": container with ID starting with 12f0a50be5189416ba4653fe2f969346457f3574864d68b444db7fda19c1a477 not found: ID does not exist"
Jul 24 15:38:46.506785 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.506760    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"]
Jul 24 15:38:46.510523 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:46.510498    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/auth-test-model-6b942c-kserve-6b79c9bb99-5r8hg"]
Jul 24 15:38:47.996705 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:38:47.996672    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbe3af15-c61b-4b53-910a-399a7086d9c9" path="/var/lib/kubelet/pods/cbe3af15-c61b-4b53-910a-399a7086d9c9/volumes"
Jul 24 15:39:23.550601 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.550554    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"]
Jul 24 15:39:23.551178 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.551111    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d538ec91-6d3c-4fb7-8895-07d957b52b4f" containerName="main"
Jul 24 15:39:23.551178 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.551129    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d538ec91-6d3c-4fb7-8895-07d957b52b4f" containerName="main"
Jul 24 15:39:23.551178 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.551157    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbe3af15-c61b-4b53-910a-399a7086d9c9" containerName="main"
Jul 24 15:39:23.551178 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.551166    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbe3af15-c61b-4b53-910a-399a7086d9c9" containerName="main"
Jul 24 15:39:23.551394 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.551245    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d538ec91-6d3c-4fb7-8895-07d957b52b4f" containerName="main"
Jul 24 15:39:23.551394 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.551264    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbe3af15-c61b-4b53-910a-399a7086d9c9" containerName="main"
Jul 24 15:39:23.554729 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.554696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.557384 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.557359    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"openshift-service-ca.crt\""
Jul 24 15:39:23.558343 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.558315    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"kube-root-ca.crt\""
Jul 24 15:39:23.558494 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.558448    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"sub-test-model-6b942c-kserve-self-signed-certs\""
Jul 24 15:39:23.558494 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.558467    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"default-dockercfg-kdmhc\""
Jul 24 15:39:23.567842 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.567810    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"]
Jul 24 15:39:23.648377 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.648337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-home\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.648377 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.648379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx9kb\" (UniqueName: \"kubernetes.io/projected/2c8303fe-2a30-4e78-b2ac-9519848010a7-kube-api-access-cx9kb\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.648654 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.648448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-tmp-dir\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.648654 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.648514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-dshm\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.648654 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.648593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8303fe-2a30-4e78-b2ac-9519848010a7-tls-certs\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.648654 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.648634    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-model-cache\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.749427 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.749389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-tmp-dir\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.749639 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.749468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-dshm\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.749639 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.749499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8303fe-2a30-4e78-b2ac-9519848010a7-tls-certs\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.749639 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.749526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-model-cache\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.749639 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.749556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-home\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.749639 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.749573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx9kb\" (UniqueName: \"kubernetes.io/projected/2c8303fe-2a30-4e78-b2ac-9519848010a7-kube-api-access-cx9kb\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.749942 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.749916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-tmp-dir\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.749942 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.749933    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-model-cache\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.750111 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.750060    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-home\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.752072 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.752046    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-dshm\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.752227 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.752208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8303fe-2a30-4e78-b2ac-9519848010a7-tls-certs\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.757630 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.757600    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx9kb\" (UniqueName: \"kubernetes.io/projected/2c8303fe-2a30-4e78-b2ac-9519848010a7-kube-api-access-cx9kb\") pod \"sub-test-model-6b942c-kserve-789d647c95-gqjb9\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") " pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:23.866598 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:23.866505    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:24.018338 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:24.018260    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"]
Jul 24 15:39:24.020775 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:39:24.020743    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c8303fe_2a30_4e78_b2ac_9519848010a7.slice/crio-58df5cdd123bdeb17a157b5f293ad661019b7b46c512349e1feef929ff467512 WatchSource:0}: Error finding container 58df5cdd123bdeb17a157b5f293ad661019b7b46c512349e1feef929ff467512: Status 404 returned error can't find the container with id 58df5cdd123bdeb17a157b5f293ad661019b7b46c512349e1feef929ff467512
Jul 24 15:39:24.663510 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:24.663471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9" event={"ID":"2c8303fe-2a30-4e78-b2ac-9519848010a7","Type":"ContainerStarted","Data":"2a3d950bc057ca7ffc0dd70cd25605621409a1ddc9fa1c6fc6e46f338c302c09"}
Jul 24 15:39:24.663510 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:24.663513    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9" event={"ID":"2c8303fe-2a30-4e78-b2ac-9519848010a7","Type":"ContainerStarted","Data":"58df5cdd123bdeb17a157b5f293ad661019b7b46c512349e1feef929ff467512"}
Jul 24 15:39:24.681779 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:24.681727    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9" podStartSLOduration=1.681709905 podStartE2EDuration="1.681709905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:39:24.681051715 +0000 UTC m=+2593.220031130" watchObservedRunningTime="2026-07-24 15:39:24.681709905 +0000 UTC m=+2593.220689366"
Jul 24 15:39:33.867702 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:33.867607    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:33.867702 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:33.867668    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:33.880255 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:33.880229    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:39:34.727837 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:39:34.727808    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:40:08.803202 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:08.803167    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"]
Jul 24 15:40:11.365504 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.365469    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"]
Jul 24 15:40:11.369380 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.369361    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.373084 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.373056    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d419ce\"/\"default-dockercfg-zh828\""
Jul 24 15:40:11.373084 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.373056    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d419ce\"/\"rate-test-model-d419ce-kserve-self-signed-certs\""
Jul 24 15:40:11.373294 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.373100    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d419ce\"/\"openshift-service-ca.crt\""
Jul 24 15:40:11.373294 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.373159    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d419ce\"/\"kube-root-ca.crt\""
Jul 24 15:40:11.382545 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.382517    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"]
Jul 24 15:40:11.470454 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.470412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tmp-dir\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.470454 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.470455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbsls\" (UniqueName: \"kubernetes.io/projected/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-kube-api-access-jbsls\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.470701 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.470481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-dshm\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.470701 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.470495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tls-certs\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.470701 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.470572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-home\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.470701 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.470589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-model-cache\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.571939 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.571904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-home\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.571939 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.571938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-model-cache\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.572245 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.572051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tmp-dir\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.572245 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.572073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbsls\" (UniqueName: \"kubernetes.io/projected/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-kube-api-access-jbsls\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.572245 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.572111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-dshm\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.572245 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.572131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tls-certs\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.572486 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.572425    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-home\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.572486 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.572466    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tmp-dir\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.572570 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.572471    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-model-cache\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.574594 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.574572    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-dshm\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.574746 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.574728    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tls-certs\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.580752 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.580726    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbsls\" (UniqueName: \"kubernetes.io/projected/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-kube-api-access-jbsls\") pod \"rate-test-model-d419ce-kserve-c67dc84cf-kfgks\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") " pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.679264 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.679228    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:11.820015 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.819969    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"]
Jul 24 15:40:11.821732 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:40:11.821700    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod432363cf_8af5_44c2_b9fc_78b2bc73bcdd.slice/crio-9e27839b07553cf44aa8f214d8d17c3858f04389647731e6cda71657db2789f6 WatchSource:0}: Error finding container 9e27839b07553cf44aa8f214d8d17c3858f04389647731e6cda71657db2789f6: Status 404 returned error can't find the container with id 9e27839b07553cf44aa8f214d8d17c3858f04389647731e6cda71657db2789f6
Jul 24 15:40:11.895080 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.895044    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks" event={"ID":"432363cf-8af5-44c2-b9fc-78b2bc73bcdd","Type":"ContainerStarted","Data":"ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4"}
Jul 24 15:40:11.895267 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.895096    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks" event={"ID":"432363cf-8af5-44c2-b9fc-78b2bc73bcdd","Type":"ContainerStarted","Data":"9e27839b07553cf44aa8f214d8d17c3858f04389647731e6cda71657db2789f6"}
Jul 24 15:40:11.912869 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:11.912819    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks" podStartSLOduration=0.912803251 podStartE2EDuration="912.803251ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:40:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:40:11.909924576 +0000 UTC m=+2640.448903990" watchObservedRunningTime="2026-07-24 15:40:11.912803251 +0000 UTC m=+2640.451782683"
Jul 24 15:40:21.679813 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:21.679777    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:21.680344 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:21.679844    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:21.692652 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:21.692624    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:21.954737 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:21.954649    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:40:23.822709 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:23.822662    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9" podUID="2c8303fe-2a30-4e78-b2ac-9519848010a7" containerName="main" containerID="cri-o://2a3d950bc057ca7ffc0dd70cd25605621409a1ddc9fa1c6fc6e46f338c302c09" gracePeriod=45
Jul 24 15:40:23.954021 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:23.953972    2582 generic.go:356] "Generic (PLEG): container finished" podID="2c8303fe-2a30-4e78-b2ac-9519848010a7" containerID="2a3d950bc057ca7ffc0dd70cd25605621409a1ddc9fa1c6fc6e46f338c302c09" exitCode=0
Jul 24 15:40:23.954187 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:23.954032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9" event={"ID":"2c8303fe-2a30-4e78-b2ac-9519848010a7","Type":"ContainerDied","Data":"2a3d950bc057ca7ffc0dd70cd25605621409a1ddc9fa1c6fc6e46f338c302c09"}
Jul 24 15:40:24.084777 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.084708    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:40:24.185827 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.185795    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8303fe-2a30-4e78-b2ac-9519848010a7-tls-certs\") pod \"2c8303fe-2a30-4e78-b2ac-9519848010a7\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") "
Jul 24 15:40:24.185827 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.185834    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx9kb\" (UniqueName: \"kubernetes.io/projected/2c8303fe-2a30-4e78-b2ac-9519848010a7-kube-api-access-cx9kb\") pod \"2c8303fe-2a30-4e78-b2ac-9519848010a7\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") "
Jul 24 15:40:24.186100 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.185888    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-tmp-dir\") pod \"2c8303fe-2a30-4e78-b2ac-9519848010a7\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") "
Jul 24 15:40:24.186100 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.186014    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-model-cache\") pod \"2c8303fe-2a30-4e78-b2ac-9519848010a7\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") "
Jul 24 15:40:24.186192 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.186102    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-dshm\") pod \"2c8303fe-2a30-4e78-b2ac-9519848010a7\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") "
Jul 24 15:40:24.186192 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.186152    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-home\") pod \"2c8303fe-2a30-4e78-b2ac-9519848010a7\" (UID: \"2c8303fe-2a30-4e78-b2ac-9519848010a7\") "
Jul 24 15:40:24.186192 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.186155    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c8303fe-2a30-4e78-b2ac-9519848010a7" (UID: "2c8303fe-2a30-4e78-b2ac-9519848010a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:40:24.186363 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.186234    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c8303fe-2a30-4e78-b2ac-9519848010a7" (UID: "2c8303fe-2a30-4e78-b2ac-9519848010a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:40:24.186464 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.186433    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-home" (OuterVolumeSpecName: "home") pod "2c8303fe-2a30-4e78-b2ac-9519848010a7" (UID: "2c8303fe-2a30-4e78-b2ac-9519848010a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:40:24.186588 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.186496    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:40:24.186588 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.186517    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:40:24.188250 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.188219    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c8303fe-2a30-4e78-b2ac-9519848010a7-kube-api-access-cx9kb" (OuterVolumeSpecName: "kube-api-access-cx9kb") pod "2c8303fe-2a30-4e78-b2ac-9519848010a7" (UID: "2c8303fe-2a30-4e78-b2ac-9519848010a7"). InnerVolumeSpecName "kube-api-access-cx9kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:40:24.188250 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.188231    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-dshm" (OuterVolumeSpecName: "dshm") pod "2c8303fe-2a30-4e78-b2ac-9519848010a7" (UID: "2c8303fe-2a30-4e78-b2ac-9519848010a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:40:24.188389 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.188347    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c8303fe-2a30-4e78-b2ac-9519848010a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c8303fe-2a30-4e78-b2ac-9519848010a7" (UID: "2c8303fe-2a30-4e78-b2ac-9519848010a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:40:24.287917 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.287879    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8303fe-2a30-4e78-b2ac-9519848010a7-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:40:24.287917 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.287911    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx9kb\" (UniqueName: \"kubernetes.io/projected/2c8303fe-2a30-4e78-b2ac-9519848010a7-kube-api-access-cx9kb\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:40:24.287917 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.287922    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:40:24.288175 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.287931    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8303fe-2a30-4e78-b2ac-9519848010a7-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:40:24.960085 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.960057    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9" event={"ID":"2c8303fe-2a30-4e78-b2ac-9519848010a7","Type":"ContainerDied","Data":"58df5cdd123bdeb17a157b5f293ad661019b7b46c512349e1feef929ff467512"}
Jul 24 15:40:24.960552 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.960067    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"
Jul 24 15:40:24.960552 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.960099    2582 scope.go:117] "RemoveContainer" containerID="2a3d950bc057ca7ffc0dd70cd25605621409a1ddc9fa1c6fc6e46f338c302c09"
Jul 24 15:40:24.988891 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.988856    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"]
Jul 24 15:40:24.990703 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:24.990680    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/sub-test-model-6b942c-kserve-789d647c95-gqjb9"]
Jul 24 15:40:25.995796 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:25.995759    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c8303fe-2a30-4e78-b2ac-9519848010a7" path="/var/lib/kubelet/pods/2c8303fe-2a30-4e78-b2ac-9519848010a7/volumes"
Jul 24 15:40:48.037432 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.037394    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"]
Jul 24 15:40:48.038033 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.037749    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c8303fe-2a30-4e78-b2ac-9519848010a7" containerName="main"
Jul 24 15:40:48.038033 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.037760    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c8303fe-2a30-4e78-b2ac-9519848010a7" containerName="main"
Jul 24 15:40:48.038033 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.037823    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c8303fe-2a30-4e78-b2ac-9519848010a7" containerName="main"
Jul 24 15:40:48.042316 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.042294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.045763 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.045743    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"kube-root-ca.crt\""
Jul 24 15:40:48.046679 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.046639    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"openshift-service-ca.crt\""
Jul 24 15:40:48.046814 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.046691    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"rate-test-model-6b942c-kserve-self-signed-certs\""
Jul 24 15:40:48.046946 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.046933    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6b942c\"/\"default-dockercfg-kdmhc\""
Jul 24 15:40:48.056107 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.056071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"]
Jul 24 15:40:48.202740 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.202710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-home\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.202740 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.202743    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-model-cache\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.203027 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.202767    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tls-certs\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.203027 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.202876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9hp7\" (UniqueName: \"kubernetes.io/projected/24ed81f3-fdfe-4cb6-807c-cf20468a6604-kube-api-access-w9hp7\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.203146 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.203022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tmp-dir\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.203146 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.203098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-dshm\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.303852 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.303741    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hp7\" (UniqueName: \"kubernetes.io/projected/24ed81f3-fdfe-4cb6-807c-cf20468a6604-kube-api-access-w9hp7\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.303852 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.303829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tmp-dir\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.304127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.303865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-dshm\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.304127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.303896    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-home\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.304127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.303912    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-model-cache\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.304127 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.303944    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tls-certs\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.304370 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.304269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tmp-dir\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.304370 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.304323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-home\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.304510 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.304488    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-model-cache\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.306506 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.306473    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-dshm\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.306747 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.306727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tls-certs\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.312137 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.312113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9hp7\" (UniqueName: \"kubernetes.io/projected/24ed81f3-fdfe-4cb6-807c-cf20468a6604-kube-api-access-w9hp7\") pod \"rate-test-model-6b942c-kserve-547448c587-rxx4l\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") " pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.352163 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.352123    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:48.491568 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:48.491527    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"]
Jul 24 15:40:48.493974 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:40:48.493948    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24ed81f3_fdfe_4cb6_807c_cf20468a6604.slice/crio-a08091edc0c9658629ed70fd38efa29a89fa727b04bd5b6d1c5ee006c645586f WatchSource:0}: Error finding container a08091edc0c9658629ed70fd38efa29a89fa727b04bd5b6d1c5ee006c645586f: Status 404 returned error can't find the container with id a08091edc0c9658629ed70fd38efa29a89fa727b04bd5b6d1c5ee006c645586f
Jul 24 15:40:49.080372 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:49.080337    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l" event={"ID":"24ed81f3-fdfe-4cb6-807c-cf20468a6604","Type":"ContainerStarted","Data":"ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29"}
Jul 24 15:40:49.080766 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:49.080380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l" event={"ID":"24ed81f3-fdfe-4cb6-807c-cf20468a6604","Type":"ContainerStarted","Data":"a08091edc0c9658629ed70fd38efa29a89fa727b04bd5b6d1c5ee006c645586f"}
Jul 24 15:40:49.096627 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:49.096558    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l" podStartSLOduration=1.096540334 podStartE2EDuration="1.096540334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:40:49.095380129 +0000 UTC m=+2677.634359543" watchObservedRunningTime="2026-07-24 15:40:49.096540334 +0000 UTC m=+2677.635519747"
Jul 24 15:40:58.353179 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:58.353140    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:58.353679 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:58.353262    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:58.366009 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:58.365956    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:40:59.140120 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:40:59.140091    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:41:12.084256 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:12.084231    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:41:12.087420 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:12.087400    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:41:38.807828 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:38.807786    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"]
Jul 24 15:41:39.730580 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:39.730544    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"]
Jul 24 15:41:53.829172 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:53.829098    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks" podUID="432363cf-8af5-44c2-b9fc-78b2bc73bcdd" containerName="main" containerID="cri-o://ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4" gracePeriod=45
Jul 24 15:41:54.075738 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.075715    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:41:54.143562 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.143528    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbsls\" (UniqueName: \"kubernetes.io/projected/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-kube-api-access-jbsls\") pod \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") "
Jul 24 15:41:54.143762 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.143585    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tls-certs\") pod \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") "
Jul 24 15:41:54.143762 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.143608    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-home\") pod \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") "
Jul 24 15:41:54.143762 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.143637    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-dshm\") pod \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") "
Jul 24 15:41:54.143762 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.143715    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-model-cache\") pod \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") "
Jul 24 15:41:54.143762 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.143744    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tmp-dir\") pod \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\" (UID: \"432363cf-8af5-44c2-b9fc-78b2bc73bcdd\") "
Jul 24 15:41:54.144060 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.143945    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-home" (OuterVolumeSpecName: "home") pod "432363cf-8af5-44c2-b9fc-78b2bc73bcdd" (UID: "432363cf-8af5-44c2-b9fc-78b2bc73bcdd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:41:54.144060 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.144017    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-model-cache" (OuterVolumeSpecName: "model-cache") pod "432363cf-8af5-44c2-b9fc-78b2bc73bcdd" (UID: "432363cf-8af5-44c2-b9fc-78b2bc73bcdd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:41:54.144360 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.144172    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "432363cf-8af5-44c2-b9fc-78b2bc73bcdd" (UID: "432363cf-8af5-44c2-b9fc-78b2bc73bcdd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:41:54.144360 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.144296    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:54.144360 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.144319    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:54.144360 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.144335    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:54.146185 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.146150    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "432363cf-8af5-44c2-b9fc-78b2bc73bcdd" (UID: "432363cf-8af5-44c2-b9fc-78b2bc73bcdd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:41:54.146185 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.146162    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-dshm" (OuterVolumeSpecName: "dshm") pod "432363cf-8af5-44c2-b9fc-78b2bc73bcdd" (UID: "432363cf-8af5-44c2-b9fc-78b2bc73bcdd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:41:54.146326 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.146197    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-kube-api-access-jbsls" (OuterVolumeSpecName: "kube-api-access-jbsls") pod "432363cf-8af5-44c2-b9fc-78b2bc73bcdd" (UID: "432363cf-8af5-44c2-b9fc-78b2bc73bcdd"). InnerVolumeSpecName "kube-api-access-jbsls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:41:54.245496 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.245459    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbsls\" (UniqueName: \"kubernetes.io/projected/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-kube-api-access-jbsls\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:54.245496 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.245489    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:54.245496 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.245498    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/432363cf-8af5-44c2-b9fc-78b2bc73bcdd-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:54.391142 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.391108    2582 generic.go:356] "Generic (PLEG): container finished" podID="432363cf-8af5-44c2-b9fc-78b2bc73bcdd" containerID="ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4" exitCode=0
Jul 24 15:41:54.391142 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.391145    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"
Jul 24 15:41:54.391376 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.391198    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks" event={"ID":"432363cf-8af5-44c2-b9fc-78b2bc73bcdd","Type":"ContainerDied","Data":"ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4"}
Jul 24 15:41:54.391376 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.391242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks" event={"ID":"432363cf-8af5-44c2-b9fc-78b2bc73bcdd","Type":"ContainerDied","Data":"9e27839b07553cf44aa8f214d8d17c3858f04389647731e6cda71657db2789f6"}
Jul 24 15:41:54.391376 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.391261    2582 scope.go:117] "RemoveContainer" containerID="ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4"
Jul 24 15:41:54.401726 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.401702    2582 scope.go:117] "RemoveContainer" containerID="ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4"
Jul 24 15:41:54.402054 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:41:54.402026    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4\": container with ID starting with ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4 not found: ID does not exist" containerID="ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4"
Jul 24 15:41:54.402133 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.402067    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4"} err="failed to get container status \"ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4\": rpc error: code = NotFound desc = could not find container \"ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4\": container with ID starting with ba85228c584f3f8ddc445b76e645d75ae0b9c87013ffd620f1aa4bca29d808e4 not found: ID does not exist"
Jul 24 15:41:54.413110 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.413084    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"]
Jul 24 15:41:54.418964 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.418940    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d419ce/rate-test-model-d419ce-kserve-c67dc84cf-kfgks"]
Jul 24 15:41:54.750132 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:54.750034    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l" podUID="24ed81f3-fdfe-4cb6-807c-cf20468a6604" containerName="main" containerID="cri-o://ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29" gracePeriod=45
Jul 24 15:41:55.004616 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.004553    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:41:55.153943 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.153905    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9hp7\" (UniqueName: \"kubernetes.io/projected/24ed81f3-fdfe-4cb6-807c-cf20468a6604-kube-api-access-w9hp7\") pod \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") "
Jul 24 15:41:55.153943 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.153945    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tmp-dir\") pod \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") "
Jul 24 15:41:55.154206 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.153966    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-home\") pod \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") "
Jul 24 15:41:55.154206 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.154005    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tls-certs\") pod \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") "
Jul 24 15:41:55.154206 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.154026    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-dshm\") pod \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") "
Jul 24 15:41:55.154206 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.154052    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-model-cache\") pod \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\" (UID: \"24ed81f3-fdfe-4cb6-807c-cf20468a6604\") "
Jul 24 15:41:55.154505 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.154273    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24ed81f3-fdfe-4cb6-807c-cf20468a6604" (UID: "24ed81f3-fdfe-4cb6-807c-cf20468a6604"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:41:55.154505 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.154430    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-model-cache" (OuterVolumeSpecName: "model-cache") pod "24ed81f3-fdfe-4cb6-807c-cf20468a6604" (UID: "24ed81f3-fdfe-4cb6-807c-cf20468a6604"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:41:55.154649 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.154620    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:55.154710 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.154649    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:55.155511 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.155485    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-home" (OuterVolumeSpecName: "home") pod "24ed81f3-fdfe-4cb6-807c-cf20468a6604" (UID: "24ed81f3-fdfe-4cb6-807c-cf20468a6604"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:41:55.156465 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.156425    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-dshm" (OuterVolumeSpecName: "dshm") pod "24ed81f3-fdfe-4cb6-807c-cf20468a6604" (UID: "24ed81f3-fdfe-4cb6-807c-cf20468a6604"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:41:55.156566 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.156506    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24ed81f3-fdfe-4cb6-807c-cf20468a6604" (UID: "24ed81f3-fdfe-4cb6-807c-cf20468a6604"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:41:55.156566 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.156526    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ed81f3-fdfe-4cb6-807c-cf20468a6604-kube-api-access-w9hp7" (OuterVolumeSpecName: "kube-api-access-w9hp7") pod "24ed81f3-fdfe-4cb6-807c-cf20468a6604" (UID: "24ed81f3-fdfe-4cb6-807c-cf20468a6604"). InnerVolumeSpecName "kube-api-access-w9hp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:41:55.255387 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.255296    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9hp7\" (UniqueName: \"kubernetes.io/projected/24ed81f3-fdfe-4cb6-807c-cf20468a6604-kube-api-access-w9hp7\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:55.255387 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.255329    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:55.255387 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.255340    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24ed81f3-fdfe-4cb6-807c-cf20468a6604-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:55.255387 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.255348    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24ed81f3-fdfe-4cb6-807c-cf20468a6604-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:41:55.397994 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.397946    2582 generic.go:356] "Generic (PLEG): container finished" podID="24ed81f3-fdfe-4cb6-807c-cf20468a6604" containerID="ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29" exitCode=0
Jul 24 15:41:55.398220 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.398028    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"
Jul 24 15:41:55.398220 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.398038    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l" event={"ID":"24ed81f3-fdfe-4cb6-807c-cf20468a6604","Type":"ContainerDied","Data":"ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29"}
Jul 24 15:41:55.398220 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.398085    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l" event={"ID":"24ed81f3-fdfe-4cb6-807c-cf20468a6604","Type":"ContainerDied","Data":"a08091edc0c9658629ed70fd38efa29a89fa727b04bd5b6d1c5ee006c645586f"}
Jul 24 15:41:55.398220 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.398109    2582 scope.go:117] "RemoveContainer" containerID="ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29"
Jul 24 15:41:55.409431 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.409408    2582 scope.go:117] "RemoveContainer" containerID="ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29"
Jul 24 15:41:55.409810 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:41:55.409783    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29\": container with ID starting with ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29 not found: ID does not exist" containerID="ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29"
Jul 24 15:41:55.409892 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.409823    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29"} err="failed to get container status \"ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29\": rpc error: code = NotFound desc = could not find container \"ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29\": container with ID starting with ada34b5cc5a2936a4b30229c0bf94d6535971a5a3b25bd8d96cc8caac2e2bc29 not found: ID does not exist"
Jul 24 15:41:55.421261 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.421235    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"]
Jul 24 15:41:55.426580 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.426555    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6b942c/rate-test-model-6b942c-kserve-547448c587-rxx4l"]
Jul 24 15:41:55.996403 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.996372    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24ed81f3-fdfe-4cb6-807c-cf20468a6604" path="/var/lib/kubelet/pods/24ed81f3-fdfe-4cb6-807c-cf20468a6604/volumes"
Jul 24 15:41:55.996772 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:41:55.996758    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="432363cf-8af5-44c2-b9fc-78b2bc73bcdd" path="/var/lib/kubelet/pods/432363cf-8af5-44c2-b9fc-78b2bc73bcdd/volumes"
Jul 24 15:42:04.318940 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.318902    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"]
Jul 24 15:42:04.319350 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.319290    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432363cf-8af5-44c2-b9fc-78b2bc73bcdd" containerName="main"
Jul 24 15:42:04.319350 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.319303    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="432363cf-8af5-44c2-b9fc-78b2bc73bcdd" containerName="main"
Jul 24 15:42:04.319350 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.319322    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ed81f3-fdfe-4cb6-807c-cf20468a6604" containerName="main"
Jul 24 15:42:04.319350 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.319327    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ed81f3-fdfe-4cb6-807c-cf20468a6604" containerName="main"
Jul 24 15:42:04.319482 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.319384    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="432363cf-8af5-44c2-b9fc-78b2bc73bcdd" containerName="main"
Jul 24 15:42:04.319482 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.319394    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ed81f3-fdfe-4cb6-807c-cf20468a6604" containerName="main"
Jul 24 15:42:04.324139 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.324122    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:42:04.326851 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.326816    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-cd9c98\""
Jul 24 15:42:04.327021 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.326943    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-cd9c98-dockercfg-f7xxd\""
Jul 24 15:42:04.333410 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.333389    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"]
Jul 24 15:42:04.355160 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.355131    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"]
Jul 24 15:42:04.358900 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.358883    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:42:04.368601 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.368567    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"]
Jul 24 15:42:04.445038 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.445007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcm98\" (UniqueName: \"kubernetes.io/projected/de85063a-ac89-4caa-9c1e-3f3bc661b680-kube-api-access-jcm98\") pod \"payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k\" (UID: \"de85063a-ac89-4caa-9c1e-3f3bc661b680\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:42:04.445214 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.445157    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de85063a-ac89-4caa-9c1e-3f3bc661b680-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k\" (UID: \"de85063a-ac89-4caa-9c1e-3f3bc661b680\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:42:04.546369 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.546333    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz\" (UID: \"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:42:04.546369 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.546382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgkj7\" (UniqueName: \"kubernetes.io/projected/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-kube-api-access-pgkj7\") pod \"payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz\" (UID: \"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:42:04.546595 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.546444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de85063a-ac89-4caa-9c1e-3f3bc661b680-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k\" (UID: \"de85063a-ac89-4caa-9c1e-3f3bc661b680\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:42:04.546595 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.546491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcm98\" (UniqueName: \"kubernetes.io/projected/de85063a-ac89-4caa-9c1e-3f3bc661b680-kube-api-access-jcm98\") pod \"payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k\" (UID: \"de85063a-ac89-4caa-9c1e-3f3bc661b680\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:42:04.547184 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.547168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de85063a-ac89-4caa-9c1e-3f3bc661b680-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k\" (UID: \"de85063a-ac89-4caa-9c1e-3f3bc661b680\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:42:04.554445 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.554420    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcm98\" (UniqueName: \"kubernetes.io/projected/de85063a-ac89-4caa-9c1e-3f3bc661b680-kube-api-access-jcm98\") pod \"payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k\" (UID: \"de85063a-ac89-4caa-9c1e-3f3bc661b680\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:42:04.636400 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.636373    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:42:04.648018 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.647966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz\" (UID: \"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:42:04.648125 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.648057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgkj7\" (UniqueName: \"kubernetes.io/projected/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-kube-api-access-pgkj7\") pod \"payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz\" (UID: \"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:42:04.648702 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.648683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz\" (UID: \"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:42:04.656253 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.656225    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgkj7\" (UniqueName: \"kubernetes.io/projected/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-kube-api-access-pgkj7\") pod \"payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz\" (UID: \"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:42:04.669722 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.669695    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:42:04.785668 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.785572    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"]
Jul 24 15:42:04.789814 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:42:04.789779    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde85063a_ac89_4caa_9c1e_3f3bc661b680.slice/crio-a4aa65cf6cf5f1c1707878536b2e8c1e1c7a593804541efdfb3379ba7cf81592 WatchSource:0}: Error finding container a4aa65cf6cf5f1c1707878536b2e8c1e1c7a593804541efdfb3379ba7cf81592: Status 404 returned error can't find the container with id a4aa65cf6cf5f1c1707878536b2e8c1e1c7a593804541efdfb3379ba7cf81592
Jul 24 15:42:04.826811 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:04.826622    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"]
Jul 24 15:42:04.829916 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:42:04.829886    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a2d499_d1b0_4cdb_acb4_ff952c2eed6c.slice/crio-1234002f49eb9f85c8e7cde3b85966599fdd4ecd11cb1b52163a85cb060d1fe3 WatchSource:0}: Error finding container 1234002f49eb9f85c8e7cde3b85966599fdd4ecd11cb1b52163a85cb060d1fe3: Status 404 returned error can't find the container with id 1234002f49eb9f85c8e7cde3b85966599fdd4ecd11cb1b52163a85cb060d1fe3
Jul 24 15:42:05.451285 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:05.451250    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz" event={"ID":"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c","Type":"ContainerStarted","Data":"3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f"}
Jul 24 15:42:05.451768 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:05.451300    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz" event={"ID":"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c","Type":"ContainerStarted","Data":"1234002f49eb9f85c8e7cde3b85966599fdd4ecd11cb1b52163a85cb060d1fe3"}
Jul 24 15:42:05.451768 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:05.451410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:42:05.452770 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:05.452751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k" event={"ID":"de85063a-ac89-4caa-9c1e-3f3bc661b680","Type":"ContainerStarted","Data":"0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e"}
Jul 24 15:42:05.452850 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:05.452786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k" event={"ID":"de85063a-ac89-4caa-9c1e-3f3bc661b680","Type":"ContainerStarted","Data":"a4aa65cf6cf5f1c1707878536b2e8c1e1c7a593804541efdfb3379ba7cf81592"}
Jul 24 15:42:05.452850 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:05.452817    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:42:05.469871 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:05.469825    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz" podStartSLOduration=1.469810671 podStartE2EDuration="1.469810671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:42:05.467586421 +0000 UTC m=+2754.006565852" watchObservedRunningTime="2026-07-24 15:42:05.469810671 +0000 UTC m=+2754.008790062"
Jul 24 15:42:05.485060 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:05.485011    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k" podStartSLOduration=1.484971625 podStartE2EDuration="1.484971625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:42:05.484163799 +0000 UTC m=+2754.023143230" watchObservedRunningTime="2026-07-24 15:42:05.484971625 +0000 UTC m=+2754.023951038"
Jul 24 15:42:16.459997 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:16.459946    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:42:16.460521 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:16.460050    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:42:24.384930 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.384885    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"]
Jul 24 15:42:24.388201 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.388178    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:42:24.390630 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.390605    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-053e45\""
Jul 24 15:42:24.390892 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.390876    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-053e45-dockercfg-dwh6h\""
Jul 24 15:42:24.397754 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.397697    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"]
Jul 24 15:42:24.421274 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.421237    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"]
Jul 24 15:42:24.422712 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.422677    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s58gx\" (UniqueName: \"kubernetes.io/projected/abb8f638-8f54-487b-8d10-f7d919dd383c-kube-api-access-s58gx\") pod \"payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft\" (UID: \"abb8f638-8f54-487b-8d10-f7d919dd383c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:42:24.422860 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.422718    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abb8f638-8f54-487b-8d10-f7d919dd383c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft\" (UID: \"abb8f638-8f54-487b-8d10-f7d919dd383c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:42:24.424829 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.424811    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:42:24.438327 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.438299    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"]
Jul 24 15:42:24.524108 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.524073    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b201eba2-39bf-4325-8b53-64d8976c1173-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p\" (UID: \"b201eba2-39bf-4325-8b53-64d8976c1173\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:42:24.524293 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.524165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s58gx\" (UniqueName: \"kubernetes.io/projected/abb8f638-8f54-487b-8d10-f7d919dd383c-kube-api-access-s58gx\") pod \"payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft\" (UID: \"abb8f638-8f54-487b-8d10-f7d919dd383c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:42:24.524293 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.524238    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnd8z\" (UniqueName: \"kubernetes.io/projected/b201eba2-39bf-4325-8b53-64d8976c1173-kube-api-access-jnd8z\") pod \"payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p\" (UID: \"b201eba2-39bf-4325-8b53-64d8976c1173\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:42:24.524293 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.524276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abb8f638-8f54-487b-8d10-f7d919dd383c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft\" (UID: \"abb8f638-8f54-487b-8d10-f7d919dd383c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:42:24.524890 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.524874    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abb8f638-8f54-487b-8d10-f7d919dd383c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft\" (UID: \"abb8f638-8f54-487b-8d10-f7d919dd383c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:42:24.532087 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.532064    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s58gx\" (UniqueName: \"kubernetes.io/projected/abb8f638-8f54-487b-8d10-f7d919dd383c-kube-api-access-s58gx\") pod \"payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft\" (UID: \"abb8f638-8f54-487b-8d10-f7d919dd383c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:42:24.625037 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.624964    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnd8z\" (UniqueName: \"kubernetes.io/projected/b201eba2-39bf-4325-8b53-64d8976c1173-kube-api-access-jnd8z\") pod \"payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p\" (UID: \"b201eba2-39bf-4325-8b53-64d8976c1173\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:42:24.625226 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.625070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b201eba2-39bf-4325-8b53-64d8976c1173-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p\" (UID: \"b201eba2-39bf-4325-8b53-64d8976c1173\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:42:24.625707 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.625689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b201eba2-39bf-4325-8b53-64d8976c1173-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p\" (UID: \"b201eba2-39bf-4325-8b53-64d8976c1173\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:42:24.632928 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.632900    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnd8z\" (UniqueName: \"kubernetes.io/projected/b201eba2-39bf-4325-8b53-64d8976c1173-kube-api-access-jnd8z\") pod \"payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p\" (UID: \"b201eba2-39bf-4325-8b53-64d8976c1173\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:42:24.702236 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.702133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:42:24.735681 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.735647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:42:24.861878 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.861847    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"]
Jul 24 15:42:24.864414 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:42:24.864378    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb8f638_8f54_487b_8d10_f7d919dd383c.slice/crio-8d3ce50bf88b50060c53d2a8bd46a19556e32542d398ec0345cfba262d975d77 WatchSource:0}: Error finding container 8d3ce50bf88b50060c53d2a8bd46a19556e32542d398ec0345cfba262d975d77: Status 404 returned error can't find the container with id 8d3ce50bf88b50060c53d2a8bd46a19556e32542d398ec0345cfba262d975d77
Jul 24 15:42:24.893214 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:24.893189    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"]
Jul 24 15:42:24.905339 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:42:24.905306    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb201eba2_39bf_4325_8b53_64d8976c1173.slice/crio-ef5ac20f57fbd3c61a0b2e83f8eddd8fa3337eee1d778e91b3b0748eaa216dbf WatchSource:0}: Error finding container ef5ac20f57fbd3c61a0b2e83f8eddd8fa3337eee1d778e91b3b0748eaa216dbf: Status 404 returned error can't find the container with id ef5ac20f57fbd3c61a0b2e83f8eddd8fa3337eee1d778e91b3b0748eaa216dbf
Jul 24 15:42:25.549554 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:25.549512    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft" event={"ID":"abb8f638-8f54-487b-8d10-f7d919dd383c","Type":"ContainerStarted","Data":"e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c"}
Jul 24 15:42:25.550016 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:25.549707    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:42:25.550016 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:25.549736    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft" event={"ID":"abb8f638-8f54-487b-8d10-f7d919dd383c","Type":"ContainerStarted","Data":"8d3ce50bf88b50060c53d2a8bd46a19556e32542d398ec0345cfba262d975d77"}
Jul 24 15:42:25.551076 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:25.551051    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p" event={"ID":"b201eba2-39bf-4325-8b53-64d8976c1173","Type":"ContainerStarted","Data":"7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919"}
Jul 24 15:42:25.551173 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:25.551090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p" event={"ID":"b201eba2-39bf-4325-8b53-64d8976c1173","Type":"ContainerStarted","Data":"ef5ac20f57fbd3c61a0b2e83f8eddd8fa3337eee1d778e91b3b0748eaa216dbf"}
Jul 24 15:42:25.551213 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:25.551174    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:42:25.565692 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:25.565644    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft" podStartSLOduration=1.565628723 podStartE2EDuration="1.565628723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:42:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:42:25.563969389 +0000 UTC m=+2774.102948815" watchObservedRunningTime="2026-07-24 15:42:25.565628723 +0000 UTC m=+2774.104608199"
Jul 24 15:42:36.557667 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:36.557568    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:42:36.558158 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:36.557890    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:42:36.575743 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:36.575692    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p" podStartSLOduration=12.575678019 podStartE2EDuration="12.575678019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:42:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:42:25.57913743 +0000 UTC m=+2774.118116843" watchObservedRunningTime="2026-07-24 15:42:36.575678019 +0000 UTC m=+2785.114657439"
Jul 24 15:42:43.886466 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:43.886427    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p_b201eba2-39bf-4325-8b53-64d8976c1173/payload-processing/0.log"
Jul 24 15:42:50.550065 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.550028    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"]
Jul 24 15:42:50.553429 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.553410    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.556924 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.556901    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-cd9c98\"/\"ipp-route-cd9c98-kserve-self-signed-certs\""
Jul 24 15:42:50.557070 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.556932    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-cd9c98\"/\"default-dockercfg-x2hqr\""
Jul 24 15:42:50.557070 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.556938    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-cd9c98\"/\"kube-root-ca.crt\""
Jul 24 15:42:50.557070 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.557016    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-cd9c98\"/\"openshift-service-ca.crt\""
Jul 24 15:42:50.565074 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.564963    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"]
Jul 24 15:42:50.677702 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.677671    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-model-cache\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.677702 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.677701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-tmp-dir\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.677922 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.677830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f657646-6af7-4bef-b5fb-706c27171d69-tls-certs\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.678397 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.677880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-dshm\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.684735 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.684697    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-home\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.684884 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.684743    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mghkx\" (UniqueName: \"kubernetes.io/projected/8f657646-6af7-4bef-b5fb-706c27171d69-kube-api-access-mghkx\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.785459 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.785413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f657646-6af7-4bef-b5fb-706c27171d69-tls-certs\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.785667 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.785487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-dshm\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.785667 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.785522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-home\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.785667 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.785545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mghkx\" (UniqueName: \"kubernetes.io/projected/8f657646-6af7-4bef-b5fb-706c27171d69-kube-api-access-mghkx\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.785667 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.785586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-model-cache\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.785667 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.785609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-tmp-dir\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.786103 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.786082    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-tmp-dir\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.786258 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.786103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-model-cache\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.786258 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.786142    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-home\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.787976 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.787944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-dshm\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.788213 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.788192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f657646-6af7-4bef-b5fb-706c27171d69-tls-certs\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.794584 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.794561    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mghkx\" (UniqueName: \"kubernetes.io/projected/8f657646-6af7-4bef-b5fb-706c27171d69-kube-api-access-mghkx\") pod \"ipp-route-cd9c98-kserve-79c95dff47-592c6\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") " pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:50.863060 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:50.862953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:42:51.006821 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:51.006793    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"]
Jul 24 15:42:51.008754 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:42:51.008725    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f657646_6af7_4bef_b5fb_706c27171d69.slice/crio-0e2a15f6f062fa063816c8b0bdb33141ecafb6c52fbda2c2cc024eb6117b4c31 WatchSource:0}: Error finding container 0e2a15f6f062fa063816c8b0bdb33141ecafb6c52fbda2c2cc024eb6117b4c31: Status 404 returned error can't find the container with id 0e2a15f6f062fa063816c8b0bdb33141ecafb6c52fbda2c2cc024eb6117b4c31
Jul 24 15:42:51.684309 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:51.684265    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6" event={"ID":"8f657646-6af7-4bef-b5fb-706c27171d69","Type":"ContainerStarted","Data":"b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e"}
Jul 24 15:42:51.684309 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:51.684314    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6" event={"ID":"8f657646-6af7-4bef-b5fb-706c27171d69","Type":"ContainerStarted","Data":"0e2a15f6f062fa063816c8b0bdb33141ecafb6c52fbda2c2cc024eb6117b4c31"}
Jul 24 15:42:51.702350 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:42:51.702301    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6" podStartSLOduration=1.702283182 podStartE2EDuration="1.702283182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:42:51.700400052 +0000 UTC m=+2800.239379467" watchObservedRunningTime="2026-07-24 15:42:51.702283182 +0000 UTC m=+2800.241262595"
Jul 24 15:43:00.863379 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:00.863344    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:43:00.863867 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:00.863398    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:43:00.876437 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:00.876404    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:43:01.744408 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:01.744379    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:43:35.861796 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:35.861757    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz_64a2d499-d1b0-4cdb-acb4-ff952c2eed6c/payload-processing/0.log"
Jul 24 15:43:36.140300 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:36.140277    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p_b201eba2-39bf-4325-8b53-64d8976c1173/payload-processing/0.log"
Jul 24 15:43:43.258285 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.258247    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"]
Jul 24 15:43:43.262000 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.261965    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:43:43.264780 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.264755    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-923368-dockercfg-pnbk6\""
Jul 24 15:43:43.264780 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.264772    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-923368\""
Jul 24 15:43:43.273354 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.273326    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"]
Jul 24 15:43:43.289944 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.289912    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"]
Jul 24 15:43:43.293411 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.293391    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:43:43.303540 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.303509    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"]
Jul 24 15:43:43.357168 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.357132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbzfb\" (UniqueName: \"kubernetes.io/projected/28eb973b-49e0-41ae-8eee-76c3c68ff287-kube-api-access-bbzfb\") pod \"payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h\" (UID: \"28eb973b-49e0-41ae-8eee-76c3c68ff287\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:43:43.357392 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.357178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28eb973b-49e0-41ae-8eee-76c3c68ff287-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h\" (UID: \"28eb973b-49e0-41ae-8eee-76c3c68ff287\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:43:43.458604 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.458564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92fd0661-2373-4901-b1f4-8f05e74fb8c9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2\" (UID: \"92fd0661-2373-4901-b1f4-8f05e74fb8c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:43:43.458785 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.458680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbzfb\" (UniqueName: \"kubernetes.io/projected/28eb973b-49e0-41ae-8eee-76c3c68ff287-kube-api-access-bbzfb\") pod \"payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h\" (UID: \"28eb973b-49e0-41ae-8eee-76c3c68ff287\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:43:43.458785 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.458717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28eb973b-49e0-41ae-8eee-76c3c68ff287-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h\" (UID: \"28eb973b-49e0-41ae-8eee-76c3c68ff287\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:43:43.458785 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.458740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndtsn\" (UniqueName: \"kubernetes.io/projected/92fd0661-2373-4901-b1f4-8f05e74fb8c9-kube-api-access-ndtsn\") pod \"payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2\" (UID: \"92fd0661-2373-4901-b1f4-8f05e74fb8c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:43:43.459476 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.459456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28eb973b-49e0-41ae-8eee-76c3c68ff287-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h\" (UID: \"28eb973b-49e0-41ae-8eee-76c3c68ff287\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:43:43.467731 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.467704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbzfb\" (UniqueName: \"kubernetes.io/projected/28eb973b-49e0-41ae-8eee-76c3c68ff287-kube-api-access-bbzfb\") pod \"payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h\" (UID: \"28eb973b-49e0-41ae-8eee-76c3c68ff287\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:43:43.560084 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.559964    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92fd0661-2373-4901-b1f4-8f05e74fb8c9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2\" (UID: \"92fd0661-2373-4901-b1f4-8f05e74fb8c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:43:43.560242 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.560108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndtsn\" (UniqueName: \"kubernetes.io/projected/92fd0661-2373-4901-b1f4-8f05e74fb8c9-kube-api-access-ndtsn\") pod \"payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2\" (UID: \"92fd0661-2373-4901-b1f4-8f05e74fb8c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:43:43.560742 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.560722    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92fd0661-2373-4901-b1f4-8f05e74fb8c9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2\" (UID: \"92fd0661-2373-4901-b1f4-8f05e74fb8c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:43:43.568135 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.568108    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndtsn\" (UniqueName: \"kubernetes.io/projected/92fd0661-2373-4901-b1f4-8f05e74fb8c9-kube-api-access-ndtsn\") pod \"payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2\" (UID: \"92fd0661-2373-4901-b1f4-8f05e74fb8c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:43:43.573935 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.573913    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:43:43.608146 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.608112    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:43:43.735844 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.735741    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"]
Jul 24 15:43:43.768928 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.768898    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"]
Jul 24 15:43:43.777293 ip-10-0-129-232 kubenswrapper[2582]: W0724 15:43:43.777262    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fd0661_2373_4901_b1f4_8f05e74fb8c9.slice/crio-64382c9f8e8be34d180a9fa9a4965e82c598d968d7efd0261daf2e21d7532cfa WatchSource:0}: Error finding container 64382c9f8e8be34d180a9fa9a4965e82c598d968d7efd0261daf2e21d7532cfa: Status 404 returned error can't find the container with id 64382c9f8e8be34d180a9fa9a4965e82c598d968d7efd0261daf2e21d7532cfa
Jul 24 15:43:43.944309 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.944269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2" event={"ID":"92fd0661-2373-4901-b1f4-8f05e74fb8c9","Type":"ContainerStarted","Data":"371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff"}
Jul 24 15:43:43.944526 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.944338    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:43:43.944526 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.944364    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2" event={"ID":"92fd0661-2373-4901-b1f4-8f05e74fb8c9","Type":"ContainerStarted","Data":"64382c9f8e8be34d180a9fa9a4965e82c598d968d7efd0261daf2e21d7532cfa"}
Jul 24 15:43:43.945868 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.945840    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h" event={"ID":"28eb973b-49e0-41ae-8eee-76c3c68ff287","Type":"ContainerStarted","Data":"0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d"}
Jul 24 15:43:43.945996 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.945890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h" event={"ID":"28eb973b-49e0-41ae-8eee-76c3c68ff287","Type":"ContainerStarted","Data":"5ea7258fda8c95a7b45e3370aff9574c8bfcc475cd2611edbbaec624dabd6adf"}
Jul 24 15:43:43.945996 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.945923    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:43:43.960470 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.960417    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2" podStartSLOduration=0.960401656 podStartE2EDuration="960.401656ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:43:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:43:43.958487316 +0000 UTC m=+2852.497466757" watchObservedRunningTime="2026-07-24 15:43:43.960401656 +0000 UTC m=+2852.499381130"
Jul 24 15:43:43.977106 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:43.977037    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h" podStartSLOduration=0.977020865 podStartE2EDuration="977.020865ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:43:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:43:43.974842341 +0000 UTC m=+2852.513821770" watchObservedRunningTime="2026-07-24 15:43:43.977020865 +0000 UTC m=+2852.516000278"
Jul 24 15:43:54.952956 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:54.952920    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:43:54.953341 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:43:54.953032    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:44:09.573736 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:09.573651    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"]
Jul 24 15:44:09.576409 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:09.573948    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h" podUID="28eb973b-49e0-41ae-8eee-76c3c68ff287" containerName="payload-processing" containerID="cri-o://0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d" gracePeriod=30
Jul 24 15:44:09.578492 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:09.578309    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"]
Jul 24 15:44:09.578641 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:09.578559    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2" podUID="92fd0661-2373-4901-b1f4-8f05e74fb8c9" containerName="payload-pre-processing" containerID="cri-o://371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff" gracePeriod=30
Jul 24 15:44:09.834758 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:09.834691    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:44:09.873097 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:09.873073    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:44:09.916568 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:09.916530    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbzfb\" (UniqueName: \"kubernetes.io/projected/28eb973b-49e0-41ae-8eee-76c3c68ff287-kube-api-access-bbzfb\") pod \"28eb973b-49e0-41ae-8eee-76c3c68ff287\" (UID: \"28eb973b-49e0-41ae-8eee-76c3c68ff287\") "
Jul 24 15:44:09.916751 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:09.916577    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28eb973b-49e0-41ae-8eee-76c3c68ff287-plugins-config-volume\") pod \"28eb973b-49e0-41ae-8eee-76c3c68ff287\" (UID: \"28eb973b-49e0-41ae-8eee-76c3c68ff287\") "
Jul 24 15:44:09.917034 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:09.917010    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28eb973b-49e0-41ae-8eee-76c3c68ff287-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "28eb973b-49e0-41ae-8eee-76c3c68ff287" (UID: "28eb973b-49e0-41ae-8eee-76c3c68ff287"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:44:09.918825 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:09.918799    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28eb973b-49e0-41ae-8eee-76c3c68ff287-kube-api-access-bbzfb" (OuterVolumeSpecName: "kube-api-access-bbzfb") pod "28eb973b-49e0-41ae-8eee-76c3c68ff287" (UID: "28eb973b-49e0-41ae-8eee-76c3c68ff287"). InnerVolumeSpecName "kube-api-access-bbzfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:44:10.018135 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.018101    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92fd0661-2373-4901-b1f4-8f05e74fb8c9-plugins-config-volume\") pod \"92fd0661-2373-4901-b1f4-8f05e74fb8c9\" (UID: \"92fd0661-2373-4901-b1f4-8f05e74fb8c9\") "
Jul 24 15:44:10.018327 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.018183    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndtsn\" (UniqueName: \"kubernetes.io/projected/92fd0661-2373-4901-b1f4-8f05e74fb8c9-kube-api-access-ndtsn\") pod \"92fd0661-2373-4901-b1f4-8f05e74fb8c9\" (UID: \"92fd0661-2373-4901-b1f4-8f05e74fb8c9\") "
Jul 24 15:44:10.018410 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.018359    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbzfb\" (UniqueName: \"kubernetes.io/projected/28eb973b-49e0-41ae-8eee-76c3c68ff287-kube-api-access-bbzfb\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:44:10.018410 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.018370    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28eb973b-49e0-41ae-8eee-76c3c68ff287-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:44:10.018520 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.018488    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92fd0661-2373-4901-b1f4-8f05e74fb8c9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "92fd0661-2373-4901-b1f4-8f05e74fb8c9" (UID: "92fd0661-2373-4901-b1f4-8f05e74fb8c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:44:10.020462 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.020436    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92fd0661-2373-4901-b1f4-8f05e74fb8c9-kube-api-access-ndtsn" (OuterVolumeSpecName: "kube-api-access-ndtsn") pod "92fd0661-2373-4901-b1f4-8f05e74fb8c9" (UID: "92fd0661-2373-4901-b1f4-8f05e74fb8c9"). InnerVolumeSpecName "kube-api-access-ndtsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:44:10.075463 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.075428    2582 generic.go:356] "Generic (PLEG): container finished" podID="92fd0661-2373-4901-b1f4-8f05e74fb8c9" containerID="371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff" exitCode=0
Jul 24 15:44:10.075677 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.075475    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"
Jul 24 15:44:10.075677 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.075507    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2" event={"ID":"92fd0661-2373-4901-b1f4-8f05e74fb8c9","Type":"ContainerDied","Data":"371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff"}
Jul 24 15:44:10.075677 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.075571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2" event={"ID":"92fd0661-2373-4901-b1f4-8f05e74fb8c9","Type":"ContainerDied","Data":"64382c9f8e8be34d180a9fa9a4965e82c598d968d7efd0261daf2e21d7532cfa"}
Jul 24 15:44:10.075677 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.075601    2582 scope.go:117] "RemoveContainer" containerID="371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff"
Jul 24 15:44:10.077118 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.077091    2582 generic.go:356] "Generic (PLEG): container finished" podID="28eb973b-49e0-41ae-8eee-76c3c68ff287" containerID="0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d" exitCode=0
Jul 24 15:44:10.077394 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.077126    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"
Jul 24 15:44:10.077394 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.077126    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h" event={"ID":"28eb973b-49e0-41ae-8eee-76c3c68ff287","Type":"ContainerDied","Data":"0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d"}
Jul 24 15:44:10.077394 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.077178    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h" event={"ID":"28eb973b-49e0-41ae-8eee-76c3c68ff287","Type":"ContainerDied","Data":"5ea7258fda8c95a7b45e3370aff9574c8bfcc475cd2611edbbaec624dabd6adf"}
Jul 24 15:44:10.086277 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.086262    2582 scope.go:117] "RemoveContainer" containerID="371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff"
Jul 24 15:44:10.086545 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:44:10.086530    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff\": container with ID starting with 371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff not found: ID does not exist" containerID="371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff"
Jul 24 15:44:10.086590 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.086554    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff"} err="failed to get container status \"371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff\": rpc error: code = NotFound desc = could not find container \"371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff\": container with ID starting with 371e7fbe530719a794c9819dace0d92633002931771eeb3857b9065c3ca285ff not found: ID does not exist"
Jul 24 15:44:10.086590 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.086568    2582 scope.go:117] "RemoveContainer" containerID="0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d"
Jul 24 15:44:10.095796 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.095763    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"]
Jul 24 15:44:10.096064 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.096014    2582 scope.go:117] "RemoveContainer" containerID="0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d"
Jul 24 15:44:10.096453 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:44:10.096435    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d\": container with ID starting with 0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d not found: ID does not exist" containerID="0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d"
Jul 24 15:44:10.096522 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.096462    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d"} err="failed to get container status \"0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d\": rpc error: code = NotFound desc = could not find container \"0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d\": container with ID starting with 0b23d36520902720ecef42c61bacfabc3e390809f549dea139cf6a347d91088d not found: ID does not exist"
Jul 24 15:44:10.100183 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.100158    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-923368-685dc4bb74-g2q7h"]
Jul 24 15:44:10.111145 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.111116    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"]
Jul 24 15:44:10.115225 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.115192    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-923368-6fbb7975d8-tmdk2"]
Jul 24 15:44:10.119745 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.119719    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92fd0661-2373-4901-b1f4-8f05e74fb8c9-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:44:10.119745 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:10.119743    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndtsn\" (UniqueName: \"kubernetes.io/projected/92fd0661-2373-4901-b1f4-8f05e74fb8c9-kube-api-access-ndtsn\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:44:11.996502 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:11.996458    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28eb973b-49e0-41ae-8eee-76c3c68ff287" path="/var/lib/kubelet/pods/28eb973b-49e0-41ae-8eee-76c3c68ff287/volumes"
Jul 24 15:44:11.996869 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:11.996826    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92fd0661-2373-4901-b1f4-8f05e74fb8c9" path="/var/lib/kubelet/pods/92fd0661-2373-4901-b1f4-8f05e74fb8c9/volumes"
Jul 24 15:44:42.141499 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.141455    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"]
Jul 24 15:44:42.142125 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.141714    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz" podUID="64a2d499-d1b0-4cdb-acb4-ff952c2eed6c" containerName="payload-processing" containerID="cri-o://3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f" gracePeriod=30
Jul 24 15:44:42.145319 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.145288    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"]
Jul 24 15:44:42.145948 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.145596    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k" podUID="de85063a-ac89-4caa-9c1e-3f3bc661b680" containerName="payload-pre-processing" containerID="cri-o://0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e" gracePeriod=30
Jul 24 15:44:42.407627 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.407547    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:44:42.435787 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.435759    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:44:42.525373 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.525338    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgkj7\" (UniqueName: \"kubernetes.io/projected/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-kube-api-access-pgkj7\") pod \"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c\" (UID: \"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c\") "
Jul 24 15:44:42.525556 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.525405    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de85063a-ac89-4caa-9c1e-3f3bc661b680-plugins-config-volume\") pod \"de85063a-ac89-4caa-9c1e-3f3bc661b680\" (UID: \"de85063a-ac89-4caa-9c1e-3f3bc661b680\") "
Jul 24 15:44:42.525556 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.525471    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcm98\" (UniqueName: \"kubernetes.io/projected/de85063a-ac89-4caa-9c1e-3f3bc661b680-kube-api-access-jcm98\") pod \"de85063a-ac89-4caa-9c1e-3f3bc661b680\" (UID: \"de85063a-ac89-4caa-9c1e-3f3bc661b680\") "
Jul 24 15:44:42.525556 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.525489    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-plugins-config-volume\") pod \"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c\" (UID: \"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c\") "
Jul 24 15:44:42.525788 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.525763    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de85063a-ac89-4caa-9c1e-3f3bc661b680-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de85063a-ac89-4caa-9c1e-3f3bc661b680" (UID: "de85063a-ac89-4caa-9c1e-3f3bc661b680"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:44:42.526022 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.525961    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64a2d499-d1b0-4cdb-acb4-ff952c2eed6c" (UID: "64a2d499-d1b0-4cdb-acb4-ff952c2eed6c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:44:42.528242 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.528220    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de85063a-ac89-4caa-9c1e-3f3bc661b680-kube-api-access-jcm98" (OuterVolumeSpecName: "kube-api-access-jcm98") pod "de85063a-ac89-4caa-9c1e-3f3bc661b680" (UID: "de85063a-ac89-4caa-9c1e-3f3bc661b680"). InnerVolumeSpecName "kube-api-access-jcm98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:44:42.528242 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.528226    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-kube-api-access-pgkj7" (OuterVolumeSpecName: "kube-api-access-pgkj7") pod "64a2d499-d1b0-4cdb-acb4-ff952c2eed6c" (UID: "64a2d499-d1b0-4cdb-acb4-ff952c2eed6c"). InnerVolumeSpecName "kube-api-access-pgkj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:44:42.626279 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.626239    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de85063a-ac89-4caa-9c1e-3f3bc661b680-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:44:42.626279 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.626279    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcm98\" (UniqueName: \"kubernetes.io/projected/de85063a-ac89-4caa-9c1e-3f3bc661b680-kube-api-access-jcm98\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:44:42.626513 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.626294    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:44:42.626513 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:42.626309    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgkj7\" (UniqueName: \"kubernetes.io/projected/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c-kube-api-access-pgkj7\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:44:43.242639 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.242607    2582 generic.go:356] "Generic (PLEG): container finished" podID="64a2d499-d1b0-4cdb-acb4-ff952c2eed6c" containerID="3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f" exitCode=0
Jul 24 15:44:43.243147 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.242653    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"
Jul 24 15:44:43.243147 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.242689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz" event={"ID":"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c","Type":"ContainerDied","Data":"3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f"}
Jul 24 15:44:43.243147 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.242740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz" event={"ID":"64a2d499-d1b0-4cdb-acb4-ff952c2eed6c","Type":"ContainerDied","Data":"1234002f49eb9f85c8e7cde3b85966599fdd4ecd11cb1b52163a85cb060d1fe3"}
Jul 24 15:44:43.243147 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.242762    2582 scope.go:117] "RemoveContainer" containerID="3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f"
Jul 24 15:44:43.244105 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.244084    2582 generic.go:356] "Generic (PLEG): container finished" podID="de85063a-ac89-4caa-9c1e-3f3bc661b680" containerID="0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e" exitCode=0
Jul 24 15:44:43.244184 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.244127    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"
Jul 24 15:44:43.244184 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.244165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k" event={"ID":"de85063a-ac89-4caa-9c1e-3f3bc661b680","Type":"ContainerDied","Data":"0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e"}
Jul 24 15:44:43.244409 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.244327    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k" event={"ID":"de85063a-ac89-4caa-9c1e-3f3bc661b680","Type":"ContainerDied","Data":"a4aa65cf6cf5f1c1707878536b2e8c1e1c7a593804541efdfb3379ba7cf81592"}
Jul 24 15:44:43.252015 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.251959    2582 scope.go:117] "RemoveContainer" containerID="3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f"
Jul 24 15:44:43.252307 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:44:43.252286    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f\": container with ID starting with 3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f not found: ID does not exist" containerID="3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f"
Jul 24 15:44:43.252409 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.252315    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f"} err="failed to get container status \"3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f\": rpc error: code = NotFound desc = could not find container \"3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f\": container with ID starting with 3df1eea18f8b09a8bc953b35342b652507dfc64b1e72b1699259469cf828503f not found: ID does not exist"
Jul 24 15:44:43.252409 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.252332    2582 scope.go:117] "RemoveContainer" containerID="0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e"
Jul 24 15:44:43.260461 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.260441    2582 scope.go:117] "RemoveContainer" containerID="0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e"
Jul 24 15:44:43.260720 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:44:43.260703    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e\": container with ID starting with 0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e not found: ID does not exist" containerID="0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e"
Jul 24 15:44:43.260766 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.260728    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e"} err="failed to get container status \"0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e\": rpc error: code = NotFound desc = could not find container \"0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e\": container with ID starting with 0127295094aa319a1e68491423e3e4c3f3faf815e50a9824ce66d3f1fc71908e not found: ID does not exist"
Jul 24 15:44:43.265356 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.265332    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"]
Jul 24 15:44:43.268786 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.268766    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd9c98-585b8cdd7d-qvzvz"]
Jul 24 15:44:43.280244 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.280203    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"]
Jul 24 15:44:43.282186 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.282164    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd9c98-788468db68-k987k"]
Jul 24 15:44:43.996869 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.996825    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a2d499-d1b0-4cdb-acb4-ff952c2eed6c" path="/var/lib/kubelet/pods/64a2d499-d1b0-4cdb-acb4-ff952c2eed6c/volumes"
Jul 24 15:44:43.997372 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:43.997353    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de85063a-ac89-4caa-9c1e-3f3bc661b680" path="/var/lib/kubelet/pods/de85063a-ac89-4caa-9c1e-3f3bc661b680/volumes"
Jul 24 15:44:52.252086 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:44:52.252046    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"]
Jul 24 15:45:07.272112 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.272069    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6" podUID="8f657646-6af7-4bef-b5fb-706c27171d69" containerName="main" containerID="cri-o://b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e" gracePeriod=45
Jul 24 15:45:07.523225 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.523155    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:45:07.658711 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.658681    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-dshm\") pod \"8f657646-6af7-4bef-b5fb-706c27171d69\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") "
Jul 24 15:45:07.658908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.658731    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mghkx\" (UniqueName: \"kubernetes.io/projected/8f657646-6af7-4bef-b5fb-706c27171d69-kube-api-access-mghkx\") pod \"8f657646-6af7-4bef-b5fb-706c27171d69\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") "
Jul 24 15:45:07.658908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.658782    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f657646-6af7-4bef-b5fb-706c27171d69-tls-certs\") pod \"8f657646-6af7-4bef-b5fb-706c27171d69\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") "
Jul 24 15:45:07.658908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.658800    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-home\") pod \"8f657646-6af7-4bef-b5fb-706c27171d69\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") "
Jul 24 15:45:07.658908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.658871    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-model-cache\") pod \"8f657646-6af7-4bef-b5fb-706c27171d69\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") "
Jul 24 15:45:07.658908 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.658897    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-tmp-dir\") pod \"8f657646-6af7-4bef-b5fb-706c27171d69\" (UID: \"8f657646-6af7-4bef-b5fb-706c27171d69\") "
Jul 24 15:45:07.659237 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.659197    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-model-cache" (OuterVolumeSpecName: "model-cache") pod "8f657646-6af7-4bef-b5fb-706c27171d69" (UID: "8f657646-6af7-4bef-b5fb-706c27171d69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:45:07.659298 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.659207    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-home" (OuterVolumeSpecName: "home") pod "8f657646-6af7-4bef-b5fb-706c27171d69" (UID: "8f657646-6af7-4bef-b5fb-706c27171d69"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:45:07.659298 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.659273    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8f657646-6af7-4bef-b5fb-706c27171d69" (UID: "8f657646-6af7-4bef-b5fb-706c27171d69"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:45:07.661340 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.661313    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-dshm" (OuterVolumeSpecName: "dshm") pod "8f657646-6af7-4bef-b5fb-706c27171d69" (UID: "8f657646-6af7-4bef-b5fb-706c27171d69"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:45:07.661340 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.661330    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f657646-6af7-4bef-b5fb-706c27171d69-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8f657646-6af7-4bef-b5fb-706c27171d69" (UID: "8f657646-6af7-4bef-b5fb-706c27171d69"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:45:07.661477 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.661335    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f657646-6af7-4bef-b5fb-706c27171d69-kube-api-access-mghkx" (OuterVolumeSpecName: "kube-api-access-mghkx") pod "8f657646-6af7-4bef-b5fb-706c27171d69" (UID: "8f657646-6af7-4bef-b5fb-706c27171d69"). InnerVolumeSpecName "kube-api-access-mghkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:45:07.759721 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.759684    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-dshm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:45:07.759721 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.759715    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mghkx\" (UniqueName: \"kubernetes.io/projected/8f657646-6af7-4bef-b5fb-706c27171d69-kube-api-access-mghkx\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:45:07.759721 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.759727    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f657646-6af7-4bef-b5fb-706c27171d69-tls-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:45:07.759946 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.759735    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-home\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:45:07.759946 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.759743    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-model-cache\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:45:07.759946 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:07.759751    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f657646-6af7-4bef-b5fb-706c27171d69-tmp-dir\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:45:08.365052 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:08.364951    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f657646-6af7-4bef-b5fb-706c27171d69" containerID="b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e" exitCode=0
Jul 24 15:45:08.365052 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:08.365017    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"
Jul 24 15:45:08.365052 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:08.365035    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6" event={"ID":"8f657646-6af7-4bef-b5fb-706c27171d69","Type":"ContainerDied","Data":"b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e"}
Jul 24 15:45:08.365650 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:08.365080    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6" event={"ID":"8f657646-6af7-4bef-b5fb-706c27171d69","Type":"ContainerDied","Data":"0e2a15f6f062fa063816c8b0bdb33141ecafb6c52fbda2c2cc024eb6117b4c31"}
Jul 24 15:45:08.365650 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:08.365098    2582 scope.go:117] "RemoveContainer" containerID="b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e"
Jul 24 15:45:08.374168 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:08.374148    2582 scope.go:117] "RemoveContainer" containerID="b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e"
Jul 24 15:45:08.374464 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:45:08.374440    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e\": container with ID starting with b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e not found: ID does not exist" containerID="b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e"
Jul 24 15:45:08.374515 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:08.374477    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e"} err="failed to get container status \"b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e\": rpc error: code = NotFound desc = could not find container \"b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e\": container with ID starting with b994294db07b327c06504906008ca4801a659f2d36c5244e1f2d81539536877e not found: ID does not exist"
Jul 24 15:45:08.382101 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:08.382074    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"]
Jul 24 15:45:08.385443 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:08.385417    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-cd9c98/ipp-route-cd9c98-kserve-79c95dff47-592c6"]
Jul 24 15:45:09.997265 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:45:09.997224    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f657646-6af7-4bef-b5fb-706c27171d69" path="/var/lib/kubelet/pods/8f657646-6af7-4bef-b5fb-706c27171d69/volumes"
Jul 24 15:46:03.948883 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:03.948846    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"]
Jul 24 15:46:03.949493 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:03.949147    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p" podUID="b201eba2-39bf-4325-8b53-64d8976c1173" containerName="payload-processing" containerID="cri-o://7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919" gracePeriod=30
Jul 24 15:46:03.955967 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:03.955934    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"]
Jul 24 15:46:03.956230 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:03.956180    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft" podUID="abb8f638-8f54-487b-8d10-f7d919dd383c" containerName="payload-pre-processing" containerID="cri-o://e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c" gracePeriod=30
Jul 24 15:46:04.240899 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.240869    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:46:04.244162 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.244133    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:46:04.370631 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.370594    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b201eba2-39bf-4325-8b53-64d8976c1173-plugins-config-volume\") pod \"b201eba2-39bf-4325-8b53-64d8976c1173\" (UID: \"b201eba2-39bf-4325-8b53-64d8976c1173\") "
Jul 24 15:46:04.370631 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.370639    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s58gx\" (UniqueName: \"kubernetes.io/projected/abb8f638-8f54-487b-8d10-f7d919dd383c-kube-api-access-s58gx\") pod \"abb8f638-8f54-487b-8d10-f7d919dd383c\" (UID: \"abb8f638-8f54-487b-8d10-f7d919dd383c\") "
Jul 24 15:46:04.370862 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.370656    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abb8f638-8f54-487b-8d10-f7d919dd383c-plugins-config-volume\") pod \"abb8f638-8f54-487b-8d10-f7d919dd383c\" (UID: \"abb8f638-8f54-487b-8d10-f7d919dd383c\") "
Jul 24 15:46:04.370862 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.370763    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnd8z\" (UniqueName: \"kubernetes.io/projected/b201eba2-39bf-4325-8b53-64d8976c1173-kube-api-access-jnd8z\") pod \"b201eba2-39bf-4325-8b53-64d8976c1173\" (UID: \"b201eba2-39bf-4325-8b53-64d8976c1173\") "
Jul 24 15:46:04.371092 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.371065    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b201eba2-39bf-4325-8b53-64d8976c1173-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b201eba2-39bf-4325-8b53-64d8976c1173" (UID: "b201eba2-39bf-4325-8b53-64d8976c1173"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:46:04.371166 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.371067    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb8f638-8f54-487b-8d10-f7d919dd383c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "abb8f638-8f54-487b-8d10-f7d919dd383c" (UID: "abb8f638-8f54-487b-8d10-f7d919dd383c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:46:04.373033 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.373008    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb8f638-8f54-487b-8d10-f7d919dd383c-kube-api-access-s58gx" (OuterVolumeSpecName: "kube-api-access-s58gx") pod "abb8f638-8f54-487b-8d10-f7d919dd383c" (UID: "abb8f638-8f54-487b-8d10-f7d919dd383c"). InnerVolumeSpecName "kube-api-access-s58gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:46:04.373124 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.373045    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b201eba2-39bf-4325-8b53-64d8976c1173-kube-api-access-jnd8z" (OuterVolumeSpecName: "kube-api-access-jnd8z") pod "b201eba2-39bf-4325-8b53-64d8976c1173" (UID: "b201eba2-39bf-4325-8b53-64d8976c1173"). InnerVolumeSpecName "kube-api-access-jnd8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:46:04.471859 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.471765    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b201eba2-39bf-4325-8b53-64d8976c1173-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:04.471859 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.471798    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s58gx\" (UniqueName: \"kubernetes.io/projected/abb8f638-8f54-487b-8d10-f7d919dd383c-kube-api-access-s58gx\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:04.471859 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.471811    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abb8f638-8f54-487b-8d10-f7d919dd383c-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:04.471859 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.471823    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnd8z\" (UniqueName: \"kubernetes.io/projected/b201eba2-39bf-4325-8b53-64d8976c1173-kube-api-access-jnd8z\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:04.628932 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.628897    2582 generic.go:356] "Generic (PLEG): container finished" podID="b201eba2-39bf-4325-8b53-64d8976c1173" containerID="7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919" exitCode=0
Jul 24 15:46:04.629159 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.628946    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"
Jul 24 15:46:04.629159 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.629011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p" event={"ID":"b201eba2-39bf-4325-8b53-64d8976c1173","Type":"ContainerDied","Data":"7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919"}
Jul 24 15:46:04.629159 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.629067    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p" event={"ID":"b201eba2-39bf-4325-8b53-64d8976c1173","Type":"ContainerDied","Data":"ef5ac20f57fbd3c61a0b2e83f8eddd8fa3337eee1d778e91b3b0748eaa216dbf"}
Jul 24 15:46:04.629159 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.629094    2582 scope.go:117] "RemoveContainer" containerID="7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919"
Jul 24 15:46:04.630396 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.630374    2582 generic.go:356] "Generic (PLEG): container finished" podID="abb8f638-8f54-487b-8d10-f7d919dd383c" containerID="e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c" exitCode=0
Jul 24 15:46:04.630521 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.630418    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft" event={"ID":"abb8f638-8f54-487b-8d10-f7d919dd383c","Type":"ContainerDied","Data":"e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c"}
Jul 24 15:46:04.630521 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.630429    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"
Jul 24 15:46:04.630521 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.630463    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft" event={"ID":"abb8f638-8f54-487b-8d10-f7d919dd383c","Type":"ContainerDied","Data":"8d3ce50bf88b50060c53d2a8bd46a19556e32542d398ec0345cfba262d975d77"}
Jul 24 15:46:04.638953 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.638839    2582 scope.go:117] "RemoveContainer" containerID="7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919"
Jul 24 15:46:04.639234 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:46:04.639197    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919\": container with ID starting with 7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919 not found: ID does not exist" containerID="7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919"
Jul 24 15:46:04.639295 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.639243    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919"} err="failed to get container status \"7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919\": rpc error: code = NotFound desc = could not find container \"7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919\": container with ID starting with 7fad9ebd340e33ad95043f3a677768a37ecac84ebb4997db78e90b641098b919 not found: ID does not exist"
Jul 24 15:46:04.639295 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.639259    2582 scope.go:117] "RemoveContainer" containerID="e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c"
Jul 24 15:46:04.649210 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.649180    2582 scope.go:117] "RemoveContainer" containerID="e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c"
Jul 24 15:46:04.649643 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:46:04.649619    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c\": container with ID starting with e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c not found: ID does not exist" containerID="e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c"
Jul 24 15:46:04.649746 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.649646    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c"} err="failed to get container status \"e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c\": rpc error: code = NotFound desc = could not find container \"e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c\": container with ID starting with e8f869f1c0eea505836bfba222799e8f7b858c0aeb215861a25c45480231099c not found: ID does not exist"
Jul 24 15:46:04.654253 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.654230    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"]
Jul 24 15:46:04.661406 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.661384    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-053e45-55b4c94c96-h4dft"]
Jul 24 15:46:04.672205 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.672178    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"]
Jul 24 15:46:04.675775 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:04.675751    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-053e45-6bd96c64b8-mmx8p"]
Jul 24 15:46:05.996325 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:05.996292    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb8f638-8f54-487b-8d10-f7d919dd383c" path="/var/lib/kubelet/pods/abb8f638-8f54-487b-8d10-f7d919dd383c/volumes"
Jul 24 15:46:05.996680 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:05.996632    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b201eba2-39bf-4325-8b53-64d8976c1173" path="/var/lib/kubelet/pods/b201eba2-39bf-4325-8b53-64d8976c1173/volumes"
Jul 24 15:46:12.112135 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:12.112108    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:46:12.115774 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:12.115749    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2lgp_9d3ae5e2-fd86-4efd-99df-ceb14a5c870b/ovn-acl-logging/0.log"
Jul 24 15:46:25.779246 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:25.779207    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"]
Jul 24 15:46:25.779726 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:25.779473    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k" podUID="db33a6dd-6270-4070-8ac2-c67f811e9d95" containerName="payload-processing" containerID="cri-o://58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd" gracePeriod=30
Jul 24 15:46:25.783211 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:25.783179    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"]
Jul 24 15:46:25.783587 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:25.783409    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494" podUID="0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68" containerName="payload-pre-processing" containerID="cri-o://c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c" gracePeriod=30
Jul 24 15:46:26.055936 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.055908    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:46:26.075559 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.075530    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:46:26.168324 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.168277    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-plugins-config-volume\") pod \"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68\" (UID: \"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68\") "
Jul 24 15:46:26.168514 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.168344    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4fcb\" (UniqueName: \"kubernetes.io/projected/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-kube-api-access-r4fcb\") pod \"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68\" (UID: \"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68\") "
Jul 24 15:46:26.168514 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.168372    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p74m\" (UniqueName: \"kubernetes.io/projected/db33a6dd-6270-4070-8ac2-c67f811e9d95-kube-api-access-2p74m\") pod \"db33a6dd-6270-4070-8ac2-c67f811e9d95\" (UID: \"db33a6dd-6270-4070-8ac2-c67f811e9d95\") "
Jul 24 15:46:26.168514 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.168391    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db33a6dd-6270-4070-8ac2-c67f811e9d95-plugins-config-volume\") pod \"db33a6dd-6270-4070-8ac2-c67f811e9d95\" (UID: \"db33a6dd-6270-4070-8ac2-c67f811e9d95\") "
Jul 24 15:46:26.168820 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.168794    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68" (UID: "0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:46:26.168820 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.168803    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db33a6dd-6270-4070-8ac2-c67f811e9d95-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "db33a6dd-6270-4070-8ac2-c67f811e9d95" (UID: "db33a6dd-6270-4070-8ac2-c67f811e9d95"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:46:26.170656 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.170631    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-kube-api-access-r4fcb" (OuterVolumeSpecName: "kube-api-access-r4fcb") pod "0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68" (UID: "0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68"). InnerVolumeSpecName "kube-api-access-r4fcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:46:26.170656 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.170638    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db33a6dd-6270-4070-8ac2-c67f811e9d95-kube-api-access-2p74m" (OuterVolumeSpecName: "kube-api-access-2p74m") pod "db33a6dd-6270-4070-8ac2-c67f811e9d95" (UID: "db33a6dd-6270-4070-8ac2-c67f811e9d95"). InnerVolumeSpecName "kube-api-access-2p74m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:46:26.269205 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.269153    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4fcb\" (UniqueName: \"kubernetes.io/projected/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-kube-api-access-r4fcb\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:26.269205 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.269201    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p74m\" (UniqueName: \"kubernetes.io/projected/db33a6dd-6270-4070-8ac2-c67f811e9d95-kube-api-access-2p74m\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:26.269205 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.269211    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db33a6dd-6270-4070-8ac2-c67f811e9d95-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:26.269205 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.269219    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:26.732325 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.732291    2582 generic.go:356] "Generic (PLEG): container finished" podID="db33a6dd-6270-4070-8ac2-c67f811e9d95" containerID="58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd" exitCode=0
Jul 24 15:46:26.732525 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.732341    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"
Jul 24 15:46:26.732525 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.732382    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k" event={"ID":"db33a6dd-6270-4070-8ac2-c67f811e9d95","Type":"ContainerDied","Data":"58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd"}
Jul 24 15:46:26.732525 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.732440    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k" event={"ID":"db33a6dd-6270-4070-8ac2-c67f811e9d95","Type":"ContainerDied","Data":"31b852406f58a3e14248013fabdf1a29999790f3334056b63296bcc6f13ac09c"}
Jul 24 15:46:26.732525 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.732463    2582 scope.go:117] "RemoveContainer" containerID="58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd"
Jul 24 15:46:26.733807 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.733782    2582 generic.go:356] "Generic (PLEG): container finished" podID="0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68" containerID="c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c" exitCode=0
Jul 24 15:46:26.733945 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.733818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494" event={"ID":"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68","Type":"ContainerDied","Data":"c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c"}
Jul 24 15:46:26.733945 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.733860    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494" event={"ID":"0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68","Type":"ContainerDied","Data":"a656910d73b5816bb5a639f503f1eba35c4b54b5a41d8a3fb3ec86e538d0564f"}
Jul 24 15:46:26.733945 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.733896    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"
Jul 24 15:46:26.744142 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.744114    2582 scope.go:117] "RemoveContainer" containerID="58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd"
Jul 24 15:46:26.744609 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:46:26.744546    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd\": container with ID starting with 58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd not found: ID does not exist" containerID="58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd"
Jul 24 15:46:26.744609 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.744571    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd"} err="failed to get container status \"58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd\": rpc error: code = NotFound desc = could not find container \"58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd\": container with ID starting with 58895fe41dfc0cd063fcd6c8ae8255ca01fb8d86b26900d7d3a2e950e9d7d7dd not found: ID does not exist"
Jul 24 15:46:26.744609 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.744591    2582 scope.go:117] "RemoveContainer" containerID="c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c"
Jul 24 15:46:26.754886 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.754865    2582 scope.go:117] "RemoveContainer" containerID="c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c"
Jul 24 15:46:26.755263 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:46:26.755241    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c\": container with ID starting with c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c not found: ID does not exist" containerID="c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c"
Jul 24 15:46:26.755337 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.755271    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c"} err="failed to get container status \"c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c\": rpc error: code = NotFound desc = could not find container \"c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c\": container with ID starting with c1af85f4df88259f87036e70bdf436d60027fd090f5a3529ee4e1850962c785c not found: ID does not exist"
Jul 24 15:46:26.759589 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.759552    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"]
Jul 24 15:46:26.761852 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.761829    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d419ce-84ff4b97bb-gxv6k"]
Jul 24 15:46:26.771715 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.771684    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"]
Jul 24 15:46:26.775157 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:26.775133    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-d419ce-697b7568b4-v2494"]
Jul 24 15:46:27.995464 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:27.995423    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68" path="/var/lib/kubelet/pods/0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68/volumes"
Jul 24 15:46:27.996032 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:27.995944    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db33a6dd-6270-4070-8ac2-c67f811e9d95" path="/var/lib/kubelet/pods/db33a6dd-6270-4070-8ac2-c67f811e9d95/volumes"
Jul 24 15:46:46.439956 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.439919    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"]
Jul 24 15:46:46.440592 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.440156    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5" podUID="bc4c501c-4939-46b7-ba07-1d1652831f47" containerName="payload-processing" containerID="cri-o://aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc" gracePeriod=30
Jul 24 15:46:46.448050 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.447806    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"]
Jul 24 15:46:46.448145 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.448075    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv" podUID="87f1c6ab-f786-4c80-bca3-4c7277af6f1a" containerName="payload-pre-processing" containerID="cri-o://ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31" gracePeriod=30
Jul 24 15:46:46.696427 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.696360    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:46:46.725485 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.725458    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:46:46.835041 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.835005    2582 generic.go:356] "Generic (PLEG): container finished" podID="bc4c501c-4939-46b7-ba07-1d1652831f47" containerID="aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc" exitCode=0
Jul 24 15:46:46.835234 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.835047    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"
Jul 24 15:46:46.835234 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.835095    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5" event={"ID":"bc4c501c-4939-46b7-ba07-1d1652831f47","Type":"ContainerDied","Data":"aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc"}
Jul 24 15:46:46.835234 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.835152    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5" event={"ID":"bc4c501c-4939-46b7-ba07-1d1652831f47","Type":"ContainerDied","Data":"8d9482da7cf366d7e79bc3f9edb95d3f1b3b07d21f5a49bbb62d9858e70b54fa"}
Jul 24 15:46:46.835234 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.835183    2582 scope.go:117] "RemoveContainer" containerID="aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc"
Jul 24 15:46:46.836395 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.836373    2582 generic.go:356] "Generic (PLEG): container finished" podID="87f1c6ab-f786-4c80-bca3-4c7277af6f1a" containerID="ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31" exitCode=0
Jul 24 15:46:46.836479 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.836424    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"
Jul 24 15:46:46.836479 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.836453    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv" event={"ID":"87f1c6ab-f786-4c80-bca3-4c7277af6f1a","Type":"ContainerDied","Data":"ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31"}
Jul 24 15:46:46.836567 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.836504    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv" event={"ID":"87f1c6ab-f786-4c80-bca3-4c7277af6f1a","Type":"ContainerDied","Data":"c65001d5bb47271ba7e4e113d483cfa262d1516a41f1cf1c38ce7e92816db43b"}
Jul 24 15:46:46.843666 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.843645    2582 scope.go:117] "RemoveContainer" containerID="aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc"
Jul 24 15:46:46.843945 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:46:46.843929    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc\": container with ID starting with aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc not found: ID does not exist" containerID="aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc"
Jul 24 15:46:46.844032 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.843955    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc"} err="failed to get container status \"aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc\": rpc error: code = NotFound desc = could not find container \"aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc\": container with ID starting with aa07b377a3982f7876fe7e08088920af70da7530a2a2f7ea6395f3f710b0a6bc not found: ID does not exist"
Jul 24 15:46:46.844032 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.843972    2582 scope.go:117] "RemoveContainer" containerID="ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31"
Jul 24 15:46:46.851753 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.851730    2582 scope.go:117] "RemoveContainer" containerID="ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31"
Jul 24 15:46:46.851959 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.851937    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc4c501c-4939-46b7-ba07-1d1652831f47-plugins-config-volume\") pod \"bc4c501c-4939-46b7-ba07-1d1652831f47\" (UID: \"bc4c501c-4939-46b7-ba07-1d1652831f47\") "
Jul 24 15:46:46.852167 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.852005    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh249\" (UniqueName: \"kubernetes.io/projected/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-kube-api-access-sh249\") pod \"87f1c6ab-f786-4c80-bca3-4c7277af6f1a\" (UID: \"87f1c6ab-f786-4c80-bca3-4c7277af6f1a\") "
Jul 24 15:46:46.852167 ip-10-0-129-232 kubenswrapper[2582]: E0724 15:46:46.852042    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31\": container with ID starting with ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31 not found: ID does not exist" containerID="ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31"
Jul 24 15:46:46.852167 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.852069    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31"} err="failed to get container status \"ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31\": rpc error: code = NotFound desc = could not find container \"ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31\": container with ID starting with ea26d9547c9642a77fc8c927a7f36396f3c97b534f39aae949662b79bfc53c31 not found: ID does not exist"
Jul 24 15:46:46.852167 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.852101    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-plugins-config-volume\") pod \"87f1c6ab-f786-4c80-bca3-4c7277af6f1a\" (UID: \"87f1c6ab-f786-4c80-bca3-4c7277af6f1a\") "
Jul 24 15:46:46.852167 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.852146    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkxg7\" (UniqueName: \"kubernetes.io/projected/bc4c501c-4939-46b7-ba07-1d1652831f47-kube-api-access-vkxg7\") pod \"bc4c501c-4939-46b7-ba07-1d1652831f47\" (UID: \"bc4c501c-4939-46b7-ba07-1d1652831f47\") "
Jul 24 15:46:46.852442 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.852363    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc4c501c-4939-46b7-ba07-1d1652831f47-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc4c501c-4939-46b7-ba07-1d1652831f47" (UID: "bc4c501c-4939-46b7-ba07-1d1652831f47"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:46:46.852442 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.852401    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "87f1c6ab-f786-4c80-bca3-4c7277af6f1a" (UID: "87f1c6ab-f786-4c80-bca3-4c7277af6f1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:46:46.852700 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.852681    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc4c501c-4939-46b7-ba07-1d1652831f47-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:46.852700 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.852701    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-plugins-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:46.854137 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.854117    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-kube-api-access-sh249" (OuterVolumeSpecName: "kube-api-access-sh249") pod "87f1c6ab-f786-4c80-bca3-4c7277af6f1a" (UID: "87f1c6ab-f786-4c80-bca3-4c7277af6f1a"). InnerVolumeSpecName "kube-api-access-sh249". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:46:46.854234 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.854217    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc4c501c-4939-46b7-ba07-1d1652831f47-kube-api-access-vkxg7" (OuterVolumeSpecName: "kube-api-access-vkxg7") pod "bc4c501c-4939-46b7-ba07-1d1652831f47" (UID: "bc4c501c-4939-46b7-ba07-1d1652831f47"). InnerVolumeSpecName "kube-api-access-vkxg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:46:46.953550 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.953448    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh249\" (UniqueName: \"kubernetes.io/projected/87f1c6ab-f786-4c80-bca3-4c7277af6f1a-kube-api-access-sh249\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:46.953550 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:46.953492    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkxg7\" (UniqueName: \"kubernetes.io/projected/bc4c501c-4939-46b7-ba07-1d1652831f47-kube-api-access-vkxg7\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\""
Jul 24 15:46:47.157140 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:47.157114    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"]
Jul 24 15:46:47.163663 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:47.163636    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6b942c-5886f9d966-bp5k5"]
Jul 24 15:46:47.175695 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:47.175650    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"]
Jul 24 15:46:47.177766 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:47.177743    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6b942c-6854589c68-bmttv"]
Jul 24 15:46:47.995830 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:47.995795    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f1c6ab-f786-4c80-bca3-4c7277af6f1a" path="/var/lib/kubelet/pods/87f1c6ab-f786-4c80-bca3-4c7277af6f1a/volumes"
Jul 24 15:46:47.996229 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:46:47.996183    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc4c501c-4939-46b7-ba07-1d1652831f47" path="/var/lib/kubelet/pods/bc4c501c-4939-46b7-ba07-1d1652831f47/volumes"
Jul 24 15:47:05.040259 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:05.040185    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5584866b-7qmsk_d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058/manager/0.log"
Jul 24 15:47:05.053210 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:05.053186    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5584866b-7qmsk_d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058/copy-manifests/0.log"
Jul 24 15:47:07.824869 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:07.824837    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dmxcn_8d9f354c-c4dc-42cc-9f65-7d807ca25ba1/kuadrant-console-plugin/0.log"
Jul 24 15:47:08.087285 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:08.087200    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hq4zw_f8354129-b663-4300-9bdc-197a9098a1e6/manager/0.log"
Jul 24 15:47:08.964237 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:08.964204    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-758f749c7-5pcrd_c4774c15-31fd-4936-856e-65bfa0e44b18/kube-auth-proxy/0.log"
Jul 24 15:47:09.330397 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:09.330313    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-9mdkt_88141022-ed92-4da7-ae77-8c7e5830fd54/payload-pre-processing/0.log"
Jul 24 15:47:10.203266 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:10.203240    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9fnxl_e4182a75-1271-41e5-a8cf-dfd1ff9897c4/main/0.log"
Jul 24 15:47:10.445934 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:10.445903    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-g84gg_bcb41182-209d-4627-a4f5-d559cfd4920f/main/0.log"
Jul 24 15:47:10.565755 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:10.565682    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-gnxrs_442dcffb-3d56-4d1e-a6ef-1c99133fa969/main/0.log"
Jul 24 15:47:16.111992 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.111951    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fd7vt/must-gather-vfpft"]
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112285    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f1c6ab-f786-4c80-bca3-4c7277af6f1a" containerName="payload-pre-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112297    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f1c6ab-f786-4c80-bca3-4c7277af6f1a" containerName="payload-pre-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112308    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92fd0661-2373-4901-b1f4-8f05e74fb8c9" containerName="payload-pre-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112313    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="92fd0661-2373-4901-b1f4-8f05e74fb8c9" containerName="payload-pre-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112322    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db33a6dd-6270-4070-8ac2-c67f811e9d95" containerName="payload-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112328    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="db33a6dd-6270-4070-8ac2-c67f811e9d95" containerName="payload-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112335    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b201eba2-39bf-4325-8b53-64d8976c1173" containerName="payload-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112341    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b201eba2-39bf-4325-8b53-64d8976c1173" containerName="payload-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112349    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4c501c-4939-46b7-ba07-1d1652831f47" containerName="payload-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112354    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4c501c-4939-46b7-ba07-1d1652831f47" containerName="payload-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112360    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de85063a-ac89-4caa-9c1e-3f3bc661b680" containerName="payload-pre-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112365    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="de85063a-ac89-4caa-9c1e-3f3bc661b680" containerName="payload-pre-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112372    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb8f638-8f54-487b-8d10-f7d919dd383c" containerName="payload-pre-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112376    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb8f638-8f54-487b-8d10-f7d919dd383c" containerName="payload-pre-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112383    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a2d499-d1b0-4cdb-acb4-ff952c2eed6c" containerName="payload-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112388    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a2d499-d1b0-4cdb-acb4-ff952c2eed6c" containerName="payload-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112394    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28eb973b-49e0-41ae-8eee-76c3c68ff287" containerName="payload-processing"
Jul 24 15:47:16.112388 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112399    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="28eb973b-49e0-41ae-8eee-76c3c68ff287" containerName="payload-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112405    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f657646-6af7-4bef-b5fb-706c27171d69" containerName="main"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112410    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f657646-6af7-4bef-b5fb-706c27171d69" containerName="main"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112418    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68" containerName="payload-pre-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112423    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68" containerName="payload-pre-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112467    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a2d499-d1b0-4cdb-acb4-ff952c2eed6c" containerName="payload-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112475    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f657646-6af7-4bef-b5fb-706c27171d69" containerName="main"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112480    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="de85063a-ac89-4caa-9c1e-3f3bc661b680" containerName="payload-pre-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112485    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4c501c-4939-46b7-ba07-1d1652831f47" containerName="payload-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112490    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b201eba2-39bf-4325-8b53-64d8976c1173" containerName="payload-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112495    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f1c6ab-f786-4c80-bca3-4c7277af6f1a" containerName="payload-pre-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112501    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="28eb973b-49e0-41ae-8eee-76c3c68ff287" containerName="payload-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112506    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="db33a6dd-6270-4070-8ac2-c67f811e9d95" containerName="payload-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112512    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb8f638-8f54-487b-8d10-f7d919dd383c" containerName="payload-pre-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112517    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="92fd0661-2373-4901-b1f4-8f05e74fb8c9" containerName="payload-pre-processing"
Jul 24 15:47:16.112972 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.112523    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8ff2f4-2b8f-43cd-aa57-9b0b9bb8bb68" containerName="payload-pre-processing"
Jul 24 15:47:16.117113 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.117094    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fd7vt/must-gather-vfpft"
Jul 24 15:47:16.120134 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.120102    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fd7vt\"/\"default-dockercfg-sprr5\""
Jul 24 15:47:16.121177 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.121159    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fd7vt\"/\"openshift-service-ca.crt\""
Jul 24 15:47:16.121643 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.121631    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fd7vt\"/\"kube-root-ca.crt\""
Jul 24 15:47:16.126213 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.126189    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fd7vt/must-gather-vfpft"]
Jul 24 15:47:16.212731 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.212694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe-must-gather-output\") pod \"must-gather-vfpft\" (UID: \"2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe\") " pod="openshift-must-gather-fd7vt/must-gather-vfpft"
Jul 24 15:47:16.212903 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.212741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hv76\" (UniqueName: \"kubernetes.io/projected/2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe-kube-api-access-9hv76\") pod \"must-gather-vfpft\" (UID: \"2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe\") " pod="openshift-must-gather-fd7vt/must-gather-vfpft"
Jul 24 15:47:16.313332 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.313295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe-must-gather-output\") pod \"must-gather-vfpft\" (UID: \"2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe\") " pod="openshift-must-gather-fd7vt/must-gather-vfpft"
Jul 24 15:47:16.313332 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.313338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hv76\" (UniqueName: \"kubernetes.io/projected/2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe-kube-api-access-9hv76\") pod \"must-gather-vfpft\" (UID: \"2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe\") " pod="openshift-must-gather-fd7vt/must-gather-vfpft"
Jul 24 15:47:16.313648 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.313627    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe-must-gather-output\") pod \"must-gather-vfpft\" (UID: \"2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe\") " pod="openshift-must-gather-fd7vt/must-gather-vfpft"
Jul 24 15:47:16.325325 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.325304    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hv76\" (UniqueName: \"kubernetes.io/projected/2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe-kube-api-access-9hv76\") pod \"must-gather-vfpft\" (UID: \"2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe\") " pod="openshift-must-gather-fd7vt/must-gather-vfpft"
Jul 24 15:47:16.427867 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.427832    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fd7vt/must-gather-vfpft"
Jul 24 15:47:16.565407 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.565381    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fd7vt/must-gather-vfpft"]
Jul 24 15:47:16.570961 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.570940    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:47:16.974611 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:16.974574    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fd7vt/must-gather-vfpft" event={"ID":"2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe","Type":"ContainerStarted","Data":"5bcd1c5e0ba886bbe40ed2982d22ebce1225355141a86c6d9c8917cfa72fa888"}
Jul 24 15:47:17.984011 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:17.983939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fd7vt/must-gather-vfpft" event={"ID":"2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe","Type":"ContainerStarted","Data":"585c0063d7cc0da81bbfc8de4cf2690ef0135c89556fadfea0fc818c4302c1b4"}
Jul 24 15:47:17.984541 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:17.984028    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fd7vt/must-gather-vfpft" event={"ID":"2ed6baae-14ba-4a4f-aef8-9d5ac2494fbe","Type":"ContainerStarted","Data":"c88836b7a7ee83cb9677999d3c3cb56981d7d85145339f894721537b58b86463"}
Jul 24 15:47:18.004169 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:18.004110    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fd7vt/must-gather-vfpft" podStartSLOduration=1.327890207 podStartE2EDuration="2.004089885s" totalImagesPullingTime="676.199678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:18.003193736 +0000 UTC m=+3066.542173152" watchObservedRunningTime="2026-07-24 15:47:18.004089885 +0000 UTC m=+3066.543069299"
Jul 24 15:47:19.099651 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:19.099617    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wq2p6_87446c40-4dc9-42d2-a645-d9ecb5f7696e/global-pull-secret-syncer/0.log"
Jul 24 15:47:19.228028 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:19.227970    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s4jmb_13e209b0-eb31-4565-85bb-72d7e64ae65d/konnectivity-agent/0.log"
Jul 24 15:47:19.252920 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:19.252892    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-232.ec2.internal_95de36e8260460990badb66cc001e3dd/haproxy/0.log"
Jul 24 15:47:25.218797 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:25.218710    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dmxcn_8d9f354c-c4dc-42cc-9f65-7d807ca25ba1/kuadrant-console-plugin/0.log"
Jul 24 15:47:25.446004 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:25.445381    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hq4zw_f8354129-b663-4300-9bdc-197a9098a1e6/manager/0.log"
Jul 24 15:47:28.117646 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.117611    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ljj6n_effaebf8-c40b-45d3-a555-4a36e0129c29/node-exporter/0.log"
Jul 24 15:47:28.147878 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.147850    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ljj6n_effaebf8-c40b-45d3-a555-4a36e0129c29/kube-rbac-proxy/0.log"
Jul 24 15:47:28.198601 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.198571    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ljj6n_effaebf8-c40b-45d3-a555-4a36e0129c29/init-textfile/0.log"
Jul 24 15:47:28.361645 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.361619    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2673a26b-158c-4054-9da2-10e5a9e9a206/prometheus/0.log"
Jul 24 15:47:28.404364 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.404264    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2673a26b-158c-4054-9da2-10e5a9e9a206/config-reloader/0.log"
Jul 24 15:47:28.456237 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.456211    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2673a26b-158c-4054-9da2-10e5a9e9a206/thanos-sidecar/0.log"
Jul 24 15:47:28.504787 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.504755    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2673a26b-158c-4054-9da2-10e5a9e9a206/kube-rbac-proxy-web/0.log"
Jul 24 15:47:28.539411 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.539378    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2673a26b-158c-4054-9da2-10e5a9e9a206/kube-rbac-proxy/0.log"
Jul 24 15:47:28.594129 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.594099    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2673a26b-158c-4054-9da2-10e5a9e9a206/kube-rbac-proxy-thanos/0.log"
Jul 24 15:47:28.636077 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.636051    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2673a26b-158c-4054-9da2-10e5a9e9a206/init-config-reloader/0.log"
Jul 24 15:47:28.681881 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.681781    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-zsbrv_b74cf44f-6ca3-4948-b50b-56e5e1649c84/prometheus-operator/0.log"
Jul 24 15:47:28.729585 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.729551    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-zsbrv_b74cf44f-6ca3-4948-b50b-56e5e1649c84/kube-rbac-proxy/0.log"
Jul 24 15:47:28.872664 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.872623    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"]
Jul 24 15:47:28.877094 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.877059    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:28.910603 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.910564    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"]
Jul 24 15:47:28.949953 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.949862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-podres\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:28.950232 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.950211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-sys\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:28.950368 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.950355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-proc\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:28.950500 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.950486    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp2rk\" (UniqueName: \"kubernetes.io/projected/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-kube-api-access-qp2rk\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:28.950621 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:28.950608    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-lib-modules\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.052443 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.052409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-podres\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.052879 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.052462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-sys\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.052879 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.052514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-proc\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.052879 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.052572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp2rk\" (UniqueName: \"kubernetes.io/projected/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-kube-api-access-qp2rk\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.052879 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.052625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-lib-modules\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.052879 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.052636    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-sys\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.052879 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.052667    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-proc\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.052879 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.052621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-podres\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.052879 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.052795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-lib-modules\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.066683 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.066649    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp2rk\" (UniqueName: \"kubernetes.io/projected/fe4faf7b-c5dc-4841-8630-62fb421b0ddf-kube-api-access-qp2rk\") pod \"perf-node-gather-daemonset-5mrwf\" (UID: \"fe4faf7b-c5dc-4841-8630-62fb421b0ddf\") " pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.189497 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.189462    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:29.400006 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:29.399077    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"]
Jul 24 15:47:30.062376 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:30.062331    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf" event={"ID":"fe4faf7b-c5dc-4841-8630-62fb421b0ddf","Type":"ContainerStarted","Data":"21646785c50f9b57650154e2bb632ad536a70a86849ea8b72a4227a14fd0267c"}
Jul 24 15:47:30.062590 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:30.062407    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf" event={"ID":"fe4faf7b-c5dc-4841-8630-62fb421b0ddf","Type":"ContainerStarted","Data":"2f2478cdc351c1efae61789b558eb03854d0d685fc2ab2bfc6108c5411cf5190"}
Jul 24 15:47:30.062835 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:30.062812    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:30.085394 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:30.085308    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf" podStartSLOduration=2.085285432 podStartE2EDuration="2.085285432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:30.083774876 +0000 UTC m=+3078.622754308" watchObservedRunningTime="2026-07-24 15:47:30.085285432 +0000 UTC m=+3078.624264846"
Jul 24 15:47:31.718142 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:31.718114    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-82sf6_f60f52f9-ee88-4cc3-a632-3407d2cdc12e/download-server/0.log"
Jul 24 15:47:33.613629 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:33.613594    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pjnb6_4df14a47-9e83-4ac2-9e20-a0687dbe3e23/dns/0.log"
Jul 24 15:47:33.639480 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:33.639442    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pjnb6_4df14a47-9e83-4ac2-9e20-a0687dbe3e23/kube-rbac-proxy/0.log"
Jul 24 15:47:33.740287 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:33.740261    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xcg42_b8ada920-febe-4ebd-a2a0-37bd8ab680b2/dns-node-resolver/0.log"
Jul 24 15:47:34.339427 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:34.339396    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c7fbf7fd4-66j6w_58cff78f-7b4a-4f67-8899-9aad4b131391/registry/0.log"
Jul 24 15:47:34.372620 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:34.372588    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fsl22_130b3016-7f8a-4094-a80a-f613ffaaace8/node-ca/0.log"
Jul 24 15:47:35.731077 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:35.731042    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-758f749c7-5pcrd_c4774c15-31fd-4936-856e-65bfa0e44b18/kube-auth-proxy/0.log"
Jul 24 15:47:35.867166 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:35.867123    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-9mdkt_88141022-ed92-4da7-ae77-8c7e5830fd54/payload-pre-processing/0.log"
Jul 24 15:47:36.081288 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:36.081223    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fd7vt/perf-node-gather-daemonset-5mrwf"
Jul 24 15:47:36.781521 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:36.781487    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5c7s2_a214c28f-faf2-4a9c-b631-84bc7182090e/serve-healthcheck-canary/0.log"
Jul 24 15:47:37.601938 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:37.601896    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kx928_39cfe828-5333-48dd-bc1a-a776139d98aa/kube-rbac-proxy/0.log"
Jul 24 15:47:37.630380 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:37.630342    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kx928_39cfe828-5333-48dd-bc1a-a776139d98aa/exporter/0.log"
Jul 24 15:47:37.658247 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:37.658207    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kx928_39cfe828-5333-48dd-bc1a-a776139d98aa/extractor/0.log"
Jul 24 15:47:39.934970 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:39.934945    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-758f749c7-5pcrd_c4774c15-31fd-4936-856e-65bfa0e44b18/kube-auth-proxy/0.log"
Jul 24 15:47:40.053630 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:40.053578    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-9mdkt_88141022-ed92-4da7-ae77-8c7e5830fd54/payload-pre-processing/0.log"
Jul 24 15:47:41.094059 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:41.094029    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5584866b-7qmsk_d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058/manager/0.log"
Jul 24 15:47:41.112976 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:41.112950    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5584866b-7qmsk_d95a1d15-a0e2-49f4-9f3b-4b51cd9f8058/copy-manifests/0.log"
Jul 24 15:47:41.654075 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:41.654046    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-758f749c7-5pcrd_c4774c15-31fd-4936-856e-65bfa0e44b18/kube-auth-proxy/0.log"
Jul 24 15:47:41.766119 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:41.766086    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-9mdkt_88141022-ed92-4da7-ae77-8c7e5830fd54/payload-pre-processing/0.log"
Jul 24 15:47:42.448054 ip-10-0-129-232 kubenswrapper[2582]: I0724 15:47:42.448028    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54d8b9c4f-j6mf6_829c9afa-f2d0-49a7-abc7-5c8736d91993/manager/0.log"