Jul 28 04:09:39.289824 ip-10-0-139-118 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 04:09:39.289836 ip-10-0-139-118 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 04:09:39.289843 ip-10-0-139-118 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 04:09:39.290061 ip-10-0-139-118 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 04:09:50.747428 ip-10-0-139-118 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 04:09:50.747442 ip-10-0-139-118 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 487642c4aaaf4e23996893fc68a059ea --
Jul 28 04:11:45.175323 ip-10-0-139-118 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 04:11:45.584800 ip-10-0-139-118 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 04:11:45.584800 ip-10-0-139-118 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 04:11:45.584800 ip-10-0-139-118 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 04:11:45.584800 ip-10-0-139-118 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 04:11:45.584800 ip-10-0-139-118 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 04:11:45.585473 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.584870    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 04:11:45.589139 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589123    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 04:11:45.589139 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589139    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589143    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589146    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589149    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589152    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589155    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589159    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589162    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589168    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589171    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589174    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589177    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589180    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589183    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589185    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589188    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589191    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589193    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589196    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589199    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 04:11:45.589198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589202    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589204    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589207    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589210    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589213    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589215    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589218    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589220    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589223    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589225    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589229    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589233    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589236    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589239    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589241    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589244    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589247    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589250    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589253    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 04:11:45.589717 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589255    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589258    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589261    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589264    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589266    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589269    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589271    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589273    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589276    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589278    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589280    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589283    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589285    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589288    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589291    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589300    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589304    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589306    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589309    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589311    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 04:11:45.590198 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589314    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589316    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589319    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589322    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589324    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589327    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589329    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589332    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589334    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589336    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589339    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589342    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589344    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589347    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589349    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589352    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589355    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589360    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589363    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589367    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 04:11:45.590683 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589369    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589372    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589375    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589378    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589381    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589384    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589388    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589390    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589393    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589396    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589398    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589402    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589405    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589408    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589411    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589414    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589417    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589419    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.589422    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 04:11:45.591177 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590903    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590911    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590915    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590917    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590926    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590929    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590932    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590935    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590938    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590941    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590945    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590948    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590951    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590953    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590956    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590959    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590962    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590964    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590967    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590969    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 04:11:45.591886 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590972    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590974    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590977    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590980    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590982    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590985    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590987    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590990    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590993    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590995    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.590998    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591000    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591003    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591006    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591008    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591011    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591013    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591016    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591018    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591021    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 04:11:45.592695 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591024    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591027    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591045    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591048    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591051    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591054    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591057    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591059    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591062    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591064    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591067    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591069    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591071    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591074    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591077    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591080    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591082    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591085    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591087    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591090    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 04:11:45.593602 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591093    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591095    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591097    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591100    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591102    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591106    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591108    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591112    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591114    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591117    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591121    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591124    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591127    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591129    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591132    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591135    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591137    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591140    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591143    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591145    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 04:11:45.594519 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591148    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591150    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591153    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591157    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591160    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591164    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591166    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591169    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591172    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591174    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591177    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591179    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591182    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591185    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591187    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591190    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591194    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591197    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 04:11:45.595228 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.591200    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592924    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592938    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592944    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592949    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592954    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592958    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592963    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592967    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592973    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592977    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592981    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592985    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592989    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592993    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.592998    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593002    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593006    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593011    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593015    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 04:11:45.595760 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593020    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593024    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593028    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593053    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593057    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593064    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593070    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593074    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593078    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593083    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593087    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593091    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593100    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593105    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593112    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593117    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593122    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593127    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593131    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 04:11:45.596440 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593135    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593140    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593144    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593148    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593152    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593156    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593160    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593164    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593168    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593173    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593177    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593181    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593185    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593189    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593193    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593197    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593201    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593204    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593209    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593213    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 04:11:45.596975 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593217    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593222    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593227    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593230    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593235    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593238    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593243    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593249    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593254    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593258    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593262    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593267    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593272    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593276    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593280    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593284    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593288    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593298    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593303    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593307    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 04:11:45.597515 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593311    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593315    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593320    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593324    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593328    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593334    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593338    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593342    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593346    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593350    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593353    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593358    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593362    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593366    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593373    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593379    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593384    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593389    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593393    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593402    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 04:11:45.598144 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.593407    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593503    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593514    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593524    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593531    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593538    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593543    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593549    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593556    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593561    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593566    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593572    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593578    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593583    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593589    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593593    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593598    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593604    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593610    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593616    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593621    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593626    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593631    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593636    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 04:11:45.598655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593642    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593647    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593652    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593657    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593662    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593667    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593671    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593677    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593681    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593688    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593693    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593697    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593702    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593706    2581 flags.go:64] FLAG: --enable-server="true"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593711    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593717    2581 flags.go:64] FLAG: --event-burst="100"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593722    2581 flags.go:64] FLAG: --event-qps="50"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593726    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593731    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593736    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593742    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593747    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593751    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593756    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593760    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 04:11:45.599264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593767    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593772    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593777    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593781    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593786    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593790    2581 flags.go:64] FLAG: --feature-gates=""
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593796    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593801    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593806    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593811    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593816    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593820    2581 flags.go:64] FLAG: --help="false"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593825    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-139-118.ec2.internal"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593830    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593835    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593839    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593845    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593851    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593855    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593860    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593864    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593869    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593874    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593879    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 04:11:45.599864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593883    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593888    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593892    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593898    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593902    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593907    2581 flags.go:64] FLAG: --lock-file=""
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593911    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593916    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593922    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593930    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593935    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593940    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593945    2581 flags.go:64] FLAG: --logging-format="text"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593950    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593955    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593960    2581 flags.go:64] FLAG: --manifest-url=""
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593964    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593970    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593975    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593982    2581 flags.go:64] FLAG: --max-pods="110"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593986    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593991    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.593996    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594000    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594005    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 04:11:45.600472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594010    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594014    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594055    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594059    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594064    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594069    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594073    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594081    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594086    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594091    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594095    2581 flags.go:64] FLAG: --port="10250"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594100    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594105    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-031965eb6f8d69000"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594109    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594114    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594121    2581 flags.go:64] FLAG: --register-node="true"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594126    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594131    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594136    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594141    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594146    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594151    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594156    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594160    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594165    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 04:11:45.601170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594170    2581 flags.go:64] FLAG: --runonce="false"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594174    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594179    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594184    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594189    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594193    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594199    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594203    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594208    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594213    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594218    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594222    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594227    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594231    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594236    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594240    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594249    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594253    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594258    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594265    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594269    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594274    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594281    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594286    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594291    2581 flags.go:64] FLAG: --v="2"
Jul 28 04:11:45.601818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594297    2581 flags.go:64] FLAG: --version="false"
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594303    2581 flags.go:64] FLAG: --vmodule=""
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594311    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.594316    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594487    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594498    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594503    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594507    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594511    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594515    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594520    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594524    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594528    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594531    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594535    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594540    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594543    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594548    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594552    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594556    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 04:11:45.602439 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594560    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594565    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594569    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594573    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594577    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594581    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594585    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594589    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594593    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594597    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594602    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594606    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594610    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594614    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594618    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594623    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594627    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594634    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594638    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594643    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 04:11:45.602914 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594647    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594651    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594655    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594659    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594663    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594667    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594673    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594679    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594684    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594689    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594693    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594697    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594701    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594706    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594711    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594714    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594719    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594723    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594728    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594732    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 04:11:45.603449 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594736    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594740    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594744    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594748    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594753    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594756    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594760    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594764    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594769    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594775    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594779    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594784    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594789    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594794    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594797    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594802    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594807    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594811    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594816    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 04:11:45.603928 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594819    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594824    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594828    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594832    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594836    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594840    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594844    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594848    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594852    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594856    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594860    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594864    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594868    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594872    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594879    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594885    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594891    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594896    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594901    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 04:11:45.604409 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594905    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594909    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594913    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594919    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.594924    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.595477    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.602101    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.602115    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.602134    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.602139    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602198    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602202    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602205    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602208    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602211    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 04:11:45.604880 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602213    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602216    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602219    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602221    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602224    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602226    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602229    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602231    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602234    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602237    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602239    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602242    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602244    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602247    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602249    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602252    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602255    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602257    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602260    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 04:11:45.605287 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602262    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602266    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602268    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602271    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602273    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602276    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602279    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602282    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602285    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602287    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602289    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602293    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602295    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602297    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602300    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602303    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602305    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602307    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602310    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602312    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 04:11:45.605770 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602315    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602317    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602320    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602323    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602328    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602330    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602333    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602336    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602338    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602341    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602344    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602346    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602349    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602352    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602355    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602358    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602360    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602363    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602365    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602368    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 04:11:45.606268 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602370    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602372    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602376    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602380    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602384    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602387    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602389    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602392    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602394    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602397    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602400    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602402    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602404    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602407    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602409    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602412    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602414    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602417    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602419    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 04:11:45.606758 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602422    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602424    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602426    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602429    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602432    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602434    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602436    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602439    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602442    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602445    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602448    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602450    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602454    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602456    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602459    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 04:11:45.607281 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602461    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.602466    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602580    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602585    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602588    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602590    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602593    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602596    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602599    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602601    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602604    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602606    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602609    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602611    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602614    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 04:11:45.607640 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602616    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602619    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602621    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602623    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602626    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602628    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602631    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602633    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602635    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602638    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602640    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602644    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602646    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602649    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602653    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602657    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602660    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602662    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602665    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 04:11:45.607997 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602668    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602670    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602674    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602677    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602680    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602682    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602685    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602687    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602690    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602692    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602695    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602697    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602699    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602702    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602704    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602707    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602709    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602711    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602714    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602716    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 04:11:45.608577 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602719    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602722    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602724    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602726    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602729    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602732    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602735    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602737    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602740    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602742    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602745    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602747    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602750    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602752    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602755    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602757    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602760    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602762    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602764    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 04:11:45.609064 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602767    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602770    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602773    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602776    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602779    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602782    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602784    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602786    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602789    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602791    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602793    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602796    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602800    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602803    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602805    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602808    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602810    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602813    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602815    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 04:11:45.609531 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602818    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602820    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602823    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602825    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602828    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602830    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602832    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602835    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:45.602837    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.602842    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.602935    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.604849    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.606813    2581 server.go:1019] "Starting client certificate rotation"
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.606921    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 04:11:45.609985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.607995    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 04:11:45.610345 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.609539    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 04:11:45.613956 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.613939    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 04:11:45.624181 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.624165    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 28 04:11:45.626571 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.626558    2581 log.go:25] "Validated CRI v1 image API"
Jul 28 04:11:45.627293 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.627278    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 04:11:45.629834 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.629815    2581 fs.go:135] Filesystem UUIDs: map[25cc7fde-b649-459d-bc31-317ec0a5278c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d0155e03-b112-4a47-b025-f6a2b4e5d9e8:/dev/nvme0n1p4]
Jul 28 04:11:45.629892 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.629833    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 04:11:45.636410 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.636307    2581 manager.go:216] Machine: {Timestamp:2026-07-28 04:11:45.635012412 +0000 UTC m=+0.342494704 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100571 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b7a7bbab2254f1c4d880686db59c0 SystemUUID:ec2b7a7b-bab2-254f-1c4d-880686db59c0 BootID:487642c4-aaaf-4e23-9968-93fc68a059ea Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:6b:93:c6:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:6b:93:c6:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:63:18:8a:7d:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 04:11:45.636410 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.636403    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 04:11:45.636530 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.636477    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 04:11:45.639345 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.639320    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 04:11:45.639468 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.639348    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 04:11:45.639983 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.639967    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 04:11:45.640012 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.639986    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 04:11:45.640012 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.639993    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 04:11:45.640540 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.640530    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 04:11:45.641681 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.641671    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 04:11:45.642071 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.642052    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 04:11:45.645960 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.645946    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 04:11:45.646089 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.646079    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 04:11:45.646120 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.646108    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 04:11:45.646120 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.646117    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 04:11:45.646170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.646131    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 04:11:45.646170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.646140    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 28 04:11:45.646170 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.646148    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 04:11:45.646474 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.646463    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 04:11:45.646521 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.646481    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 04:11:45.648600 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.648587    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 04:11:45.650417 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.650404    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 04:11:45.650477 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.650433    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 04:11:45.651864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651852    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 04:11:45.651909 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651869    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 04:11:45.651909 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651875    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 04:11:45.651909 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651881    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 04:11:45.651909 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651890    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 04:11:45.651909 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651895    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 04:11:45.651909 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651903    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 04:11:45.651909 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651908    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 04:11:45.652115 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651915    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 04:11:45.652115 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651921    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 04:11:45.652115 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651931    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 04:11:45.652115 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.651937    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 04:11:45.652673 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.652657    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 04:11:45.652706 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.652676    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 04:11:45.654865 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.654833    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 04:11:45.655369 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.655348    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 04:11:45.655425 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.655356    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 04:11:45.656341 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.656329    2581 server.go:1268] "Started kubelet"
Jul 28 04:11:45.656484 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.656439    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 04:11:45.656700 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.656423    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 04:11:45.656809 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.656717    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 04:11:45.657049 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.657015    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vtfq4"
Jul 28 04:11:45.657206 ip-10-0-139-118 systemd[1]: Started Kubernetes Kubelet.
Jul 28 04:11:45.657950 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.657935    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 04:11:45.659187 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.659174    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 04:11:45.661900 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.661882    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vtfq4"
Jul 28 04:11:45.662079 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.660990    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-118.ec2.internal.18c658c50d7128eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-118.ec2.internal,UID:ip-10-0-139-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-118.ec2.internal,},FirstTimestamp:2026-07-28 04:11:45.656301803 +0000 UTC m=+0.363784095,LastTimestamp:2026-07-28 04:11:45.656301803 +0000 UTC m=+0.363784095,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-118.ec2.internal,}"
Jul 28 04:11:45.663792 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.663771    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 04:11:45.667022 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.667008    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 04:11:45.667110 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.667020    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 04:11:45.667319 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.667192    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:45.667671 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.667653    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 04:11:45.667888 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.667870    2581 factory.go:55] Registering systemd factory
Jul 28 04:11:45.667960 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.667891    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 28 04:11:45.667960 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.667897    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 04:11:45.667960 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.667912    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 04:11:45.668167 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.668152    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 04:11:45.668167 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.668165    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 04:11:45.668423 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.668406    2581 factory.go:153] Registering CRI-O factory
Jul 28 04:11:45.668497 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.668426    2581 factory.go:223] Registration of the crio container factory successfully
Jul 28 04:11:45.668497 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.668479    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 04:11:45.668580 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.668503    2581 factory.go:103] Registering Raw factory
Jul 28 04:11:45.668580 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.668519    2581 manager.go:1196] Started watching for new ooms in manager
Jul 28 04:11:45.669113 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.668797    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 04:11:45.669210 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.668916    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 04:11:45.669276 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.669221    2581 manager.go:349] Starting recovery of all containers
Jul 28 04:11:45.680988 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.680839    2581 manager.go:354] Recovery completed
Jul 28 04:11:45.682751 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.682729    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 28 04:11:45.686332 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.686314    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 04:11:45.688112 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.688093    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 04:11:45.688172 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.688130    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 04:11:45.688172 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.688143    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 04:11:45.688651 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.688638    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 04:11:45.688651 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.688650    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 04:11:45.688738 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.688666    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 04:11:45.688738 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.688703    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 04:11:45.690141 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.690129    2581 policy_none.go:49] "None policy: Start"
Jul 28 04:11:45.690178 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.690145    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 04:11:45.690178 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.690155    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 04:11:45.690940 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.690931    2581 policy_none.go:47] "Start"
Jul 28 04:11:45.693985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.693964    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 04:11:45.694098 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.693995    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 04:11:45.694098 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.694005    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 04:11:45.720585 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.720567    2581 manager.go:337] "Starting Device Plugin manager"
Jul 28 04:11:45.720669 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.720594    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 04:11:45.720669 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.720603    2581 server.go:87] "Starting device plugin registration server"
Jul 28 04:11:45.720840 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.720828    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 04:11:45.720893 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.720843    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 04:11:45.721198 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.721052    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 04:11:45.721198 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.721131    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 04:11:45.721198 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.721139    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 04:11:45.722665 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.722644    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 04:11:45.722759 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.722700    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:45.821237 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.821214    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 04:11:45.822315 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.822057    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 04:11:45.822315 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.822081    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 04:11:45.822315 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.822092    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 04:11:45.822315 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.822140    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-118.ec2.internal"
Jul 28 04:11:45.829081 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.829066    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-118.ec2.internal"
Jul 28 04:11:45.829147 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.829087    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-118.ec2.internal\": node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:45.830914 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.830894    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 04:11:45.832207 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.832188    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 04:11:45.832287 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.832220    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 04:11:45.832287 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.832239    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 04:11:45.832287 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.832271    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 04:11:45.834967 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.834926    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 04:11:45.878478 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.878458    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:45.933182 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.933160    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"]
Jul 28 04:11:45.933243 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.933231    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 04:11:45.934129 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.934113    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 04:11:45.934195 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.934139    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 04:11:45.934195 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.934148    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 04:11:45.935617 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.935605    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 04:11:45.935727 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.935714    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:45.935771 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.935742    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 04:11:45.936398 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.936377    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 04:11:45.936492 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.936408    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 04:11:45.936492 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.936382    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 04:11:45.936492 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.936422    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 04:11:45.936492 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.936442    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 04:11:45.936492 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.936453    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 04:11:45.937540 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.937522    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:45.937629 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.937545    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 04:11:45.938272 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.938256    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 04:11:45.938337 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.938285    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 04:11:45.938337 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.938295    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 04:11:45.954564 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.954547    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-118.ec2.internal\" not found" node="ip-10-0-139-118.ec2.internal"
Jul 28 04:11:45.959515 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.959069    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-118.ec2.internal\" not found" node="ip-10-0-139-118.ec2.internal"
Jul 28 04:11:45.969777 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.969761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fff63694d8e862dfdf6221d63f1d183f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"fff63694d8e862dfdf6221d63f1d183f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:45.969860 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.969783    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/839373d01f4d4231aa21f422395e27a5-config\") pod \"kube-apiserver-proxy-ip-10-0-139-118.ec2.internal\" (UID: \"839373d01f4d4231aa21f422395e27a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:45.969860 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:45.969800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fff63694d8e862dfdf6221d63f1d183f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"fff63694d8e862dfdf6221d63f1d183f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:45.978547 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:45.978535    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:46.070831 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.070791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fff63694d8e862dfdf6221d63f1d183f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"fff63694d8e862dfdf6221d63f1d183f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:46.070831 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.070832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fff63694d8e862dfdf6221d63f1d183f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"fff63694d8e862dfdf6221d63f1d183f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:46.071017 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.070847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/839373d01f4d4231aa21f422395e27a5-config\") pod \"kube-apiserver-proxy-ip-10-0-139-118.ec2.internal\" (UID: \"839373d01f4d4231aa21f422395e27a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:46.071017 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.070894    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fff63694d8e862dfdf6221d63f1d183f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"fff63694d8e862dfdf6221d63f1d183f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:46.071017 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.070902    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fff63694d8e862dfdf6221d63f1d183f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"fff63694d8e862dfdf6221d63f1d183f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:46.071017 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.070952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/839373d01f4d4231aa21f422395e27a5-config\") pod \"kube-apiserver-proxy-ip-10-0-139-118.ec2.internal\" (UID: \"839373d01f4d4231aa21f422395e27a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:46.078895 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:46.078868    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:46.179774 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:46.179688    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:46.256913 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.256888    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:46.262719 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.262702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:46.280251 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:46.280221    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:46.380813 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:46.380785    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:46.481344 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:46.481264    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:46.582409 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:46.582381    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:46.607426 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.607398    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 04:11:46.608051 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.607569    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 04:11:46.665493 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.665443    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 04:06:46 +0000 UTC" deadline="2028-01-28 19:52:58.996434414 +0000 UTC"
Jul 28 04:11:46.665493 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.665488    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13191h41m12.330948966s"
Jul 28 04:11:46.682834 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:46.682798    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:46.783375 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:46.783346    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:46.850052 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:46.849995    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff63694d8e862dfdf6221d63f1d183f.slice/crio-f71add5dbc8bce26ef0cfefad87a9941dd9cc48236fdd6323ef6a3823daad1ff WatchSource:0}: Error finding container f71add5dbc8bce26ef0cfefad87a9941dd9cc48236fdd6323ef6a3823daad1ff: Status 404 returned error can't find the container with id f71add5dbc8bce26ef0cfefad87a9941dd9cc48236fdd6323ef6a3823daad1ff
Jul 28 04:11:46.851783 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:46.851755    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839373d01f4d4231aa21f422395e27a5.slice/crio-7c008fb3bca6e74ac1dde60ba3780cccc1b78b3f4c5a249b524c262690404ac4 WatchSource:0}: Error finding container 7c008fb3bca6e74ac1dde60ba3780cccc1b78b3f4c5a249b524c262690404ac4: Status 404 returned error can't find the container with id 7c008fb3bca6e74ac1dde60ba3780cccc1b78b3f4c5a249b524c262690404ac4
Jul 28 04:11:46.857906 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.857884    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 04:11:46.883736 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:46.883704    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:46.911173 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:46.911150    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 04:11:46.983882 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:46.983846    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:47.085084 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.085007    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:47.185754 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.185719    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 28 04:11:47.207906 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.207882    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 04:11:47.218577 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.218548    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 04:11:47.268144 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.268113    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:47.278565 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.278539    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 04:11:47.279775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.279744    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 28 04:11:47.289390 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.289288    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 04:11:47.649730 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.649465    2581 apiserver.go:52] "Watching apiserver"
Jul 28 04:11:47.656339 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.656311    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 04:11:47.656800 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.656768    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-6mwzc","openshift-multus/network-metrics-daemon-g86tz","openshift-network-diagnostics/network-check-target-r48nx","kube-system/konnectivity-agent-skww4","openshift-dns/node-resolver-ljczk","openshift-image-registry/node-ca-xqlft","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal","openshift-multus/multus-additional-cni-plugins-9tllh","openshift-network-operator/iptables-alerter-mhqg4","openshift-ovn-kubernetes/ovnkube-node-pggtj","kube-system/global-pull-secret-syncer-q99nq","kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62","openshift-cluster-node-tuning-operator/tuned-5wsjp"]
Jul 28 04:11:47.658782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.658765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.660471 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.660188    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.661295 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.661274    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 04:11:47.661425 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.661397    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 04:11:47.661567 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.661550    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 04:11:47.661645 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.661631    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 04:11:47.661775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.661751    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 04:11:47.661990 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.661973    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 04:11:47.662039 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.662000    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8dr2z\""
Jul 28 04:11:47.662310 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.662293    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 04:11:47.662383 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.662372    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 04:11:47.662582 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.662547    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-279wd\""
Jul 28 04:11:47.663362 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.663344    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:47.663535 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.663506    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:11:47.664054 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.664028    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 04:11:47.665015 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.664332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:11:47.665015 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.664368    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:47.669097 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.669074    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 04:11:47.670039 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.670017    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 04:11:47.670215 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.670196    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 04:11:47.670324 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.670306    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bzh7h\""
Jul 28 04:11:47.670491 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.670472    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 04:11:47.670610 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.670590    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 04:11:47.671724 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.670904    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kzlf2\""
Jul 28 04:11:47.672083 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.672056    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:47.673794 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.673772    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:47.675305 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.675286    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bzjvz\""
Jul 28 04:11:47.675305 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.675304    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 04:11:47.675459 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.675357    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 04:11:47.675646 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.675628    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.675887 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.675629    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 04:11:47.676309 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.675878    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cbcbp\""
Jul 28 04:11:47.676309 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.676156    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 04:11:47.676309 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.676276    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 04:11:47.676526 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.676363    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 04:11:47.676656 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.676635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:47.676772 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.676743    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:11:47.677747 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.677573    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 04:11:47.677857 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.677825    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jftcw\""
Jul 28 04:11:47.677918 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.677883    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 04:11:47.678150 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.678133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.679445 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.679424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:47.679541 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.679494    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.680839    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.681126    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.681348    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.681549    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xmg7q\""
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.681945    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682202    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61a3863a-3bf9-4a7a-915c-7106f2e93df7-hosts-file\") pod \"node-resolver-ljczk\" (UID: \"61a3863a-3bf9-4a7a-915c-7106f2e93df7\") " pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03e6400b-8dcc-4525-9e3f-3166a169f06f-serviceca\") pod \"node-ca-xqlft\" (UID: \"03e6400b-8dcc-4525-9e3f-3166a169f06f\") " pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-systemd-units\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-cni-bin\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7w2v\" (UniqueName: \"kubernetes.io/projected/61a3863a-3bf9-4a7a-915c-7106f2e93df7-kube-api-access-l7w2v\") pod \"node-resolver-ljczk\" (UID: \"61a3863a-3bf9-4a7a-915c-7106f2e93df7\") " pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682863    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jtt5\" (UniqueName: \"kubernetes.io/projected/03e6400b-8dcc-4525-9e3f-3166a169f06f-kube-api-access-4jtt5\") pod \"node-ca-xqlft\" (UID: \"03e6400b-8dcc-4525-9e3f-3166a169f06f\") " pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-var-lib-openvswitch\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7101fac5-991a-47d3-b2be-bdcde548d303-ovn-node-metrics-cert\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-slash\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-run-systemd\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.682997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-log-socket\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/274bf2d5-1311-4b5e-9201-c88c31386088-konnectivity-ca\") pod \"konnectivity-agent-skww4\" (UID: \"274bf2d5-1311-4b5e-9201-c88c31386088\") " pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:11:47.685128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683049    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03e6400b-8dcc-4525-9e3f-3166a169f06f-host\") pod \"node-ca-xqlft\" (UID: \"03e6400b-8dcc-4525-9e3f-3166a169f06f\") " pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-run-ovn\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-node-log\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683151    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7101fac5-991a-47d3-b2be-bdcde548d303-ovnkube-script-lib\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-device-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nsz5\" (UniqueName: \"kubernetes.io/projected/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-kube-api-access-4nsz5\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7101fac5-991a-47d3-b2be-bdcde548d303-ovnkube-config\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/274bf2d5-1311-4b5e-9201-c88c31386088-agent-certs\") pod \"konnectivity-agent-skww4\" (UID: \"274bf2d5-1311-4b5e-9201-c88c31386088\") " pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683290    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61a3863a-3bf9-4a7a-915c-7106f2e93df7-tmp-dir\") pod \"node-resolver-ljczk\" (UID: \"61a3863a-3bf9-4a7a-915c-7106f2e93df7\") " pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-run-netns\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-etc-openvswitch\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-run-openvswitch\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-run-ovn-kubernetes\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683472    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7101fac5-991a-47d3-b2be-bdcde548d303-env-overrides\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thct2\" (UniqueName: \"kubernetes.io/projected/7101fac5-991a-47d3-b2be-bdcde548d303-kube-api-access-thct2\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.686399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-socket-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.687066 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-kubelet\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.687066 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.687066 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-registration-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.687066 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-sys-fs\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.687066 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-cni-netd\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.687066 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.683719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dclvw\" (UniqueName: \"kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw\") pod \"network-check-target-r48nx\" (UID: \"ec143d3e-dba3-4a4f-a0c1-749c014e71f2\") " pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:47.687066 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.684233    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.687785 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.687754    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 04:11:47.687871 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.687809    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mjpwv\""
Jul 28 04:11:47.687975 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.687759    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 04:11:47.695841 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.695819    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 04:11:47.698478 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.698456    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-77vc8"
Jul 28 04:11:47.709397 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.709374    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-77vc8"
Jul 28 04:11:47.769232 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.769205    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 04:11:47.787360 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-device-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.787495 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nsz5\" (UniqueName: \"kubernetes.io/projected/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-kube-api-access-4nsz5\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.787495 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-device-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.787495 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-run-openvswitch\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.787495 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-run-ovn-kubernetes\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.787495 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-run-openvswitch\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.787775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7a3fd1c-ba41-4315-ac90-d7c77de1777c-host-slash\") pod \"iptables-alerter-mhqg4\" (UID: \"c7a3fd1c-ba41-4315-ac90-d7c77de1777c\") " pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:47.787775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.787775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-run-ovn-kubernetes\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.787775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7101fac5-991a-47d3-b2be-bdcde548d303-env-overrides\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.787775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thct2\" (UniqueName: \"kubernetes.io/projected/7101fac5-991a-47d3-b2be-bdcde548d303-kube-api-access-thct2\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.787775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.787775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-cnibin\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.787775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-daemon-config\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.788014 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.787972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-lib-modules\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.788051 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.788014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-var-lib-kubelet\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.788051 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.788042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kpdm\" (UniqueName: \"kubernetes.io/projected/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-kube-api-access-2kpdm\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.788159 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.788130    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-socket-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.788224 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.788201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-system-cni-dir\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.788468 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.788392    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-socket-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.788905 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.788277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-socket-dir-parent\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.788905 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.788848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-var-lib-cni-multus\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.788905 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.788872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66596be3-19df-47a0-b3e7-8733521981fa-dbus\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:47.789398 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-kubelet\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.789398 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.789563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-registration-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.789563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7101fac5-991a-47d3-b2be-bdcde548d303-env-overrides\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.789563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-etc-kubernetes\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.789563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-kubelet\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.789563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-cni-netd\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.789563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.789563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-cni-netd\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.789563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclvw\" (UniqueName: \"kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw\") pod \"network-check-target-r48nx\" (UID: \"ec143d3e-dba3-4a4f-a0c1-749c014e71f2\") " pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:47.789563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789546    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-registration-dir\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03e6400b-8dcc-4525-9e3f-3166a169f06f-serviceca\") pod \"node-ca-xqlft\" (UID: \"03e6400b-8dcc-4525-9e3f-3166a169f06f\") " pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-cni-bin\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-sysctl-d\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-systemd\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-var-lib-openvswitch\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789731    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-modprobe-d\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-cni-bin\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-tuned\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-var-lib-openvswitch\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-run-systemd\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-os-release\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789800    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-run-netns\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789859    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-run-systemd\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789849    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6mxk\" (UniqueName: \"kubernetes.io/projected/200bdc65-dd3a-445c-a8eb-1d2996896486-kube-api-access-g6mxk\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-kubernetes\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/274bf2d5-1311-4b5e-9201-c88c31386088-konnectivity-ca\") pod \"konnectivity-agent-skww4\" (UID: \"274bf2d5-1311-4b5e-9201-c88c31386088\") " pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-run-ovn\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.789956    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-node-log\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-run-ovn\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03e6400b-8dcc-4525-9e3f-3166a169f06f-serviceca\") pod \"node-ca-xqlft\" (UID: \"03e6400b-8dcc-4525-9e3f-3166a169f06f\") " pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf6b5\" (UniqueName: \"kubernetes.io/projected/c7a3fd1c-ba41-4315-ac90-d7c77de1777c-kube-api-access-zf6b5\") pod \"iptables-alerter-mhqg4\" (UID: \"c7a3fd1c-ba41-4315-ac90-d7c77de1777c\") " pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790002    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-node-log\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-system-cni-dir\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-os-release\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-cni-binary-copy\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szzmj\" (UniqueName: \"kubernetes.io/projected/63fd0789-69d2-487c-b10b-b66deba1de75-kube-api-access-szzmj\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7101fac5-991a-47d3-b2be-bdcde548d303-ovnkube-config\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/274bf2d5-1311-4b5e-9201-c88c31386088-agent-certs\") pod \"konnectivity-agent-skww4\" (UID: \"274bf2d5-1311-4b5e-9201-c88c31386088\") " pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61a3863a-3bf9-4a7a-915c-7106f2e93df7-tmp-dir\") pod \"node-resolver-ljczk\" (UID: \"61a3863a-3bf9-4a7a-915c-7106f2e93df7\") " pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-run-netns\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.790912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790287    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-etc-openvswitch\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790312    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-conf-dir\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-cnibin\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n25p5\" (UniqueName: \"kubernetes.io/projected/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-kube-api-access-n25p5\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-cni-dir\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-run-multus-certs\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-sysctl-conf\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-tmp\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790494    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/274bf2d5-1311-4b5e-9201-c88c31386088-konnectivity-ca\") pod \"konnectivity-agent-skww4\" (UID: \"274bf2d5-1311-4b5e-9201-c88c31386088\") " pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-sys-fs\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/200bdc65-dd3a-445c-a8eb-1d2996896486-cni-binary-copy\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790658    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-sys-fs\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7101fac5-991a-47d3-b2be-bdcde548d303-ovnkube-config\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-run-netns\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-run-k8s-cni-cncf-io\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.791782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.790980    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-etc-openvswitch\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7a3fd1c-ba41-4315-ac90-d7c77de1777c-iptables-alerter-script\") pod \"iptables-alerter-mhqg4\" (UID: \"c7a3fd1c-ba41-4315-ac90-d7c77de1777c\") " pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-sysconfig\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-sys\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-host\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61a3863a-3bf9-4a7a-915c-7106f2e93df7-hosts-file\") pod \"node-resolver-ljczk\" (UID: \"61a3863a-3bf9-4a7a-915c-7106f2e93df7\") " pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-systemd-units\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66596be3-19df-47a0-b3e7-8733521981fa-kubelet-config\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w2v\" (UniqueName: \"kubernetes.io/projected/61a3863a-3bf9-4a7a-915c-7106f2e93df7-kube-api-access-l7w2v\") pod \"node-resolver-ljczk\" (UID: \"61a3863a-3bf9-4a7a-915c-7106f2e93df7\") " pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jtt5\" (UniqueName: \"kubernetes.io/projected/03e6400b-8dcc-4525-9e3f-3166a169f06f-kube-api-access-4jtt5\") pod \"node-ca-xqlft\" (UID: \"03e6400b-8dcc-4525-9e3f-3166a169f06f\") " pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7101fac5-991a-47d3-b2be-bdcde548d303-ovn-node-metrics-cert\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791303    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61a3863a-3bf9-4a7a-915c-7106f2e93df7-tmp-dir\") pod \"node-resolver-ljczk\" (UID: \"61a3863a-3bf9-4a7a-915c-7106f2e93df7\") " pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791338    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-hostroot\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791375    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61a3863a-3bf9-4a7a-915c-7106f2e93df7-hosts-file\") pod \"node-resolver-ljczk\" (UID: \"61a3863a-3bf9-4a7a-915c-7106f2e93df7\") " pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-systemd-units\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-slash\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.792343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-log-socket\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-var-lib-cni-bin\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-var-lib-kubelet\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-run\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03e6400b-8dcc-4525-9e3f-3166a169f06f-host\") pod \"node-ca-xqlft\" (UID: \"03e6400b-8dcc-4525-9e3f-3166a169f06f\") " pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7101fac5-991a-47d3-b2be-bdcde548d303-ovnkube-script-lib\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.791991    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-log-socket\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.792016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7101fac5-991a-47d3-b2be-bdcde548d303-host-slash\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.792042    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03e6400b-8dcc-4525-9e3f-3166a169f06f-host\") pod \"node-ca-xqlft\" (UID: \"03e6400b-8dcc-4525-9e3f-3166a169f06f\") " pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:47.793221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.792496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7101fac5-991a-47d3-b2be-bdcde548d303-ovnkube-script-lib\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.794195 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.794176    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 04:11:47.794293 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.794199    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 04:11:47.794293 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.794209    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dclvw for pod openshift-network-diagnostics/network-check-target-r48nx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:11:47.794293 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.794270    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw podName:ec143d3e-dba3-4a4f-a0c1-749c014e71f2 nodeName:}" failed. No retries permitted until 2026-07-28 04:11:48.294254839 +0000 UTC m=+3.001737119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dclvw" (UniqueName: "kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw") pod "network-check-target-r48nx" (UID: "ec143d3e-dba3-4a4f-a0c1-749c014e71f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:11:47.795763 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.795738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7101fac5-991a-47d3-b2be-bdcde548d303-ovn-node-metrics-cert\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.795999 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.795981    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/274bf2d5-1311-4b5e-9201-c88c31386088-agent-certs\") pod \"konnectivity-agent-skww4\" (UID: \"274bf2d5-1311-4b5e-9201-c88c31386088\") " pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:11:47.796350 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.796329    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thct2\" (UniqueName: \"kubernetes.io/projected/7101fac5-991a-47d3-b2be-bdcde548d303-kube-api-access-thct2\") pod \"ovnkube-node-pggtj\" (UID: \"7101fac5-991a-47d3-b2be-bdcde548d303\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.797690 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.797664    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nsz5\" (UniqueName: \"kubernetes.io/projected/2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9-kube-api-access-4nsz5\") pod \"aws-ebs-csi-driver-node-wrk62\" (UID: \"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:47.801919 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.801894    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7w2v\" (UniqueName: \"kubernetes.io/projected/61a3863a-3bf9-4a7a-915c-7106f2e93df7-kube-api-access-l7w2v\") pod \"node-resolver-ljczk\" (UID: \"61a3863a-3bf9-4a7a-915c-7106f2e93df7\") " pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:47.803249 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.803203    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jtt5\" (UniqueName: \"kubernetes.io/projected/03e6400b-8dcc-4525-9e3f-3166a169f06f-kube-api-access-4jtt5\") pod \"node-ca-xqlft\" (UID: \"03e6400b-8dcc-4525-9e3f-3166a169f06f\") " pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:47.837768 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.837720    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal" event={"ID":"839373d01f4d4231aa21f422395e27a5","Type":"ContainerStarted","Data":"7c008fb3bca6e74ac1dde60ba3780cccc1b78b3f4c5a249b524c262690404ac4"}
Jul 28 04:11:47.838918 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.838888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal" event={"ID":"fff63694d8e862dfdf6221d63f1d183f","Type":"ContainerStarted","Data":"f71add5dbc8bce26ef0cfefad87a9941dd9cc48236fdd6323ef6a3823daad1ff"}
Jul 28 04:11:47.893127 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf6b5\" (UniqueName: \"kubernetes.io/projected/c7a3fd1c-ba41-4315-ac90-d7c77de1777c-kube-api-access-zf6b5\") pod \"iptables-alerter-mhqg4\" (UID: \"c7a3fd1c-ba41-4315-ac90-d7c77de1777c\") " pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:47.893323 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-system-cni-dir\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.893323 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893194    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-system-cni-dir\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.893323 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-os-release\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.893323 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-cni-binary-copy\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.893556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szzmj\" (UniqueName: \"kubernetes.io/projected/63fd0789-69d2-487c-b10b-b66deba1de75-kube-api-access-szzmj\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:47.893556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-conf-dir\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.893556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-cnibin\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.893556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n25p5\" (UniqueName: \"kubernetes.io/projected/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-kube-api-access-n25p5\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.893556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-cni-dir\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.893556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-conf-dir\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.893556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893502    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-run-multus-certs\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-sysctl-conf\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-tmp\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893625    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/200bdc65-dd3a-445c-a8eb-1d2996896486-cni-binary-copy\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-run-k8s-cni-cncf-io\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893721    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-run-multus-certs\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-cnibin\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893780    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-cni-binary-copy\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7a3fd1c-ba41-4315-ac90-d7c77de1777c-iptables-alerter-script\") pod \"iptables-alerter-mhqg4\" (UID: \"c7a3fd1c-ba41-4315-ac90-d7c77de1777c\") " pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-sysconfig\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-sys\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893860    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-cni-dir\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-host\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-os-release\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66596be3-19df-47a0-b3e7-8733521981fa-kubelet-config\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:47.893916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-host\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-hostroot\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-var-lib-cni-bin\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-var-lib-kubelet\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-run\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7a3fd1c-ba41-4315-ac90-d7c77de1777c-host-slash\") pod \"iptables-alerter-mhqg4\" (UID: \"c7a3fd1c-ba41-4315-ac90-d7c77de1777c\") " pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-cnibin\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-daemon-config\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-lib-modules\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-var-lib-kubelet\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpdm\" (UniqueName: \"kubernetes.io/projected/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-kube-api-access-2kpdm\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-system-cni-dir\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-socket-dir-parent\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-var-lib-cni-multus\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66596be3-19df-47a0-b3e7-8733521981fa-dbus\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/200bdc65-dd3a-445c-a8eb-1d2996896486-cni-binary-copy\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.894801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-etc-kubernetes\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-etc-kubernetes\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-sysctl-d\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-systemd\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66596be3-19df-47a0-b3e7-8733521981fa-kubelet-config\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-modprobe-d\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-tuned\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-hostroot\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7a3fd1c-ba41-4315-ac90-d7c77de1777c-iptables-alerter-script\") pod \"iptables-alerter-mhqg4\" (UID: \"c7a3fd1c-ba41-4315-ac90-d7c77de1777c\") " pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894583    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-var-lib-cni-bin\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.893960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-run-k8s-cni-cncf-io\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-os-release\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-run-netns\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6mxk\" (UniqueName: \"kubernetes.io/projected/200bdc65-dd3a-445c-a8eb-1d2996896486-kube-api-access-g6mxk\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894662    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-run\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-kubernetes\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-sysconfig\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.895707 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894849    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-sysctl-conf\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-sys\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.894918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-var-lib-kubelet\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.895389    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-system-cni-dir\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.895453    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs podName:63fd0789-69d2-487c-b10b-b66deba1de75 nodeName:}" failed. No retries permitted until 2026-07-28 04:11:48.395434007 +0000 UTC m=+3.102916288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs") pod "network-metrics-daemon-g86tz" (UID: "63fd0789-69d2-487c-b10b-b66deba1de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-socket-dir-parent\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895525    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-var-lib-cni-multus\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-systemd\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66596be3-19df-47a0-b3e7-8733521981fa-dbus\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-modprobe-d\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895661    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-sysctl-d\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7a3fd1c-ba41-4315-ac90-d7c77de1777c-host-slash\") pod \"iptables-alerter-mhqg4\" (UID: \"c7a3fd1c-ba41-4315-ac90-d7c77de1777c\") " pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-lib-modules\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895920    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-run-netns\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.896626 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-os-release\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.897507 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.895958    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-host-var-lib-kubelet\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.897507 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.896151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.897507 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.896182    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/200bdc65-dd3a-445c-a8eb-1d2996896486-multus-daemon-config\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.897507 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.896218    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 04:11:47.897507 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.896223    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-kubernetes\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.897507 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:47.896269    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret podName:66596be3-19df-47a0-b3e7-8733521981fa nodeName:}" failed. No retries permitted until 2026-07-28 04:11:48.396250842 +0000 UTC m=+3.103733137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret") pod "global-pull-secret-syncer-q99nq" (UID: "66596be3-19df-47a0-b3e7-8733521981fa") : object "kube-system"/"original-pull-secret" not registered
Jul 28 04:11:47.897507 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.896376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/200bdc65-dd3a-445c-a8eb-1d2996896486-cnibin\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.900788 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.900731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-tmp\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.900788 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.900764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-etc-tuned\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.904098 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.904053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szzmj\" (UniqueName: \"kubernetes.io/projected/63fd0789-69d2-487c-b10b-b66deba1de75-kube-api-access-szzmj\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:47.904291 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.904269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6mxk\" (UniqueName: \"kubernetes.io/projected/200bdc65-dd3a-445c-a8eb-1d2996896486-kube-api-access-g6mxk\") pod \"multus-6mwzc\" (UID: \"200bdc65-dd3a-445c-a8eb-1d2996896486\") " pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:47.908683 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.908659    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kpdm\" (UniqueName: \"kubernetes.io/projected/00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8-kube-api-access-2kpdm\") pod \"tuned-5wsjp\" (UID: \"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8\") " pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:47.908788 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.908682    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf6b5\" (UniqueName: \"kubernetes.io/projected/c7a3fd1c-ba41-4315-ac90-d7c77de1777c-kube-api-access-zf6b5\") pod \"iptables-alerter-mhqg4\" (UID: \"c7a3fd1c-ba41-4315-ac90-d7c77de1777c\") " pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:47.910262 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.910230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n25p5\" (UniqueName: \"kubernetes.io/projected/db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd-kube-api-access-n25p5\") pod \"multus-additional-cni-plugins-9tllh\" (UID: \"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd\") " pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:47.980516 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.980477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:11:47.988584 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:47.988562    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62"
Jul 28 04:11:48.000606 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.000586    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ljczk"
Jul 28 04:11:48.006095 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.006072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:11:48.015807 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.015787    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqlft"
Jul 28 04:11:48.022291 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.022272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mhqg4"
Jul 28 04:11:48.031110 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.031094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5wsjp"
Jul 28 04:11:48.046777 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.046759    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6mwzc"
Jul 28 04:11:48.052463 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.052443    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9tllh"
Jul 28 04:11:48.298456 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.298365    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclvw\" (UniqueName: \"kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw\") pod \"network-check-target-r48nx\" (UID: \"ec143d3e-dba3-4a4f-a0c1-749c014e71f2\") " pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:48.298618 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:48.298572    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 04:11:48.298618 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:48.298599    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 04:11:48.298618 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:48.298611    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dclvw for pod openshift-network-diagnostics/network-check-target-r48nx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:11:48.298775 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:48.298686    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw podName:ec143d3e-dba3-4a4f-a0c1-749c014e71f2 nodeName:}" failed. No retries permitted until 2026-07-28 04:11:49.298665662 +0000 UTC m=+4.006147958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dclvw" (UniqueName: "kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw") pod "network-check-target-r48nx" (UID: "ec143d3e-dba3-4a4f-a0c1-749c014e71f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:11:48.399216 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.399178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:48.399405 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.399277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:48.399405 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:48.399383    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:11:48.399405 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:48.399385    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 04:11:48.399571 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:48.399446    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs podName:63fd0789-69d2-487c-b10b-b66deba1de75 nodeName:}" failed. No retries permitted until 2026-07-28 04:11:49.399428208 +0000 UTC m=+4.106910505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs") pod "network-metrics-daemon-g86tz" (UID: "63fd0789-69d2-487c-b10b-b66deba1de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:11:48.399571 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:48.399469    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret podName:66596be3-19df-47a0-b3e7-8733521981fa nodeName:}" failed. No retries permitted until 2026-07-28 04:11:49.399456813 +0000 UTC m=+4.106939097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret") pod "global-pull-secret-syncer-q99nq" (UID: "66596be3-19df-47a0-b3e7-8733521981fa") : object "kube-system"/"original-pull-secret" not registered
Jul 28 04:11:48.711713 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.711668    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 04:06:48 +0000 UTC" deadline="2028-03-13 10:31:12.804192297 +0000 UTC"
Jul 28 04:11:48.711713 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:48.711704    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14262h19m24.092491505s"
Jul 28 04:11:48.842057 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:48.842025    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7101fac5_991a_47d3_b2be_bdcde548d303.slice/crio-cb3b8d469575877762291159a223a75e42ea5ebf94b53c28ddd72d176991c2e2 WatchSource:0}: Error finding container cb3b8d469575877762291159a223a75e42ea5ebf94b53c28ddd72d176991c2e2: Status 404 returned error can't find the container with id cb3b8d469575877762291159a223a75e42ea5ebf94b53c28ddd72d176991c2e2
Jul 28 04:11:48.845201 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:48.844772    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb16db9c_a7c1_48cb_ae6e_f6ee94f3fabd.slice/crio-6f177cf6b4cd4c4420fc3eeffbc3f9e29caf713f56db18c45f485c005e14ce24 WatchSource:0}: Error finding container 6f177cf6b4cd4c4420fc3eeffbc3f9e29caf713f56db18c45f485c005e14ce24: Status 404 returned error can't find the container with id 6f177cf6b4cd4c4420fc3eeffbc3f9e29caf713f56db18c45f485c005e14ce24
Jul 28 04:11:48.848203 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:48.848174    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200bdc65_dd3a_445c_a8eb_1d2996896486.slice/crio-917d4ae73f07e2c773aca7f357ba00351478b8c362b7609255b9a3fb9b6e07a4 WatchSource:0}: Error finding container 917d4ae73f07e2c773aca7f357ba00351478b8c362b7609255b9a3fb9b6e07a4: Status 404 returned error can't find the container with id 917d4ae73f07e2c773aca7f357ba00351478b8c362b7609255b9a3fb9b6e07a4
Jul 28 04:11:48.848835 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:48.848803    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00fcb0fa_6011_46aa_8f5e_0c95aff0a8a8.slice/crio-c5112882ed3f2bbe326e4ec480df3c95142bae5cfd0ac5c9e60e93dbc5ad7187 WatchSource:0}: Error finding container c5112882ed3f2bbe326e4ec480df3c95142bae5cfd0ac5c9e60e93dbc5ad7187: Status 404 returned error can't find the container with id c5112882ed3f2bbe326e4ec480df3c95142bae5cfd0ac5c9e60e93dbc5ad7187
Jul 28 04:11:48.850077 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:48.850033    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e6400b_8dcc_4525_9e3f_3166a169f06f.slice/crio-97d1c4e8274c618ef269ee2418a5a04379f8a933d28e95e6eb6fe47b1d639e93 WatchSource:0}: Error finding container 97d1c4e8274c618ef269ee2418a5a04379f8a933d28e95e6eb6fe47b1d639e93: Status 404 returned error can't find the container with id 97d1c4e8274c618ef269ee2418a5a04379f8a933d28e95e6eb6fe47b1d639e93
Jul 28 04:11:48.852553 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:48.852272    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecf3c06_5c88_4bc0_90bb_ca1f7942fbb9.slice/crio-f287b0d901c6c7a2f64eef8abff685e42935ad2c0ff351eaf2868bfed4e0e8b1 WatchSource:0}: Error finding container f287b0d901c6c7a2f64eef8abff685e42935ad2c0ff351eaf2868bfed4e0e8b1: Status 404 returned error can't find the container with id f287b0d901c6c7a2f64eef8abff685e42935ad2c0ff351eaf2868bfed4e0e8b1
Jul 28 04:11:48.853256 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:48.853080    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a3fd1c_ba41_4315_ac90_d7c77de1777c.slice/crio-70f2e3b4cb3efdb7aeed10b7de72d69e2269dd4c4e61aa605b30ee96136488a5 WatchSource:0}: Error finding container 70f2e3b4cb3efdb7aeed10b7de72d69e2269dd4c4e61aa605b30ee96136488a5: Status 404 returned error can't find the container with id 70f2e3b4cb3efdb7aeed10b7de72d69e2269dd4c4e61aa605b30ee96136488a5
Jul 28 04:11:48.855996 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:48.855974    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274bf2d5_1311_4b5e_9201_c88c31386088.slice/crio-602dc4a524dd0fe446b90bb5b08b767b50c606e4771da1f70c8f37b818c8fd3c WatchSource:0}: Error finding container 602dc4a524dd0fe446b90bb5b08b767b50c606e4771da1f70c8f37b818c8fd3c: Status 404 returned error can't find the container with id 602dc4a524dd0fe446b90bb5b08b767b50c606e4771da1f70c8f37b818c8fd3c
Jul 28 04:11:48.859126 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:11:48.857723    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a3863a_3bf9_4a7a_915c_7106f2e93df7.slice/crio-c1510950c6e41287b1a97b2b7b94e2a512a61aa1a42fb55386f062aa8a914dc9 WatchSource:0}: Error finding container c1510950c6e41287b1a97b2b7b94e2a512a61aa1a42fb55386f062aa8a914dc9: Status 404 returned error can't find the container with id c1510950c6e41287b1a97b2b7b94e2a512a61aa1a42fb55386f062aa8a914dc9
Jul 28 04:11:49.306849 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.306476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclvw\" (UniqueName: \"kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw\") pod \"network-check-target-r48nx\" (UID: \"ec143d3e-dba3-4a4f-a0c1-749c014e71f2\") " pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:49.307082 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.306978    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 04:11:49.307082 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.307055    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 04:11:49.307082 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.307071    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dclvw for pod openshift-network-diagnostics/network-check-target-r48nx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:11:49.307247 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.307163    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw podName:ec143d3e-dba3-4a4f-a0c1-749c014e71f2 nodeName:}" failed. No retries permitted until 2026-07-28 04:11:51.307139472 +0000 UTC m=+6.014621777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dclvw" (UniqueName: "kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw") pod "network-check-target-r48nx" (UID: "ec143d3e-dba3-4a4f-a0c1-749c014e71f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:11:49.407551 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.407512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:49.407708 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.407578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:49.407752 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.407726    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 04:11:49.407802 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.407793    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret podName:66596be3-19df-47a0-b3e7-8733521981fa nodeName:}" failed. No retries permitted until 2026-07-28 04:11:51.407772941 +0000 UTC m=+6.115255239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret") pod "global-pull-secret-syncer-q99nq" (UID: "66596be3-19df-47a0-b3e7-8733521981fa") : object "kube-system"/"original-pull-secret" not registered
Jul 28 04:11:49.408251 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.408230    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:11:49.408329 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.408288    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs podName:63fd0789-69d2-487c-b10b-b66deba1de75 nodeName:}" failed. No retries permitted until 2026-07-28 04:11:51.408272588 +0000 UTC m=+6.115754873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs") pod "network-metrics-daemon-g86tz" (UID: "63fd0789-69d2-487c-b10b-b66deba1de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:11:49.713044 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.712892    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 04:06:48 +0000 UTC" deadline="2028-05-01 00:26:24.784220932 +0000 UTC"
Jul 28 04:11:49.713044 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.712956    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15428h14m35.07126973s"
Jul 28 04:11:49.836785 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.835889    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:49.836785 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.836032    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:11:49.836785 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.836477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:49.836785 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.836590    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:11:49.836785 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.836655    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:49.836785 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:49.836728    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:11:49.857056 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.856797    2581 generic.go:356] "Generic (PLEG): container finished" podID="fff63694d8e862dfdf6221d63f1d183f" containerID="c94fd375d7b8fd7bb1fd84814b9a0191bca03da2c09c373e4d96fe779aedc3a5" exitCode=0
Jul 28 04:11:49.857056 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.856870    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal" event={"ID":"fff63694d8e862dfdf6221d63f1d183f","Type":"ContainerDied","Data":"c94fd375d7b8fd7bb1fd84814b9a0191bca03da2c09c373e4d96fe779aedc3a5"}
Jul 28 04:11:49.884465 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.884437    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-skww4" event={"ID":"274bf2d5-1311-4b5e-9201-c88c31386088","Type":"ContainerStarted","Data":"602dc4a524dd0fe446b90bb5b08b767b50c606e4771da1f70c8f37b818c8fd3c"}
Jul 28 04:11:49.888646 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.888619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62" event={"ID":"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9","Type":"ContainerStarted","Data":"f287b0d901c6c7a2f64eef8abff685e42935ad2c0ff351eaf2868bfed4e0e8b1"}
Jul 28 04:11:49.891031 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.891004    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqlft" event={"ID":"03e6400b-8dcc-4525-9e3f-3166a169f06f","Type":"ContainerStarted","Data":"97d1c4e8274c618ef269ee2418a5a04379f8a933d28e95e6eb6fe47b1d639e93"}
Jul 28 04:11:49.893675 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.893648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tllh" event={"ID":"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd","Type":"ContainerStarted","Data":"6f177cf6b4cd4c4420fc3eeffbc3f9e29caf713f56db18c45f485c005e14ce24"}
Jul 28 04:11:49.897489 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.897458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" event={"ID":"7101fac5-991a-47d3-b2be-bdcde548d303","Type":"ContainerStarted","Data":"cb3b8d469575877762291159a223a75e42ea5ebf94b53c28ddd72d176991c2e2"}
Jul 28 04:11:49.905981 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.905953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal" event={"ID":"839373d01f4d4231aa21f422395e27a5","Type":"ContainerStarted","Data":"e3f36776e7206dac990a0bb92d0fd049b3be30e5fcb25676d4e8478134571a26"}
Jul 28 04:11:49.919495 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.918775    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal" podStartSLOduration=2.9187547560000002 podStartE2EDuration="2.918754756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:11:49.918243234 +0000 UTC m=+4.625725539" watchObservedRunningTime="2026-07-28 04:11:49.918754756 +0000 UTC m=+4.626237063"
Jul 28 04:11:49.919881 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.919690    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ljczk" event={"ID":"61a3863a-3bf9-4a7a-915c-7106f2e93df7","Type":"ContainerStarted","Data":"c1510950c6e41287b1a97b2b7b94e2a512a61aa1a42fb55386f062aa8a914dc9"}
Jul 28 04:11:49.925229 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.924903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mhqg4" event={"ID":"c7a3fd1c-ba41-4315-ac90-d7c77de1777c","Type":"ContainerStarted","Data":"70f2e3b4cb3efdb7aeed10b7de72d69e2269dd4c4e61aa605b30ee96136488a5"}
Jul 28 04:11:49.940947 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.940916    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5wsjp" event={"ID":"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8","Type":"ContainerStarted","Data":"c5112882ed3f2bbe326e4ec480df3c95142bae5cfd0ac5c9e60e93dbc5ad7187"}
Jul 28 04:11:49.958597 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:49.958550    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6mwzc" event={"ID":"200bdc65-dd3a-445c-a8eb-1d2996896486","Type":"ContainerStarted","Data":"917d4ae73f07e2c773aca7f357ba00351478b8c362b7609255b9a3fb9b6e07a4"}
Jul 28 04:11:50.983600 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:50.983199    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal" event={"ID":"fff63694d8e862dfdf6221d63f1d183f","Type":"ContainerStarted","Data":"5c3d258445f9045ab994f4663e167c5d54eb70ee97acf76f55aa48dda6795711"}
Jul 28 04:11:51.326139 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:51.326030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclvw\" (UniqueName: \"kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw\") pod \"network-check-target-r48nx\" (UID: \"ec143d3e-dba3-4a4f-a0c1-749c014e71f2\") " pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:51.326312 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.326257    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 04:11:51.326312 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.326278    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 04:11:51.326312 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.326292    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dclvw for pod openshift-network-diagnostics/network-check-target-r48nx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:11:51.326492 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.326350    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw podName:ec143d3e-dba3-4a4f-a0c1-749c014e71f2 nodeName:}" failed. No retries permitted until 2026-07-28 04:11:55.326330537 +0000 UTC m=+10.033812833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dclvw" (UniqueName: "kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw") pod "network-check-target-r48nx" (UID: "ec143d3e-dba3-4a4f-a0c1-749c014e71f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:11:51.426836 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:51.426807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:51.427031 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:51.426870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:51.427031 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.426962    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:11:51.427031 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.427008    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs podName:63fd0789-69d2-487c-b10b-b66deba1de75 nodeName:}" failed. No retries permitted until 2026-07-28 04:11:55.42699478 +0000 UTC m=+10.134477075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs") pod "network-metrics-daemon-g86tz" (UID: "63fd0789-69d2-487c-b10b-b66deba1de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:11:51.427421 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.427403    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 04:11:51.427511 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.427453    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret podName:66596be3-19df-47a0-b3e7-8733521981fa nodeName:}" failed. No retries permitted until 2026-07-28 04:11:55.427438752 +0000 UTC m=+10.134921046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret") pod "global-pull-secret-syncer-q99nq" (UID: "66596be3-19df-47a0-b3e7-8733521981fa") : object "kube-system"/"original-pull-secret" not registered
Jul 28 04:11:51.835510 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:51.835476    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:51.836355 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.836303    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:11:51.846264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:51.846241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:51.846454 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.846425    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:11:51.846535 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:51.846515    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:51.846664 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:51.846644    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:11:53.832920 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:53.832878    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:53.833399 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:53.833022    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:11:53.833471 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:53.833451    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:53.833586 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:53.833559    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:11:53.833694 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:53.833677    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:53.833785 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:53.833758    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:11:55.356729 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:55.356688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclvw\" (UniqueName: \"kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw\") pod \"network-check-target-r48nx\" (UID: \"ec143d3e-dba3-4a4f-a0c1-749c014e71f2\") " pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:55.357165 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.356871    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 04:11:55.357165 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.356893    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 04:11:55.357165 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.356906    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dclvw for pod openshift-network-diagnostics/network-check-target-r48nx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:11:55.357165 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.356964    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw podName:ec143d3e-dba3-4a4f-a0c1-749c014e71f2 nodeName:}" failed. No retries permitted until 2026-07-28 04:12:03.356945264 +0000 UTC m=+18.064427546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dclvw" (UniqueName: "kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw") pod "network-check-target-r48nx" (UID: "ec143d3e-dba3-4a4f-a0c1-749c014e71f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:11:55.457555 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:55.457522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:55.457725 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:55.457607    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:55.457725 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.457718    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:11:55.457840 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.457778    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs podName:63fd0789-69d2-487c-b10b-b66deba1de75 nodeName:}" failed. No retries permitted until 2026-07-28 04:12:03.457760058 +0000 UTC m=+18.165242358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs") pod "network-metrics-daemon-g86tz" (UID: "63fd0789-69d2-487c-b10b-b66deba1de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:11:55.458107 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.457989    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 04:11:55.458107 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.458072    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret podName:66596be3-19df-47a0-b3e7-8733521981fa nodeName:}" failed. No retries permitted until 2026-07-28 04:12:03.458027144 +0000 UTC m=+18.165509423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret") pod "global-pull-secret-syncer-q99nq" (UID: "66596be3-19df-47a0-b3e7-8733521981fa") : object "kube-system"/"original-pull-secret" not registered
Jul 28 04:11:55.834296 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:55.834218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:55.834445 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.834338    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:11:55.835105 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:55.834745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:55.835105 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.834884    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:11:55.835366 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:55.835345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:55.835494 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:55.835472    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:11:57.833283 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:57.833201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:57.833809 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:57.833211    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:57.833809 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:57.833338    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:57.833809 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:57.833331    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:11:57.833809 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:57.833448    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:11:57.833809 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:57.833541    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:11:59.833268 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:59.833235    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:11:59.833268 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:59.833268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:11:59.833708 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:11:59.833235    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:11:59.833708 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:59.833354    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:11:59.833708 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:59.833427    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:11:59.833708 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:11:59.833488    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:01.833516 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:01.833485    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:01.833972 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:01.833483    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:01.833972 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:01.833629    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:01.833972 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:01.833485    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:01.833972 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:01.833676    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:01.833972 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:01.833762    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:03.415161 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:03.415121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclvw\" (UniqueName: \"kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw\") pod \"network-check-target-r48nx\" (UID: \"ec143d3e-dba3-4a4f-a0c1-749c014e71f2\") " pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:03.415610 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.415320    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 04:12:03.415610 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.415347    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 04:12:03.415610 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.415361    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dclvw for pod openshift-network-diagnostics/network-check-target-r48nx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:12:03.415610 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.415432    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw podName:ec143d3e-dba3-4a4f-a0c1-749c014e71f2 nodeName:}" failed. No retries permitted until 2026-07-28 04:12:19.415411548 +0000 UTC m=+34.122893850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dclvw" (UniqueName: "kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw") pod "network-check-target-r48nx" (UID: "ec143d3e-dba3-4a4f-a0c1-749c014e71f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:12:03.515589 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:03.515546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:03.515739 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:03.515610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:03.515739 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.515711    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:12:03.515739 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.515718    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 04:12:03.515867 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.515780    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret podName:66596be3-19df-47a0-b3e7-8733521981fa nodeName:}" failed. No retries permitted until 2026-07-28 04:12:19.515759352 +0000 UTC m=+34.223241646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret") pod "global-pull-secret-syncer-q99nq" (UID: "66596be3-19df-47a0-b3e7-8733521981fa") : object "kube-system"/"original-pull-secret" not registered
Jul 28 04:12:03.515867 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.515795    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs podName:63fd0789-69d2-487c-b10b-b66deba1de75 nodeName:}" failed. No retries permitted until 2026-07-28 04:12:19.515788019 +0000 UTC m=+34.223270297 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs") pod "network-metrics-daemon-g86tz" (UID: "63fd0789-69d2-487c-b10b-b66deba1de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:12:03.832726 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:03.832633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:03.832886 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.832781    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:03.833185 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:03.833166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:03.833295 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.833262    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:03.833354 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:03.833313    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:03.833408 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:03.833385    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:05.833805 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:05.833767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:05.834276 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:05.833882    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:05.834276 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:05.833935    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:05.834276 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:05.833995    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:05.834410 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:05.834357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:05.834458 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:05.834436    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:07.834648 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:07.834440    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:07.834997 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:07.834750    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:07.834997 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:07.834633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:07.834997 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:07.834849    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:07.834997 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:07.834874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:07.834997 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:07.834961    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:08.024660 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.024092    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6mwzc" event={"ID":"200bdc65-dd3a-445c-a8eb-1d2996896486","Type":"ContainerStarted","Data":"02c8dc474b72643130105a844bf310ec9a6dfd0849c774092d64b1b0e217b878"}
Jul 28 04:12:08.025664 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.025640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-skww4" event={"ID":"274bf2d5-1311-4b5e-9201-c88c31386088","Type":"ContainerStarted","Data":"31d39648066f31b9863d08fff7b5bb3346bdcb3b3ae4a13e02ae6e1b10c4e179"}
Jul 28 04:12:08.027203 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.027176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62" event={"ID":"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9","Type":"ContainerStarted","Data":"6addcc24c6c90726872e465fb67a200c9286984ffe31687779bb4b8138f7a713"}
Jul 28 04:12:08.028786 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.028752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqlft" event={"ID":"03e6400b-8dcc-4525-9e3f-3166a169f06f","Type":"ContainerStarted","Data":"3c87f287e05d0854e953c4749f1a0c0044683c3d48769d643bba46b7112806f7"}
Jul 28 04:12:08.030520 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.030495    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tllh" event={"ID":"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd","Type":"ContainerStarted","Data":"c28ac9d5f015dbd0f98c475ed904809bb468c18de4c16338f5b565992a195007"}
Jul 28 04:12:08.032217 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.032190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ljczk" event={"ID":"61a3863a-3bf9-4a7a-915c-7106f2e93df7","Type":"ContainerStarted","Data":"773571e6621b704609a9f3fdd615b2470e4fca7ddd8260dfd4de5d2ad6f3af6c"}
Jul 28 04:12:08.034076 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.034052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5wsjp" event={"ID":"00fcb0fa-6011-46aa-8f5e-0c95aff0a8a8","Type":"ContainerStarted","Data":"5577d2086d5f36ea76cae139ab3fc0c9033b5ef234e6cb3f14ca1efdc2bfac52"}
Jul 28 04:12:08.039488 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.039437    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal" podStartSLOduration=21.039419456 podStartE2EDuration="21.039419456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:11:50.997229222 +0000 UTC m=+5.704711528" watchObservedRunningTime="2026-07-28 04:12:08.039419456 +0000 UTC m=+22.746901768"
Jul 28 04:12:08.040232 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.040194    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6mwzc" podStartSLOduration=3.253102682 podStartE2EDuration="22.040182629s" totalImagesPullingTime="18.787079947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:08.039185123 +0000 UTC m=+22.746667426" watchObservedRunningTime="2026-07-28 04:12:08.040182629 +0000 UTC m=+22.747664931"
Jul 28 04:12:08.051924 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.051885    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-skww4" podStartSLOduration=11.279979434 podStartE2EDuration="22.051869692s" totalImagesPullingTime="10.771890258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:08.051549471 +0000 UTC m=+22.759031773" watchObservedRunningTime="2026-07-28 04:12:08.051869692 +0000 UTC m=+22.759351994"
Jul 28 04:12:08.067359 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.067314    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ljczk" podStartSLOduration=3.314623955 podStartE2EDuration="22.067300065s" totalImagesPullingTime="18.75267611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:08.066921939 +0000 UTC m=+22.774404240" watchObservedRunningTime="2026-07-28 04:12:08.067300065 +0000 UTC m=+22.774782365"
Jul 28 04:12:08.079903 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.079860    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xqlft" podStartSLOduration=3.3204503819999998 podStartE2EDuration="22.079846169s" totalImagesPullingTime="18.759395787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:08.079681056 +0000 UTC m=+22.787163356" watchObservedRunningTime="2026-07-28 04:12:08.079846169 +0000 UTC m=+22.787328469"
Jul 28 04:12:08.095063 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:08.094998    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5wsjp" podStartSLOduration=3.331855743 podStartE2EDuration="22.094982995s" totalImagesPullingTime="18.763127252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:08.094644129 +0000 UTC m=+22.802126431" watchObservedRunningTime="2026-07-28 04:12:08.094982995 +0000 UTC m=+22.802465297"
Jul 28 04:12:09.037994 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.037785    2581 generic.go:356] "Generic (PLEG): container finished" podID="db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd" containerID="c28ac9d5f015dbd0f98c475ed904809bb468c18de4c16338f5b565992a195007" exitCode=0
Jul 28 04:12:09.038784 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.038061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tllh" event={"ID":"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd","Type":"ContainerDied","Data":"c28ac9d5f015dbd0f98c475ed904809bb468c18de4c16338f5b565992a195007"}
Jul 28 04:12:09.042201 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.042172    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:12:09.042796 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.042771    2581 generic.go:356] "Generic (PLEG): container finished" podID="7101fac5-991a-47d3-b2be-bdcde548d303" containerID="2afa719d53f3b36e7e0db9990a25db425839dc80c50d1dfc8acedb223997c0f9" exitCode=1
Jul 28 04:12:09.042944 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.042922    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" event={"ID":"7101fac5-991a-47d3-b2be-bdcde548d303","Type":"ContainerStarted","Data":"edd27bbbf823c198af08cda046c0edec9b7ab056eec91a336561f4f9d81fa497"}
Jul 28 04:12:09.043021 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.043006    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" event={"ID":"7101fac5-991a-47d3-b2be-bdcde548d303","Type":"ContainerStarted","Data":"a0141551b1bdae193822574f9f53934411c4a1092dc0af23e077016517cbe63c"}
Jul 28 04:12:09.043101 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.043085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" event={"ID":"7101fac5-991a-47d3-b2be-bdcde548d303","Type":"ContainerStarted","Data":"fdf12b1b2ec69a80c541100ad70f2ecf272fbff75fc340fc1bd43a0663a08b39"}
Jul 28 04:12:09.043159 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.043137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" event={"ID":"7101fac5-991a-47d3-b2be-bdcde548d303","Type":"ContainerStarted","Data":"2a884177798e1bb0e8601afcfcc387d54b5604a8744dbec281827fec349abd6f"}
Jul 28 04:12:09.043213 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.043187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" event={"ID":"7101fac5-991a-47d3-b2be-bdcde548d303","Type":"ContainerDied","Data":"2afa719d53f3b36e7e0db9990a25db425839dc80c50d1dfc8acedb223997c0f9"}
Jul 28 04:12:09.043268 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.043239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" event={"ID":"7101fac5-991a-47d3-b2be-bdcde548d303","Type":"ContainerStarted","Data":"e4959d15fced26bd601575cd245421105fd00f093c627af956afcd6e04508adc"}
Jul 28 04:12:09.074097 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.074067    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 04:12:09.738189 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.738055    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T04:12:09.074089232Z","UUID":"270f878f-1f57-42d5-8cdd-67f7dd052ec7","Handler":null,"Name":"","Endpoint":""}
Jul 28 04:12:09.739895 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.739874    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 04:12:09.740021 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.739919    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 04:12:09.834914 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.834883    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:09.835098 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:09.834997    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:09.835439 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.835417    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:09.835553 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:09.835526    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:09.835619 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:09.835595    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:09.835691 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:09.835668    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:10.047846 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:10.047750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62" event={"ID":"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9","Type":"ContainerStarted","Data":"1f95404a27c5de0c7a8b8d461f45e1b1286f2d521f81dac1fcbfd1cc3d288a8c"}
Jul 28 04:12:10.047846 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:10.047830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62" event={"ID":"2ecf3c06-5c88-4bc0-90bb-ca1f7942fbb9","Type":"ContainerStarted","Data":"4077c0c90f8d8b1eb36223b0ed8ae0457be1d89bd0c64e2595af92727ab0cf67"}
Jul 28 04:12:10.049672 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:10.049619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mhqg4" event={"ID":"c7a3fd1c-ba41-4315-ac90-d7c77de1777c","Type":"ContainerStarted","Data":"69577778ac971459669936a5b5ab056b88895f5fe89ad6086e67d88adc891f55"}
Jul 28 04:12:10.062359 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:10.062255    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrk62" podStartSLOduration=3.440102339 podStartE2EDuration="24.062237232s" totalImagesPullingTime="20.622134893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:10.061561036 +0000 UTC m=+24.769043337" watchObservedRunningTime="2026-07-28 04:12:10.062237232 +0000 UTC m=+24.769719531"
Jul 28 04:12:10.072908 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:10.072840    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mhqg4" podStartSLOduration=5.315700757 podStartE2EDuration="24.072828359s" totalImagesPullingTime="18.757127602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:10.072338835 +0000 UTC m=+24.779821136" watchObservedRunningTime="2026-07-28 04:12:10.072828359 +0000 UTC m=+24.780310659"
Jul 28 04:12:11.348873 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:11.348834    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:12:11.349527 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:11.349507    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:12:11.833280 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:11.833095    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:11.833480 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:11.833104    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:11.833480 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:11.833373    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:11.833480 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:11.833246    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:11.833480 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:11.833460    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:11.833693 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:11.833526    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:12.054226 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:12.054187    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:12:12.054693 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:12.054677    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-skww4"
Jul 28 04:12:13.058166 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:13.058133    2581 generic.go:356] "Generic (PLEG): container finished" podID="db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd" containerID="4057bd647c7714f6679e02054134a3d8d10455d008384f9ca260212c448c13cf" exitCode=0
Jul 28 04:12:13.058166 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:13.058164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tllh" event={"ID":"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd","Type":"ContainerDied","Data":"4057bd647c7714f6679e02054134a3d8d10455d008384f9ca260212c448c13cf"}
Jul 28 04:12:13.061353 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:13.061335    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:12:13.061695 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:13.061675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" event={"ID":"7101fac5-991a-47d3-b2be-bdcde548d303","Type":"ContainerStarted","Data":"fda4d5fc7c793bcb2aa3c084566afb982f4f31445e42c8d9590d117b391df062"}
Jul 28 04:12:13.833048 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:13.833011    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:13.833156 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:13.833012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:13.833156 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:13.833130    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:13.833156 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:13.833142    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:13.833265 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:13.833214    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:13.833304 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:13.833289    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:14.066440 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:14.066359    2581 generic.go:356] "Generic (PLEG): container finished" podID="db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd" containerID="35bda9fb644ab7fda055c9750b640bf2c306193ad6a8db2be8d976b4ec411928" exitCode=0
Jul 28 04:12:14.066895 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:14.066451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tllh" event={"ID":"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd","Type":"ContainerDied","Data":"35bda9fb644ab7fda055c9750b640bf2c306193ad6a8db2be8d976b4ec411928"}
Jul 28 04:12:15.071011 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:15.070772    2581 generic.go:356] "Generic (PLEG): container finished" podID="db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd" containerID="ffdec34868768d2a7a6cab5fbd0e448ba06960dbb8dbea0a48e792b7c4289aca" exitCode=0
Jul 28 04:12:15.071011 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:15.070830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tllh" event={"ID":"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd","Type":"ContainerDied","Data":"ffdec34868768d2a7a6cab5fbd0e448ba06960dbb8dbea0a48e792b7c4289aca"}
Jul 28 04:12:15.074679 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:15.074595    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:12:15.075028 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:15.074971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" event={"ID":"7101fac5-991a-47d3-b2be-bdcde548d303","Type":"ContainerStarted","Data":"0b40cab5027be51e0b5465be6340fffd3d5348345815a46d739a0c5865bdf15d"}
Jul 28 04:12:15.075248 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:15.075224    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:12:15.075418 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:15.075404    2581 scope.go:117] "RemoveContainer" containerID="2afa719d53f3b36e7e0db9990a25db425839dc80c50d1dfc8acedb223997c0f9"
Jul 28 04:12:15.092197 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:15.092174    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:12:15.833696 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:15.833666    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:15.833877 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:15.833760    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:15.834204 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:15.834166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:15.834326 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:15.834297    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:15.834389 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:15.834169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:15.834439 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:15.834400    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:16.085150 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.085067    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:12:16.085568 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.085462    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" event={"ID":"7101fac5-991a-47d3-b2be-bdcde548d303","Type":"ContainerStarted","Data":"e022d1783352726eb32d8867283c8b7008e2ffa05c867d68b4993c3985272b44"}
Jul 28 04:12:16.087346 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.087176    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:12:16.087346 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.087294    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:12:16.108548 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.108520    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:12:16.113602 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.113381    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj" podStartSLOduration=10.900637454 podStartE2EDuration="30.113362261s" totalImagesPullingTime="19.212724807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:16.111012529 +0000 UTC m=+30.818494830" watchObservedRunningTime="2026-07-28 04:12:16.113362261 +0000 UTC m=+30.820844563"
Jul 28 04:12:16.324011 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.323973    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g86tz"]
Jul 28 04:12:16.324268 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.324127    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:16.324268 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:16.324249    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:16.333537 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.333511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q99nq"]
Jul 28 04:12:16.333684 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.333596    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r48nx"]
Jul 28 04:12:16.333684 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.333678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:16.333799 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:16.333775    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:16.333885 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:16.333867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:16.334261 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:16.334237    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:17.833370 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:17.833295    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:17.833370 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:17.833332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:17.833984 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:17.833295    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:17.833984 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:17.833431    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:17.833984 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:17.833500    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:17.833984 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:17.833576    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:19.447253 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:19.447212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclvw\" (UniqueName: \"kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw\") pod \"network-check-target-r48nx\" (UID: \"ec143d3e-dba3-4a4f-a0c1-749c014e71f2\") " pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:19.447696 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.447360    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 04:12:19.447696 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.447376    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 04:12:19.447696 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.447386    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dclvw for pod openshift-network-diagnostics/network-check-target-r48nx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:12:19.447696 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.447432    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw podName:ec143d3e-dba3-4a4f-a0c1-749c014e71f2 nodeName:}" failed. No retries permitted until 2026-07-28 04:12:51.447419217 +0000 UTC m=+66.154901509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dclvw" (UniqueName: "kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw") pod "network-check-target-r48nx" (UID: "ec143d3e-dba3-4a4f-a0c1-749c014e71f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 04:12:19.547968 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:19.547936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:19.547968 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:19.547975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:19.548167 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.548089    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 04:12:19.548167 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.548091    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:12:19.548167 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.548146    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret podName:66596be3-19df-47a0-b3e7-8733521981fa nodeName:}" failed. No retries permitted until 2026-07-28 04:12:51.548128267 +0000 UTC m=+66.255610559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret") pod "global-pull-secret-syncer-q99nq" (UID: "66596be3-19df-47a0-b3e7-8733521981fa") : object "kube-system"/"original-pull-secret" not registered
Jul 28 04:12:19.548167 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.548159    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs podName:63fd0789-69d2-487c-b10b-b66deba1de75 nodeName:}" failed. No retries permitted until 2026-07-28 04:12:51.548153361 +0000 UTC m=+66.255635639 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs") pod "network-metrics-daemon-g86tz" (UID: "63fd0789-69d2-487c-b10b-b66deba1de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 04:12:19.832913 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:19.832881    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:19.833008 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:19.832885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:19.833062 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.833014    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r48nx" podUID="ec143d3e-dba3-4a4f-a0c1-749c014e71f2"
Jul 28 04:12:19.833062 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:19.833051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:19.833189 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.833169    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:12:19.833352 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:19.833327    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q99nq" podUID="66596be3-19df-47a0-b3e7-8733521981fa"
Jul 28 04:12:20.098023 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.097944    2581 generic.go:356] "Generic (PLEG): container finished" podID="db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd" containerID="99bfe43e72cfb2befb3d2dee24f5e5579edc35a2ef3a86b2f64959d4d578e3f6" exitCode=0
Jul 28 04:12:20.098023 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.097990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tllh" event={"ID":"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd","Type":"ContainerDied","Data":"99bfe43e72cfb2befb3d2dee24f5e5579edc35a2ef3a86b2f64959d4d578e3f6"}
Jul 28 04:12:20.645892 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.645864    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeReady"
Jul 28 04:12:20.646628 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.645990    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 04:12:20.683776 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.683750    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ftv8z"]
Jul 28 04:12:20.703395 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.703362    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gw442"]
Jul 28 04:12:20.703532 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.703486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.705465 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.705446    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 04:12:20.705574 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.705446    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 04:12:20.705574 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.705448    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7zgg8\""
Jul 28 04:12:20.727128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.727111    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ftv8z"]
Jul 28 04:12:20.727230 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.727140    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gw442"]
Jul 28 04:12:20.727230 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.727205    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gw442"
Jul 28 04:12:20.729524 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.729509    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 04:12:20.729637 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.729558    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 04:12:20.729712 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.729678    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-69gm8\""
Jul 28 04:12:20.729793 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.729774    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 04:12:20.859843 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.859812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l9fc\" (UniqueName: \"kubernetes.io/projected/37aba33f-561c-475a-b57f-9f31035b8967-kube-api-access-4l9fc\") pod \"ingress-canary-gw442\" (UID: \"37aba33f-561c-475a-b57f-9f31035b8967\") " pod="openshift-ingress-canary/ingress-canary-gw442"
Jul 28 04:12:20.859988 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.859851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-tmp-dir\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.859988 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.859891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37aba33f-561c-475a-b57f-9f31035b8967-cert\") pod \"ingress-canary-gw442\" (UID: \"37aba33f-561c-475a-b57f-9f31035b8967\") " pod="openshift-ingress-canary/ingress-canary-gw442"
Jul 28 04:12:20.859988 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.859941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.859988 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.859966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-config-volume\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.859988 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.859982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9x9q\" (UniqueName: \"kubernetes.io/projected/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-kube-api-access-f9x9q\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.961251 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.961177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37aba33f-561c-475a-b57f-9f31035b8967-cert\") pod \"ingress-canary-gw442\" (UID: \"37aba33f-561c-475a-b57f-9f31035b8967\") " pod="openshift-ingress-canary/ingress-canary-gw442"
Jul 28 04:12:20.961251 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.961234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.961443 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.961269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-config-volume\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.961443 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.961286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9x9q\" (UniqueName: \"kubernetes.io/projected/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-kube-api-access-f9x9q\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.961443 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.961316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l9fc\" (UniqueName: \"kubernetes.io/projected/37aba33f-561c-475a-b57f-9f31035b8967-kube-api-access-4l9fc\") pod \"ingress-canary-gw442\" (UID: \"37aba33f-561c-475a-b57f-9f31035b8967\") " pod="openshift-ingress-canary/ingress-canary-gw442"
Jul 28 04:12:20.961443 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:20.961429    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 04:12:20.961617 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.961493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-tmp-dir\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.961617 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:20.961499    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls podName:6ec8f2fb-b989-439f-b0dc-f0e98d36a44f nodeName:}" failed. No retries permitted until 2026-07-28 04:12:21.461478226 +0000 UTC m=+36.168960519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls") pod "dns-default-ftv8z" (UID: "6ec8f2fb-b989-439f-b0dc-f0e98d36a44f") : secret "dns-default-metrics-tls" not found
Jul 28 04:12:20.961836 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.961816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-tmp-dir\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.961918 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.961900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-config-volume\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:20.965613 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.965591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37aba33f-561c-475a-b57f-9f31035b8967-cert\") pod \"ingress-canary-gw442\" (UID: \"37aba33f-561c-475a-b57f-9f31035b8967\") " pod="openshift-ingress-canary/ingress-canary-gw442"
Jul 28 04:12:20.971390 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.971359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l9fc\" (UniqueName: \"kubernetes.io/projected/37aba33f-561c-475a-b57f-9f31035b8967-kube-api-access-4l9fc\") pod \"ingress-canary-gw442\" (UID: \"37aba33f-561c-475a-b57f-9f31035b8967\") " pod="openshift-ingress-canary/ingress-canary-gw442"
Jul 28 04:12:20.971597 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:20.971579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9x9q\" (UniqueName: \"kubernetes.io/projected/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-kube-api-access-f9x9q\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:21.035141 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.035110    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gw442"
Jul 28 04:12:21.103280 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.103250    2581 generic.go:356] "Generic (PLEG): container finished" podID="db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd" containerID="6c1a3cbea1d88782bbe54f13cf71522b4bce80f4996ce4a744afdd98dc38d5f7" exitCode=0
Jul 28 04:12:21.103428 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.103308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tllh" event={"ID":"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd","Type":"ContainerDied","Data":"6c1a3cbea1d88782bbe54f13cf71522b4bce80f4996ce4a744afdd98dc38d5f7"}
Jul 28 04:12:21.218425 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.218271    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gw442"]
Jul 28 04:12:21.222061 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:12:21.222021    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37aba33f_561c_475a_b57f_9f31035b8967.slice/crio-2df38a4d30ace7e93672a7f5c63042dc810dc1ac79d1ea1811844a119fb4033a WatchSource:0}: Error finding container 2df38a4d30ace7e93672a7f5c63042dc810dc1ac79d1ea1811844a119fb4033a: Status 404 returned error can't find the container with id 2df38a4d30ace7e93672a7f5c63042dc810dc1ac79d1ea1811844a119fb4033a
Jul 28 04:12:21.465457 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.465422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:21.465655 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:21.465571    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 04:12:21.465655 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:21.465634    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls podName:6ec8f2fb-b989-439f-b0dc-f0e98d36a44f nodeName:}" failed. No retries permitted until 2026-07-28 04:12:22.465618373 +0000 UTC m=+37.173100666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls") pod "dns-default-ftv8z" (UID: "6ec8f2fb-b989-439f-b0dc-f0e98d36a44f") : secret "dns-default-metrics-tls" not found
Jul 28 04:12:21.833410 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.833373    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:21.833410 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.833415    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:21.834048 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.833390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:21.835983 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.835965    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 04:12:21.836197 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.836182    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 04:12:21.836394 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.836380    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x5zc2\""
Jul 28 04:12:21.836565 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.836552    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 04:12:21.836777 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.836764    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 04:12:21.836964 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:21.836951    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9nvrd\""
Jul 28 04:12:22.107436 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:22.107348    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gw442" event={"ID":"37aba33f-561c-475a-b57f-9f31035b8967","Type":"ContainerStarted","Data":"2df38a4d30ace7e93672a7f5c63042dc810dc1ac79d1ea1811844a119fb4033a"}
Jul 28 04:12:22.111201 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:22.111177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tllh" event={"ID":"db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd","Type":"ContainerStarted","Data":"992790103d6ff8a1a49d5e1ad0a17a9dfd9a472ac3e8e5156b410620b0eda04a"}
Jul 28 04:12:22.131081 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:22.131008    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9tllh" podStartSLOduration=7.247962531 podStartE2EDuration="36.130994875s" totalImagesPullingTime="28.883032344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:22.130462375 +0000 UTC m=+36.837944676" watchObservedRunningTime="2026-07-28 04:12:22.130994875 +0000 UTC m=+36.838477176"
Jul 28 04:12:22.474578 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:22.474492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:22.474751 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:22.474670    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 04:12:22.474804 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:22.474762    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls podName:6ec8f2fb-b989-439f-b0dc-f0e98d36a44f nodeName:}" failed. No retries permitted until 2026-07-28 04:12:24.474739776 +0000 UTC m=+39.182222078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls") pod "dns-default-ftv8z" (UID: "6ec8f2fb-b989-439f-b0dc-f0e98d36a44f") : secret "dns-default-metrics-tls" not found
Jul 28 04:12:24.117483 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:24.117309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gw442" event={"ID":"37aba33f-561c-475a-b57f-9f31035b8967","Type":"ContainerStarted","Data":"3b258195ef8594d656c66e9e3b8338feb8a22390db7211961beb057b77d7e345"}
Jul 28 04:12:24.132611 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:24.132570    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gw442" podStartSLOduration=1.756562333 podStartE2EDuration="4.132554692s" totalImagesPullingTime="2.375992359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:12:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:24.132154372 +0000 UTC m=+38.839636674" watchObservedRunningTime="2026-07-28 04:12:24.132554692 +0000 UTC m=+38.840036994"
Jul 28 04:12:24.489551 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:24.489467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:24.489690 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:24.489597    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 04:12:24.489690 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:24.489652    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls podName:6ec8f2fb-b989-439f-b0dc-f0e98d36a44f nodeName:}" failed. No retries permitted until 2026-07-28 04:12:28.489637857 +0000 UTC m=+43.197120136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls") pod "dns-default-ftv8z" (UID: "6ec8f2fb-b989-439f-b0dc-f0e98d36a44f") : secret "dns-default-metrics-tls" not found
Jul 28 04:12:28.519662 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:28.519620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:28.520210 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:28.519760    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 04:12:28.520210 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:28.519825    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls podName:6ec8f2fb-b989-439f-b0dc-f0e98d36a44f nodeName:}" failed. No retries permitted until 2026-07-28 04:12:36.519809661 +0000 UTC m=+51.227291960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls") pod "dns-default-ftv8z" (UID: "6ec8f2fb-b989-439f-b0dc-f0e98d36a44f") : secret "dns-default-metrics-tls" not found
Jul 28 04:12:36.566263 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:36.566220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:36.566737 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:36.566371    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 04:12:36.566737 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:36.566437    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls podName:6ec8f2fb-b989-439f-b0dc-f0e98d36a44f nodeName:}" failed. No retries permitted until 2026-07-28 04:12:52.566419961 +0000 UTC m=+67.273902240 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls") pod "dns-default-ftv8z" (UID: "6ec8f2fb-b989-439f-b0dc-f0e98d36a44f") : secret "dns-default-metrics-tls" not found
Jul 28 04:12:48.101881 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:48.101852    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggtj"
Jul 28 04:12:51.473245 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.473204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclvw\" (UniqueName: \"kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw\") pod \"network-check-target-r48nx\" (UID: \"ec143d3e-dba3-4a4f-a0c1-749c014e71f2\") " pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:51.475362 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.475336    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 04:12:51.486293 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.486273    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 04:12:51.498665 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.498643    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dclvw\" (UniqueName: \"kubernetes.io/projected/ec143d3e-dba3-4a4f-a0c1-749c014e71f2-kube-api-access-dclvw\") pod \"network-check-target-r48nx\" (UID: \"ec143d3e-dba3-4a4f-a0c1-749c014e71f2\") " pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:51.555818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.555799    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9nvrd\""
Jul 28 04:12:51.564454 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.564433    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:51.573819 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.573798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:12:51.573872 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.573831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:51.575716 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.575700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 04:12:51.575806 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.575767    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 04:12:51.584419 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:51.584402    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 04:12:51.584493 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:51.584462    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs podName:63fd0789-69d2-487c-b10b-b66deba1de75 nodeName:}" failed. No retries permitted until 2026-07-28 04:13:55.58444388 +0000 UTC m=+130.291926158 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs") pod "network-metrics-daemon-g86tz" (UID: "63fd0789-69d2-487c-b10b-b66deba1de75") : secret "metrics-daemon-secret" not found
Jul 28 04:12:51.586611 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.586590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66596be3-19df-47a0-b3e7-8733521981fa-original-pull-secret\") pod \"global-pull-secret-syncer-q99nq\" (UID: \"66596be3-19df-47a0-b3e7-8733521981fa\") " pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:51.724498 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.724429    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r48nx"]
Jul 28 04:12:51.728242 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:12:51.728216    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec143d3e_dba3_4a4f_a0c1_749c014e71f2.slice/crio-f3a21fe5c10e01f18a9190d3625e04c758d935c844834dd03d86beeaffb6c246 WatchSource:0}: Error finding container f3a21fe5c10e01f18a9190d3625e04c758d935c844834dd03d86beeaffb6c246: Status 404 returned error can't find the container with id f3a21fe5c10e01f18a9190d3625e04c758d935c844834dd03d86beeaffb6c246
Jul 28 04:12:51.846648 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.846628    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q99nq"
Jul 28 04:12:51.959400 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:51.959365    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q99nq"]
Jul 28 04:12:51.962712 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:12:51.962692    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66596be3_19df_47a0_b3e7_8733521981fa.slice/crio-2afdc2f83ebc4424671430d85f6590bbf9cc62c3e1036e37273bb117b66898b5 WatchSource:0}: Error finding container 2afdc2f83ebc4424671430d85f6590bbf9cc62c3e1036e37273bb117b66898b5: Status 404 returned error can't find the container with id 2afdc2f83ebc4424671430d85f6590bbf9cc62c3e1036e37273bb117b66898b5
Jul 28 04:12:52.182126 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:52.182083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q99nq" event={"ID":"66596be3-19df-47a0-b3e7-8733521981fa","Type":"ContainerStarted","Data":"2afdc2f83ebc4424671430d85f6590bbf9cc62c3e1036e37273bb117b66898b5"}
Jul 28 04:12:52.183326 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:52.183294    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r48nx" event={"ID":"ec143d3e-dba3-4a4f-a0c1-749c014e71f2","Type":"ContainerStarted","Data":"f3a21fe5c10e01f18a9190d3625e04c758d935c844834dd03d86beeaffb6c246"}
Jul 28 04:12:52.581457 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:52.581420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:12:52.581898 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:52.581595    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 04:12:52.581898 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:12:52.581660    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls podName:6ec8f2fb-b989-439f-b0dc-f0e98d36a44f nodeName:}" failed. No retries permitted until 2026-07-28 04:13:24.581644358 +0000 UTC m=+99.289126636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls") pod "dns-default-ftv8z" (UID: "6ec8f2fb-b989-439f-b0dc-f0e98d36a44f") : secret "dns-default-metrics-tls" not found
Jul 28 04:12:56.195728 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:56.195685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q99nq" event={"ID":"66596be3-19df-47a0-b3e7-8733521981fa","Type":"ContainerStarted","Data":"69b1f85f12f3bbec437496a32a3a0617c0b358125c29d447f9c67286b8fc2434"}
Jul 28 04:12:56.197303 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:56.197278    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r48nx" event={"ID":"ec143d3e-dba3-4a4f-a0c1-749c014e71f2","Type":"ContainerStarted","Data":"6ca9172ef12309d1f8f99a783b8290a5395d2445d99af8bc7eb09bb72ed5c5b8"}
Jul 28 04:12:56.197428 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:56.197413    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:12:56.208998 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:56.208950    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q99nq" podStartSLOduration=66.119016129 podStartE2EDuration="1m10.208935091s" totalImagesPullingTime="4.089918962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:56.207797577 +0000 UTC m=+70.915279878" watchObservedRunningTime="2026-07-28 04:12:56.208935091 +0000 UTC m=+70.916417391"
Jul 28 04:12:56.220845 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:12:56.220794    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r48nx" podStartSLOduration=65.900114777 podStartE2EDuration="1m10.220780295s" totalImagesPullingTime="4.320665518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:12:56.220482518 +0000 UTC m=+70.927964819" watchObservedRunningTime="2026-07-28 04:12:56.220780295 +0000 UTC m=+70.928262574"
Jul 28 04:13:24.598861 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:24.598718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:13:24.598861 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:13:24.598851    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 04:13:24.599402 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:13:24.598913    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls podName:6ec8f2fb-b989-439f-b0dc-f0e98d36a44f nodeName:}" failed. No retries permitted until 2026-07-28 04:14:28.598898605 +0000 UTC m=+163.306380883 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls") pod "dns-default-ftv8z" (UID: "6ec8f2fb-b989-439f-b0dc-f0e98d36a44f") : secret "dns-default-metrics-tls" not found
Jul 28 04:13:27.202533 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:27.202503    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r48nx"
Jul 28 04:13:46.321345 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.321311    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"]
Jul 28 04:13:46.323112 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.323095    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.325823 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.325799    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 04:13:46.325823 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.325814    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 04:13:46.325992 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.325799    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 04:13:46.325992 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.325854    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 04:13:46.334003 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.333983    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"]
Jul 28 04:13:46.444898 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.444871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4f8e9e23-8737-4c65-836e-f088cb2ad750-klusterlet-config\") pod \"klusterlet-addon-workmgr-8664f666bc-xpcnc\" (UID: \"4f8e9e23-8737-4c65-836e-f088cb2ad750\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.445058 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.444926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcmht\" (UniqueName: \"kubernetes.io/projected/4f8e9e23-8737-4c65-836e-f088cb2ad750-kube-api-access-rcmht\") pod \"klusterlet-addon-workmgr-8664f666bc-xpcnc\" (UID: \"4f8e9e23-8737-4c65-836e-f088cb2ad750\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.445058 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.445004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f8e9e23-8737-4c65-836e-f088cb2ad750-tmp\") pod \"klusterlet-addon-workmgr-8664f666bc-xpcnc\" (UID: \"4f8e9e23-8737-4c65-836e-f088cb2ad750\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.546003 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.545979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4f8e9e23-8737-4c65-836e-f088cb2ad750-klusterlet-config\") pod \"klusterlet-addon-workmgr-8664f666bc-xpcnc\" (UID: \"4f8e9e23-8737-4c65-836e-f088cb2ad750\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.546092 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.546049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcmht\" (UniqueName: \"kubernetes.io/projected/4f8e9e23-8737-4c65-836e-f088cb2ad750-kube-api-access-rcmht\") pod \"klusterlet-addon-workmgr-8664f666bc-xpcnc\" (UID: \"4f8e9e23-8737-4c65-836e-f088cb2ad750\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.546130 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.546093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f8e9e23-8737-4c65-836e-f088cb2ad750-tmp\") pod \"klusterlet-addon-workmgr-8664f666bc-xpcnc\" (UID: \"4f8e9e23-8737-4c65-836e-f088cb2ad750\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.546514 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.546494    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f8e9e23-8737-4c65-836e-f088cb2ad750-tmp\") pod \"klusterlet-addon-workmgr-8664f666bc-xpcnc\" (UID: \"4f8e9e23-8737-4c65-836e-f088cb2ad750\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.548881 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.548855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4f8e9e23-8737-4c65-836e-f088cb2ad750-klusterlet-config\") pod \"klusterlet-addon-workmgr-8664f666bc-xpcnc\" (UID: \"4f8e9e23-8737-4c65-836e-f088cb2ad750\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.553886 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.553867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcmht\" (UniqueName: \"kubernetes.io/projected/4f8e9e23-8737-4c65-836e-f088cb2ad750-kube-api-access-rcmht\") pod \"klusterlet-addon-workmgr-8664f666bc-xpcnc\" (UID: \"4f8e9e23-8737-4c65-836e-f088cb2ad750\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.632072 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.631988    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:46.747288 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:46.747259    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"]
Jul 28 04:13:46.750083 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:13:46.750011    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8e9e23_8737_4c65_836e_f088cb2ad750.slice/crio-97b4d8a67f3496b1f54e7d8d5fddcd0f6586dddcf4b2ee1ce52c675d8adb3d64 WatchSource:0}: Error finding container 97b4d8a67f3496b1f54e7d8d5fddcd0f6586dddcf4b2ee1ce52c675d8adb3d64: Status 404 returned error can't find the container with id 97b4d8a67f3496b1f54e7d8d5fddcd0f6586dddcf4b2ee1ce52c675d8adb3d64
Jul 28 04:13:47.318869 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:47.318830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc" event={"ID":"4f8e9e23-8737-4c65-836e-f088cb2ad750","Type":"ContainerStarted","Data":"97b4d8a67f3496b1f54e7d8d5fddcd0f6586dddcf4b2ee1ce52c675d8adb3d64"}
Jul 28 04:13:51.331401 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:51.331360    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc" event={"ID":"4f8e9e23-8737-4c65-836e-f088cb2ad750","Type":"ContainerStarted","Data":"35a4b474e87d595792872280887aee7ecc188163f357e2186af56a97f4a9a43e"}
Jul 28 04:13:51.331798 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:51.331565    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:51.333148 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:51.333127    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:13:51.345538 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:51.345497    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc" podStartSLOduration=1.4339172709999999 podStartE2EDuration="5.345483638s" totalImagesPullingTime="3.911566367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:13:51.34529637 +0000 UTC m=+126.052778671" watchObservedRunningTime="2026-07-28 04:13:51.345483638 +0000 UTC m=+126.052965938"
Jul 28 04:13:55.609476 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:13:55.609436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:13:55.609976 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:13:55.609534    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 04:13:55.609976 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:13:55.609602    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs podName:63fd0789-69d2-487c-b10b-b66deba1de75 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:57.609586139 +0000 UTC m=+252.317068418 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs") pod "network-metrics-daemon-g86tz" (UID: "63fd0789-69d2-487c-b10b-b66deba1de75") : secret "metrics-daemon-secret" not found
Jul 28 04:14:23.712379 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:14:23.712328    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ftv8z" podUID="6ec8f2fb-b989-439f-b0dc-f0e98d36a44f"
Jul 28 04:14:24.409591 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:14:24.409565    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:14:24.860289 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:14:24.860251    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g86tz" podUID="63fd0789-69d2-487c-b10b-b66deba1de75"
Jul 28 04:14:28.626402 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:14:28.626351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:14:28.626828 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:14:28.626511    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 04:14:28.626828 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:14:28.626578    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls podName:6ec8f2fb-b989-439f-b0dc-f0e98d36a44f nodeName:}" failed. No retries permitted until 2026-07-28 04:16:30.626561582 +0000 UTC m=+285.334043896 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls") pod "dns-default-ftv8z" (UID: "6ec8f2fb-b989-439f-b0dc-f0e98d36a44f") : secret "dns-default-metrics-tls" not found
Jul 28 04:14:36.833223 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:14:36.833146    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:15:36.927217 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:36.927183    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8455cf7f7b-ft9jg"]
Jul 28 04:15:36.928941 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:36.928926    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:36.930916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:36.930887    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 04:15:36.931088 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:36.930937    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 04:15:36.931212 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:36.931197    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 04:15:36.931404 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:36.931390    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s6545\""
Jul 28 04:15:36.936238 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:36.936216    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 04:15:36.949596 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:36.949575    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8455cf7f7b-ft9jg"]
Jul 28 04:15:37.017945 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.017918    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q"]
Jul 28 04:15:37.019962 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.019946    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"]
Jul 28 04:15:37.020110 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.020095    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q"
Jul 28 04:15:37.021792 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.021774    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:37.022292 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.022266    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dhvmb\""
Jul 28 04:15:37.022380 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.022337    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 04:15:37.022380 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.022352    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 04:15:37.023938 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.023922    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 04:15:37.023938 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.023935    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 04:15:37.024496 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.024478    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gk725\""
Jul 28 04:15:37.024593 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.024482    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 04:15:37.032088 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.032067    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q"]
Jul 28 04:15:37.033006 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.032981    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"]
Jul 28 04:15:37.078176 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72ee3344-fdbc-4422-a238-ebc1d19f15e3-ca-trust-extracted\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.078176 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxng8\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-kube-api-access-cxng8\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.078377 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:37.078377 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-certificates\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.078377 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-image-registry-private-configuration\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.078377 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5zp8\" (UniqueName: \"kubernetes.io/projected/c8df8c91-daa2-4839-afb6-b347e989d820-kube-api-access-c5zp8\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:37.078377 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.078531 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-trusted-ca\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.078531 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-installation-pull-secrets\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.078531 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-bound-sa-token\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.078531 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.078475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hnh2\" (UniqueName: \"kubernetes.io/projected/f9194231-1c7e-48f8-b3d7-c64d8f9f2350-kube-api-access-5hnh2\") pod \"volume-data-source-validator-549c6d54cf-6kb5q\" (UID: \"f9194231-1c7e-48f8-b3d7-c64d8f9f2350\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q"
Jul 28 04:15:37.179541 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72ee3344-fdbc-4422-a238-ebc1d19f15e3-ca-trust-extracted\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.179541 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxng8\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-kube-api-access-cxng8\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.179541 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:37.179774 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-certificates\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.179774 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-image-registry-private-configuration\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.179774 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:37.179660    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 04:15:37.179774 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5zp8\" (UniqueName: \"kubernetes.io/projected/c8df8c91-daa2-4839-afb6-b347e989d820-kube-api-access-c5zp8\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:37.179774 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:37.179729    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls podName:c8df8c91-daa2-4839-afb6-b347e989d820 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:37.67970845 +0000 UTC m=+232.387190731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls") pod "cluster-samples-operator-6748489656-2rc9k" (UID: "c8df8c91-daa2-4839-afb6-b347e989d820") : secret "samples-operator-tls" not found
Jul 28 04:15:37.179774 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.180116 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-trusted-ca\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.180116 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-installation-pull-secrets\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.180116 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-bound-sa-token\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.180116 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72ee3344-fdbc-4422-a238-ebc1d19f15e3-ca-trust-extracted\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.180116 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.179885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hnh2\" (UniqueName: \"kubernetes.io/projected/f9194231-1c7e-48f8-b3d7-c64d8f9f2350-kube-api-access-5hnh2\") pod \"volume-data-source-validator-549c6d54cf-6kb5q\" (UID: \"f9194231-1c7e-48f8-b3d7-c64d8f9f2350\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q"
Jul 28 04:15:37.180116 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:37.179882    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 04:15:37.180116 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:37.179921    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8455cf7f7b-ft9jg: secret "image-registry-tls" not found
Jul 28 04:15:37.180116 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:37.179976    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls podName:72ee3344-fdbc-4422-a238-ebc1d19f15e3 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:37.679959385 +0000 UTC m=+232.387441665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls") pod "image-registry-8455cf7f7b-ft9jg" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3") : secret "image-registry-tls" not found
Jul 28 04:15:37.180461 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.180251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-certificates\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.180725 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.180706    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-trusted-ca\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.182091 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.182069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-image-registry-private-configuration\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.182256 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.182240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-installation-pull-secrets\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.187711 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.187687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxng8\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-kube-api-access-cxng8\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.187943 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.187925    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5zp8\" (UniqueName: \"kubernetes.io/projected/c8df8c91-daa2-4839-afb6-b347e989d820-kube-api-access-c5zp8\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:37.188549 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.188523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-bound-sa-token\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.188750 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.188730    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hnh2\" (UniqueName: \"kubernetes.io/projected/f9194231-1c7e-48f8-b3d7-c64d8f9f2350-kube-api-access-5hnh2\") pod \"volume-data-source-validator-549c6d54cf-6kb5q\" (UID: \"f9194231-1c7e-48f8-b3d7-c64d8f9f2350\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q"
Jul 28 04:15:37.329981 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.329944    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q"
Jul 28 04:15:37.446398 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.446330    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q"]
Jul 28 04:15:37.449495 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:15:37.449468    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9194231_1c7e_48f8_b3d7_c64d8f9f2350.slice/crio-d78136ba43f8d51952cf29c8d45e774456b6de2b7ec19f255af28f26283c4893 WatchSource:0}: Error finding container d78136ba43f8d51952cf29c8d45e774456b6de2b7ec19f255af28f26283c4893: Status 404 returned error can't find the container with id d78136ba43f8d51952cf29c8d45e774456b6de2b7ec19f255af28f26283c4893
Jul 28 04:15:37.587492 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.587462    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q" event={"ID":"f9194231-1c7e-48f8-b3d7-c64d8f9f2350","Type":"ContainerStarted","Data":"d78136ba43f8d51952cf29c8d45e774456b6de2b7ec19f255af28f26283c4893"}
Jul 28 04:15:37.683183 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.683151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:37.683305 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:37.683194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:37.683305 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:37.683287    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 04:15:37.683305 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:37.683287    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 04:15:37.683305 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:37.683297    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8455cf7f7b-ft9jg: secret "image-registry-tls" not found
Jul 28 04:15:37.683445 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:37.683347    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls podName:72ee3344-fdbc-4422-a238-ebc1d19f15e3 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:38.683333115 +0000 UTC m=+233.390815393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls") pod "image-registry-8455cf7f7b-ft9jg" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3") : secret "image-registry-tls" not found
Jul 28 04:15:37.683445 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:37.683360    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls podName:c8df8c91-daa2-4839-afb6-b347e989d820 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:38.68335378 +0000 UTC m=+233.390836059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls") pod "cluster-samples-operator-6748489656-2rc9k" (UID: "c8df8c91-daa2-4839-afb6-b347e989d820") : secret "samples-operator-tls" not found
Jul 28 04:15:38.690086 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:38.690057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:38.690467 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:38.690105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:38.690467 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:38.690227    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 04:15:38.690467 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:38.690226    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 04:15:38.690467 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:38.690238    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8455cf7f7b-ft9jg: secret "image-registry-tls" not found
Jul 28 04:15:38.690467 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:38.690311    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls podName:c8df8c91-daa2-4839-afb6-b347e989d820 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:40.690287714 +0000 UTC m=+235.397770007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls") pod "cluster-samples-operator-6748489656-2rc9k" (UID: "c8df8c91-daa2-4839-afb6-b347e989d820") : secret "samples-operator-tls" not found
Jul 28 04:15:38.690467 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:38.690336    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls podName:72ee3344-fdbc-4422-a238-ebc1d19f15e3 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:40.69032229 +0000 UTC m=+235.397804575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls") pod "image-registry-8455cf7f7b-ft9jg" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3") : secret "image-registry-tls" not found
Jul 28 04:15:39.593930 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:39.593896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q" event={"ID":"f9194231-1c7e-48f8-b3d7-c64d8f9f2350","Type":"ContainerStarted","Data":"87fca0b61666845bbfd7633f8e9df4b9b17cc6deac8269f9cea6cc629b046268"}
Jul 28 04:15:39.608731 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:39.608682    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6kb5q" podStartSLOduration=1.470424319 podStartE2EDuration="2.608667615s" totalImagesPullingTime="1.138243296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:15:39.60792964 +0000 UTC m=+234.315411942" watchObservedRunningTime="2026-07-28 04:15:39.608667615 +0000 UTC m=+234.316149915"
Jul 28 04:15:40.705264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:40.705220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:40.705264 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:40.705280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:40.705694 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:40.705369    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 04:15:40.705694 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:40.705382    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 04:15:40.705694 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:40.705399    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8455cf7f7b-ft9jg: secret "image-registry-tls" not found
Jul 28 04:15:40.705694 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:40.705430    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls podName:c8df8c91-daa2-4839-afb6-b347e989d820 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:44.705415529 +0000 UTC m=+239.412897808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls") pod "cluster-samples-operator-6748489656-2rc9k" (UID: "c8df8c91-daa2-4839-afb6-b347e989d820") : secret "samples-operator-tls" not found
Jul 28 04:15:40.705694 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:40.705447    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls podName:72ee3344-fdbc-4422-a238-ebc1d19f15e3 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:44.705438834 +0000 UTC m=+239.412921113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls") pod "image-registry-8455cf7f7b-ft9jg" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3") : secret "image-registry-tls" not found
Jul 28 04:15:42.526751 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.526717    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd"]
Jul 28 04:15:42.530990 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.530964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd"
Jul 28 04:15:42.533163 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.533141    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 04:15:42.533163 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.533154    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 04:15:42.533358 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.533191    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-l9jwv\""
Jul 28 04:15:42.538168 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.538146    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd"]
Jul 28 04:15:42.565714 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.565691    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wgv9v"]
Jul 28 04:15:42.568568 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.568546    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.570380 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.570363    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 04:15:42.570693 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.570676    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tkv7l\""
Jul 28 04:15:42.570756 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.570697    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 04:15:42.570756 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.570718    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 04:15:42.570907 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.570894    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 04:15:42.581225 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.581209    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wgv9v"]
Jul 28 04:15:42.620242 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.620217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf528\" (UniqueName: \"kubernetes.io/projected/bce371a2-8aad-4342-87c3-1cf9fe9d3e55-kube-api-access-jf528\") pod \"migrator-6865c9967-x94xd\" (UID: \"bce371a2-8aad-4342-87c3-1cf9fe9d3e55\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd"
Jul 28 04:15:42.721486 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.721455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-crio-socket\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.721486 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.721491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkjpc\" (UniqueName: \"kubernetes.io/projected/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-api-access-nkjpc\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.721646 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.721528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.721646 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.721593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-data-volume\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.721646 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.721623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.721740 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.721652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf528\" (UniqueName: \"kubernetes.io/projected/bce371a2-8aad-4342-87c3-1cf9fe9d3e55-kube-api-access-jf528\") pod \"migrator-6865c9967-x94xd\" (UID: \"bce371a2-8aad-4342-87c3-1cf9fe9d3e55\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd"
Jul 28 04:15:42.729192 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.729167    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf528\" (UniqueName: \"kubernetes.io/projected/bce371a2-8aad-4342-87c3-1cf9fe9d3e55-kube-api-access-jf528\") pod \"migrator-6865c9967-x94xd\" (UID: \"bce371a2-8aad-4342-87c3-1cf9fe9d3e55\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd"
Jul 28 04:15:42.822486 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.822414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.822486 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.822470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-data-volume\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.822486 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.822489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.822692 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.822546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-crio-socket\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.822692 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:42.822549    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 04:15:42.822692 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:42.822573    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 04:15:42.822692 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.822586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkjpc\" (UniqueName: \"kubernetes.io/projected/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-api-access-nkjpc\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.822692 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:42.822625    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm podName:0f379dcb-16d1-409f-a2ab-dae029ab2f1b nodeName:}" failed. No retries permitted until 2026-07-28 04:15:43.322604402 +0000 UTC m=+238.030086716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wgv9v" (UID: "0f379dcb-16d1-409f-a2ab-dae029ab2f1b") : configmap "kube-rbac-proxy" not found
Jul 28 04:15:42.822692 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:42.822642    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls podName:0f379dcb-16d1-409f-a2ab-dae029ab2f1b nodeName:}" failed. No retries permitted until 2026-07-28 04:15:43.32263331 +0000 UTC m=+238.030115590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wgv9v" (UID: "0f379dcb-16d1-409f-a2ab-dae029ab2f1b") : secret "insights-runtime-extractor-tls" not found
Jul 28 04:15:42.822692 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.822642    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-crio-socket\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.822938 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.822771    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-data-volume\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.830391 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.830367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkjpc\" (UniqueName: \"kubernetes.io/projected/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-api-access-nkjpc\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:42.840725 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.840705    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd"
Jul 28 04:15:42.955825 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:42.955797    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd"]
Jul 28 04:15:42.959441 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:15:42.959410    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce371a2_8aad_4342_87c3_1cf9fe9d3e55.slice/crio-15ad3d74f97547bc579a170be21c027ccea8537147b4639529d0541552317df7 WatchSource:0}: Error finding container 15ad3d74f97547bc579a170be21c027ccea8537147b4639529d0541552317df7: Status 404 returned error can't find the container with id 15ad3d74f97547bc579a170be21c027ccea8537147b4639529d0541552317df7
Jul 28 04:15:43.326377 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:43.326344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:43.326541 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:43.326392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:43.326541 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:43.326455    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 04:15:43.326541 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:43.326494    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 04:15:43.326541 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:43.326510    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm podName:0f379dcb-16d1-409f-a2ab-dae029ab2f1b nodeName:}" failed. No retries permitted until 2026-07-28 04:15:44.326496126 +0000 UTC m=+239.033978405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wgv9v" (UID: "0f379dcb-16d1-409f-a2ab-dae029ab2f1b") : configmap "kube-rbac-proxy" not found
Jul 28 04:15:43.326681 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:43.326547    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls podName:0f379dcb-16d1-409f-a2ab-dae029ab2f1b nodeName:}" failed. No retries permitted until 2026-07-28 04:15:44.326533799 +0000 UTC m=+239.034016077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wgv9v" (UID: "0f379dcb-16d1-409f-a2ab-dae029ab2f1b") : secret "insights-runtime-extractor-tls" not found
Jul 28 04:15:43.607677 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:43.607606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd" event={"ID":"bce371a2-8aad-4342-87c3-1cf9fe9d3e55","Type":"ContainerStarted","Data":"15ad3d74f97547bc579a170be21c027ccea8537147b4639529d0541552317df7"}
Jul 28 04:15:44.335243 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:44.335203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:44.335399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:44.335279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:44.335399 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:44.335353    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 04:15:44.335399 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:44.335360    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 04:15:44.335494 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:44.335417    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls podName:0f379dcb-16d1-409f-a2ab-dae029ab2f1b nodeName:}" failed. No retries permitted until 2026-07-28 04:15:46.335401216 +0000 UTC m=+241.042883494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wgv9v" (UID: "0f379dcb-16d1-409f-a2ab-dae029ab2f1b") : secret "insights-runtime-extractor-tls" not found
Jul 28 04:15:44.335494 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:44.335433    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm podName:0f379dcb-16d1-409f-a2ab-dae029ab2f1b nodeName:}" failed. No retries permitted until 2026-07-28 04:15:46.335425997 +0000 UTC m=+241.042908275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wgv9v" (UID: "0f379dcb-16d1-409f-a2ab-dae029ab2f1b") : configmap "kube-rbac-proxy" not found
Jul 28 04:15:44.612223 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:44.612194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd" event={"ID":"bce371a2-8aad-4342-87c3-1cf9fe9d3e55","Type":"ContainerStarted","Data":"31f62b7705b35bf416434906e1e0966bf2fe19f351cfa3c8ef38d3e721ad6b0c"}
Jul 28 04:15:44.612572 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:44.612248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd" event={"ID":"bce371a2-8aad-4342-87c3-1cf9fe9d3e55","Type":"ContainerStarted","Data":"ed675045d0da45f7b6aa47abb45def528b27c70555d78cbfc2f47ee4ec5d51d6"}
Jul 28 04:15:44.625403 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:44.625360    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-x94xd" podStartSLOduration=1.486484487 podStartE2EDuration="2.625346497s" totalImagesPullingTime="1.13886201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:15:44.624438189 +0000 UTC m=+239.331920490" watchObservedRunningTime="2026-07-28 04:15:44.625346497 +0000 UTC m=+239.332828797"
Jul 28 04:15:44.737862 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:44.737835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:44.737962 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:44.737912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:44.738057 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:44.738020    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 04:15:44.738057 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:44.738025    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 04:15:44.738131 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:44.738062    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8455cf7f7b-ft9jg: secret "image-registry-tls" not found
Jul 28 04:15:44.738131 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:44.738100    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls podName:c8df8c91-daa2-4839-afb6-b347e989d820 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:52.738084734 +0000 UTC m=+247.445567016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls") pod "cluster-samples-operator-6748489656-2rc9k" (UID: "c8df8c91-daa2-4839-afb6-b347e989d820") : secret "samples-operator-tls" not found
Jul 28 04:15:44.738131 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:44.738114    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls podName:72ee3344-fdbc-4422-a238-ebc1d19f15e3 nodeName:}" failed. No retries permitted until 2026-07-28 04:15:52.738107681 +0000 UTC m=+247.445589959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls") pod "image-registry-8455cf7f7b-ft9jg" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3") : secret "image-registry-tls" not found
Jul 28 04:15:45.162287 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:45.162257    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ljczk_61a3863a-3bf9-4a7a-915c-7106f2e93df7/dns-node-resolver/0.log"
Jul 28 04:15:46.350197 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:46.350160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:46.350630 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:46.350240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:46.350630 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:46.350302    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 04:15:46.350630 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:46.350368    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 04:15:46.350630 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:46.350372    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls podName:0f379dcb-16d1-409f-a2ab-dae029ab2f1b nodeName:}" failed. No retries permitted until 2026-07-28 04:15:50.350349048 +0000 UTC m=+245.057831327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wgv9v" (UID: "0f379dcb-16d1-409f-a2ab-dae029ab2f1b") : secret "insights-runtime-extractor-tls" not found
Jul 28 04:15:46.350630 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:46.350424    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm podName:0f379dcb-16d1-409f-a2ab-dae029ab2f1b nodeName:}" failed. No retries permitted until 2026-07-28 04:15:50.35040977 +0000 UTC m=+245.057892049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wgv9v" (UID: "0f379dcb-16d1-409f-a2ab-dae029ab2f1b") : configmap "kube-rbac-proxy" not found
Jul 28 04:15:46.560374 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:46.560348    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqlft_03e6400b-8dcc-4525-9e3f-3166a169f06f/node-ca/0.log"
Jul 28 04:15:46.959655 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:46.959623    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gw442_37aba33f-561c-475a-b57f-9f31035b8967/serve-healthcheck-canary/0.log"
Jul 28 04:15:47.560481 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:47.560457    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-x94xd_bce371a2-8aad-4342-87c3-1cf9fe9d3e55/migrator/0.log"
Jul 28 04:15:47.760089 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:47.760059    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-x94xd_bce371a2-8aad-4342-87c3-1cf9fe9d3e55/graceful-termination/0.log"
Jul 28 04:15:50.382408 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:50.382370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:50.382793 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:50.382423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:50.382793 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:50.382501    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 04:15:50.382793 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:50.382520    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 04:15:50.382793 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:50.382562    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm podName:0f379dcb-16d1-409f-a2ab-dae029ab2f1b nodeName:}" failed. No retries permitted until 2026-07-28 04:15:58.382545961 +0000 UTC m=+253.090028243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wgv9v" (UID: "0f379dcb-16d1-409f-a2ab-dae029ab2f1b") : configmap "kube-rbac-proxy" not found
Jul 28 04:15:50.382793 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:15:50.382576    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls podName:0f379dcb-16d1-409f-a2ab-dae029ab2f1b nodeName:}" failed. No retries permitted until 2026-07-28 04:15:58.382570082 +0000 UTC m=+253.090052360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wgv9v" (UID: "0f379dcb-16d1-409f-a2ab-dae029ab2f1b") : secret "insights-runtime-extractor-tls" not found
Jul 28 04:15:51.332347 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:51.332292    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc" podUID="4f8e9e23-8737-4c65-836e-f088cb2ad750" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Jul 28 04:15:51.634175 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:51.634089    2581 generic.go:356] "Generic (PLEG): container finished" podID="4f8e9e23-8737-4c65-836e-f088cb2ad750" containerID="35a4b474e87d595792872280887aee7ecc188163f357e2186af56a97f4a9a43e" exitCode=1
Jul 28 04:15:51.634175 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:51.634133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc" event={"ID":"4f8e9e23-8737-4c65-836e-f088cb2ad750","Type":"ContainerDied","Data":"35a4b474e87d595792872280887aee7ecc188163f357e2186af56a97f4a9a43e"}
Jul 28 04:15:51.634558 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:51.634471    2581 scope.go:117] "RemoveContainer" containerID="35a4b474e87d595792872280887aee7ecc188163f357e2186af56a97f4a9a43e"
Jul 28 04:15:52.642790 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.642756    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc" event={"ID":"4f8e9e23-8737-4c65-836e-f088cb2ad750","Type":"ContainerStarted","Data":"c996ae53882ec799d28be979488b2e4f02e8f60a8b4f38413b73c9630ac62fff"}
Jul 28 04:15:52.643208 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.643069    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:15:52.643633 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.643616    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8664f666bc-xpcnc"
Jul 28 04:15:52.799500 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.799467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:52.799711 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.799550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:52.802134 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.802106    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8df8c91-daa2-4839-afb6-b347e989d820-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2rc9k\" (UID: \"c8df8c91-daa2-4839-afb6-b347e989d820\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:52.802253 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.802175    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls\") pod \"image-registry-8455cf7f7b-ft9jg\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") " pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:52.839507 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.839483    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s6545\""
Jul 28 04:15:52.848128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.848107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:52.937182 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.937158    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gk725\""
Jul 28 04:15:52.945699 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.945673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"
Jul 28 04:15:52.973135 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:52.973103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8455cf7f7b-ft9jg"]
Jul 28 04:15:52.976306 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:15:52.976276    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ee3344_fdbc_4422_a238_ebc1d19f15e3.slice/crio-1a88d30c6cff6443c2dc1811d710af61ccc0c797ec3980222e373fb7504d4b14 WatchSource:0}: Error finding container 1a88d30c6cff6443c2dc1811d710af61ccc0c797ec3980222e373fb7504d4b14: Status 404 returned error can't find the container with id 1a88d30c6cff6443c2dc1811d710af61ccc0c797ec3980222e373fb7504d4b14
Jul 28 04:15:53.078118 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:53.078090    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k"]
Jul 28 04:15:53.647009 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:53.646979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k" event={"ID":"c8df8c91-daa2-4839-afb6-b347e989d820","Type":"ContainerStarted","Data":"746f1579e6684645ba94f902988368cc5b9801be7538cf10203247d017670704"}
Jul 28 04:15:53.648276 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:53.648254    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg" event={"ID":"72ee3344-fdbc-4422-a238-ebc1d19f15e3","Type":"ContainerStarted","Data":"ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166"}
Jul 28 04:15:53.648373 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:53.648296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg" event={"ID":"72ee3344-fdbc-4422-a238-ebc1d19f15e3","Type":"ContainerStarted","Data":"1a88d30c6cff6443c2dc1811d710af61ccc0c797ec3980222e373fb7504d4b14"}
Jul 28 04:15:53.664951 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:53.664904    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg" podStartSLOduration=17.664887735 podStartE2EDuration="17.664887735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:15:53.664012787 +0000 UTC m=+248.371495093" watchObservedRunningTime="2026-07-28 04:15:53.664887735 +0000 UTC m=+248.372370035"
Jul 28 04:15:54.652198 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:54.652166    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:15:55.656303 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:55.656265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k" event={"ID":"c8df8c91-daa2-4839-afb6-b347e989d820","Type":"ContainerStarted","Data":"d80301711dfa81daa9088de52a96739a324989d0cc71282b93d0d3cd5117e592"}
Jul 28 04:15:55.656716 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:55.656320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k" event={"ID":"c8df8c91-daa2-4839-afb6-b347e989d820","Type":"ContainerStarted","Data":"fc4295de94b7188f2365f4dd3560419e0268cf4d1fdda7b6a561c320c154a679"}
Jul 28 04:15:55.671535 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:55.671484    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2rc9k" podStartSLOduration=16.704364993 podStartE2EDuration="18.671471176s" totalImagesPullingTime="1.967106183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:15:55.670419651 +0000 UTC m=+250.377901954" watchObservedRunningTime="2026-07-28 04:15:55.671471176 +0000 UTC m=+250.378953477"
Jul 28 04:15:57.636274 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:57.636225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:15:57.638779 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:57.638757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63fd0789-69d2-487c-b10b-b66deba1de75-metrics-certs\") pod \"network-metrics-daemon-g86tz\" (UID: \"63fd0789-69d2-487c-b10b-b66deba1de75\") " pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:15:57.835506 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:57.835480    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x5zc2\""
Jul 28 04:15:57.844005 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:57.843985    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g86tz"
Jul 28 04:15:57.964483 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:57.964451    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g86tz"]
Jul 28 04:15:57.968021 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:15:57.967999    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fd0789_69d2_487c_b10b_b66deba1de75.slice/crio-dfad320ae44303088e07c06b964116fd4ad4a443141e7b1dbb4e0145ecb2836f WatchSource:0}: Error finding container dfad320ae44303088e07c06b964116fd4ad4a443141e7b1dbb4e0145ecb2836f: Status 404 returned error can't find the container with id dfad320ae44303088e07c06b964116fd4ad4a443141e7b1dbb4e0145ecb2836f
Jul 28 04:15:58.442041 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:58.441984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:58.442221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:58.442066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:58.442724 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:58.442698    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:58.445017 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:58.444986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f379dcb-16d1-409f-a2ab-dae029ab2f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgv9v\" (UID: \"0f379dcb-16d1-409f-a2ab-dae029ab2f1b\") " pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:58.478804 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:58.478771    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tkv7l\""
Jul 28 04:15:58.487496 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:58.487471    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wgv9v"
Jul 28 04:15:58.626990 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:58.626954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wgv9v"]
Jul 28 04:15:58.666439 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:58.666395    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g86tz" event={"ID":"63fd0789-69d2-487c-b10b-b66deba1de75","Type":"ContainerStarted","Data":"dfad320ae44303088e07c06b964116fd4ad4a443141e7b1dbb4e0145ecb2836f"}
Jul 28 04:15:58.758390 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:15:58.758351    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f379dcb_16d1_409f_a2ab_dae029ab2f1b.slice/crio-fb78e59332fee5b6690405edbd47e9197cccd501637530f0b06d37d9f034cbf8 WatchSource:0}: Error finding container fb78e59332fee5b6690405edbd47e9197cccd501637530f0b06d37d9f034cbf8: Status 404 returned error can't find the container with id fb78e59332fee5b6690405edbd47e9197cccd501637530f0b06d37d9f034cbf8
Jul 28 04:15:59.672194 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:59.672147    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g86tz" event={"ID":"63fd0789-69d2-487c-b10b-b66deba1de75","Type":"ContainerStarted","Data":"5bc5edd1d0eefeb4b09d54d565b679dc256c70de210e7bbe81958bc6807e52f5"}
Jul 28 04:15:59.672688 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:59.672210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g86tz" event={"ID":"63fd0789-69d2-487c-b10b-b66deba1de75","Type":"ContainerStarted","Data":"016d5edc844d8051629d3ee99f80e366fcf72d532434074ea41862e351966fc9"}
Jul 28 04:15:59.673838 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:59.673785    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgv9v" event={"ID":"0f379dcb-16d1-409f-a2ab-dae029ab2f1b","Type":"ContainerStarted","Data":"fb78e59332fee5b6690405edbd47e9197cccd501637530f0b06d37d9f034cbf8"}
Jul 28 04:15:59.686477 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:15:59.686207    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g86tz" podStartSLOduration=252.854676656 podStartE2EDuration="4m13.686187659s" totalImagesPullingTime="831.511003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:15:59.685904298 +0000 UTC m=+254.393386600" watchObservedRunningTime="2026-07-28 04:15:59.686187659 +0000 UTC m=+254.393669962"
Jul 28 04:16:04.693760 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:04.693716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgv9v" event={"ID":"0f379dcb-16d1-409f-a2ab-dae029ab2f1b","Type":"ContainerStarted","Data":"682d0e4eb6d8e5c678a22c9f79129de0f5bf032fa0725b9fd33f73b753f7cf2b"}
Jul 28 04:16:06.441447 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.441355    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8455cf7f7b-ft9jg"]
Jul 28 04:16:06.456503 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.456473    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f44d6dcf-ctqgj"]
Jul 28 04:16:06.461617 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.461269    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.471391 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.471368    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f44d6dcf-ctqgj"]
Jul 28 04:16:06.605776 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.605740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b6c4b67-5bed-43e2-95b3-911833682ea7-ca-trust-extracted\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.605941 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.605802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b6c4b67-5bed-43e2-95b3-911833682ea7-registry-certificates\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.606005 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.605953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b6c4b67-5bed-43e2-95b3-911833682ea7-image-registry-private-configuration\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.606097 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.606006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b6c4b67-5bed-43e2-95b3-911833682ea7-trusted-ca\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.606097 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.606067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b6c4b67-5bed-43e2-95b3-911833682ea7-bound-sa-token\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.606190 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.606095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b6c4b67-5bed-43e2-95b3-911833682ea7-registry-tls\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.606190 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.606125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b6c4b67-5bed-43e2-95b3-911833682ea7-installation-pull-secrets\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.606190 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.606155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lcgh\" (UniqueName: \"kubernetes.io/projected/7b6c4b67-5bed-43e2-95b3-911833682ea7-kube-api-access-4lcgh\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.706687 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.706615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b6c4b67-5bed-43e2-95b3-911833682ea7-image-registry-private-configuration\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.706687 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.706651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b6c4b67-5bed-43e2-95b3-911833682ea7-trusted-ca\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.706687 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.706683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b6c4b67-5bed-43e2-95b3-911833682ea7-bound-sa-token\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.706946 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.706798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b6c4b67-5bed-43e2-95b3-911833682ea7-registry-tls\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.706946 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.706843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b6c4b67-5bed-43e2-95b3-911833682ea7-installation-pull-secrets\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.706946 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.706879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lcgh\" (UniqueName: \"kubernetes.io/projected/7b6c4b67-5bed-43e2-95b3-911833682ea7-kube-api-access-4lcgh\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.706946 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.706913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b6c4b67-5bed-43e2-95b3-911833682ea7-ca-trust-extracted\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.707224 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.706965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b6c4b67-5bed-43e2-95b3-911833682ea7-registry-certificates\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.707499 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.707347    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b6c4b67-5bed-43e2-95b3-911833682ea7-ca-trust-extracted\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.707728 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.707682    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b6c4b67-5bed-43e2-95b3-911833682ea7-trusted-ca\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.707850 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.707807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b6c4b67-5bed-43e2-95b3-911833682ea7-registry-certificates\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.709414 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.709367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b6c4b67-5bed-43e2-95b3-911833682ea7-image-registry-private-configuration\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.709794 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.709770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b6c4b67-5bed-43e2-95b3-911833682ea7-registry-tls\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.709876 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.709820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b6c4b67-5bed-43e2-95b3-911833682ea7-installation-pull-secrets\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.715632 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.715589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b6c4b67-5bed-43e2-95b3-911833682ea7-bound-sa-token\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.715908 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.715886    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lcgh\" (UniqueName: \"kubernetes.io/projected/7b6c4b67-5bed-43e2-95b3-911833682ea7-kube-api-access-4lcgh\") pod \"image-registry-6f44d6dcf-ctqgj\" (UID: \"7b6c4b67-5bed-43e2-95b3-911833682ea7\") " pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:06.772227 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:06.772202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:07.059808 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:07.059775    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f44d6dcf-ctqgj"]
Jul 28 04:16:07.062142 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:16:07.062119    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6c4b67_5bed_43e2_95b3_911833682ea7.slice/crio-506db582c29c8fd146ee3067938ec39e1bc0d2e75e4fd9711f3b9bb0c508a3d7 WatchSource:0}: Error finding container 506db582c29c8fd146ee3067938ec39e1bc0d2e75e4fd9711f3b9bb0c508a3d7: Status 404 returned error can't find the container with id 506db582c29c8fd146ee3067938ec39e1bc0d2e75e4fd9711f3b9bb0c508a3d7
Jul 28 04:16:07.705817 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:07.705781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" event={"ID":"7b6c4b67-5bed-43e2-95b3-911833682ea7","Type":"ContainerStarted","Data":"980e396c6c2ed15bbc78c423522b0577ca440c7f4306d6c70947e7eb435e63a4"}
Jul 28 04:16:07.706333 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:07.705844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" event={"ID":"7b6c4b67-5bed-43e2-95b3-911833682ea7","Type":"ContainerStarted","Data":"506db582c29c8fd146ee3067938ec39e1bc0d2e75e4fd9711f3b9bb0c508a3d7"}
Jul 28 04:16:07.706333 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:07.705889    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:07.712577 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:07.712482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgv9v" event={"ID":"0f379dcb-16d1-409f-a2ab-dae029ab2f1b","Type":"ContainerStarted","Data":"856a5f4a9bc67d36b240a59aa3f91a3d885d2f0681c53184cf7750438c12b71d"}
Jul 28 04:16:07.725072 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:07.724998    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" podStartSLOduration=1.72498014 podStartE2EDuration="1.72498014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:16:07.72345547 +0000 UTC m=+262.430937771" watchObservedRunningTime="2026-07-28 04:16:07.72498014 +0000 UTC m=+262.432462442"
Jul 28 04:16:10.725644 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:10.725610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgv9v" event={"ID":"0f379dcb-16d1-409f-a2ab-dae029ab2f1b","Type":"ContainerStarted","Data":"6ff89eea96a15568391241df570e405885467fb5531cde2f53b219b238436994"}
Jul 28 04:16:10.742400 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:10.742352    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wgv9v" podStartSLOduration=17.158849695 podStartE2EDuration="28.742333021s" totalImagesPullingTime="11.583483326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 04:15:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:16:10.740659055 +0000 UTC m=+265.448141356" watchObservedRunningTime="2026-07-28 04:16:10.742333021 +0000 UTC m=+265.449815325"
Jul 28 04:16:12.819053 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:12.819004    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"]
Jul 28 04:16:12.821521 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:12.821504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"
Jul 28 04:16:12.823625 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:12.823603    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 04:16:12.823752 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:12.823659    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wqsvr\""
Jul 28 04:16:12.828571 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:12.828549    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"]
Jul 28 04:16:12.850391 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:12.850363    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/457a2f44-18cb-4cfa-870f-e786164d927d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ghblb\" (UID: \"457a2f44-18cb-4cfa-870f-e786164d927d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"
Jul 28 04:16:12.950923 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:12.950882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/457a2f44-18cb-4cfa-870f-e786164d927d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ghblb\" (UID: \"457a2f44-18cb-4cfa-870f-e786164d927d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"
Jul 28 04:16:12.951055 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:16:12.951020    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 04:16:12.951117 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:16:12.951107    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457a2f44-18cb-4cfa-870f-e786164d927d-tls-certificates podName:457a2f44-18cb-4cfa-870f-e786164d927d nodeName:}" failed. No retries permitted until 2026-07-28 04:16:13.451091711 +0000 UTC m=+268.158573990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/457a2f44-18cb-4cfa-870f-e786164d927d-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-ghblb" (UID: "457a2f44-18cb-4cfa-870f-e786164d927d") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 04:16:13.453417 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:13.453385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/457a2f44-18cb-4cfa-870f-e786164d927d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ghblb\" (UID: \"457a2f44-18cb-4cfa-870f-e786164d927d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"
Jul 28 04:16:13.455972 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:13.455938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/457a2f44-18cb-4cfa-870f-e786164d927d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ghblb\" (UID: \"457a2f44-18cb-4cfa-870f-e786164d927d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"
Jul 28 04:16:13.730944 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:13.730853    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"
Jul 28 04:16:13.850847 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:13.850773    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"]
Jul 28 04:16:13.853309 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:16:13.853282    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457a2f44_18cb_4cfa_870f_e786164d927d.slice/crio-0adebaad5f4b9f51d81a5a0d0cfc6d04bac242c8891d9a84ab7ae6db393bd1f3 WatchSource:0}: Error finding container 0adebaad5f4b9f51d81a5a0d0cfc6d04bac242c8891d9a84ab7ae6db393bd1f3: Status 404 returned error can't find the container with id 0adebaad5f4b9f51d81a5a0d0cfc6d04bac242c8891d9a84ab7ae6db393bd1f3
Jul 28 04:16:14.739916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:14.739876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb" event={"ID":"457a2f44-18cb-4cfa-870f-e786164d927d","Type":"ContainerStarted","Data":"0adebaad5f4b9f51d81a5a0d0cfc6d04bac242c8891d9a84ab7ae6db393bd1f3"}
Jul 28 04:16:15.744063 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:15.744012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb" event={"ID":"457a2f44-18cb-4cfa-870f-e786164d927d","Type":"ContainerStarted","Data":"585446767cacd842f5b8dc28137ec2b07139f49bbea112f2d922a27b11a24a2d"}
Jul 28 04:16:15.744423 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:15.744195    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"
Jul 28 04:16:15.748598 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:15.748574    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb"
Jul 28 04:16:15.756739 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:15.756665    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ghblb" podStartSLOduration=2.601287622 podStartE2EDuration="3.756651206s" totalImagesPullingTime="1.155363584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:16:15.756248292 +0000 UTC m=+270.463730596" watchObservedRunningTime="2026-07-28 04:16:15.756651206 +0000 UTC m=+270.464133506"
Jul 28 04:16:16.446324 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:16.446295    2581 patch_prober.go:28] interesting pod/image-registry-8455cf7f7b-ft9jg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 04:16:16.446495 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:16.446343    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg" podUID="72ee3344-fdbc-4422-a238-ebc1d19f15e3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 04:16:21.225324 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.225292    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"]
Jul 28 04:16:21.227853 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.227834    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.230113 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.230064    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 04:16:21.230257 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.230118    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 04:16:21.230366 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.230348    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tt7mz\""
Jul 28 04:16:21.230429 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.230402    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 04:16:21.230429 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.230412    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 04:16:21.230555 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.230447    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 04:16:21.230752 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.230720    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 04:16:21.241514 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.241491    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"]
Jul 28 04:16:21.242557 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.242536    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9h4gf"]
Jul 28 04:16:21.244811 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.244796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.246719 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.246698    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 04:16:21.246810 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.246720    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 04:16:21.246894 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.246876    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 04:16:21.247048 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.247014    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6692x\""
Jul 28 04:16:21.308361 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/df9eb54e-a6c7-4774-a46c-689e173bf6a6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.308485 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.308485 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df9eb54e-a6c7-4774-a46c-689e173bf6a6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.308485 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb4sr\" (UniqueName: \"kubernetes.io/projected/c22cf685-12aa-463c-b3b4-196cc9d620c0-kube-api-access-zb4sr\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.308485 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c22cf685-12aa-463c-b3b4-196cc9d620c0-sys\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.308674 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.308674 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ntrr\" (UniqueName: \"kubernetes.io/projected/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-api-access-5ntrr\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.308674 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.308674 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c22cf685-12aa-463c-b3b4-196cc9d620c0-root\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.308674 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c22cf685-12aa-463c-b3b4-196cc9d620c0-metrics-client-ca\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.308674 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.308674 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.308902 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-wtmp\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.308902 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-textfile\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.308902 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.308733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-tls\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409135 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntrr\" (UniqueName: \"kubernetes.io/projected/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-api-access-5ntrr\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.409227 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.409227 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c22cf685-12aa-463c-b3b4-196cc9d620c0-root\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409227 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c22cf685-12aa-463c-b3b4-196cc9d620c0-metrics-client-ca\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409227 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409405 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.409405 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:16:21.409266    2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 28 04:16:21.409405 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:16:21.409320    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-tls podName:df9eb54e-a6c7-4774-a46c-689e173bf6a6 nodeName:}" failed. No retries permitted until 2026-07-28 04:16:21.909303243 +0000 UTC m=+276.616785522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-2scw5" (UID: "df9eb54e-a6c7-4774-a46c-689e173bf6a6") : secret "kube-state-metrics-tls" not found
Jul 28 04:16:21.409405 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409263    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c22cf685-12aa-463c-b3b4-196cc9d620c0-root\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409405 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409266    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-wtmp\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409405 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-textfile\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409405 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-tls\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409751 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/df9eb54e-a6c7-4774-a46c-689e173bf6a6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.409751 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409751 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df9eb54e-a6c7-4774-a46c-689e173bf6a6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.409751 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb4sr\" (UniqueName: \"kubernetes.io/projected/c22cf685-12aa-463c-b3b4-196cc9d620c0-kube-api-access-zb4sr\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409751 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c22cf685-12aa-463c-b3b4-196cc9d620c0-sys\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.409751 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.409751 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-textfile\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.410115 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409806    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c22cf685-12aa-463c-b3b4-196cc9d620c0-metrics-client-ca\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.410115 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.409842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.410115 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.410000    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-wtmp\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.410115 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.410087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c22cf685-12aa-463c-b3b4-196cc9d620c0-sys\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.410289 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.410129    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/df9eb54e-a6c7-4774-a46c-689e173bf6a6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.410326 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.410297    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.410834 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.410813    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df9eb54e-a6c7-4774-a46c-689e173bf6a6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.411989 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.411964    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.412334 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.412314    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c22cf685-12aa-463c-b3b4-196cc9d620c0-node-exporter-tls\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.412498 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.412476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.416916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.416897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ntrr\" (UniqueName: \"kubernetes.io/projected/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-api-access-5ntrr\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.417160 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.417141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb4sr\" (UniqueName: \"kubernetes.io/projected/c22cf685-12aa-463c-b3b4-196cc9d620c0-kube-api-access-zb4sr\") pod \"node-exporter-9h4gf\" (UID: \"c22cf685-12aa-463c-b3b4-196cc9d620c0\") " pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.552859 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.552831    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9h4gf"
Jul 28 04:16:21.562111 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:16:21.562087    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22cf685_12aa_463c_b3b4_196cc9d620c0.slice/crio-b185b1f897dbf4fbeba1fafd39d7cc25f2b676b7650cf5c065b820f02bdda8e9 WatchSource:0}: Error finding container b185b1f897dbf4fbeba1fafd39d7cc25f2b676b7650cf5c065b820f02bdda8e9: Status 404 returned error can't find the container with id b185b1f897dbf4fbeba1fafd39d7cc25f2b676b7650cf5c065b820f02bdda8e9
Jul 28 04:16:21.763955 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.763925    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9h4gf" event={"ID":"c22cf685-12aa-463c-b3b4-196cc9d620c0","Type":"ContainerStarted","Data":"b185b1f897dbf4fbeba1fafd39d7cc25f2b676b7650cf5c065b820f02bdda8e9"}
Jul 28 04:16:21.913134 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.913055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:21.916003 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:21.915981    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/df9eb54e-a6c7-4774-a46c-689e173bf6a6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2scw5\" (UID: \"df9eb54e-a6c7-4774-a46c-689e173bf6a6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:22.137188 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:22.137149    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"
Jul 28 04:16:22.441013 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:22.440984    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5"]
Jul 28 04:16:22.444430 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:16:22.444404    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf9eb54e_a6c7_4774_a46c_689e173bf6a6.slice/crio-67e90d907644de8450be9a55ddc71e434f946ac70cdaffec9604124e6222027d WatchSource:0}: Error finding container 67e90d907644de8450be9a55ddc71e434f946ac70cdaffec9604124e6222027d: Status 404 returned error can't find the container with id 67e90d907644de8450be9a55ddc71e434f946ac70cdaffec9604124e6222027d
Jul 28 04:16:22.767790 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:22.767758    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5" event={"ID":"df9eb54e-a6c7-4774-a46c-689e173bf6a6","Type":"ContainerStarted","Data":"67e90d907644de8450be9a55ddc71e434f946ac70cdaffec9604124e6222027d"}
Jul 28 04:16:22.769105 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:22.769081    2581 generic.go:356] "Generic (PLEG): container finished" podID="c22cf685-12aa-463c-b3b4-196cc9d620c0" containerID="29840da8ac0fa0284f755a4dcdfbd483be7095072002f2cfa9bb9e70737e7115" exitCode=0
Jul 28 04:16:22.769216 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:22.769129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9h4gf" event={"ID":"c22cf685-12aa-463c-b3b4-196cc9d620c0","Type":"ContainerDied","Data":"29840da8ac0fa0284f755a4dcdfbd483be7095072002f2cfa9bb9e70737e7115"}
Jul 28 04:16:23.775832 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:23.775791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9h4gf" event={"ID":"c22cf685-12aa-463c-b3b4-196cc9d620c0","Type":"ContainerStarted","Data":"85daab286b210fc88883eafa33f1ed44d015c941a19638909ca565e4b9181ed5"}
Jul 28 04:16:23.776265 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:23.775857    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9h4gf" event={"ID":"c22cf685-12aa-463c-b3b4-196cc9d620c0","Type":"ContainerStarted","Data":"3411eea822537d256fdc6ec230c2700eeb411b067545df340baa22561c1c4fee"}
Jul 28 04:16:23.797419 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:23.797366    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9h4gf" podStartSLOduration=1.95022223 podStartE2EDuration="2.797345729s" totalImagesPullingTime="770.157926ms" totalInitContainerRuntime="76.965573ms" isStatefulPod=true podCreationTimestamp="2026-07-28 04:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:16:23.79684339 +0000 UTC m=+278.504325690" watchObservedRunningTime="2026-07-28 04:16:23.797345729 +0000 UTC m=+278.504828014"
Jul 28 04:16:24.780619 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:24.780574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5" event={"ID":"df9eb54e-a6c7-4774-a46c-689e173bf6a6","Type":"ContainerStarted","Data":"dd2f0aa82d46bdf2481850d28b65c5172bd0ac7edcafed48b88e7c69e0d4a4a5"}
Jul 28 04:16:24.781176 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:24.780639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5" event={"ID":"df9eb54e-a6c7-4774-a46c-689e173bf6a6","Type":"ContainerStarted","Data":"002b08757dc4258a3e0a9eef8559532e42bed68b472f62cf3cec4681e15caa3f"}
Jul 28 04:16:24.781176 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:24.780660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5" event={"ID":"df9eb54e-a6c7-4774-a46c-689e173bf6a6","Type":"ContainerStarted","Data":"302084cb0c62ae295a8bf02882b55242751d4614582a3eb73b02ab22914f6904"}
Jul 28 04:16:24.797558 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:24.797514    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2scw5" podStartSLOduration=2.3074390129999998 podStartE2EDuration="3.797493987s" totalImagesPullingTime="1.490054974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:16:24.796867047 +0000 UTC m=+279.504349347" watchObservedRunningTime="2026-07-28 04:16:24.797493987 +0000 UTC m=+279.504976289"
Jul 28 04:16:26.446379 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:26.446342    2581 patch_prober.go:28] interesting pod/image-registry-8455cf7f7b-ft9jg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 04:16:26.446726 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:26.446393    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg" podUID="72ee3344-fdbc-4422-a238-ebc1d19f15e3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 04:16:26.777412 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:26.777383    2581 patch_prober.go:28] interesting pod/image-registry-6f44d6dcf-ctqgj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 04:16:26.777589 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:26.777428    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" podUID="7b6c4b67-5bed-43e2-95b3-911833682ea7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 04:16:27.410659 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:16:27.410618    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ftv8z" podUID="6ec8f2fb-b989-439f-b0dc-f0e98d36a44f"
Jul 28 04:16:27.790356 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:27.790330    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:16:28.720531 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:28.720498    2581 patch_prober.go:28] interesting pod/image-registry-6f44d6dcf-ctqgj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 04:16:28.720694 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:28.720546    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" podUID="7b6c4b67-5bed-43e2-95b3-911833682ea7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 04:16:30.678186 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:30.678132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:16:30.680605 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:30.680573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec8f2fb-b989-439f-b0dc-f0e98d36a44f-metrics-tls\") pod \"dns-default-ftv8z\" (UID: \"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f\") " pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:16:30.793615 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:30.793585    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7zgg8\""
Jul 28 04:16:30.802096 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:30.802077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:16:30.926539 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:30.926423    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ftv8z"]
Jul 28 04:16:30.929147 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:16:30.929084    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec8f2fb_b989_439f_b0dc_f0e98d36a44f.slice/crio-7ac7b04ab4040b141b916f896c3259ec709ecf02ce45aca577710b2e1392abfe WatchSource:0}: Error finding container 7ac7b04ab4040b141b916f896c3259ec709ecf02ce45aca577710b2e1392abfe: Status 404 returned error can't find the container with id 7ac7b04ab4040b141b916f896c3259ec709ecf02ce45aca577710b2e1392abfe
Jul 28 04:16:31.464542 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.464494    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg" podUID="72ee3344-fdbc-4422-a238-ebc1d19f15e3" containerName="registry" containerID="cri-o://ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166" gracePeriod=30
Jul 28 04:16:31.716984 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.716921    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:16:31.785661 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.785624    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72ee3344-fdbc-4422-a238-ebc1d19f15e3-ca-trust-extracted\") pod \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") "
Jul 28 04:16:31.785819 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.785682    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-image-registry-private-configuration\") pod \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") "
Jul 28 04:16:31.785819 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.785737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxng8\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-kube-api-access-cxng8\") pod \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") "
Jul 28 04:16:31.785819 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.785791    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-trusted-ca\") pod \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") "
Jul 28 04:16:31.785986 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.785915    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-bound-sa-token\") pod \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") "
Jul 28 04:16:31.785986 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.785975    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls\") pod \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") "
Jul 28 04:16:31.786107 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.786002    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-installation-pull-secrets\") pod \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") "
Jul 28 04:16:31.786107 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.786049    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-certificates\") pod \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\" (UID: \"72ee3344-fdbc-4422-a238-ebc1d19f15e3\") "
Jul 28 04:16:31.786770 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.786270    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "72ee3344-fdbc-4422-a238-ebc1d19f15e3" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:16:31.786770 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.786695    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "72ee3344-fdbc-4422-a238-ebc1d19f15e3" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:16:31.789174 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.789151    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "72ee3344-fdbc-4422-a238-ebc1d19f15e3" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:16:31.789559 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.789473    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "72ee3344-fdbc-4422-a238-ebc1d19f15e3" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 04:16:31.790086 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.790029    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "72ee3344-fdbc-4422-a238-ebc1d19f15e3" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:16:31.790187 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.790104    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "72ee3344-fdbc-4422-a238-ebc1d19f15e3" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 04:16:31.791134 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.791109    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-kube-api-access-cxng8" (OuterVolumeSpecName: "kube-api-access-cxng8") pod "72ee3344-fdbc-4422-a238-ebc1d19f15e3" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3"). InnerVolumeSpecName "kube-api-access-cxng8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:16:31.796789 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.796758    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ee3344-fdbc-4422-a238-ebc1d19f15e3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "72ee3344-fdbc-4422-a238-ebc1d19f15e3" (UID: "72ee3344-fdbc-4422-a238-ebc1d19f15e3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:16:31.806202 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.806178    2581 generic.go:356] "Generic (PLEG): container finished" podID="72ee3344-fdbc-4422-a238-ebc1d19f15e3" containerID="ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166" exitCode=0
Jul 28 04:16:31.806319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.806240    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg"
Jul 28 04:16:31.806319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.806268    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg" event={"ID":"72ee3344-fdbc-4422-a238-ebc1d19f15e3","Type":"ContainerDied","Data":"ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166"}
Jul 28 04:16:31.806422 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.806344    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8455cf7f7b-ft9jg" event={"ID":"72ee3344-fdbc-4422-a238-ebc1d19f15e3","Type":"ContainerDied","Data":"1a88d30c6cff6443c2dc1811d710af61ccc0c797ec3980222e373fb7504d4b14"}
Jul 28 04:16:31.806422 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.806369    2581 scope.go:117] "RemoveContainer" containerID="ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166"
Jul 28 04:16:31.807921 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.807687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftv8z" event={"ID":"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f","Type":"ContainerStarted","Data":"7ac7b04ab4040b141b916f896c3259ec709ecf02ce45aca577710b2e1392abfe"}
Jul 28 04:16:31.821235 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.821209    2581 scope.go:117] "RemoveContainer" containerID="ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166"
Jul 28 04:16:31.821557 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:16:31.821525    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166\": container with ID starting with ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166 not found: ID does not exist" containerID="ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166"
Jul 28 04:16:31.821664 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.821563    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166"} err="failed to get container status \"ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166\": rpc error: code = NotFound desc = could not find container \"ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166\": container with ID starting with ba587179d2e9dd4aa69a1476f5d7988c99a33abba25c63a41fe25716bb77f166 not found: ID does not exist"
Jul 28 04:16:31.829715 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.829693    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8455cf7f7b-ft9jg"]
Jul 28 04:16:31.837387 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.837368    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8455cf7f7b-ft9jg"]
Jul 28 04:16:31.887323 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.887296    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72ee3344-fdbc-4422-a238-ebc1d19f15e3-ca-trust-extracted\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:16:31.887456 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.887327    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-image-registry-private-configuration\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:16:31.887456 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.887343    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxng8\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-kube-api-access-cxng8\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:16:31.887456 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.887358    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-trusted-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:16:31.887456 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.887370    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-bound-sa-token\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:16:31.887456 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.887379    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-tls\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:16:31.887456 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.887391    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72ee3344-fdbc-4422-a238-ebc1d19f15e3-installation-pull-secrets\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:16:31.887456 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:31.887402    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72ee3344-fdbc-4422-a238-ebc1d19f15e3-registry-certificates\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:16:32.813671 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:32.813640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftv8z" event={"ID":"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f","Type":"ContainerStarted","Data":"ea791732a23916da024a721034a0d9db3c8073b6123eec8337d95fb832af5e60"}
Jul 28 04:16:32.814017 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:32.813686    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftv8z" event={"ID":"6ec8f2fb-b989-439f-b0dc-f0e98d36a44f","Type":"ContainerStarted","Data":"b22122f895f9b1e9c364b76bce938cedc1931dc19b3dfdec63c199e54a4666a2"}
Jul 28 04:16:32.814017 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:32.813779    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:16:32.827929 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:32.827870    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ftv8z" podStartSLOduration=251.13241014 podStartE2EDuration="4m12.827854124s" totalImagesPullingTime="1.695443984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:12:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:16:32.827344281 +0000 UTC m=+287.534826582" watchObservedRunningTime="2026-07-28 04:16:32.827854124 +0000 UTC m=+287.535336428"
Jul 28 04:16:33.837154 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:33.837120    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72ee3344-fdbc-4422-a238-ebc1d19f15e3" path="/var/lib/kubelet/pods/72ee3344-fdbc-4422-a238-ebc1d19f15e3/volumes"
Jul 28 04:16:36.776639 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:36.776605    2581 patch_prober.go:28] interesting pod/image-registry-6f44d6dcf-ctqgj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 04:16:36.777059 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:36.776654    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" podUID="7b6c4b67-5bed-43e2-95b3-911833682ea7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 04:16:37.032944 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.032870    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58b9ffb5b-5grtk"]
Jul 28 04:16:37.033161 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.033149    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72ee3344-fdbc-4422-a238-ebc1d19f15e3" containerName="registry"
Jul 28 04:16:37.033212 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.033163    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ee3344-fdbc-4422-a238-ebc1d19f15e3" containerName="registry"
Jul 28 04:16:37.033247 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.033215    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="72ee3344-fdbc-4422-a238-ebc1d19f15e3" containerName="registry"
Jul 28 04:16:37.170270 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.170239    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58b9ffb5b-5grtk"]
Jul 28 04:16:37.170415 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.170349    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.173053 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.173007    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 04:16:37.173206 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.173157    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 04:16:37.173274 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.173222    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 04:16:37.173617 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.173592    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 04:16:37.173682 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.173649    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 04:16:37.173682 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.173675    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7n5sw\""
Jul 28 04:16:37.173780 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.173654    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 04:16:37.173828 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.173786    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 04:16:37.178661 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.178638    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 04:16:37.225063 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.225022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9pp\" (UniqueName: \"kubernetes.io/projected/86b04b56-a5e7-44e0-9350-c532de80a3a3-kube-api-access-jz9pp\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.225184 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.225103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-serving-cert\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.225184 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.225123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-config\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.225184 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.225143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-service-ca\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.225184 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.225165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-oauth-config\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.225360 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.225238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-trusted-ca-bundle\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.225360 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.225268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-oauth-serving-cert\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.326077 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.326008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-oauth-config\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.326077 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.326056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-trusted-ca-bundle\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.326269 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.326176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-oauth-serving-cert\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.326269 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.326224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9pp\" (UniqueName: \"kubernetes.io/projected/86b04b56-a5e7-44e0-9350-c532de80a3a3-kube-api-access-jz9pp\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.326394 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.326278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-serving-cert\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.326394 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.326306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-config\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.326394 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.326332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-service-ca\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.326983 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.326923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-trusted-ca-bundle\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.326983 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.327019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-oauth-serving-cert\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.327268 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.327074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-service-ca\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.327268 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.327129    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-config\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.328796 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.328769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-oauth-config\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.328871 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.328845    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-serving-cert\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.333154 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.333137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9pp\" (UniqueName: \"kubernetes.io/projected/86b04b56-a5e7-44e0-9350-c532de80a3a3-kube-api-access-jz9pp\") pod \"console-58b9ffb5b-5grtk\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") " pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.480332 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.480296    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:37.640149 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.640112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58b9ffb5b-5grtk"]
Jul 28 04:16:37.643557 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:16:37.643530    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b04b56_a5e7_44e0_9350_c532de80a3a3.slice/crio-89ce19edfbdf9f7c825525fd788a344522b24862ff144dc52e38f8df8e3dab30 WatchSource:0}: Error finding container 89ce19edfbdf9f7c825525fd788a344522b24862ff144dc52e38f8df8e3dab30: Status 404 returned error can't find the container with id 89ce19edfbdf9f7c825525fd788a344522b24862ff144dc52e38f8df8e3dab30
Jul 28 04:16:37.837126 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:37.837094    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b9ffb5b-5grtk" event={"ID":"86b04b56-a5e7-44e0-9350-c532de80a3a3","Type":"ContainerStarted","Data":"89ce19edfbdf9f7c825525fd788a344522b24862ff144dc52e38f8df8e3dab30"}
Jul 28 04:16:38.723503 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:38.723457    2581 patch_prober.go:28] interesting pod/image-registry-6f44d6dcf-ctqgj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 04:16:38.723690 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:38.723554    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" podUID="7b6c4b67-5bed-43e2-95b3-911833682ea7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 04:16:41.851354 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:41.851315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b9ffb5b-5grtk" event={"ID":"86b04b56-a5e7-44e0-9350-c532de80a3a3","Type":"ContainerStarted","Data":"e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059"}
Jul 28 04:16:41.867821 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:41.867341    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58b9ffb5b-5grtk" podStartSLOduration=1.336227354 podStartE2EDuration="4.867319819s" totalImagesPullingTime="3.531092465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:16:41.866612423 +0000 UTC m=+296.574094735" watchObservedRunningTime="2026-07-28 04:16:41.867319819 +0000 UTC m=+296.574802122"
Jul 28 04:16:42.819716 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:42.819690    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ftv8z"
Jul 28 04:16:45.696666 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:45.696641    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:16:45.697006 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:45.696951    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:16:45.699519 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:45.699493    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 04:16:46.776938 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:46.776905    2581 patch_prober.go:28] interesting pod/image-registry-6f44d6dcf-ctqgj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 04:16:46.779371 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:46.776950    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" podUID="7b6c4b67-5bed-43e2-95b3-911833682ea7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 04:16:46.779371 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:46.776985    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:16:46.779371 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:46.777378    2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"980e396c6c2ed15bbc78c423522b0577ca440c7f4306d6c70947e7eb435e63a4"} pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 28 04:16:46.782628 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:46.782604    2581 patch_prober.go:28] interesting pod/image-registry-6f44d6dcf-ctqgj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 04:16:46.782768 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:46.782648    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" podUID="7b6c4b67-5bed-43e2-95b3-911833682ea7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 04:16:47.481293 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:47.481259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:47.481453 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:47.481348    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:47.485842 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:47.485821    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:47.875545 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:47.875519    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:16:56.781940 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:16:56.781911    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:17:11.796102 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:11.796056    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" podUID="7b6c4b67-5bed-43e2-95b3-911833682ea7" containerName="registry" containerID="cri-o://980e396c6c2ed15bbc78c423522b0577ca440c7f4306d6c70947e7eb435e63a4" gracePeriod=30
Jul 28 04:17:12.960623 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:12.960599    2581 generic.go:356] "Generic (PLEG): container finished" podID="7b6c4b67-5bed-43e2-95b3-911833682ea7" containerID="980e396c6c2ed15bbc78c423522b0577ca440c7f4306d6c70947e7eb435e63a4" exitCode=0
Jul 28 04:17:12.961087 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:12.960633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" event={"ID":"7b6c4b67-5bed-43e2-95b3-911833682ea7","Type":"ContainerDied","Data":"980e396c6c2ed15bbc78c423522b0577ca440c7f4306d6c70947e7eb435e63a4"}
Jul 28 04:17:12.961087 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:12.960666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj" event={"ID":"7b6c4b67-5bed-43e2-95b3-911833682ea7","Type":"ContainerStarted","Data":"c1c9160470c51b49f70b3ba6466b325794771daba5116a1a71187ab816ca770b"}
Jul 28 04:17:12.961087 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:12.960692    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:17:33.969120 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:33.969094    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f44d6dcf-ctqgj"
Jul 28 04:17:49.700647 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.700614    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-564f9dcddc-c7ktv"]
Jul 28 04:17:49.703894 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.703879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.715355 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.715331    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564f9dcddc-c7ktv"]
Jul 28 04:17:49.744215 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.744185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-service-ca\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.744215 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.744216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-serving-cert\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.744430 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.744235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9cjl\" (UniqueName: \"kubernetes.io/projected/b5f5c53b-b80c-40ec-9035-69e14af8b781-kube-api-access-x9cjl\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.744430 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.744341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-oauth-config\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.744430 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.744389    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-oauth-serving-cert\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.744574 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.744427    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-config\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.744574 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.744480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-trusted-ca-bundle\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.845003 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.844974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-oauth-config\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.845003 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.845009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-oauth-serving-cert\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.845261 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.845025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-config\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.845261 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.845074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-trusted-ca-bundle\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.845261 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.845092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-service-ca\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.845261 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.845111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-serving-cert\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.845261 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.845131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9cjl\" (UniqueName: \"kubernetes.io/projected/b5f5c53b-b80c-40ec-9035-69e14af8b781-kube-api-access-x9cjl\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.845748 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.845725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-oauth-serving-cert\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.845885 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.845842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-service-ca\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.845885 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.845848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-config\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.846186 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.846168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-trusted-ca-bundle\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.848296 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.848276    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-serving-cert\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.848421 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.848364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-oauth-config\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:49.852025 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:49.852003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9cjl\" (UniqueName: \"kubernetes.io/projected/b5f5c53b-b80c-40ec-9035-69e14af8b781-kube-api-access-x9cjl\") pod \"console-564f9dcddc-c7ktv\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") " pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:50.013204 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:50.013171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:17:50.140921 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:50.140889    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564f9dcddc-c7ktv"]
Jul 28 04:17:50.143983 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:17:50.143936    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f5c53b_b80c_40ec_9035_69e14af8b781.slice/crio-9314ea1d7f2d564af7b6058f9416bf10438f2e825b06f7e9d82f5749ec089053 WatchSource:0}: Error finding container 9314ea1d7f2d564af7b6058f9416bf10438f2e825b06f7e9d82f5749ec089053: Status 404 returned error can't find the container with id 9314ea1d7f2d564af7b6058f9416bf10438f2e825b06f7e9d82f5749ec089053
Jul 28 04:17:51.092504 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:51.092464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564f9dcddc-c7ktv" event={"ID":"b5f5c53b-b80c-40ec-9035-69e14af8b781","Type":"ContainerStarted","Data":"c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9"}
Jul 28 04:17:51.092911 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:51.092516    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564f9dcddc-c7ktv" event={"ID":"b5f5c53b-b80c-40ec-9035-69e14af8b781","Type":"ContainerStarted","Data":"9314ea1d7f2d564af7b6058f9416bf10438f2e825b06f7e9d82f5749ec089053"}
Jul 28 04:17:51.108788 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:17:51.108743    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-564f9dcddc-c7ktv" podStartSLOduration=2.108728153 podStartE2EDuration="2.108728153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:17:51.107160512 +0000 UTC m=+365.814642813" watchObservedRunningTime="2026-07-28 04:17:51.108728153 +0000 UTC m=+365.816210454"
Jul 28 04:18:00.013618 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:00.013584    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:18:00.014003 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:00.013642    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:18:00.018374 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:00.018354    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:18:00.128006 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:00.127982    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:18:00.169623 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:00.169597    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58b9ffb5b-5grtk"]
Jul 28 04:18:25.189422 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.189375    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58b9ffb5b-5grtk" podUID="86b04b56-a5e7-44e0-9350-c532de80a3a3" containerName="console" containerID="cri-o://e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059" gracePeriod=15
Jul 28 04:18:25.427784 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.427763    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:18:25.496657 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.496634    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-config\") pod \"86b04b56-a5e7-44e0-9350-c532de80a3a3\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") "
Jul 28 04:18:25.496813 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.496688    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-service-ca\") pod \"86b04b56-a5e7-44e0-9350-c532de80a3a3\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") "
Jul 28 04:18:25.496813 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.496715    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz9pp\" (UniqueName: \"kubernetes.io/projected/86b04b56-a5e7-44e0-9350-c532de80a3a3-kube-api-access-jz9pp\") pod \"86b04b56-a5e7-44e0-9350-c532de80a3a3\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") "
Jul 28 04:18:25.496813 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.496733    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-oauth-config\") pod \"86b04b56-a5e7-44e0-9350-c532de80a3a3\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") "
Jul 28 04:18:25.496813 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.496778    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-oauth-serving-cert\") pod \"86b04b56-a5e7-44e0-9350-c532de80a3a3\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") "
Jul 28 04:18:25.496813 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.496808    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-trusted-ca-bundle\") pod \"86b04b56-a5e7-44e0-9350-c532de80a3a3\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") "
Jul 28 04:18:25.497109 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.496832    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-serving-cert\") pod \"86b04b56-a5e7-44e0-9350-c532de80a3a3\" (UID: \"86b04b56-a5e7-44e0-9350-c532de80a3a3\") "
Jul 28 04:18:25.497109 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.497065    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "86b04b56-a5e7-44e0-9350-c532de80a3a3" (UID: "86b04b56-a5e7-44e0-9350-c532de80a3a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:18:25.497209 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.497146    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:18:25.497209 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.497166    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-config" (OuterVolumeSpecName: "console-config") pod "86b04b56-a5e7-44e0-9350-c532de80a3a3" (UID: "86b04b56-a5e7-44e0-9350-c532de80a3a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:18:25.497366 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.497278    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "86b04b56-a5e7-44e0-9350-c532de80a3a3" (UID: "86b04b56-a5e7-44e0-9350-c532de80a3a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:18:25.497479 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.497439    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "86b04b56-a5e7-44e0-9350-c532de80a3a3" (UID: "86b04b56-a5e7-44e0-9350-c532de80a3a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:18:25.499208 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.499181    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "86b04b56-a5e7-44e0-9350-c532de80a3a3" (UID: "86b04b56-a5e7-44e0-9350-c532de80a3a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 04:18:25.499294 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.499236    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b04b56-a5e7-44e0-9350-c532de80a3a3-kube-api-access-jz9pp" (OuterVolumeSpecName: "kube-api-access-jz9pp") pod "86b04b56-a5e7-44e0-9350-c532de80a3a3" (UID: "86b04b56-a5e7-44e0-9350-c532de80a3a3"). InnerVolumeSpecName "kube-api-access-jz9pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:18:25.499294 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.499246    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "86b04b56-a5e7-44e0-9350-c532de80a3a3" (UID: "86b04b56-a5e7-44e0-9350-c532de80a3a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 04:18:25.597927 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.597889    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-oauth-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:18:25.597927 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.597926    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-trusted-ca-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:18:25.597927 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.597935    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:18:25.598136 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.597945    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:18:25.598136 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.597954    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz9pp\" (UniqueName: \"kubernetes.io/projected/86b04b56-a5e7-44e0-9350-c532de80a3a3-kube-api-access-jz9pp\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:18:25.598136 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:25.597963    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86b04b56-a5e7-44e0-9350-c532de80a3a3-console-oauth-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:18:26.217289 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:26.217209    2581 generic.go:356] "Generic (PLEG): container finished" podID="86b04b56-a5e7-44e0-9350-c532de80a3a3" containerID="e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059" exitCode=0
Jul 28 04:18:26.217289 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:26.217256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b9ffb5b-5grtk" event={"ID":"86b04b56-a5e7-44e0-9350-c532de80a3a3","Type":"ContainerDied","Data":"e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059"}
Jul 28 04:18:26.217289 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:26.217271    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b9ffb5b-5grtk"
Jul 28 04:18:26.217753 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:26.217296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b9ffb5b-5grtk" event={"ID":"86b04b56-a5e7-44e0-9350-c532de80a3a3","Type":"ContainerDied","Data":"89ce19edfbdf9f7c825525fd788a344522b24862ff144dc52e38f8df8e3dab30"}
Jul 28 04:18:26.217753 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:26.217314    2581 scope.go:117] "RemoveContainer" containerID="e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059"
Jul 28 04:18:26.225433 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:26.225418    2581 scope.go:117] "RemoveContainer" containerID="e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059"
Jul 28 04:18:26.225693 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:18:26.225674    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059\": container with ID starting with e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059 not found: ID does not exist" containerID="e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059"
Jul 28 04:18:26.225746 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:26.225701    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059"} err="failed to get container status \"e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059\": rpc error: code = NotFound desc = could not find container \"e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059\": container with ID starting with e303c7deca539b36e0c7641f9bf0321e470559ac58befae4e28b6e50b378c059 not found: ID does not exist"
Jul 28 04:18:26.231131 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:26.231111    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58b9ffb5b-5grtk"]
Jul 28 04:18:26.238461 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:26.238442    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58b9ffb5b-5grtk"]
Jul 28 04:18:27.837296 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:27.837263    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86b04b56-a5e7-44e0-9350-c532de80a3a3" path="/var/lib/kubelet/pods/86b04b56-a5e7-44e0-9350-c532de80a3a3/volumes"
Jul 28 04:18:59.281383 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.281345    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-844f7b68ff-965c9"]
Jul 28 04:18:59.281848 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.281604    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b04b56-a5e7-44e0-9350-c532de80a3a3" containerName="console"
Jul 28 04:18:59.281848 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.281614    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b04b56-a5e7-44e0-9350-c532de80a3a3" containerName="console"
Jul 28 04:18:59.281848 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.281659    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="86b04b56-a5e7-44e0-9350-c532de80a3a3" containerName="console"
Jul 28 04:18:59.285731 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.285710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.294227 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.294203    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844f7b68ff-965c9"]
Jul 28 04:18:59.443315 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.443283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-config\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.443315 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.443321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49t85\" (UniqueName: \"kubernetes.io/projected/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-kube-api-access-49t85\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.443556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.443342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-service-ca\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.443556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.443446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-trusted-ca-bundle\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.443556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.443476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-oauth-config\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.443556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.443515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-serving-cert\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.443556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.443530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-oauth-serving-cert\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.544094 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.543997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-trusted-ca-bundle\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.544094 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.544047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-oauth-config\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.544094 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.544086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-serving-cert\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.544354 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.544101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-oauth-serving-cert\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.544354 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.544125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-config\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.544354 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.544142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49t85\" (UniqueName: \"kubernetes.io/projected/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-kube-api-access-49t85\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.544354 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.544167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-service-ca\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.544874 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.544835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-oauth-serving-cert\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.544874 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.544836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-config\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.545144 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.545123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-trusted-ca-bundle\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.545203 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.545181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-service-ca\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.546749 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.546733    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-oauth-config\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.546841 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.546825    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-serving-cert\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.557673 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.557652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49t85\" (UniqueName: \"kubernetes.io/projected/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-kube-api-access-49t85\") pod \"console-844f7b68ff-965c9\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") " pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.595840 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.595812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:18:59.721111 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:18:59.721079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844f7b68ff-965c9"]
Jul 28 04:18:59.724270 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:18:59.724251    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc08758_75ae_4e2a_8bc2_bbf7f26b1262.slice/crio-f47dc0078a45b234bdc3c1987372ef61c04ca5809802167dcd652649748e24dd WatchSource:0}: Error finding container f47dc0078a45b234bdc3c1987372ef61c04ca5809802167dcd652649748e24dd: Status 404 returned error can't find the container with id f47dc0078a45b234bdc3c1987372ef61c04ca5809802167dcd652649748e24dd
Jul 28 04:19:00.338642 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:00.338604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844f7b68ff-965c9" event={"ID":"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262","Type":"ContainerStarted","Data":"051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87"}
Jul 28 04:19:00.339018 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:00.338660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844f7b68ff-965c9" event={"ID":"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262","Type":"ContainerStarted","Data":"f47dc0078a45b234bdc3c1987372ef61c04ca5809802167dcd652649748e24dd"}
Jul 28 04:19:00.355293 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:00.355244    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-844f7b68ff-965c9" podStartSLOduration=1.3552298569999999 podStartE2EDuration="1.355229857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:18:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:19:00.352992454 +0000 UTC m=+435.060474755" watchObservedRunningTime="2026-07-28 04:19:00.355229857 +0000 UTC m=+435.062712159"
Jul 28 04:19:09.596860 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:09.596771    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:19:09.597263 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:09.597057    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:19:09.601694 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:09.601676    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:19:10.377443 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:10.377417    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:19:10.419156 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:10.419127    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564f9dcddc-c7ktv"]
Jul 28 04:19:35.438172 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.438112    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-564f9dcddc-c7ktv" podUID="b5f5c53b-b80c-40ec-9035-69e14af8b781" containerName="console" containerID="cri-o://c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9" gracePeriod=15
Jul 28 04:19:35.673784 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.673759    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:19:35.701162 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701106    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-serving-cert\") pod \"b5f5c53b-b80c-40ec-9035-69e14af8b781\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") "
Jul 28 04:19:35.701162 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701144    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9cjl\" (UniqueName: \"kubernetes.io/projected/b5f5c53b-b80c-40ec-9035-69e14af8b781-kube-api-access-x9cjl\") pod \"b5f5c53b-b80c-40ec-9035-69e14af8b781\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") "
Jul 28 04:19:35.701308 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701279    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-config\") pod \"b5f5c53b-b80c-40ec-9035-69e14af8b781\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") "
Jul 28 04:19:35.701368 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701352    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-service-ca\") pod \"b5f5c53b-b80c-40ec-9035-69e14af8b781\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") "
Jul 28 04:19:35.701425 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701385    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-trusted-ca-bundle\") pod \"b5f5c53b-b80c-40ec-9035-69e14af8b781\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") "
Jul 28 04:19:35.701425 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701416    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-oauth-config\") pod \"b5f5c53b-b80c-40ec-9035-69e14af8b781\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") "
Jul 28 04:19:35.701528 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701459    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-oauth-serving-cert\") pod \"b5f5c53b-b80c-40ec-9035-69e14af8b781\" (UID: \"b5f5c53b-b80c-40ec-9035-69e14af8b781\") "
Jul 28 04:19:35.701831 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701762    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-config" (OuterVolumeSpecName: "console-config") pod "b5f5c53b-b80c-40ec-9035-69e14af8b781" (UID: "b5f5c53b-b80c-40ec-9035-69e14af8b781"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:19:35.701949 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701845    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-service-ca" (OuterVolumeSpecName: "service-ca") pod "b5f5c53b-b80c-40ec-9035-69e14af8b781" (UID: "b5f5c53b-b80c-40ec-9035-69e14af8b781"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:19:35.701949 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701904    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b5f5c53b-b80c-40ec-9035-69e14af8b781" (UID: "b5f5c53b-b80c-40ec-9035-69e14af8b781"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:19:35.701949 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.701913    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b5f5c53b-b80c-40ec-9035-69e14af8b781" (UID: "b5f5c53b-b80c-40ec-9035-69e14af8b781"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:19:35.703672 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.703639    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b5f5c53b-b80c-40ec-9035-69e14af8b781" (UID: "b5f5c53b-b80c-40ec-9035-69e14af8b781"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 04:19:35.703842 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.703821    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b5f5c53b-b80c-40ec-9035-69e14af8b781" (UID: "b5f5c53b-b80c-40ec-9035-69e14af8b781"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 04:19:35.703889 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.703839    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5f5c53b-b80c-40ec-9035-69e14af8b781-kube-api-access-x9cjl" (OuterVolumeSpecName: "kube-api-access-x9cjl") pod "b5f5c53b-b80c-40ec-9035-69e14af8b781" (UID: "b5f5c53b-b80c-40ec-9035-69e14af8b781"). InnerVolumeSpecName "kube-api-access-x9cjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:19:35.802402 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.802376    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:19:35.802402 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.802397    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-trusted-ca-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:19:35.802402 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.802406    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-oauth-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:19:35.802620 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.802415    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-oauth-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:19:35.802620 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.802424    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:19:35.802620 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.802432    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9cjl\" (UniqueName: \"kubernetes.io/projected/b5f5c53b-b80c-40ec-9035-69e14af8b781-kube-api-access-x9cjl\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:19:35.802620 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:35.802440    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5f5c53b-b80c-40ec-9035-69e14af8b781-console-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:19:36.464556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:36.464521    2581 generic.go:356] "Generic (PLEG): container finished" podID="b5f5c53b-b80c-40ec-9035-69e14af8b781" containerID="c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9" exitCode=0
Jul 28 04:19:36.465001 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:36.464570    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564f9dcddc-c7ktv"
Jul 28 04:19:36.465001 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:36.464615    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564f9dcddc-c7ktv" event={"ID":"b5f5c53b-b80c-40ec-9035-69e14af8b781","Type":"ContainerDied","Data":"c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9"}
Jul 28 04:19:36.465001 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:36.464671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564f9dcddc-c7ktv" event={"ID":"b5f5c53b-b80c-40ec-9035-69e14af8b781","Type":"ContainerDied","Data":"9314ea1d7f2d564af7b6058f9416bf10438f2e825b06f7e9d82f5749ec089053"}
Jul 28 04:19:36.465001 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:36.464703    2581 scope.go:117] "RemoveContainer" containerID="c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9"
Jul 28 04:19:36.472749 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:36.472732    2581 scope.go:117] "RemoveContainer" containerID="c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9"
Jul 28 04:19:36.473015 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:19:36.472996    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9\": container with ID starting with c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9 not found: ID does not exist" containerID="c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9"
Jul 28 04:19:36.473094 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:36.473024    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9"} err="failed to get container status \"c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9\": rpc error: code = NotFound desc = could not find container \"c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9\": container with ID starting with c224821e75d3790abfd722ee63946eed534efc9fad9a1665a2206966a482fee9 not found: ID does not exist"
Jul 28 04:19:36.478028 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:36.478007    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564f9dcddc-c7ktv"]
Jul 28 04:19:36.481884 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:36.481866    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-564f9dcddc-c7ktv"]
Jul 28 04:19:37.837089 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:19:37.837058    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5f5c53b-b80c-40ec-9035-69e14af8b781" path="/var/lib/kubelet/pods/b5f5c53b-b80c-40ec-9035-69e14af8b781/volumes"
Jul 28 04:20:16.608301 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.608242    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"]
Jul 28 04:20:16.608820 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.608514    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5f5c53b-b80c-40ec-9035-69e14af8b781" containerName="console"
Jul 28 04:20:16.608820 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.608524    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5f5c53b-b80c-40ec-9035-69e14af8b781" containerName="console"
Jul 28 04:20:16.608820 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.608569    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5f5c53b-b80c-40ec-9035-69e14af8b781" containerName="console"
Jul 28 04:20:16.611437 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.611421    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:16.614247 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.614228    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 04:20:16.614372 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.614232    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 04:20:16.614810 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.614795    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d5mvz\""
Jul 28 04:20:16.621631 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.621606    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"]
Jul 28 04:20:16.668102 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.668078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:16.668197 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.668138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7lk2\" (UniqueName: \"kubernetes.io/projected/ecf6a870-df7c-4e16-85a2-08507e2ee03f-kube-api-access-z7lk2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:16.668197 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.668174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:16.769398 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.769372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7lk2\" (UniqueName: \"kubernetes.io/projected/ecf6a870-df7c-4e16-85a2-08507e2ee03f-kube-api-access-z7lk2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:16.769489 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.769407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:16.769489 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.769432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:16.769726 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.769712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:16.769759 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.769744    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:16.778087 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.778070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7lk2\" (UniqueName: \"kubernetes.io/projected/ecf6a870-df7c-4e16-85a2-08507e2ee03f-kube-api-access-z7lk2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:16.920055 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:16.919946    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:17.049475 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:17.049450    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"]
Jul 28 04:20:17.052489 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:20:17.052463    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf6a870_df7c_4e16_85a2_08507e2ee03f.slice/crio-88d325049928ccd41150be66d7fb747a0c04d22dcff281aa7d576ee46f82055d WatchSource:0}: Error finding container 88d325049928ccd41150be66d7fb747a0c04d22dcff281aa7d576ee46f82055d: Status 404 returned error can't find the container with id 88d325049928ccd41150be66d7fb747a0c04d22dcff281aa7d576ee46f82055d
Jul 28 04:20:17.054440 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:17.054424    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 04:20:17.607884 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:17.607846    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4" event={"ID":"ecf6a870-df7c-4e16-85a2-08507e2ee03f","Type":"ContainerStarted","Data":"88d325049928ccd41150be66d7fb747a0c04d22dcff281aa7d576ee46f82055d"}
Jul 28 04:20:24.637254 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:24.637214    2581 generic.go:356] "Generic (PLEG): container finished" podID="ecf6a870-df7c-4e16-85a2-08507e2ee03f" containerID="7e92a0ed368463a81362dfa20cf98ab176753e1d2ba70983c525dde8f0452565" exitCode=0
Jul 28 04:20:24.637747 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:24.637303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4" event={"ID":"ecf6a870-df7c-4e16-85a2-08507e2ee03f","Type":"ContainerDied","Data":"7e92a0ed368463a81362dfa20cf98ab176753e1d2ba70983c525dde8f0452565"}
Jul 28 04:20:27.652269 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:27.652235    2581 generic.go:356] "Generic (PLEG): container finished" podID="ecf6a870-df7c-4e16-85a2-08507e2ee03f" containerID="1702e86c18037e636b96f06e7814257f28b22301891524c15fb6c3b072cfc2f4" exitCode=0
Jul 28 04:20:27.652619 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:27.652285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4" event={"ID":"ecf6a870-df7c-4e16-85a2-08507e2ee03f","Type":"ContainerDied","Data":"1702e86c18037e636b96f06e7814257f28b22301891524c15fb6c3b072cfc2f4"}
Jul 28 04:20:36.694175 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:36.694132    2581 generic.go:356] "Generic (PLEG): container finished" podID="ecf6a870-df7c-4e16-85a2-08507e2ee03f" containerID="b581cb70b26c93765e20c9eaee4dd92c4499025e0fa16ab9aadada5d111514b7" exitCode=0
Jul 28 04:20:36.694624 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:36.694224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4" event={"ID":"ecf6a870-df7c-4e16-85a2-08507e2ee03f","Type":"ContainerDied","Data":"b581cb70b26c93765e20c9eaee4dd92c4499025e0fa16ab9aadada5d111514b7"}
Jul 28 04:20:37.819554 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:37.819530    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:37.949403 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:37.949304    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-util\") pod \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") "
Jul 28 04:20:37.949403 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:37.949354    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-bundle\") pod \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") "
Jul 28 04:20:37.949403 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:37.949394    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7lk2\" (UniqueName: \"kubernetes.io/projected/ecf6a870-df7c-4e16-85a2-08507e2ee03f-kube-api-access-z7lk2\") pod \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\" (UID: \"ecf6a870-df7c-4e16-85a2-08507e2ee03f\") "
Jul 28 04:20:37.950161 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:37.950136    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-bundle" (OuterVolumeSpecName: "bundle") pod "ecf6a870-df7c-4e16-85a2-08507e2ee03f" (UID: "ecf6a870-df7c-4e16-85a2-08507e2ee03f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:20:37.951677 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:37.951657    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecf6a870-df7c-4e16-85a2-08507e2ee03f-kube-api-access-z7lk2" (OuterVolumeSpecName: "kube-api-access-z7lk2") pod "ecf6a870-df7c-4e16-85a2-08507e2ee03f" (UID: "ecf6a870-df7c-4e16-85a2-08507e2ee03f"). InnerVolumeSpecName "kube-api-access-z7lk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:20:37.956109 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:37.956085    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-util" (OuterVolumeSpecName: "util") pod "ecf6a870-df7c-4e16-85a2-08507e2ee03f" (UID: "ecf6a870-df7c-4e16-85a2-08507e2ee03f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:20:38.049992 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:38.049945    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7lk2\" (UniqueName: \"kubernetes.io/projected/ecf6a870-df7c-4e16-85a2-08507e2ee03f-kube-api-access-z7lk2\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:20:38.049992 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:38.049987    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:20:38.050191 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:38.050015    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecf6a870-df7c-4e16-85a2-08507e2ee03f-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:20:38.702114 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:38.702078    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4" event={"ID":"ecf6a870-df7c-4e16-85a2-08507e2ee03f","Type":"ContainerDied","Data":"88d325049928ccd41150be66d7fb747a0c04d22dcff281aa7d576ee46f82055d"}
Jul 28 04:20:38.702114 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:38.702111    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vjgw4"
Jul 28 04:20:38.702344 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:38.702136    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88d325049928ccd41150be66d7fb747a0c04d22dcff281aa7d576ee46f82055d"
Jul 28 04:20:44.522126 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.522095    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"]
Jul 28 04:20:44.522709 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.522509    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecf6a870-df7c-4e16-85a2-08507e2ee03f" containerName="extract"
Jul 28 04:20:44.522709 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.522525    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf6a870-df7c-4e16-85a2-08507e2ee03f" containerName="extract"
Jul 28 04:20:44.522709 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.522543    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecf6a870-df7c-4e16-85a2-08507e2ee03f" containerName="util"
Jul 28 04:20:44.522709 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.522552    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf6a870-df7c-4e16-85a2-08507e2ee03f" containerName="util"
Jul 28 04:20:44.522709 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.522562    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecf6a870-df7c-4e16-85a2-08507e2ee03f" containerName="pull"
Jul 28 04:20:44.522709 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.522570    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf6a870-df7c-4e16-85a2-08507e2ee03f" containerName="pull"
Jul 28 04:20:44.522709 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.522645    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecf6a870-df7c-4e16-85a2-08507e2ee03f" containerName="extract"
Jul 28 04:20:44.527219 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.527198    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"
Jul 28 04:20:44.529413 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.529396    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8svwv\""
Jul 28 04:20:44.529748 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.529733    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 28 04:20:44.530274 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.530253    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 28 04:20:44.538665 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.538644    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"]
Jul 28 04:20:44.595523 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.595490    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5rcd\" (UniqueName: \"kubernetes.io/projected/683fb4a1-201a-4fe8-8e9c-a7b5a47189c6-kube-api-access-l5rcd\") pod \"cert-manager-operator-controller-manager-55c444bf86-2nb88\" (UID: \"683fb4a1-201a-4fe8-8e9c-a7b5a47189c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"
Jul 28 04:20:44.595659 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.595531    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/683fb4a1-201a-4fe8-8e9c-a7b5a47189c6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2nb88\" (UID: \"683fb4a1-201a-4fe8-8e9c-a7b5a47189c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"
Jul 28 04:20:44.696847 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.696813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5rcd\" (UniqueName: \"kubernetes.io/projected/683fb4a1-201a-4fe8-8e9c-a7b5a47189c6-kube-api-access-l5rcd\") pod \"cert-manager-operator-controller-manager-55c444bf86-2nb88\" (UID: \"683fb4a1-201a-4fe8-8e9c-a7b5a47189c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"
Jul 28 04:20:44.697061 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.696863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/683fb4a1-201a-4fe8-8e9c-a7b5a47189c6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2nb88\" (UID: \"683fb4a1-201a-4fe8-8e9c-a7b5a47189c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"
Jul 28 04:20:44.697272 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.697253    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/683fb4a1-201a-4fe8-8e9c-a7b5a47189c6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2nb88\" (UID: \"683fb4a1-201a-4fe8-8e9c-a7b5a47189c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"
Jul 28 04:20:44.704575 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.704555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5rcd\" (UniqueName: \"kubernetes.io/projected/683fb4a1-201a-4fe8-8e9c-a7b5a47189c6-kube-api-access-l5rcd\") pod \"cert-manager-operator-controller-manager-55c444bf86-2nb88\" (UID: \"683fb4a1-201a-4fe8-8e9c-a7b5a47189c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"
Jul 28 04:20:44.836245 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.836151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"
Jul 28 04:20:44.960193 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:44.960162    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88"]
Jul 28 04:20:44.963967 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:20:44.963945    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683fb4a1_201a_4fe8_8e9c_a7b5a47189c6.slice/crio-1e57494e8efc12be78a3f025fd588c10cc9dfa9b9aa8e80f5e814763b4e1420d WatchSource:0}: Error finding container 1e57494e8efc12be78a3f025fd588c10cc9dfa9b9aa8e80f5e814763b4e1420d: Status 404 returned error can't find the container with id 1e57494e8efc12be78a3f025fd588c10cc9dfa9b9aa8e80f5e814763b4e1420d
Jul 28 04:20:45.727852 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:45.727823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88" event={"ID":"683fb4a1-201a-4fe8-8e9c-a7b5a47189c6","Type":"ContainerStarted","Data":"1e57494e8efc12be78a3f025fd588c10cc9dfa9b9aa8e80f5e814763b4e1420d"}
Jul 28 04:20:47.738415 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:47.738380    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88" event={"ID":"683fb4a1-201a-4fe8-8e9c-a7b5a47189c6","Type":"ContainerStarted","Data":"4fed37e30b12a0ecdae6b45348a5b38f0148cbc29d86278c445fbe971d584ec7"}
Jul 28 04:20:47.758699 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:47.758644    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2nb88" podStartSLOduration=1.782527857 podStartE2EDuration="3.758625597s" totalImagesPullingTime="1.97609774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:20:47.757329847 +0000 UTC m=+542.464812173" watchObservedRunningTime="2026-07-28 04:20:47.758625597 +0000 UTC m=+542.466107899"
Jul 28 04:20:47.825287 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:47.825260    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-56r2d"]
Jul 28 04:20:47.827382 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:47.827365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d"
Jul 28 04:20:47.829351 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:47.829327    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 04:20:47.829461 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:47.829386    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 04:20:47.838750 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:47.838729    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-56r2d"]
Jul 28 04:20:47.924027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:47.923999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3974022-d56b-4af2-9d66-02d49363fb6c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-56r2d\" (UID: \"e3974022-d56b-4af2-9d66-02d49363fb6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d"
Jul 28 04:20:47.924166 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:47.924070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45nsv\" (UniqueName: \"kubernetes.io/projected/e3974022-d56b-4af2-9d66-02d49363fb6c-kube-api-access-45nsv\") pod \"cert-manager-webhook-6486ffd997-56r2d\" (UID: \"e3974022-d56b-4af2-9d66-02d49363fb6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d"
Jul 28 04:20:48.024857 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.024783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3974022-d56b-4af2-9d66-02d49363fb6c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-56r2d\" (UID: \"e3974022-d56b-4af2-9d66-02d49363fb6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d"
Jul 28 04:20:48.024857 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.024838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45nsv\" (UniqueName: \"kubernetes.io/projected/e3974022-d56b-4af2-9d66-02d49363fb6c-kube-api-access-45nsv\") pod \"cert-manager-webhook-6486ffd997-56r2d\" (UID: \"e3974022-d56b-4af2-9d66-02d49363fb6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d"
Jul 28 04:20:48.038609 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.038588    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3974022-d56b-4af2-9d66-02d49363fb6c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-56r2d\" (UID: \"e3974022-d56b-4af2-9d66-02d49363fb6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d"
Jul 28 04:20:48.038879 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.038862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45nsv\" (UniqueName: \"kubernetes.io/projected/e3974022-d56b-4af2-9d66-02d49363fb6c-kube-api-access-45nsv\") pod \"cert-manager-webhook-6486ffd997-56r2d\" (UID: \"e3974022-d56b-4af2-9d66-02d49363fb6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d"
Jul 28 04:20:48.147823 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.147799    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d"
Jul 28 04:20:48.294941 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.294787    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-56r2d"]
Jul 28 04:20:48.297428 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:20:48.297403    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3974022_d56b_4af2_9d66_02d49363fb6c.slice/crio-4c389284becd19d843422c8f075df5810eb9357831520f1d7f29c4e41e7f20b2 WatchSource:0}: Error finding container 4c389284becd19d843422c8f075df5810eb9357831520f1d7f29c4e41e7f20b2: Status 404 returned error can't find the container with id 4c389284becd19d843422c8f075df5810eb9357831520f1d7f29c4e41e7f20b2
Jul 28 04:20:48.724916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.724840    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"]
Jul 28 04:20:48.727509 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.727494    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:48.729609 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.729574    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 04:20:48.729609 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.729593    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d5mvz\""
Jul 28 04:20:48.729761 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.729612    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 04:20:48.736365 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.736346    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"]
Jul 28 04:20:48.744917 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.744889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d" event={"ID":"e3974022-d56b-4af2-9d66-02d49363fb6c","Type":"ContainerStarted","Data":"4c389284becd19d843422c8f075df5810eb9357831520f1d7f29c4e41e7f20b2"}
Jul 28 04:20:48.830691 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.830660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wk26\" (UniqueName: \"kubernetes.io/projected/274a0240-7ab4-4829-b07c-689e9bdf2b77-kube-api-access-4wk26\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:48.830814 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.830697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:48.830814 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.830749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:48.931522 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.931489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wk26\" (UniqueName: \"kubernetes.io/projected/274a0240-7ab4-4829-b07c-689e9bdf2b77-kube-api-access-4wk26\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:48.931522 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.931527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:48.931758 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.931560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:48.931953 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.931935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:48.932008 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.931933    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:48.946433 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:48.946404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wk26\" (UniqueName: \"kubernetes.io/projected/274a0240-7ab4-4829-b07c-689e9bdf2b77-kube-api-access-4wk26\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:49.036968 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:49.036934    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:49.187326 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:49.186849    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"]
Jul 28 04:20:49.190005 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:20:49.189976    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274a0240_7ab4_4829_b07c_689e9bdf2b77.slice/crio-c4812b9c86b07898539561e2edb4fcdb3872e86904273554fdc5de8384214fab WatchSource:0}: Error finding container c4812b9c86b07898539561e2edb4fcdb3872e86904273554fdc5de8384214fab: Status 404 returned error can't find the container with id c4812b9c86b07898539561e2edb4fcdb3872e86904273554fdc5de8384214fab
Jul 28 04:20:49.751805 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:49.751763    2581 generic.go:356] "Generic (PLEG): container finished" podID="274a0240-7ab4-4829-b07c-689e9bdf2b77" containerID="c5d5d2c5224bdf79aa7f490d6f91ed415eef656d0e1ca209843a5c3136d6c712" exitCode=0
Jul 28 04:20:49.752325 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:49.751855    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp" event={"ID":"274a0240-7ab4-4829-b07c-689e9bdf2b77","Type":"ContainerDied","Data":"c5d5d2c5224bdf79aa7f490d6f91ed415eef656d0e1ca209843a5c3136d6c712"}
Jul 28 04:20:49.752325 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:49.751915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp" event={"ID":"274a0240-7ab4-4829-b07c-689e9bdf2b77","Type":"ContainerStarted","Data":"c4812b9c86b07898539561e2edb4fcdb3872e86904273554fdc5de8384214fab"}
Jul 28 04:20:51.764719 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:51.764677    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d" event={"ID":"e3974022-d56b-4af2-9d66-02d49363fb6c","Type":"ContainerStarted","Data":"d9f52dc2e7e867dfc78be91d40d0063406d29ff4171b7c447f2a8a572c6f8410"}
Jul 28 04:20:51.765198 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:51.764916    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d"
Jul 28 04:20:51.784848 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:51.784789    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d" podStartSLOduration=2.282273106 podStartE2EDuration="4.78477379s" totalImagesPullingTime="2.502500684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:20:51.78360169 +0000 UTC m=+546.491083992" watchObservedRunningTime="2026-07-28 04:20:51.78477379 +0000 UTC m=+546.492256090"
Jul 28 04:20:52.771122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:52.771085    2581 generic.go:356] "Generic (PLEG): container finished" podID="274a0240-7ab4-4829-b07c-689e9bdf2b77" containerID="b64e214b445beb841d4cc30032eb2e786c3b0a3a3b1b4b1b911ad53f8411c159" exitCode=0
Jul 28 04:20:52.771575 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:52.771180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp" event={"ID":"274a0240-7ab4-4829-b07c-689e9bdf2b77","Type":"ContainerDied","Data":"b64e214b445beb841d4cc30032eb2e786c3b0a3a3b1b4b1b911ad53f8411c159"}
Jul 28 04:20:53.777563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:53.777531    2581 generic.go:356] "Generic (PLEG): container finished" podID="274a0240-7ab4-4829-b07c-689e9bdf2b77" containerID="87d8b13f59662258a6c6653a818d7e41d7055e3b746b4da7324e53b4ad8c9e87" exitCode=0
Jul 28 04:20:53.777969 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:53.777622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp" event={"ID":"274a0240-7ab4-4829-b07c-689e9bdf2b77","Type":"ContainerDied","Data":"87d8b13f59662258a6c6653a818d7e41d7055e3b746b4da7324e53b4ad8c9e87"}
Jul 28 04:20:54.492507 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.492473    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"]
Jul 28 04:20:54.495577 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.495558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"
Jul 28 04:20:54.497354 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.497336    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-sxb9n\""
Jul 28 04:20:54.501218 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.501188    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"]
Jul 28 04:20:54.578399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.578357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be5f22bb-2757-452f-8b61-63b7f940c2eb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-snwwv\" (UID: \"be5f22bb-2757-452f-8b61-63b7f940c2eb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"
Jul 28 04:20:54.578399 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.578393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22rjd\" (UniqueName: \"kubernetes.io/projected/be5f22bb-2757-452f-8b61-63b7f940c2eb-kube-api-access-22rjd\") pod \"cert-manager-cainjector-559cdd8c87-snwwv\" (UID: \"be5f22bb-2757-452f-8b61-63b7f940c2eb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"
Jul 28 04:20:54.679394 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.679360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be5f22bb-2757-452f-8b61-63b7f940c2eb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-snwwv\" (UID: \"be5f22bb-2757-452f-8b61-63b7f940c2eb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"
Jul 28 04:20:54.679394 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.679393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22rjd\" (UniqueName: \"kubernetes.io/projected/be5f22bb-2757-452f-8b61-63b7f940c2eb-kube-api-access-22rjd\") pod \"cert-manager-cainjector-559cdd8c87-snwwv\" (UID: \"be5f22bb-2757-452f-8b61-63b7f940c2eb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"
Jul 28 04:20:54.687961 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.687933    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be5f22bb-2757-452f-8b61-63b7f940c2eb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-snwwv\" (UID: \"be5f22bb-2757-452f-8b61-63b7f940c2eb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"
Jul 28 04:20:54.688227 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.688202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22rjd\" (UniqueName: \"kubernetes.io/projected/be5f22bb-2757-452f-8b61-63b7f940c2eb-kube-api-access-22rjd\") pod \"cert-manager-cainjector-559cdd8c87-snwwv\" (UID: \"be5f22bb-2757-452f-8b61-63b7f940c2eb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"
Jul 28 04:20:54.805644 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.805610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"
Jul 28 04:20:54.918907 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.918876    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:54.940469 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:54.940437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-snwwv"]
Jul 28 04:20:54.948902 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:20:54.948877    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe5f22bb_2757_452f_8b61_63b7f940c2eb.slice/crio-4eea8da1dcc3c6d5a8b6ba420bd57940e7edeb7d07b5e38b588ff023bdfe90b2 WatchSource:0}: Error finding container 4eea8da1dcc3c6d5a8b6ba420bd57940e7edeb7d07b5e38b588ff023bdfe90b2: Status 404 returned error can't find the container with id 4eea8da1dcc3c6d5a8b6ba420bd57940e7edeb7d07b5e38b588ff023bdfe90b2
Jul 28 04:20:55.082829 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.082744    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-bundle\") pod \"274a0240-7ab4-4829-b07c-689e9bdf2b77\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") "
Jul 28 04:20:55.082829 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.082787    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wk26\" (UniqueName: \"kubernetes.io/projected/274a0240-7ab4-4829-b07c-689e9bdf2b77-kube-api-access-4wk26\") pod \"274a0240-7ab4-4829-b07c-689e9bdf2b77\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") "
Jul 28 04:20:55.082829 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.082823    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-util\") pod \"274a0240-7ab4-4829-b07c-689e9bdf2b77\" (UID: \"274a0240-7ab4-4829-b07c-689e9bdf2b77\") "
Jul 28 04:20:55.083388 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.083317    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-bundle" (OuterVolumeSpecName: "bundle") pod "274a0240-7ab4-4829-b07c-689e9bdf2b77" (UID: "274a0240-7ab4-4829-b07c-689e9bdf2b77"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:20:55.085269 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.085244    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/274a0240-7ab4-4829-b07c-689e9bdf2b77-kube-api-access-4wk26" (OuterVolumeSpecName: "kube-api-access-4wk26") pod "274a0240-7ab4-4829-b07c-689e9bdf2b77" (UID: "274a0240-7ab4-4829-b07c-689e9bdf2b77"). InnerVolumeSpecName "kube-api-access-4wk26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:20:55.088400 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.088377    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-util" (OuterVolumeSpecName: "util") pod "274a0240-7ab4-4829-b07c-689e9bdf2b77" (UID: "274a0240-7ab4-4829-b07c-689e9bdf2b77"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:20:55.184186 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.184156    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:20:55.184186 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.184189    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wk26\" (UniqueName: \"kubernetes.io/projected/274a0240-7ab4-4829-b07c-689e9bdf2b77-kube-api-access-4wk26\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:20:55.184366 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.184203    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/274a0240-7ab4-4829-b07c-689e9bdf2b77-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:20:55.787788 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.787761    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp"
Jul 28 04:20:55.787955 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.787791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhvjp" event={"ID":"274a0240-7ab4-4829-b07c-689e9bdf2b77","Type":"ContainerDied","Data":"c4812b9c86b07898539561e2edb4fcdb3872e86904273554fdc5de8384214fab"}
Jul 28 04:20:55.787955 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.787832    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4812b9c86b07898539561e2edb4fcdb3872e86904273554fdc5de8384214fab"
Jul 28 04:20:55.789334 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.789309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv" event={"ID":"be5f22bb-2757-452f-8b61-63b7f940c2eb","Type":"ContainerStarted","Data":"b0b5bb1c6ce4160f349105ab1cf310cafc156de77a36ba22c8e529aee6b9ca2b"}
Jul 28 04:20:55.789442 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.789345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv" event={"ID":"be5f22bb-2757-452f-8b61-63b7f940c2eb","Type":"ContainerStarted","Data":"4eea8da1dcc3c6d5a8b6ba420bd57940e7edeb7d07b5e38b588ff023bdfe90b2"}
Jul 28 04:20:55.807280 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:55.807231    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-snwwv" podStartSLOduration=1.8072108789999999 podStartE2EDuration="1.807210879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:20:55.805563676 +0000 UTC m=+550.513045990" watchObservedRunningTime="2026-07-28 04:20:55.807210879 +0000 UTC m=+550.514693186"
Jul 28 04:20:57.773972 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:20:57.773941    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-56r2d"
Jul 28 04:21:08.116652 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.116618    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"]
Jul 28 04:21:08.117118 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.116908    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="274a0240-7ab4-4829-b07c-689e9bdf2b77" containerName="extract"
Jul 28 04:21:08.117118 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.116920    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="274a0240-7ab4-4829-b07c-689e9bdf2b77" containerName="extract"
Jul 28 04:21:08.117118 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.116930    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="274a0240-7ab4-4829-b07c-689e9bdf2b77" containerName="util"
Jul 28 04:21:08.117118 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.116936    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="274a0240-7ab4-4829-b07c-689e9bdf2b77" containerName="util"
Jul 28 04:21:08.117118 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.116943    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="274a0240-7ab4-4829-b07c-689e9bdf2b77" containerName="pull"
Jul 28 04:21:08.117118 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.116948    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="274a0240-7ab4-4829-b07c-689e9bdf2b77" containerName="pull"
Jul 28 04:21:08.117118 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.116992    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="274a0240-7ab4-4829-b07c-689e9bdf2b77" containerName="extract"
Jul 28 04:21:08.131084 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.131064    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"]
Jul 28 04:21:08.131188 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.131129    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.133127 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.133109    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 04:21:08.133765 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.133749    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d5mvz\""
Jul 28 04:21:08.133817 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.133751    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 04:21:08.272656 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.272629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.272798 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.272672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.272798 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.272697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntqp\" (UniqueName: \"kubernetes.io/projected/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-kube-api-access-rntqp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.373284 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.373214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.373284 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.373251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntqp\" (UniqueName: \"kubernetes.io/projected/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-kube-api-access-rntqp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.373463 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.373296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.373638 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.373614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.373697 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.373640    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.380482 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.380464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntqp\" (UniqueName: \"kubernetes.io/projected/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-kube-api-access-rntqp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.440593 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.440571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:08.586951 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.586917    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"]
Jul 28 04:21:08.589882 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:21:08.589855    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db9bcbc_2057_47d0_b1b4_43f21fa058f3.slice/crio-860ccd600ad0f3a4540398e498cd51fa2b39c772db3ae21a8cfe45718a987d15 WatchSource:0}: Error finding container 860ccd600ad0f3a4540398e498cd51fa2b39c772db3ae21a8cfe45718a987d15: Status 404 returned error can't find the container with id 860ccd600ad0f3a4540398e498cd51fa2b39c772db3ae21a8cfe45718a987d15
Jul 28 04:21:08.841848 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.841821    2581 generic.go:356] "Generic (PLEG): container finished" podID="7db9bcbc-2057-47d0-b1b4-43f21fa058f3" containerID="ba0b29dc87e5de7031ed044318016f35edb285ee74d0101d16d81be3d7e67c31" exitCode=0
Jul 28 04:21:08.841964 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.841867    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg" event={"ID":"7db9bcbc-2057-47d0-b1b4-43f21fa058f3","Type":"ContainerDied","Data":"ba0b29dc87e5de7031ed044318016f35edb285ee74d0101d16d81be3d7e67c31"}
Jul 28 04:21:08.841964 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:08.841901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg" event={"ID":"7db9bcbc-2057-47d0-b1b4-43f21fa058f3","Type":"ContainerStarted","Data":"860ccd600ad0f3a4540398e498cd51fa2b39c772db3ae21a8cfe45718a987d15"}
Jul 28 04:21:09.846895 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:09.846862    2581 generic.go:356] "Generic (PLEG): container finished" podID="7db9bcbc-2057-47d0-b1b4-43f21fa058f3" containerID="a7fb3badd1a81002b1ff3610a23fe302582a5f7c33a0d9946704352f68d91f15" exitCode=0
Jul 28 04:21:09.847239 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:09.846945    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg" event={"ID":"7db9bcbc-2057-47d0-b1b4-43f21fa058f3","Type":"ContainerDied","Data":"a7fb3badd1a81002b1ff3610a23fe302582a5f7c33a0d9946704352f68d91f15"}
Jul 28 04:21:10.853247 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:10.853215    2581 generic.go:356] "Generic (PLEG): container finished" podID="7db9bcbc-2057-47d0-b1b4-43f21fa058f3" containerID="adb1f0608cd10f3031f89de412cfbacccfe49d52d1d68aae30202e8e9d463675" exitCode=0
Jul 28 04:21:10.853596 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:10.853279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg" event={"ID":"7db9bcbc-2057-47d0-b1b4-43f21fa058f3","Type":"ContainerDied","Data":"adb1f0608cd10f3031f89de412cfbacccfe49d52d1d68aae30202e8e9d463675"}
Jul 28 04:21:11.989778 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:11.989755    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:12.098915 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.098886    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-util\") pod \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") "
Jul 28 04:21:12.099028 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.098946    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-bundle\") pod \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") "
Jul 28 04:21:12.099028 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.098972    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rntqp\" (UniqueName: \"kubernetes.io/projected/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-kube-api-access-rntqp\") pod \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\" (UID: \"7db9bcbc-2057-47d0-b1b4-43f21fa058f3\") "
Jul 28 04:21:12.099774 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.099706    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-bundle" (OuterVolumeSpecName: "bundle") pod "7db9bcbc-2057-47d0-b1b4-43f21fa058f3" (UID: "7db9bcbc-2057-47d0-b1b4-43f21fa058f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:21:12.101165 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.101143    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-kube-api-access-rntqp" (OuterVolumeSpecName: "kube-api-access-rntqp") pod "7db9bcbc-2057-47d0-b1b4-43f21fa058f3" (UID: "7db9bcbc-2057-47d0-b1b4-43f21fa058f3"). InnerVolumeSpecName "kube-api-access-rntqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:21:12.104501 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.104484    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-util" (OuterVolumeSpecName: "util") pod "7db9bcbc-2057-47d0-b1b4-43f21fa058f3" (UID: "7db9bcbc-2057-47d0-b1b4-43f21fa058f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:21:12.200336 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.200283    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:21:12.200336 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.200302    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rntqp\" (UniqueName: \"kubernetes.io/projected/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-kube-api-access-rntqp\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:21:12.200336 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.200310    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7db9bcbc-2057-47d0-b1b4-43f21fa058f3-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:21:12.863872 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.863848    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg"
Jul 28 04:21:12.864005 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.863888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nfhg" event={"ID":"7db9bcbc-2057-47d0-b1b4-43f21fa058f3","Type":"ContainerDied","Data":"860ccd600ad0f3a4540398e498cd51fa2b39c772db3ae21a8cfe45718a987d15"}
Jul 28 04:21:12.864005 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:12.863925    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="860ccd600ad0f3a4540398e498cd51fa2b39c772db3ae21a8cfe45718a987d15"
Jul 28 04:21:22.224644 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.224610    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"]
Jul 28 04:21:22.225275 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.225004    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db9bcbc-2057-47d0-b1b4-43f21fa058f3" containerName="pull"
Jul 28 04:21:22.225275 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.225020    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db9bcbc-2057-47d0-b1b4-43f21fa058f3" containerName="pull"
Jul 28 04:21:22.225275 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.225050    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db9bcbc-2057-47d0-b1b4-43f21fa058f3" containerName="extract"
Jul 28 04:21:22.225275 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.225060    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db9bcbc-2057-47d0-b1b4-43f21fa058f3" containerName="extract"
Jul 28 04:21:22.225275 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.225088    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db9bcbc-2057-47d0-b1b4-43f21fa058f3" containerName="util"
Jul 28 04:21:22.225275 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.225097    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db9bcbc-2057-47d0-b1b4-43f21fa058f3" containerName="util"
Jul 28 04:21:22.225275 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.225187    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7db9bcbc-2057-47d0-b1b4-43f21fa058f3" containerName="extract"
Jul 28 04:21:22.227752 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.227731    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.229936 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.229912    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9c6v4\""
Jul 28 04:21:22.230472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.230454    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 04:21:22.230760 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.230740    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 04:21:22.230858 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.230785    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 04:21:22.231026 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.231009    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 04:21:22.241855 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.241837    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"]
Jul 28 04:21:22.376084 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.376028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9db6461d-a4fe-4933-a4f8-1bef077eb1db-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.376259 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.376092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kffl\" (UniqueName: \"kubernetes.io/projected/9db6461d-a4fe-4933-a4f8-1bef077eb1db-kube-api-access-9kffl\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.376259 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.376148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9db6461d-a4fe-4933-a4f8-1bef077eb1db-manifests\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.376339 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.376265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9db6461d-a4fe-4933-a4f8-1bef077eb1db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.376339 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.376296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9db6461d-a4fe-4933-a4f8-1bef077eb1db-tmp\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.477073 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.476972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9db6461d-a4fe-4933-a4f8-1bef077eb1db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.477073 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.477018    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9db6461d-a4fe-4933-a4f8-1bef077eb1db-tmp\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.477073 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.477071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9db6461d-a4fe-4933-a4f8-1bef077eb1db-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.477338 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.477102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kffl\" (UniqueName: \"kubernetes.io/projected/9db6461d-a4fe-4933-a4f8-1bef077eb1db-kube-api-access-9kffl\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.477338 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.477128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9db6461d-a4fe-4933-a4f8-1bef077eb1db-manifests\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.477530 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.477501    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9db6461d-a4fe-4933-a4f8-1bef077eb1db-manifests\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.479389 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.479365    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9db6461d-a4fe-4933-a4f8-1bef077eb1db-tmp\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.479671 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.479654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9db6461d-a4fe-4933-a4f8-1bef077eb1db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.479712 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.479671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9db6461d-a4fe-4933-a4f8-1bef077eb1db-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.484026 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.484010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kffl\" (UniqueName: \"kubernetes.io/projected/9db6461d-a4fe-4933-a4f8-1bef077eb1db-kube-api-access-9kffl\") pod \"opendatahub-operator-controller-manager-69d65f9dd8-gntlm\" (UID: \"9db6461d-a4fe-4933-a4f8-1bef077eb1db\") " pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.537940 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.537915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:22.669294 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.669259    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"]
Jul 28 04:21:22.672366 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:21:22.672342    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db6461d_a4fe_4933_a4f8_1bef077eb1db.slice/crio-24f0921aac5efbde9d40f93ed5ab7d596ce8d3b440fa5aa98e6ca44b16ee8cb1 WatchSource:0}: Error finding container 24f0921aac5efbde9d40f93ed5ab7d596ce8d3b440fa5aa98e6ca44b16ee8cb1: Status 404 returned error can't find the container with id 24f0921aac5efbde9d40f93ed5ab7d596ce8d3b440fa5aa98e6ca44b16ee8cb1
Jul 28 04:21:22.906642 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:22.906605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm" event={"ID":"9db6461d-a4fe-4933-a4f8-1bef077eb1db","Type":"ContainerStarted","Data":"24f0921aac5efbde9d40f93ed5ab7d596ce8d3b440fa5aa98e6ca44b16ee8cb1"}
Jul 28 04:21:25.922276 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:25.922197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm" event={"ID":"9db6461d-a4fe-4933-a4f8-1bef077eb1db","Type":"ContainerStarted","Data":"86735885c74d6c6c3b53f5a656d3bc743680468bafe8f34daaf5808cc84f5f65"}
Jul 28 04:21:26.928451 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:26.928366    2581 generic.go:356] "Generic (PLEG): container finished" podID="9db6461d-a4fe-4933-a4f8-1bef077eb1db" containerID="86735885c74d6c6c3b53f5a656d3bc743680468bafe8f34daaf5808cc84f5f65" exitCode=0
Jul 28 04:21:26.928451 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:26.928427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm" event={"ID":"9db6461d-a4fe-4933-a4f8-1bef077eb1db","Type":"ContainerDied","Data":"86735885c74d6c6c3b53f5a656d3bc743680468bafe8f34daaf5808cc84f5f65"}
Jul 28 04:21:27.934051 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:27.933999    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm" event={"ID":"9db6461d-a4fe-4933-a4f8-1bef077eb1db","Type":"ContainerStarted","Data":"12b06fc9239869416c213244a048cc1f9cecfebf8df91119c9b8687e61bf64ec"}
Jul 28 04:21:27.934449 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:27.934102    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:27.953660 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:27.953615    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm" podStartSLOduration=1.7723455590000001 podStartE2EDuration="5.953599942s" totalImagesPullingTime="3.150726937s" totalInitContainerRuntime="1.030527446s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:21:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:21:27.951246411 +0000 UTC m=+582.658728712" watchObservedRunningTime="2026-07-28 04:21:27.953599942 +0000 UTC m=+582.661082242"
Jul 28 04:21:38.940834 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:38.940800    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69d65f9dd8-gntlm"
Jul 28 04:21:40.700884 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.700852    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"]
Jul 28 04:21:40.758815 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.758779    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"]
Jul 28 04:21:40.758959 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.758872    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.761233 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.761212    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 04:21:40.762343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.762315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 04:21:40.762458 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.762437    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 04:21:40.762572 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.762537    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 04:21:40.762716 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.762599    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 04:21:40.764640 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.764621    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f4c7r\""
Jul 28 04:21:40.809206 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.809186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a326803-1700-48ef-9190-60c1921c2e50-cert\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.809319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.809215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjrdx\" (UniqueName: \"kubernetes.io/projected/5a326803-1700-48ef-9190-60c1921c2e50-kube-api-access-sjrdx\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.809319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.809242    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5a326803-1700-48ef-9190-60c1921c2e50-manager-config\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.809319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.809272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a326803-1700-48ef-9190-60c1921c2e50-metrics-cert\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.909964 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.909938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a326803-1700-48ef-9190-60c1921c2e50-cert\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.910122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.909977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjrdx\" (UniqueName: \"kubernetes.io/projected/5a326803-1700-48ef-9190-60c1921c2e50-kube-api-access-sjrdx\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.910122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.910026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5a326803-1700-48ef-9190-60c1921c2e50-manager-config\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.910122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.910101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a326803-1700-48ef-9190-60c1921c2e50-metrics-cert\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.910842 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.910822    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5a326803-1700-48ef-9190-60c1921c2e50-manager-config\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.913179 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.913127    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a326803-1700-48ef-9190-60c1921c2e50-cert\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.913179 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.913142    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a326803-1700-48ef-9190-60c1921c2e50-metrics-cert\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:40.920116 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:40.920091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjrdx\" (UniqueName: \"kubernetes.io/projected/5a326803-1700-48ef-9190-60c1921c2e50-kube-api-access-sjrdx\") pod \"lws-controller-manager-7796f8d956-jm9kj\" (UID: \"5a326803-1700-48ef-9190-60c1921c2e50\") " pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:41.068379 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:41.068347    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:41.199668 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:41.199638    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"]
Jul 28 04:21:41.202981 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:21:41.202958    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a326803_1700_48ef_9190_60c1921c2e50.slice/crio-a565bd5bf96e9c8dd6b6af372d0b53f42a65dc93e3536723fe7f99ee9740bf05 WatchSource:0}: Error finding container a565bd5bf96e9c8dd6b6af372d0b53f42a65dc93e3536723fe7f99ee9740bf05: Status 404 returned error can't find the container with id a565bd5bf96e9c8dd6b6af372d0b53f42a65dc93e3536723fe7f99ee9740bf05
Jul 28 04:21:41.992753 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:41.992715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj" event={"ID":"5a326803-1700-48ef-9190-60c1921c2e50","Type":"ContainerStarted","Data":"a565bd5bf96e9c8dd6b6af372d0b53f42a65dc93e3536723fe7f99ee9740bf05"}
Jul 28 04:21:42.998631 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:42.998597    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj" event={"ID":"5a326803-1700-48ef-9190-60c1921c2e50","Type":"ContainerStarted","Data":"2f731163e2e3e9a0e32ee820532428b4a7421c32f57608f89d2e06aeb436720b"}
Jul 28 04:21:42.998983 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:42.998733    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:43.013768 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:43.013720    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj" podStartSLOduration=1.649960759 podStartE2EDuration="3.013706905s" totalImagesPullingTime="1.363746146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:21:43.012222508 +0000 UTC m=+597.719704807" watchObservedRunningTime="2026-07-28 04:21:43.013706905 +0000 UTC m=+597.721189204"
Jul 28 04:21:45.727642 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:45.727614    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:21:45.728371 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:45.728349    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:21:54.004920 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:54.004888    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7796f8d956-jm9kj"
Jul 28 04:21:59.794755 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.794721    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"]
Jul 28 04:21:59.798050 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.798012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.800143 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.800119    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 04:21:59.800323 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.800303    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 04:21:59.800401 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.800340    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wk8qs\""
Jul 28 04:21:59.800784 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.800764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 04:21:59.808326 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.808249    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"]
Jul 28 04:21:59.855858 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.855830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.855858 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.855862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.856055 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.855882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.856055 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.855897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.856055 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.856022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.856157 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.856070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssqwt\" (UniqueName: \"kubernetes.io/projected/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-kube-api-access-ssqwt\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.856157 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.856107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.856157 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.856125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.856157 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.856146    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957417 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957417 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957636 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957636 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957727 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957780 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssqwt\" (UniqueName: \"kubernetes.io/projected/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-kube-api-access-ssqwt\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957835 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957835 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957939 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957939 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.957939 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.957916    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.958123 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.958060    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.958227 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.958213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.958365 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.958342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.960244 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.960225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.960544 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.960523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.968575 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.968549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:21:59.968996 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:21:59.968977    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssqwt\" (UniqueName: \"kubernetes.io/projected/1cb2bb2e-32b6-4a51-a1d6-8affb0430870-kube-api-access-ssqwt\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r\" (UID: \"1cb2bb2e-32b6-4a51-a1d6-8affb0430870\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:22:00.109531 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:00.109439    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:22:00.242636 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:00.242602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"]
Jul 28 04:22:00.245380 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:22:00.245348    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb2bb2e_32b6_4a51_a1d6_8affb0430870.slice/crio-705933cd3b2333a5fa672ac9cb03bf3dd34dd5be7c1bbb32c980bf87cd8c9103 WatchSource:0}: Error finding container 705933cd3b2333a5fa672ac9cb03bf3dd34dd5be7c1bbb32c980bf87cd8c9103: Status 404 returned error can't find the container with id 705933cd3b2333a5fa672ac9cb03bf3dd34dd5be7c1bbb32c980bf87cd8c9103
Jul 28 04:22:01.085757 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:01.085714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r" event={"ID":"1cb2bb2e-32b6-4a51-a1d6-8affb0430870","Type":"ContainerStarted","Data":"705933cd3b2333a5fa672ac9cb03bf3dd34dd5be7c1bbb32c980bf87cd8c9103"}
Jul 28 04:22:02.847392 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:02.847338    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:22:02.847711 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:02.847446    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:22:02.847711 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:02.847486    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:22:03.097726 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:03.097646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r" event={"ID":"1cb2bb2e-32b6-4a51-a1d6-8affb0430870","Type":"ContainerStarted","Data":"cab27438fcaa208c61da1672cb0a8893343d47ba977b3b7c2bd8f3c6931849d7"}
Jul 28 04:22:03.110018 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:03.109996    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:22:03.111513 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:03.111492    2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 28 04:22:03.111608 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:03.111545    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r" podUID="1cb2bb2e-32b6-4a51-a1d6-8affb0430870" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 28 04:22:03.116786 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:03.116743    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r" podStartSLOduration=1.51706064 podStartE2EDuration="4.116730786s" totalImagesPullingTime="2.599670146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:22:03.114449843 +0000 UTC m=+617.821932138" watchObservedRunningTime="2026-07-28 04:22:03.116730786 +0000 UTC m=+617.824213086"
Jul 28 04:22:04.113602 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:04.113565    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:22:05.105583 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:05.105553    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:22:05.106683 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:05.106665    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r"
Jul 28 04:22:42.589203 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.589169    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vlzj"]
Jul 28 04:22:42.591628 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.591612    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vlzj"
Jul 28 04:22:42.594180 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.594154    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 04:22:42.594355 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.594327    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 04:22:42.594748 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.594725    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jl2fp\""
Jul 28 04:22:42.603240 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.600716    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vlzj"]
Jul 28 04:22:42.614756 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.614727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x2ms\" (UniqueName: \"kubernetes.io/projected/0a7df7fd-7700-4bde-8591-af0e9087acc7-kube-api-access-2x2ms\") pod \"kuadrant-operator-catalog-5vlzj\" (UID: \"0a7df7fd-7700-4bde-8591-af0e9087acc7\") " pod="kuadrant-system/kuadrant-operator-catalog-5vlzj"
Jul 28 04:22:42.715411 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.715382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x2ms\" (UniqueName: \"kubernetes.io/projected/0a7df7fd-7700-4bde-8591-af0e9087acc7-kube-api-access-2x2ms\") pod \"kuadrant-operator-catalog-5vlzj\" (UID: \"0a7df7fd-7700-4bde-8591-af0e9087acc7\") " pod="kuadrant-system/kuadrant-operator-catalog-5vlzj"
Jul 28 04:22:42.732892 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.732852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x2ms\" (UniqueName: \"kubernetes.io/projected/0a7df7fd-7700-4bde-8591-af0e9087acc7-kube-api-access-2x2ms\") pod \"kuadrant-operator-catalog-5vlzj\" (UID: \"0a7df7fd-7700-4bde-8591-af0e9087acc7\") " pod="kuadrant-system/kuadrant-operator-catalog-5vlzj"
Jul 28 04:22:42.907428 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.907330    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vlzj"
Jul 28 04:22:42.959776 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:42.959700    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vlzj"]
Jul 28 04:22:43.036644 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:43.036611    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vlzj"]
Jul 28 04:22:43.039723 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:22:43.039685    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7df7fd_7700_4bde_8591_af0e9087acc7.slice/crio-8050d5ba71196b726e0814776475a93ab5f734b49de69bb82937c0206adae006 WatchSource:0}: Error finding container 8050d5ba71196b726e0814776475a93ab5f734b49de69bb82937c0206adae006: Status 404 returned error can't find the container with id 8050d5ba71196b726e0814776475a93ab5f734b49de69bb82937c0206adae006
Jul 28 04:22:43.168247 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:43.168154    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dfs2v"]
Jul 28 04:22:43.170677 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:43.170652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dfs2v"
Jul 28 04:22:43.178203 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:43.178167    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dfs2v"]
Jul 28 04:22:43.219055 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:43.219001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf6hn\" (UniqueName: \"kubernetes.io/projected/dcf57feb-6db5-4757-8ffb-66ca742d31b3-kube-api-access-kf6hn\") pod \"kuadrant-operator-catalog-dfs2v\" (UID: \"dcf57feb-6db5-4757-8ffb-66ca742d31b3\") " pod="kuadrant-system/kuadrant-operator-catalog-dfs2v"
Jul 28 04:22:43.272660 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:43.272625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vlzj" event={"ID":"0a7df7fd-7700-4bde-8591-af0e9087acc7","Type":"ContainerStarted","Data":"8050d5ba71196b726e0814776475a93ab5f734b49de69bb82937c0206adae006"}
Jul 28 04:22:43.319991 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:43.319958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf6hn\" (UniqueName: \"kubernetes.io/projected/dcf57feb-6db5-4757-8ffb-66ca742d31b3-kube-api-access-kf6hn\") pod \"kuadrant-operator-catalog-dfs2v\" (UID: \"dcf57feb-6db5-4757-8ffb-66ca742d31b3\") " pod="kuadrant-system/kuadrant-operator-catalog-dfs2v"
Jul 28 04:22:43.327340 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:43.327319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf6hn\" (UniqueName: \"kubernetes.io/projected/dcf57feb-6db5-4757-8ffb-66ca742d31b3-kube-api-access-kf6hn\") pod \"kuadrant-operator-catalog-dfs2v\" (UID: \"dcf57feb-6db5-4757-8ffb-66ca742d31b3\") " pod="kuadrant-system/kuadrant-operator-catalog-dfs2v"
Jul 28 04:22:43.483931 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:43.483848    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dfs2v"
Jul 28 04:22:43.615756 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:43.615725    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dfs2v"]
Jul 28 04:22:43.642667 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:22:43.642637    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf57feb_6db5_4757_8ffb_66ca742d31b3.slice/crio-bec62acfeea7ba315176ab561d2ba85120bda010cc576f350e78f9800cbd48e1 WatchSource:0}: Error finding container bec62acfeea7ba315176ab561d2ba85120bda010cc576f350e78f9800cbd48e1: Status 404 returned error can't find the container with id bec62acfeea7ba315176ab561d2ba85120bda010cc576f350e78f9800cbd48e1
Jul 28 04:22:44.279108 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:44.279071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dfs2v" event={"ID":"dcf57feb-6db5-4757-8ffb-66ca742d31b3","Type":"ContainerStarted","Data":"bec62acfeea7ba315176ab561d2ba85120bda010cc576f350e78f9800cbd48e1"}
Jul 28 04:22:45.286200 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:45.286157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dfs2v" event={"ID":"dcf57feb-6db5-4757-8ffb-66ca742d31b3","Type":"ContainerStarted","Data":"88fcaf8a80b89a3c6658db8844b3b2b5dd5c70fde288ffec296ae5d193e52154"}
Jul 28 04:22:45.287687 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:45.287661    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vlzj" event={"ID":"0a7df7fd-7700-4bde-8591-af0e9087acc7","Type":"ContainerStarted","Data":"6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa"}
Jul 28 04:22:45.287811 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:45.287776    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5vlzj" podUID="0a7df7fd-7700-4bde-8591-af0e9087acc7" containerName="registry-server" containerID="cri-o://6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa" gracePeriod=2
Jul 28 04:22:45.300408 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:45.300353    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dfs2v" podStartSLOduration=0.863892738 podStartE2EDuration="2.300336908s" totalImagesPullingTime="1.43644417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:22:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:22:45.298659536 +0000 UTC m=+660.006141839" watchObservedRunningTime="2026-07-28 04:22:45.300336908 +0000 UTC m=+660.007819225"
Jul 28 04:22:45.312858 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:45.312803    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5vlzj" podStartSLOduration=1.2760385 podStartE2EDuration="3.312786725s" totalImagesPullingTime="2.036748225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:22:45.310790487 +0000 UTC m=+660.018272791" watchObservedRunningTime="2026-07-28 04:22:45.312786725 +0000 UTC m=+660.020269026"
Jul 28 04:22:45.529947 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:45.529923    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vlzj"
Jul 28 04:22:45.642083 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:45.641965    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x2ms\" (UniqueName: \"kubernetes.io/projected/0a7df7fd-7700-4bde-8591-af0e9087acc7-kube-api-access-2x2ms\") pod \"0a7df7fd-7700-4bde-8591-af0e9087acc7\" (UID: \"0a7df7fd-7700-4bde-8591-af0e9087acc7\") "
Jul 28 04:22:45.644345 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:45.644318    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7df7fd-7700-4bde-8591-af0e9087acc7-kube-api-access-2x2ms" (OuterVolumeSpecName: "kube-api-access-2x2ms") pod "0a7df7fd-7700-4bde-8591-af0e9087acc7" (UID: "0a7df7fd-7700-4bde-8591-af0e9087acc7"). InnerVolumeSpecName "kube-api-access-2x2ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:22:45.743422 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:45.743394    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x2ms\" (UniqueName: \"kubernetes.io/projected/0a7df7fd-7700-4bde-8591-af0e9087acc7-kube-api-access-2x2ms\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:22:46.294378 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:46.294336    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a7df7fd-7700-4bde-8591-af0e9087acc7" containerID="6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa" exitCode=0
Jul 28 04:22:46.294821 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:46.294399    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vlzj"
Jul 28 04:22:46.294821 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:46.294423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vlzj" event={"ID":"0a7df7fd-7700-4bde-8591-af0e9087acc7","Type":"ContainerDied","Data":"6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa"}
Jul 28 04:22:46.294821 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:46.294475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vlzj" event={"ID":"0a7df7fd-7700-4bde-8591-af0e9087acc7","Type":"ContainerDied","Data":"8050d5ba71196b726e0814776475a93ab5f734b49de69bb82937c0206adae006"}
Jul 28 04:22:46.294821 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:46.294496    2581 scope.go:117] "RemoveContainer" containerID="6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa"
Jul 28 04:22:46.303449 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:46.303431    2581 scope.go:117] "RemoveContainer" containerID="6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa"
Jul 28 04:22:46.303690 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:22:46.303671    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa\": container with ID starting with 6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa not found: ID does not exist" containerID="6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa"
Jul 28 04:22:46.303744 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:46.303700    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa"} err="failed to get container status \"6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa\": rpc error: code = NotFound desc = could not find container \"6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa\": container with ID starting with 6b336edfdbe404db78ffc265ac2a93cabe401448645c0e534c31b2e9d8dabcfa not found: ID does not exist"
Jul 28 04:22:46.308444 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:46.308423    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vlzj"]
Jul 28 04:22:46.311997 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:46.311975    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vlzj"]
Jul 28 04:22:47.837898 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:47.837865    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a7df7fd-7700-4bde-8591-af0e9087acc7" path="/var/lib/kubelet/pods/0a7df7fd-7700-4bde-8591-af0e9087acc7/volumes"
Jul 28 04:22:53.484902 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:53.484866    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dfs2v"
Jul 28 04:22:53.485359 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:53.484928    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dfs2v"
Jul 28 04:22:53.506844 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:53.506816    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dfs2v"
Jul 28 04:22:54.352806 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:54.352779    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dfs2v"
Jul 28 04:22:57.975396 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:57.975355    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"]
Jul 28 04:22:57.975867 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:57.975800    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a7df7fd-7700-4bde-8591-af0e9087acc7" containerName="registry-server"
Jul 28 04:22:57.975867 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:57.975818    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a7df7fd-7700-4bde-8591-af0e9087acc7" containerName="registry-server"
Jul 28 04:22:57.975990 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:57.975914    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a7df7fd-7700-4bde-8591-af0e9087acc7" containerName="registry-server"
Jul 28 04:22:57.978766 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:57.978745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:57.981176 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:57.981151    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cbl8r\""
Jul 28 04:22:57.985280 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:57.985256    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"]
Jul 28 04:22:58.041277 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.041250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s86sx\" (UniqueName: \"kubernetes.io/projected/020dbab7-7534-4d2a-82fe-22b02e9e4a87-kube-api-access-s86sx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:58.041509 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.041293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:58.041509 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.041404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:58.142680 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.142650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:58.142778 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.142691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s86sx\" (UniqueName: \"kubernetes.io/projected/020dbab7-7534-4d2a-82fe-22b02e9e4a87-kube-api-access-s86sx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:58.142778 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.142719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:58.143147 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.143128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:58.143147 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.143140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:58.150065 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.150028    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s86sx\" (UniqueName: \"kubernetes.io/projected/020dbab7-7534-4d2a-82fe-22b02e9e4a87-kube-api-access-s86sx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:58.288744 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.288712    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:22:58.414742 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.414710    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"]
Jul 28 04:22:58.417490 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:22:58.417462    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020dbab7_7534_4d2a_82fe_22b02e9e4a87.slice/crio-cf13e1c162139a3acee9f290f0897ca12af41abc5b188f8b221f7cb99b8394a0 WatchSource:0}: Error finding container cf13e1c162139a3acee9f290f0897ca12af41abc5b188f8b221f7cb99b8394a0: Status 404 returned error can't find the container with id cf13e1c162139a3acee9f290f0897ca12af41abc5b188f8b221f7cb99b8394a0
Jul 28 04:22:58.771606 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.771572    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"]
Jul 28 04:22:58.773847 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.773829    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:58.781920 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.781896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"]
Jul 28 04:22:58.849133 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.849103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:58.849261 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.849153    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s46fd\" (UniqueName: \"kubernetes.io/projected/45001788-1043-4c7a-a6b2-7179c23987d5-kube-api-access-s46fd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:58.849261 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.849229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:58.950442 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.950407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:58.950572 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.950461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:58.950572 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.950495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s46fd\" (UniqueName: \"kubernetes.io/projected/45001788-1043-4c7a-a6b2-7179c23987d5-kube-api-access-s46fd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:58.950774 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.950755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:58.950814 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.950792    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:58.957982 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:58.957958    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s46fd\" (UniqueName: \"kubernetes.io/projected/45001788-1043-4c7a-a6b2-7179c23987d5-kube-api-access-s46fd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:59.084016 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.083939    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:22:59.213522 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.213496    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"]
Jul 28 04:22:59.216092 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:22:59.216069    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45001788_1043_4c7a_a6b2_7179c23987d5.slice/crio-b17757c81409bd9529d89af0793ce9a37924dddcd0a1fba73e71ccf43cd22153 WatchSource:0}: Error finding container b17757c81409bd9529d89af0793ce9a37924dddcd0a1fba73e71ccf43cd22153: Status 404 returned error can't find the container with id b17757c81409bd9529d89af0793ce9a37924dddcd0a1fba73e71ccf43cd22153
Jul 28 04:22:59.356016 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.355935    2581 generic.go:356] "Generic (PLEG): container finished" podID="45001788-1043-4c7a-a6b2-7179c23987d5" containerID="5e597b7e639c2ddd17bbcda62dcbcb186e50483eff7a992a33edd1a68ceb7123" exitCode=0
Jul 28 04:22:59.356206 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.356022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt" event={"ID":"45001788-1043-4c7a-a6b2-7179c23987d5","Type":"ContainerDied","Data":"5e597b7e639c2ddd17bbcda62dcbcb186e50483eff7a992a33edd1a68ceb7123"}
Jul 28 04:22:59.356206 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.356086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt" event={"ID":"45001788-1043-4c7a-a6b2-7179c23987d5","Type":"ContainerStarted","Data":"b17757c81409bd9529d89af0793ce9a37924dddcd0a1fba73e71ccf43cd22153"}
Jul 28 04:22:59.357568 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.357539    2581 generic.go:356] "Generic (PLEG): container finished" podID="020dbab7-7534-4d2a-82fe-22b02e9e4a87" containerID="54e3877b4fc74950b07daa62241d52ffdd5a9a1fb248ee8027eea8d98674f361" exitCode=0
Jul 28 04:22:59.357681 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.357575    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm" event={"ID":"020dbab7-7534-4d2a-82fe-22b02e9e4a87","Type":"ContainerDied","Data":"54e3877b4fc74950b07daa62241d52ffdd5a9a1fb248ee8027eea8d98674f361"}
Jul 28 04:22:59.357681 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.357620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm" event={"ID":"020dbab7-7534-4d2a-82fe-22b02e9e4a87","Type":"ContainerStarted","Data":"cf13e1c162139a3acee9f290f0897ca12af41abc5b188f8b221f7cb99b8394a0"}
Jul 28 04:22:59.368142 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.368118    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"]
Jul 28 04:22:59.370402 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.370383    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.378858 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.378837    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"]
Jul 28 04:22:59.454711 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.454683    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f45t4\" (UniqueName: \"kubernetes.io/projected/31874a7a-4e52-49d8-bf2e-b393101557a5-kube-api-access-f45t4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.454711 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.454714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.454890 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.454810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.555304 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.555268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f45t4\" (UniqueName: \"kubernetes.io/projected/31874a7a-4e52-49d8-bf2e-b393101557a5-kube-api-access-f45t4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.555304 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.555303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.555559 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.555341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.555710 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.555688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.555777 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.555711    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.563202 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.563182    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f45t4\" (UniqueName: \"kubernetes.io/projected/31874a7a-4e52-49d8-bf2e-b393101557a5-kube-api-access-f45t4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.690641 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.690555    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:22:59.769296 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.769267    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"]
Jul 28 04:22:59.771947 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.771926    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:22:59.780244 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.780212    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"]
Jul 28 04:22:59.827183 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.827097    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"]
Jul 28 04:22:59.829214 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:22:59.829191    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31874a7a_4e52_49d8_bf2e_b393101557a5.slice/crio-e558dd30a7f8067d9e136b0a83f41b15d646e85949bd2690e71151e943f53d0c WatchSource:0}: Error finding container e558dd30a7f8067d9e136b0a83f41b15d646e85949bd2690e71151e943f53d0c: Status 404 returned error can't find the container with id e558dd30a7f8067d9e136b0a83f41b15d646e85949bd2690e71151e943f53d0c
Jul 28 04:22:59.858048 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.857998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:22:59.858185 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.858056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:22:59.858185 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.858161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmnbd\" (UniqueName: \"kubernetes.io/projected/9f27435c-c2ec-40e4-9206-10bf2d00cf76-kube-api-access-vmnbd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:22:59.959119 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.959079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:22:59.959285 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.959196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmnbd\" (UniqueName: \"kubernetes.io/projected/9f27435c-c2ec-40e4-9206-10bf2d00cf76-kube-api-access-vmnbd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:22:59.959285 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.959273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:22:59.959567 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.959545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:22:59.959567 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.959559    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:22:59.967570 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:22:59.967546    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmnbd\" (UniqueName: \"kubernetes.io/projected/9f27435c-c2ec-40e4-9206-10bf2d00cf76-kube-api-access-vmnbd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:23:00.086677 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.086644    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:23:00.242513 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.242481    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"]
Jul 28 04:23:00.245307 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:23:00.245274    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f27435c_c2ec_40e4_9206_10bf2d00cf76.slice/crio-c4a30a32233f6afdf4a09bdb9512d34b3483ad6a60e4c7f9d44594860162cff9 WatchSource:0}: Error finding container c4a30a32233f6afdf4a09bdb9512d34b3483ad6a60e4c7f9d44594860162cff9: Status 404 returned error can't find the container with id c4a30a32233f6afdf4a09bdb9512d34b3483ad6a60e4c7f9d44594860162cff9
Jul 28 04:23:00.363783 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.363752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w" event={"ID":"9f27435c-c2ec-40e4-9206-10bf2d00cf76","Type":"ContainerStarted","Data":"2573c89dbad1aa27bc2e6f471b97da203c5a30182f8fd67951d7f0fae84e6eb8"}
Jul 28 04:23:00.363921 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.363805    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w" event={"ID":"9f27435c-c2ec-40e4-9206-10bf2d00cf76","Type":"ContainerStarted","Data":"c4a30a32233f6afdf4a09bdb9512d34b3483ad6a60e4c7f9d44594860162cff9"}
Jul 28 04:23:00.365642 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.365621    2581 generic.go:356] "Generic (PLEG): container finished" podID="020dbab7-7534-4d2a-82fe-22b02e9e4a87" containerID="07d225a96dfe2f5e90d286224728e6b1d2b667001e63b013ab44e76d7df26f36" exitCode=0
Jul 28 04:23:00.365774 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.365746    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm" event={"ID":"020dbab7-7534-4d2a-82fe-22b02e9e4a87","Type":"ContainerDied","Data":"07d225a96dfe2f5e90d286224728e6b1d2b667001e63b013ab44e76d7df26f36"}
Jul 28 04:23:00.367633 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.367611    2581 generic.go:356] "Generic (PLEG): container finished" podID="31874a7a-4e52-49d8-bf2e-b393101557a5" containerID="96e77b2818d7e0d27fb82e994546b4d8cac649fbf648baa2f2fbc73f4f12c829" exitCode=0
Jul 28 04:23:00.367734 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.367699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2" event={"ID":"31874a7a-4e52-49d8-bf2e-b393101557a5","Type":"ContainerDied","Data":"96e77b2818d7e0d27fb82e994546b4d8cac649fbf648baa2f2fbc73f4f12c829"}
Jul 28 04:23:00.367793 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.367754    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2" event={"ID":"31874a7a-4e52-49d8-bf2e-b393101557a5","Type":"ContainerStarted","Data":"e558dd30a7f8067d9e136b0a83f41b15d646e85949bd2690e71151e943f53d0c"}
Jul 28 04:23:00.369778 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.369752    2581 generic.go:356] "Generic (PLEG): container finished" podID="45001788-1043-4c7a-a6b2-7179c23987d5" containerID="482a61abfa092e75d480db17b65aa823888924ee7e23fa4c02b7188516cd06a5" exitCode=0
Jul 28 04:23:00.369886 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:00.369801    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt" event={"ID":"45001788-1043-4c7a-a6b2-7179c23987d5","Type":"ContainerDied","Data":"482a61abfa092e75d480db17b65aa823888924ee7e23fa4c02b7188516cd06a5"}
Jul 28 04:23:01.376584 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:01.376556    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f27435c-c2ec-40e4-9206-10bf2d00cf76" containerID="2573c89dbad1aa27bc2e6f471b97da203c5a30182f8fd67951d7f0fae84e6eb8" exitCode=0
Jul 28 04:23:01.376995 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:01.376646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w" event={"ID":"9f27435c-c2ec-40e4-9206-10bf2d00cf76","Type":"ContainerDied","Data":"2573c89dbad1aa27bc2e6f471b97da203c5a30182f8fd67951d7f0fae84e6eb8"}
Jul 28 04:23:01.378930 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:01.378906    2581 generic.go:356] "Generic (PLEG): container finished" podID="020dbab7-7534-4d2a-82fe-22b02e9e4a87" containerID="4fb59761b705d1307cc9fc0b5de5b3f362bcaae00269738f30a880f120af9c85" exitCode=0
Jul 28 04:23:01.379072 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:01.378985    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm" event={"ID":"020dbab7-7534-4d2a-82fe-22b02e9e4a87","Type":"ContainerDied","Data":"4fb59761b705d1307cc9fc0b5de5b3f362bcaae00269738f30a880f120af9c85"}
Jul 28 04:23:01.380838 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:01.380816    2581 generic.go:356] "Generic (PLEG): container finished" podID="31874a7a-4e52-49d8-bf2e-b393101557a5" containerID="e49c79f1da8d3235ff240fdbec35e67ce26526764f3c117f0abeac5f422eaef8" exitCode=0
Jul 28 04:23:01.380933 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:01.380844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2" event={"ID":"31874a7a-4e52-49d8-bf2e-b393101557a5","Type":"ContainerDied","Data":"e49c79f1da8d3235ff240fdbec35e67ce26526764f3c117f0abeac5f422eaef8"}
Jul 28 04:23:01.383757 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:01.383736    2581 generic.go:356] "Generic (PLEG): container finished" podID="45001788-1043-4c7a-a6b2-7179c23987d5" containerID="c37fdb08e34b46283d7f4937505b83dfc901b90de79429928ca1b3b51da1cf9d" exitCode=0
Jul 28 04:23:01.383845 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:01.383768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt" event={"ID":"45001788-1043-4c7a-a6b2-7179c23987d5","Type":"ContainerDied","Data":"c37fdb08e34b46283d7f4937505b83dfc901b90de79429928ca1b3b51da1cf9d"}
Jul 28 04:23:02.391087 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.391025    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f27435c-c2ec-40e4-9206-10bf2d00cf76" containerID="dd1b4ed6cb33b6067b5d53214c9e32aebd4b28c063f0c218ea1de0c780fac8d5" exitCode=0
Jul 28 04:23:02.391501 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.391138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w" event={"ID":"9f27435c-c2ec-40e4-9206-10bf2d00cf76","Type":"ContainerDied","Data":"dd1b4ed6cb33b6067b5d53214c9e32aebd4b28c063f0c218ea1de0c780fac8d5"}
Jul 28 04:23:02.393296 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.393276    2581 generic.go:356] "Generic (PLEG): container finished" podID="31874a7a-4e52-49d8-bf2e-b393101557a5" containerID="8eec3b34f645ccbbe5d4cfc94674bf953f805685095efada9a85b0c454fb2499" exitCode=0
Jul 28 04:23:02.393386 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.393308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2" event={"ID":"31874a7a-4e52-49d8-bf2e-b393101557a5","Type":"ContainerDied","Data":"8eec3b34f645ccbbe5d4cfc94674bf953f805685095efada9a85b0c454fb2499"}
Jul 28 04:23:02.537087 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.536977    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:23:02.580611 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.580586    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-util\") pod \"45001788-1043-4c7a-a6b2-7179c23987d5\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") "
Jul 28 04:23:02.580738 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.580684    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-bundle\") pod \"45001788-1043-4c7a-a6b2-7179c23987d5\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") "
Jul 28 04:23:02.580738 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.580731    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s46fd\" (UniqueName: \"kubernetes.io/projected/45001788-1043-4c7a-a6b2-7179c23987d5-kube-api-access-s46fd\") pod \"45001788-1043-4c7a-a6b2-7179c23987d5\" (UID: \"45001788-1043-4c7a-a6b2-7179c23987d5\") "
Jul 28 04:23:02.581204 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.581178    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-bundle" (OuterVolumeSpecName: "bundle") pod "45001788-1043-4c7a-a6b2-7179c23987d5" (UID: "45001788-1043-4c7a-a6b2-7179c23987d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:23:02.583213 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.583186    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45001788-1043-4c7a-a6b2-7179c23987d5-kube-api-access-s46fd" (OuterVolumeSpecName: "kube-api-access-s46fd") pod "45001788-1043-4c7a-a6b2-7179c23987d5" (UID: "45001788-1043-4c7a-a6b2-7179c23987d5"). InnerVolumeSpecName "kube-api-access-s46fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:23:02.586521 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.586501    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-util" (OuterVolumeSpecName: "util") pod "45001788-1043-4c7a-a6b2-7179c23987d5" (UID: "45001788-1043-4c7a-a6b2-7179c23987d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:23:02.586609 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.586594    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:23:02.681581 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.681550    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s86sx\" (UniqueName: \"kubernetes.io/projected/020dbab7-7534-4d2a-82fe-22b02e9e4a87-kube-api-access-s86sx\") pod \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") "
Jul 28 04:23:02.681581 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.681580    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-util\") pod \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") "
Jul 28 04:23:02.681767 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.681634    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-bundle\") pod \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\" (UID: \"020dbab7-7534-4d2a-82fe-22b02e9e4a87\") "
Jul 28 04:23:02.681833 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.681817    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:02.681869 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.681840    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s46fd\" (UniqueName: \"kubernetes.io/projected/45001788-1043-4c7a-a6b2-7179c23987d5-kube-api-access-s46fd\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:02.681869 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.681855    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45001788-1043-4c7a-a6b2-7179c23987d5-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:02.682290 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.682268    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-bundle" (OuterVolumeSpecName: "bundle") pod "020dbab7-7534-4d2a-82fe-22b02e9e4a87" (UID: "020dbab7-7534-4d2a-82fe-22b02e9e4a87"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:23:02.683680 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.683661    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/020dbab7-7534-4d2a-82fe-22b02e9e4a87-kube-api-access-s86sx" (OuterVolumeSpecName: "kube-api-access-s86sx") pod "020dbab7-7534-4d2a-82fe-22b02e9e4a87" (UID: "020dbab7-7534-4d2a-82fe-22b02e9e4a87"). InnerVolumeSpecName "kube-api-access-s86sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:23:02.687369 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.687337    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-util" (OuterVolumeSpecName: "util") pod "020dbab7-7534-4d2a-82fe-22b02e9e4a87" (UID: "020dbab7-7534-4d2a-82fe-22b02e9e4a87"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:23:02.782529 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.782500    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:02.782529 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.782526    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s86sx\" (UniqueName: \"kubernetes.io/projected/020dbab7-7534-4d2a-82fe-22b02e9e4a87-kube-api-access-s86sx\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:02.782684 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:02.782537    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/020dbab7-7534-4d2a-82fe-22b02e9e4a87-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:03.400313 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.400280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt" event={"ID":"45001788-1043-4c7a-a6b2-7179c23987d5","Type":"ContainerDied","Data":"b17757c81409bd9529d89af0793ce9a37924dddcd0a1fba73e71ccf43cd22153"}
Jul 28 04:23:03.400715 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.400329    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b17757c81409bd9529d89af0793ce9a37924dddcd0a1fba73e71ccf43cd22153"
Jul 28 04:23:03.400715 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.400286    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt"
Jul 28 04:23:03.402347 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.402323    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f27435c-c2ec-40e4-9206-10bf2d00cf76" containerID="640253c0be9ff086d598d4d116ab6a9ddc1cba133148c9a1fb304463dece4ff6" exitCode=0
Jul 28 04:23:03.402472 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.402402    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w" event={"ID":"9f27435c-c2ec-40e4-9206-10bf2d00cf76","Type":"ContainerDied","Data":"640253c0be9ff086d598d4d116ab6a9ddc1cba133148c9a1fb304463dece4ff6"}
Jul 28 04:23:03.404243 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.404223    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm"
Jul 28 04:23:03.404356 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.404260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm" event={"ID":"020dbab7-7534-4d2a-82fe-22b02e9e4a87","Type":"ContainerDied","Data":"cf13e1c162139a3acee9f290f0897ca12af41abc5b188f8b221f7cb99b8394a0"}
Jul 28 04:23:03.404356 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.404298    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf13e1c162139a3acee9f290f0897ca12af41abc5b188f8b221f7cb99b8394a0"
Jul 28 04:23:03.534934 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.534910    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:23:03.589372 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.589344    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f45t4\" (UniqueName: \"kubernetes.io/projected/31874a7a-4e52-49d8-bf2e-b393101557a5-kube-api-access-f45t4\") pod \"31874a7a-4e52-49d8-bf2e-b393101557a5\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") "
Jul 28 04:23:03.589510 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.589385    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-util\") pod \"31874a7a-4e52-49d8-bf2e-b393101557a5\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") "
Jul 28 04:23:03.589510 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.589434    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-bundle\") pod \"31874a7a-4e52-49d8-bf2e-b393101557a5\" (UID: \"31874a7a-4e52-49d8-bf2e-b393101557a5\") "
Jul 28 04:23:03.589912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.589879    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-bundle" (OuterVolumeSpecName: "bundle") pod "31874a7a-4e52-49d8-bf2e-b393101557a5" (UID: "31874a7a-4e52-49d8-bf2e-b393101557a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:23:03.591447 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.591426    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31874a7a-4e52-49d8-bf2e-b393101557a5-kube-api-access-f45t4" (OuterVolumeSpecName: "kube-api-access-f45t4") pod "31874a7a-4e52-49d8-bf2e-b393101557a5" (UID: "31874a7a-4e52-49d8-bf2e-b393101557a5"). InnerVolumeSpecName "kube-api-access-f45t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:23:03.594408 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.594384    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-util" (OuterVolumeSpecName: "util") pod "31874a7a-4e52-49d8-bf2e-b393101557a5" (UID: "31874a7a-4e52-49d8-bf2e-b393101557a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:23:03.690785 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.690758    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f45t4\" (UniqueName: \"kubernetes.io/projected/31874a7a-4e52-49d8-bf2e-b393101557a5-kube-api-access-f45t4\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:03.690785 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.690781    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:03.690941 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:03.690792    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31874a7a-4e52-49d8-bf2e-b393101557a5-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:04.410804 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.410777    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2"
Jul 28 04:23:04.410804 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.410781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2" event={"ID":"31874a7a-4e52-49d8-bf2e-b393101557a5","Type":"ContainerDied","Data":"e558dd30a7f8067d9e136b0a83f41b15d646e85949bd2690e71151e943f53d0c"}
Jul 28 04:23:04.411331 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.410826    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e558dd30a7f8067d9e136b0a83f41b15d646e85949bd2690e71151e943f53d0c"
Jul 28 04:23:04.536994 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.536975    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:23:04.596921 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.596898    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmnbd\" (UniqueName: \"kubernetes.io/projected/9f27435c-c2ec-40e4-9206-10bf2d00cf76-kube-api-access-vmnbd\") pod \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") "
Jul 28 04:23:04.597082 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.596955    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-bundle\") pod \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") "
Jul 28 04:23:04.597082 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.596995    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-util\") pod \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\" (UID: \"9f27435c-c2ec-40e4-9206-10bf2d00cf76\") "
Jul 28 04:23:04.597421 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.597398    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-bundle" (OuterVolumeSpecName: "bundle") pod "9f27435c-c2ec-40e4-9206-10bf2d00cf76" (UID: "9f27435c-c2ec-40e4-9206-10bf2d00cf76"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:23:04.599062 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.599024    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f27435c-c2ec-40e4-9206-10bf2d00cf76-kube-api-access-vmnbd" (OuterVolumeSpecName: "kube-api-access-vmnbd") pod "9f27435c-c2ec-40e4-9206-10bf2d00cf76" (UID: "9f27435c-c2ec-40e4-9206-10bf2d00cf76"). InnerVolumeSpecName "kube-api-access-vmnbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:23:04.602397 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.602371    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-util" (OuterVolumeSpecName: "util") pod "9f27435c-c2ec-40e4-9206-10bf2d00cf76" (UID: "9f27435c-c2ec-40e4-9206-10bf2d00cf76"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:23:04.698087 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.698001    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:04.698087 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.698025    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f27435c-c2ec-40e4-9206-10bf2d00cf76-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:04.698087 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:04.698051    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmnbd\" (UniqueName: \"kubernetes.io/projected/9f27435c-c2ec-40e4-9206-10bf2d00cf76-kube-api-access-vmnbd\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:05.417548 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:05.417517    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w"
Jul 28 04:23:05.417548 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:05.417535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w" event={"ID":"9f27435c-c2ec-40e4-9206-10bf2d00cf76","Type":"ContainerDied","Data":"c4a30a32233f6afdf4a09bdb9512d34b3483ad6a60e4c7f9d44594860162cff9"}
Jul 28 04:23:05.417949 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:05.417582    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4a30a32233f6afdf4a09bdb9512d34b3483ad6a60e4c7f9d44594860162cff9"
Jul 28 04:23:16.085576 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085539    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"]
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085834    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f27435c-c2ec-40e4-9206-10bf2d00cf76" containerName="pull"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085845    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f27435c-c2ec-40e4-9206-10bf2d00cf76" containerName="pull"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085855    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31874a7a-4e52-49d8-bf2e-b393101557a5" containerName="pull"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085860    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="31874a7a-4e52-49d8-bf2e-b393101557a5" containerName="pull"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085868    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45001788-1043-4c7a-a6b2-7179c23987d5" containerName="pull"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085873    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45001788-1043-4c7a-a6b2-7179c23987d5" containerName="pull"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085882    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45001788-1043-4c7a-a6b2-7179c23987d5" containerName="util"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085886    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45001788-1043-4c7a-a6b2-7179c23987d5" containerName="util"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085893    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f27435c-c2ec-40e4-9206-10bf2d00cf76" containerName="util"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085897    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f27435c-c2ec-40e4-9206-10bf2d00cf76" containerName="util"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085903    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020dbab7-7534-4d2a-82fe-22b02e9e4a87" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085908    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="020dbab7-7534-4d2a-82fe-22b02e9e4a87" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085915    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020dbab7-7534-4d2a-82fe-22b02e9e4a87" containerName="pull"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085920    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="020dbab7-7534-4d2a-82fe-22b02e9e4a87" containerName="pull"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085925    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31874a7a-4e52-49d8-bf2e-b393101557a5" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085930    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="31874a7a-4e52-49d8-bf2e-b393101557a5" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085937    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31874a7a-4e52-49d8-bf2e-b393101557a5" containerName="util"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085942    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="31874a7a-4e52-49d8-bf2e-b393101557a5" containerName="util"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085950    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45001788-1043-4c7a-a6b2-7179c23987d5" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085954    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45001788-1043-4c7a-a6b2-7179c23987d5" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085963    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020dbab7-7534-4d2a-82fe-22b02e9e4a87" containerName="util"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085967    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="020dbab7-7534-4d2a-82fe-22b02e9e4a87" containerName="util"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085973    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f27435c-c2ec-40e4-9206-10bf2d00cf76" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.085978    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f27435c-c2ec-40e4-9206-10bf2d00cf76" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.086021    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="020dbab7-7534-4d2a-82fe-22b02e9e4a87" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.086029    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f27435c-c2ec-40e4-9206-10bf2d00cf76" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.086050    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="31874a7a-4e52-49d8-bf2e-b393101557a5" containerName="extract"
Jul 28 04:23:16.086122 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.086056    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="45001788-1043-4c7a-a6b2-7179c23987d5" containerName="extract"
Jul 28 04:23:16.092633 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.092611    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:16.095378 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.095354    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s2lcg\""
Jul 28 04:23:16.101473 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.101447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"]
Jul 28 04:23:16.198606 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.198568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/392ad090-a647-44a8-9bc2-a620c1a79ab8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" (UID: \"392ad090-a647-44a8-9bc2-a620c1a79ab8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:16.198790 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.198633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rr9m\" (UniqueName: \"kubernetes.io/projected/392ad090-a647-44a8-9bc2-a620c1a79ab8-kube-api-access-2rr9m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" (UID: \"392ad090-a647-44a8-9bc2-a620c1a79ab8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:16.300027 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.299990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rr9m\" (UniqueName: \"kubernetes.io/projected/392ad090-a647-44a8-9bc2-a620c1a79ab8-kube-api-access-2rr9m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" (UID: \"392ad090-a647-44a8-9bc2-a620c1a79ab8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:16.300213 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.300070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/392ad090-a647-44a8-9bc2-a620c1a79ab8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" (UID: \"392ad090-a647-44a8-9bc2-a620c1a79ab8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:16.300396 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.300380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/392ad090-a647-44a8-9bc2-a620c1a79ab8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" (UID: \"392ad090-a647-44a8-9bc2-a620c1a79ab8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:16.321548 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.321521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rr9m\" (UniqueName: \"kubernetes.io/projected/392ad090-a647-44a8-9bc2-a620c1a79ab8-kube-api-access-2rr9m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" (UID: \"392ad090-a647-44a8-9bc2-a620c1a79ab8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:16.403866 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.403792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:16.542279 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:16.536522    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"]
Jul 28 04:23:17.481972 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:17.481931    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g" event={"ID":"392ad090-a647-44a8-9bc2-a620c1a79ab8","Type":"ContainerStarted","Data":"6ec9ba3cbad8ba0b0210811727d9bf21c5e17e7cda6a1af4b5e2a16534d31b5a"}
Jul 28 04:23:18.447885 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:18.447853    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zskhd"]
Jul 28 04:23:18.451057 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:18.451020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zskhd"
Jul 28 04:23:18.453285 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:18.453258    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-b68lr\""
Jul 28 04:23:18.462052 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:18.462007    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zskhd"]
Jul 28 04:23:18.619717 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:18.619678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhwv\" (UniqueName: \"kubernetes.io/projected/b6d9775c-d1f4-47ea-92cd-25f782818ed4-kube-api-access-pmhwv\") pod \"authorino-operator-75cc8d5cb7-zskhd\" (UID: \"b6d9775c-d1f4-47ea-92cd-25f782818ed4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zskhd"
Jul 28 04:23:18.721168 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:18.721081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhwv\" (UniqueName: \"kubernetes.io/projected/b6d9775c-d1f4-47ea-92cd-25f782818ed4-kube-api-access-pmhwv\") pod \"authorino-operator-75cc8d5cb7-zskhd\" (UID: \"b6d9775c-d1f4-47ea-92cd-25f782818ed4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zskhd"
Jul 28 04:23:18.736694 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:18.736667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhwv\" (UniqueName: \"kubernetes.io/projected/b6d9775c-d1f4-47ea-92cd-25f782818ed4-kube-api-access-pmhwv\") pod \"authorino-operator-75cc8d5cb7-zskhd\" (UID: \"b6d9775c-d1f4-47ea-92cd-25f782818ed4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zskhd"
Jul 28 04:23:18.763624 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:18.763601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zskhd"
Jul 28 04:23:18.918426 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:18.918315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zskhd"]
Jul 28 04:23:18.920969 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:23:18.920941    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d9775c_d1f4_47ea_92cd_25f782818ed4.slice/crio-d092d09460b2ed01e646ff2a476609438e91822c7faa8c4246812bfd41f0321e WatchSource:0}: Error finding container d092d09460b2ed01e646ff2a476609438e91822c7faa8c4246812bfd41f0321e: Status 404 returned error can't find the container with id d092d09460b2ed01e646ff2a476609438e91822c7faa8c4246812bfd41f0321e
Jul 28 04:23:19.496933 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:19.496858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zskhd" event={"ID":"b6d9775c-d1f4-47ea-92cd-25f782818ed4","Type":"ContainerStarted","Data":"d092d09460b2ed01e646ff2a476609438e91822c7faa8c4246812bfd41f0321e"}
Jul 28 04:23:22.517105 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:22.517066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g" event={"ID":"392ad090-a647-44a8-9bc2-a620c1a79ab8","Type":"ContainerStarted","Data":"a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60"}
Jul 28 04:23:22.517528 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:22.517143    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:22.518566 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:22.518544    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zskhd" event={"ID":"b6d9775c-d1f4-47ea-92cd-25f782818ed4","Type":"ContainerStarted","Data":"8c2798a44e53410e7a7ca95b5562e0489a58e7fef2e1c1cd33ce223e7d04c114"}
Jul 28 04:23:22.518674 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:22.518622    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zskhd"
Jul 28 04:23:22.549124 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:22.547796    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g" podStartSLOduration=0.733236167 podStartE2EDuration="6.547775172s" totalImagesPullingTime="5.814539005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:23:22.5452488 +0000 UTC m=+697.252731102" watchObservedRunningTime="2026-07-28 04:23:22.547775172 +0000 UTC m=+697.255257474"
Jul 28 04:23:22.562800 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:22.562750    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zskhd" podStartSLOduration=1.094777244 podStartE2EDuration="4.56273444s" totalImagesPullingTime="3.467957196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:23:22.561416979 +0000 UTC m=+697.268899280" watchObservedRunningTime="2026-07-28 04:23:22.56273444 +0000 UTC m=+697.270216741"
Jul 28 04:23:25.299669 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.299631    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"]
Jul 28 04:23:25.303060 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.303026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.305173 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.305144    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 28 04:23:25.305173 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.305163    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 28 04:23:25.305333 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.305286    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cbl8r\""
Jul 28 04:23:25.311890 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.311867    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"]
Jul 28 04:23:25.481963 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.481924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9bbq\" (UniqueName: \"kubernetes.io/projected/16380f34-4cc8-449a-95fc-57df5cb06a50-kube-api-access-k9bbq\") pod \"kuadrant-console-plugin-66b5774985-trrmt\" (UID: \"16380f34-4cc8-449a-95fc-57df5cb06a50\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.482171 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.481981    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/16380f34-4cc8-449a-95fc-57df5cb06a50-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-trrmt\" (UID: \"16380f34-4cc8-449a-95fc-57df5cb06a50\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.482171 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.482009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/16380f34-4cc8-449a-95fc-57df5cb06a50-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-trrmt\" (UID: \"16380f34-4cc8-449a-95fc-57df5cb06a50\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.583221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.583137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9bbq\" (UniqueName: \"kubernetes.io/projected/16380f34-4cc8-449a-95fc-57df5cb06a50-kube-api-access-k9bbq\") pod \"kuadrant-console-plugin-66b5774985-trrmt\" (UID: \"16380f34-4cc8-449a-95fc-57df5cb06a50\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.583221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.583185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/16380f34-4cc8-449a-95fc-57df5cb06a50-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-trrmt\" (UID: \"16380f34-4cc8-449a-95fc-57df5cb06a50\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.583221 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.583205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/16380f34-4cc8-449a-95fc-57df5cb06a50-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-trrmt\" (UID: \"16380f34-4cc8-449a-95fc-57df5cb06a50\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.583808 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.583785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/16380f34-4cc8-449a-95fc-57df5cb06a50-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-trrmt\" (UID: \"16380f34-4cc8-449a-95fc-57df5cb06a50\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.585808 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.585791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/16380f34-4cc8-449a-95fc-57df5cb06a50-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-trrmt\" (UID: \"16380f34-4cc8-449a-95fc-57df5cb06a50\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.590657 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.590633    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9bbq\" (UniqueName: \"kubernetes.io/projected/16380f34-4cc8-449a-95fc-57df5cb06a50-kube-api-access-k9bbq\") pod \"kuadrant-console-plugin-66b5774985-trrmt\" (UID: \"16380f34-4cc8-449a-95fc-57df5cb06a50\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.612718 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.612687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"
Jul 28 04:23:25.744105 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:25.744079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt"]
Jul 28 04:23:25.745976 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:23:25.745938    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16380f34_4cc8_449a_95fc_57df5cb06a50.slice/crio-28ce3102010628aee21b71995941b13f5fa37977f9cf1a3a79d10a9c22dd5bd2 WatchSource:0}: Error finding container 28ce3102010628aee21b71995941b13f5fa37977f9cf1a3a79d10a9c22dd5bd2: Status 404 returned error can't find the container with id 28ce3102010628aee21b71995941b13f5fa37977f9cf1a3a79d10a9c22dd5bd2
Jul 28 04:23:26.541805 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:26.541769    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt" event={"ID":"16380f34-4cc8-449a-95fc-57df5cb06a50","Type":"ContainerStarted","Data":"28ce3102010628aee21b71995941b13f5fa37977f9cf1a3a79d10a9c22dd5bd2"}
Jul 28 04:23:30.900886 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:30.900851    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844f7b68ff-965c9"]
Jul 28 04:23:33.526145 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:33.526112    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:33.526589 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:33.526216    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zskhd"
Jul 28 04:23:35.407789 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.407752    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"]
Jul 28 04:23:35.408746 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.407976    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" containerName="manager" containerID="cri-o://a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60" gracePeriod=2
Jul 28 04:23:35.409838 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:23:35.409800    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:35.412249 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.412224    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"]
Jul 28 04:23:35.434854 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.433282    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"]
Jul 28 04:23:35.434854 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.433750    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" containerName="manager"
Jul 28 04:23:35.434854 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.433766    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" containerName="manager"
Jul 28 04:23:35.434854 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.433862    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" containerName="manager"
Jul 28 04:23:35.438463 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.438251    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:35.440020 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:23:35.439984    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:35.452576 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.451932    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"]
Jul 28 04:23:35.458360 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.458333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rspn2\" (UniqueName: \"kubernetes.io/projected/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-kube-api-access-rspn2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ht9sg\" (UID: \"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:35.458503 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.458375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ht9sg\" (UID: \"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:35.559598 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.559562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rspn2\" (UniqueName: \"kubernetes.io/projected/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-kube-api-access-rspn2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ht9sg\" (UID: \"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:35.559795 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.559616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ht9sg\" (UID: \"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:35.559986 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.559966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ht9sg\" (UID: \"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:35.568616 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.568589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rspn2\" (UniqueName: \"kubernetes.io/projected/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-kube-api-access-rspn2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ht9sg\" (UID: \"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:35.790255 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:35.790155    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:35.837814 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:23:35.837769    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:48.207410 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.207378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"]
Jul 28 04:23:48.208734 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:23:48.208708    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb47fae_a205_4dda_8fb7_88eb46f4bc7c.slice/crio-18835576fb300547b7ed1a55e2ea8f90bfdfcf24fa9789502289cbb44170ffd1 WatchSource:0}: Error finding container 18835576fb300547b7ed1a55e2ea8f90bfdfcf24fa9789502289cbb44170ffd1: Status 404 returned error can't find the container with id 18835576fb300547b7ed1a55e2ea8f90bfdfcf24fa9789502289cbb44170ffd1
Jul 28 04:23:48.214950 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.214917    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:48.216661 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:23:48.216636    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:48.275783 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.275760    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rr9m\" (UniqueName: \"kubernetes.io/projected/392ad090-a647-44a8-9bc2-a620c1a79ab8-kube-api-access-2rr9m\") pod \"392ad090-a647-44a8-9bc2-a620c1a79ab8\" (UID: \"392ad090-a647-44a8-9bc2-a620c1a79ab8\") "
Jul 28 04:23:48.275902 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.275849    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/392ad090-a647-44a8-9bc2-a620c1a79ab8-extensions-socket-volume\") pod \"392ad090-a647-44a8-9bc2-a620c1a79ab8\" (UID: \"392ad090-a647-44a8-9bc2-a620c1a79ab8\") "
Jul 28 04:23:48.276402 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.276378    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/392ad090-a647-44a8-9bc2-a620c1a79ab8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "392ad090-a647-44a8-9bc2-a620c1a79ab8" (UID: "392ad090-a647-44a8-9bc2-a620c1a79ab8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:23:48.278241 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.278221    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/392ad090-a647-44a8-9bc2-a620c1a79ab8-kube-api-access-2rr9m" (OuterVolumeSpecName: "kube-api-access-2rr9m") pod "392ad090-a647-44a8-9bc2-a620c1a79ab8" (UID: "392ad090-a647-44a8-9bc2-a620c1a79ab8"). InnerVolumeSpecName "kube-api-access-2rr9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:23:48.377451 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.377373    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/392ad090-a647-44a8-9bc2-a620c1a79ab8-extensions-socket-volume\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:48.377451 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.377399    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rr9m\" (UniqueName: \"kubernetes.io/projected/392ad090-a647-44a8-9bc2-a620c1a79ab8-kube-api-access-2rr9m\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:48.679790 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.679704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg" event={"ID":"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c","Type":"ContainerStarted","Data":"05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b"}
Jul 28 04:23:48.679790 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.679769    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:48.679995 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.679794    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg" event={"ID":"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c","Type":"ContainerStarted","Data":"18835576fb300547b7ed1a55e2ea8f90bfdfcf24fa9789502289cbb44170ffd1"}
Jul 28 04:23:48.681381 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.681345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt" event={"ID":"16380f34-4cc8-449a-95fc-57df5cb06a50","Type":"ContainerStarted","Data":"240dcb8b69ced99ebd49e4da8bc82675faecdc8a0560f49e04f90d6cc3e2f76c"}
Jul 28 04:23:48.681623 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:23:48.681482    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:48.682588 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.682567    2581 generic.go:356] "Generic (PLEG): container finished" podID="392ad090-a647-44a8-9bc2-a620c1a79ab8" containerID="a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60" exitCode=0
Jul 28 04:23:48.682672 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.682600    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:48.682672 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.682629    2581 scope.go:117] "RemoveContainer" containerID="a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60"
Jul 28 04:23:48.691663 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.691642    2581 scope.go:117] "RemoveContainer" containerID="a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60"
Jul 28 04:23:48.691911 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:23:48.691891    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60\": container with ID starting with a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60 not found: ID does not exist" containerID="a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60"
Jul 28 04:23:48.691957 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.691921    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60"} err="failed to get container status \"a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60\": rpc error: code = NotFound desc = could not find container \"a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60\": container with ID starting with a284d03e60a89e96c44d2c8f9504268f821f0cefadf0eff34e7641194a436a60 not found: ID does not exist"
Jul 28 04:23:48.697641 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.697605    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg" podStartSLOduration=13.697594306 podStartE2EDuration="13.697594306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:23:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:23:48.697252902 +0000 UTC m=+723.404735216" watchObservedRunningTime="2026-07-28 04:23:48.697594306 +0000 UTC m=+723.405076606"
Jul 28 04:23:48.699276 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:23:48.699241    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9qd9g\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9qd9g"
Jul 28 04:23:48.716907 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:48.716869    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-trrmt" podStartSLOduration=1.327937749 podStartE2EDuration="23.716857026s" totalImagesPullingTime="22.388919277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:23:48.714719958 +0000 UTC m=+723.422202258" watchObservedRunningTime="2026-07-28 04:23:48.716857026 +0000 UTC m=+723.424339373"
Jul 28 04:23:49.837850 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:49.837816    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="392ad090-a647-44a8-9bc2-a620c1a79ab8" path="/var/lib/kubelet/pods/392ad090-a647-44a8-9bc2-a620c1a79ab8/volumes"
Jul 28 04:23:51.954143 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:51.954100    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"]
Jul 28 04:23:51.954534 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:51.954323    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg" podUID="0fb47fae-a205-4dda-8fb7-88eb46f4bc7c" containerName="manager" containerID="cri-o://05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b" gracePeriod=10
Jul 28 04:23:52.201469 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.201442    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:52.307678 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.307638    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-extensions-socket-volume\") pod \"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c\" (UID: \"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c\") "
Jul 28 04:23:52.307864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.307726    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rspn2\" (UniqueName: \"kubernetes.io/projected/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-kube-api-access-rspn2\") pod \"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c\" (UID: \"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c\") "
Jul 28 04:23:52.307990 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.307967    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0fb47fae-a205-4dda-8fb7-88eb46f4bc7c" (UID: "0fb47fae-a205-4dda-8fb7-88eb46f4bc7c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:23:52.309839 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.309816    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-kube-api-access-rspn2" (OuterVolumeSpecName: "kube-api-access-rspn2") pod "0fb47fae-a205-4dda-8fb7-88eb46f4bc7c" (UID: "0fb47fae-a205-4dda-8fb7-88eb46f4bc7c"). InnerVolumeSpecName "kube-api-access-rspn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:23:52.408359 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.408333    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-extensions-socket-volume\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:52.408359 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.408359    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rspn2\" (UniqueName: \"kubernetes.io/projected/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c-kube-api-access-rspn2\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:52.703836 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.703752    2581 generic.go:356] "Generic (PLEG): container finished" podID="0fb47fae-a205-4dda-8fb7-88eb46f4bc7c" containerID="05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b" exitCode=0
Jul 28 04:23:52.703836 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.703801    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg" event={"ID":"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c","Type":"ContainerDied","Data":"05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b"}
Jul 28 04:23:52.703836 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.703802    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"
Jul 28 04:23:52.704132 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.703842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg" event={"ID":"0fb47fae-a205-4dda-8fb7-88eb46f4bc7c","Type":"ContainerDied","Data":"18835576fb300547b7ed1a55e2ea8f90bfdfcf24fa9789502289cbb44170ffd1"}
Jul 28 04:23:52.704132 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.703864    2581 scope.go:117] "RemoveContainer" containerID="05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b"
Jul 28 04:23:52.713413 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.713395    2581 scope.go:117] "RemoveContainer" containerID="05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b"
Jul 28 04:23:52.713672 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:23:52.713655    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b\": container with ID starting with 05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b not found: ID does not exist" containerID="05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b"
Jul 28 04:23:52.713737 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.713682    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b"} err="failed to get container status \"05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b\": rpc error: code = NotFound desc = could not find container \"05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b\": container with ID starting with 05dafba106ab2df5ebfded9d51d08dc5ee408b98621c435e8b61922ce21a633b not found: ID does not exist"
Jul 28 04:23:52.726881 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.726861    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"]
Jul 28 04:23:52.732465 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:52.732444    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ht9sg"]
Jul 28 04:23:53.838245 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:53.838206    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fb47fae-a205-4dda-8fb7-88eb46f4bc7c" path="/var/lib/kubelet/pods/0fb47fae-a205-4dda-8fb7-88eb46f4bc7c/volumes"
Jul 28 04:23:55.928712 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:55.928673    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-844f7b68ff-965c9" podUID="bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" containerName="console" containerID="cri-o://051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87" gracePeriod=15
Jul 28 04:23:56.201741 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.201688    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:23:56.343805 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.343771    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-oauth-serving-cert\") pod \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") "
Jul 28 04:23:56.343975 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.343839    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-service-ca\") pod \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") "
Jul 28 04:23:56.343975 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.343886    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-config\") pod \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") "
Jul 28 04:23:56.343975 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.343911    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49t85\" (UniqueName: \"kubernetes.io/projected/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-kube-api-access-49t85\") pod \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") "
Jul 28 04:23:56.343975 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.343943    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-oauth-config\") pod \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") "
Jul 28 04:23:56.343975 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.343974    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-trusted-ca-bundle\") pod \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") "
Jul 28 04:23:56.344250 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.344020    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-serving-cert\") pod \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\" (UID: \"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262\") "
Jul 28 04:23:56.344364 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.344318    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" (UID: "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:23:56.344725 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.344365    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-service-ca" (OuterVolumeSpecName: "service-ca") pod "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" (UID: "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:23:56.344725 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.344466    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" (UID: "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:23:56.344725 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.344652    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-config" (OuterVolumeSpecName: "console-config") pod "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" (UID: "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:23:56.346568 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.346548    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" (UID: "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 04:23:56.346837 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.346811    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" (UID: "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 04:23:56.346837 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.346812    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-kube-api-access-49t85" (OuterVolumeSpecName: "kube-api-access-49t85") pod "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" (UID: "bcc08758-75ae-4e2a-8bc2-bbf7f26b1262"). InnerVolumeSpecName "kube-api-access-49t85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:23:56.445514 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.445486    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-trusted-ca-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:56.445514 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.445512    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:56.445679 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.445522    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-oauth-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:56.445679 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.445531    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:56.445679 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.445542    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:56.445679 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.445550    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49t85\" (UniqueName: \"kubernetes.io/projected/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-kube-api-access-49t85\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:56.445679 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.445559    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262-console-oauth-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:23:56.729600 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.729565    2581 generic.go:356] "Generic (PLEG): container finished" podID="bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" containerID="051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87" exitCode=0
Jul 28 04:23:56.729784 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.729607    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844f7b68ff-965c9"
Jul 28 04:23:56.729784 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.729657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844f7b68ff-965c9" event={"ID":"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262","Type":"ContainerDied","Data":"051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87"}
Jul 28 04:23:56.729784 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.729708    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844f7b68ff-965c9" event={"ID":"bcc08758-75ae-4e2a-8bc2-bbf7f26b1262","Type":"ContainerDied","Data":"f47dc0078a45b234bdc3c1987372ef61c04ca5809802167dcd652649748e24dd"}
Jul 28 04:23:56.729784 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.729729    2581 scope.go:117] "RemoveContainer" containerID="051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87"
Jul 28 04:23:56.738958 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.738941    2581 scope.go:117] "RemoveContainer" containerID="051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87"
Jul 28 04:23:56.739248 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:23:56.739231    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87\": container with ID starting with 051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87 not found: ID does not exist" containerID="051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87"
Jul 28 04:23:56.739313 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.739257    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87"} err="failed to get container status \"051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87\": rpc error: code = NotFound desc = could not find container \"051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87\": container with ID starting with 051be8221e85957e1e6761fdf748948c7be3d4ceb8dcd4c1c1b034e09c7c5b87 not found: ID does not exist"
Jul 28 04:23:56.750359 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.750315    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844f7b68ff-965c9"]
Jul 28 04:23:56.759191 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:56.759169    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-844f7b68ff-965c9"]
Jul 28 04:23:57.837895 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:23:57.837865    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" path="/var/lib/kubelet/pods/bcc08758-75ae-4e2a-8bc2-bbf7f26b1262/volumes"
Jul 28 04:24:08.376240 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.376212    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"]
Jul 28 04:24:08.376614 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.376537    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb47fae-a205-4dda-8fb7-88eb46f4bc7c" containerName="manager"
Jul 28 04:24:08.376614 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.376548    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb47fae-a205-4dda-8fb7-88eb46f4bc7c" containerName="manager"
Jul 28 04:24:08.376614 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.376556    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" containerName="console"
Jul 28 04:24:08.376614 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.376562    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" containerName="console"
Jul 28 04:24:08.376755 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.376623    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fb47fae-a205-4dda-8fb7-88eb46f4bc7c" containerName="manager"
Jul 28 04:24:08.376755 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.376631    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcc08758-75ae-4e2a-8bc2-bbf7f26b1262" containerName="console"
Jul 28 04:24:08.386520 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.386500    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.388800 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.388775    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fslbs\""
Jul 28 04:24:08.391246 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.391218    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"]
Jul 28 04:24:08.539521 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.539474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.539521 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.539519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81d6af87-000b-48e7-9e20-b840cb2be293-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.539753 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.539593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.539753 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.539641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81d6af87-000b-48e7-9e20-b840cb2be293-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.539753 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.539692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc2hm\" (UniqueName: \"kubernetes.io/projected/81d6af87-000b-48e7-9e20-b840cb2be293-kube-api-access-tc2hm\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.539753 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.539714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81d6af87-000b-48e7-9e20-b840cb2be293-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.539753 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.539732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.539928 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.539778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.539928 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.539802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641065 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.640968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641065 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81d6af87-000b-48e7-9e20-b840cb2be293-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641065 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81d6af87-000b-48e7-9e20-b840cb2be293-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641110    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc2hm\" (UniqueName: \"kubernetes.io/projected/81d6af87-000b-48e7-9e20-b840cb2be293-kube-api-access-tc2hm\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81d6af87-000b-48e7-9e20-b840cb2be293-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641319 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641576 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641385    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641576 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641576 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641728 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641656    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.641944 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.641885    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81d6af87-000b-48e7-9e20-b840cb2be293-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.643437 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.643416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81d6af87-000b-48e7-9e20-b840cb2be293-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.643660 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.643643    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81d6af87-000b-48e7-9e20-b840cb2be293-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.648251 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.648232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81d6af87-000b-48e7-9e20-b840cb2be293-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.648495 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.648477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc2hm\" (UniqueName: \"kubernetes.io/projected/81d6af87-000b-48e7-9e20-b840cb2be293-kube-api-access-tc2hm\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8b8fn\" (UID: \"81d6af87-000b-48e7-9e20-b840cb2be293\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.697865 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.697841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:08.832069 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.831658    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"]
Jul 28 04:24:08.834210 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:24:08.834162    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d6af87_000b_48e7_9e20_b840cb2be293.slice/crio-e5cd2e6be1ca0be3a73ecf51e65d75b099f76979e1a560d7cd9a6bff165903d1 WatchSource:0}: Error finding container e5cd2e6be1ca0be3a73ecf51e65d75b099f76979e1a560d7cd9a6bff165903d1: Status 404 returned error can't find the container with id e5cd2e6be1ca0be3a73ecf51e65d75b099f76979e1a560d7cd9a6bff165903d1
Jul 28 04:24:08.838996 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.838325    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:24:08.838996 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.838404    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:24:08.838996 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:08.838445    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:24:09.800746 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:09.800713    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn" event={"ID":"81d6af87-000b-48e7-9e20-b840cb2be293","Type":"ContainerStarted","Data":"380775c88e59b27252caed932da7446562ce06f7977956ac0c49f4310da28c3c"}
Jul 28 04:24:09.801237 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:09.800763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn" event={"ID":"81d6af87-000b-48e7-9e20-b840cb2be293","Type":"ContainerStarted","Data":"e5cd2e6be1ca0be3a73ecf51e65d75b099f76979e1a560d7cd9a6bff165903d1"}
Jul 28 04:24:09.820563 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:09.820516    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn" podStartSLOduration=1.820502061 podStartE2EDuration="1.820502061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:24:09.817109549 +0000 UTC m=+744.524591850" watchObservedRunningTime="2026-07-28 04:24:09.820502061 +0000 UTC m=+744.527984361"
Jul 28 04:24:10.698873 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:10.698835    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:10.703826 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:10.703801    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:10.805346 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:10.805324    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:10.806147 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:10.806129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:24:23.866279 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:23.866237    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-968h5"]
Jul 28 04:24:23.908202 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:23.908166    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-968h5"]
Jul 28 04:24:23.908349 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:23.908274    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:23.910182 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:23.910163    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 04:24:23.963503 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:23.963470    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-968h5"]
Jul 28 04:24:24.066694 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.066628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg6z2\" (UniqueName: \"kubernetes.io/projected/9208b93b-d850-4205-a771-009875a29790-kube-api-access-jg6z2\") pod \"limitador-limitador-64c94fd64f-968h5\" (UID: \"9208b93b-d850-4205-a771-009875a29790\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:24.066694 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.066685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9208b93b-d850-4205-a771-009875a29790-config-file\") pod \"limitador-limitador-64c94fd64f-968h5\" (UID: \"9208b93b-d850-4205-a771-009875a29790\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:24.167878 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.167794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg6z2\" (UniqueName: \"kubernetes.io/projected/9208b93b-d850-4205-a771-009875a29790-kube-api-access-jg6z2\") pod \"limitador-limitador-64c94fd64f-968h5\" (UID: \"9208b93b-d850-4205-a771-009875a29790\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:24.167878 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.167840    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9208b93b-d850-4205-a771-009875a29790-config-file\") pod \"limitador-limitador-64c94fd64f-968h5\" (UID: \"9208b93b-d850-4205-a771-009875a29790\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:24.168455 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.168436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9208b93b-d850-4205-a771-009875a29790-config-file\") pod \"limitador-limitador-64c94fd64f-968h5\" (UID: \"9208b93b-d850-4205-a771-009875a29790\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:24.180711 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.180686    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg6z2\" (UniqueName: \"kubernetes.io/projected/9208b93b-d850-4205-a771-009875a29790-kube-api-access-jg6z2\") pod \"limitador-limitador-64c94fd64f-968h5\" (UID: \"9208b93b-d850-4205-a771-009875a29790\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:24.219316 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.219294    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:24.354763 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.354737    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-968h5"]
Jul 28 04:24:24.356598 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:24:24.356559    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9208b93b_d850_4205_a771_009875a29790.slice/crio-785b88fe1ade1ea515c3c15148425a216a38e114ea28638b4ec1565cff559bf3 WatchSource:0}: Error finding container 785b88fe1ade1ea515c3c15148425a216a38e114ea28638b4ec1565cff559bf3: Status 404 returned error can't find the container with id 785b88fe1ade1ea515c3c15148425a216a38e114ea28638b4ec1565cff559bf3
Jul 28 04:24:24.766979 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.766949    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-mk542"]
Jul 28 04:24:24.771734 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.771712    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mk542"
Jul 28 04:24:24.773414 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.773387    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mk542"]
Jul 28 04:24:24.773666 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.773648    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9jn4d\""
Jul 28 04:24:24.871368 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.871340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvbg8\" (UniqueName: \"kubernetes.io/projected/51973960-45dd-430d-b29d-e9d2a5db2d07-kube-api-access-lvbg8\") pod \"authorino-75d556bd77-mk542\" (UID: \"51973960-45dd-430d-b29d-e9d2a5db2d07\") " pod="kuadrant-system/authorino-75d556bd77-mk542"
Jul 28 04:24:24.878844 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.878815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5" event={"ID":"9208b93b-d850-4205-a771-009875a29790","Type":"ContainerStarted","Data":"785b88fe1ade1ea515c3c15148425a216a38e114ea28638b4ec1565cff559bf3"}
Jul 28 04:24:24.971922 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.971889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvbg8\" (UniqueName: \"kubernetes.io/projected/51973960-45dd-430d-b29d-e9d2a5db2d07-kube-api-access-lvbg8\") pod \"authorino-75d556bd77-mk542\" (UID: \"51973960-45dd-430d-b29d-e9d2a5db2d07\") " pod="kuadrant-system/authorino-75d556bd77-mk542"
Jul 28 04:24:24.978782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:24.978752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvbg8\" (UniqueName: \"kubernetes.io/projected/51973960-45dd-430d-b29d-e9d2a5db2d07-kube-api-access-lvbg8\") pod \"authorino-75d556bd77-mk542\" (UID: \"51973960-45dd-430d-b29d-e9d2a5db2d07\") " pod="kuadrant-system/authorino-75d556bd77-mk542"
Jul 28 04:24:25.082224 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:25.082165    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mk542"
Jul 28 04:24:25.219686 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:25.219629    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mk542"]
Jul 28 04:24:25.220815 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:24:25.220784    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51973960_45dd_430d_b29d_e9d2a5db2d07.slice/crio-069af2416e905387158e32726493e7df2a4919d66c2ab354f4929ea29e59070a WatchSource:0}: Error finding container 069af2416e905387158e32726493e7df2a4919d66c2ab354f4929ea29e59070a: Status 404 returned error can't find the container with id 069af2416e905387158e32726493e7df2a4919d66c2ab354f4929ea29e59070a
Jul 28 04:24:25.889114 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:25.888981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mk542" event={"ID":"51973960-45dd-430d-b29d-e9d2a5db2d07","Type":"ContainerStarted","Data":"069af2416e905387158e32726493e7df2a4919d66c2ab354f4929ea29e59070a"}
Jul 28 04:24:29.919188 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:29.919140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5" event={"ID":"9208b93b-d850-4205-a771-009875a29790","Type":"ContainerStarted","Data":"d2a920069afdeaf937a07fbd325549175006366432a86657a51ca43b6e3758b7"}
Jul 28 04:24:29.919648 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:29.919205    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:29.920587 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:29.920563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mk542" event={"ID":"51973960-45dd-430d-b29d-e9d2a5db2d07","Type":"ContainerStarted","Data":"42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678"}
Jul 28 04:24:29.934735 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:29.934689    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5" podStartSLOduration=2.252661265 podStartE2EDuration="6.934676494s" totalImagesPullingTime="4.682015229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:24:29.933301867 +0000 UTC m=+764.640784195" watchObservedRunningTime="2026-07-28 04:24:29.934676494 +0000 UTC m=+764.642158794"
Jul 28 04:24:29.945317 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:29.945279    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-mk542" podStartSLOduration=2.120136913 podStartE2EDuration="5.945266291s" totalImagesPullingTime="3.825129378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:24:29.944140702 +0000 UTC m=+764.651623002" watchObservedRunningTime="2026-07-28 04:24:29.945266291 +0000 UTC m=+764.652748592"
Jul 28 04:24:38.484919 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:38.484885    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-968h5"]
Jul 28 04:24:38.485525 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:38.485068    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5" podUID="9208b93b-d850-4205-a771-009875a29790" containerName="limitador" containerID="cri-o://d2a920069afdeaf937a07fbd325549175006366432a86657a51ca43b6e3758b7" gracePeriod=30
Jul 28 04:24:38.485891 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:38.485869    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:38.971614 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:38.971584    2581 generic.go:356] "Generic (PLEG): container finished" podID="9208b93b-d850-4205-a771-009875a29790" containerID="d2a920069afdeaf937a07fbd325549175006366432a86657a51ca43b6e3758b7" exitCode=0
Jul 28 04:24:38.971764 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:38.971666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5" event={"ID":"9208b93b-d850-4205-a771-009875a29790","Type":"ContainerDied","Data":"d2a920069afdeaf937a07fbd325549175006366432a86657a51ca43b6e3758b7"}
Jul 28 04:24:39.032576 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.032554    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:39.085013 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.084940    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg6z2\" (UniqueName: \"kubernetes.io/projected/9208b93b-d850-4205-a771-009875a29790-kube-api-access-jg6z2\") pod \"9208b93b-d850-4205-a771-009875a29790\" (UID: \"9208b93b-d850-4205-a771-009875a29790\") "
Jul 28 04:24:39.085188 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.085023    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9208b93b-d850-4205-a771-009875a29790-config-file\") pod \"9208b93b-d850-4205-a771-009875a29790\" (UID: \"9208b93b-d850-4205-a771-009875a29790\") "
Jul 28 04:24:39.085341 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.085319    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9208b93b-d850-4205-a771-009875a29790-config-file" (OuterVolumeSpecName: "config-file") pod "9208b93b-d850-4205-a771-009875a29790" (UID: "9208b93b-d850-4205-a771-009875a29790"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:24:39.087226 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.087202    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9208b93b-d850-4205-a771-009875a29790-kube-api-access-jg6z2" (OuterVolumeSpecName: "kube-api-access-jg6z2") pod "9208b93b-d850-4205-a771-009875a29790" (UID: "9208b93b-d850-4205-a771-009875a29790"). InnerVolumeSpecName "kube-api-access-jg6z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:24:39.186180 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.186148    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg6z2\" (UniqueName: \"kubernetes.io/projected/9208b93b-d850-4205-a771-009875a29790-kube-api-access-jg6z2\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:24:39.186180 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.186174    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9208b93b-d850-4205-a771-009875a29790-config-file\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:24:39.977790 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.977759    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5"
Jul 28 04:24:39.978139 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.977756    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-968h5" event={"ID":"9208b93b-d850-4205-a771-009875a29790","Type":"ContainerDied","Data":"785b88fe1ade1ea515c3c15148425a216a38e114ea28638b4ec1565cff559bf3"}
Jul 28 04:24:39.978139 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.977891    2581 scope.go:117] "RemoveContainer" containerID="d2a920069afdeaf937a07fbd325549175006366432a86657a51ca43b6e3758b7"
Jul 28 04:24:39.992301 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.992278    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-968h5"]
Jul 28 04:24:39.994205 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:39.994184    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-968h5"]
Jul 28 04:24:41.839496 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:41.839459    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9208b93b-d850-4205-a771-009875a29790" path="/var/lib/kubelet/pods/9208b93b-d850-4205-a771-009875a29790/volumes"
Jul 28 04:24:43.054685 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.054653    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"]
Jul 28 04:24:43.055144 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.055124    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9208b93b-d850-4205-a771-009875a29790" containerName="limitador"
Jul 28 04:24:43.055196 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.055148    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9208b93b-d850-4205-a771-009875a29790" containerName="limitador"
Jul 28 04:24:43.055273 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.055261    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9208b93b-d850-4205-a771-009875a29790" containerName="limitador"
Jul 28 04:24:43.058598 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.058578    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"
Jul 28 04:24:43.062602 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.061646    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 04:24:43.062602 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.061801    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 04:24:43.062602 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.061859    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 04:24:43.062602 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.062015    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zwhdt\""
Jul 28 04:24:43.063849 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.063829    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"]
Jul 28 04:24:43.114172 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.114137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpnfs\" (UniqueName: \"kubernetes.io/projected/69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3-kube-api-access-fpnfs\") pod \"postgres-69fb4594cf-6gztp\" (UID: \"69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"
Jul 28 04:24:43.114304 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.114173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3-data\") pod \"postgres-69fb4594cf-6gztp\" (UID: \"69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"
Jul 28 04:24:43.214756 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.214727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3-data\") pod \"postgres-69fb4594cf-6gztp\" (UID: \"69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"
Jul 28 04:24:43.214921 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.214813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnfs\" (UniqueName: \"kubernetes.io/projected/69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3-kube-api-access-fpnfs\") pod \"postgres-69fb4594cf-6gztp\" (UID: \"69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"
Jul 28 04:24:43.215121 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.215100    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3-data\") pod \"postgres-69fb4594cf-6gztp\" (UID: \"69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"
Jul 28 04:24:43.223017 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.222994    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpnfs\" (UniqueName: \"kubernetes.io/projected/69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3-kube-api-access-fpnfs\") pod \"postgres-69fb4594cf-6gztp\" (UID: \"69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"
Jul 28 04:24:43.370702 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.370620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"
Jul 28 04:24:43.500907 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.500885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"]
Jul 28 04:24:43.502954 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:24:43.502923    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69af385e_f8f9_4cd9_b4cf_5dbcb8aaf2d3.slice/crio-a95cdd2f0c5151ef2e5497c84157d1796d45b32cfbce6224f33160c9c1dd8ba9 WatchSource:0}: Error finding container a95cdd2f0c5151ef2e5497c84157d1796d45b32cfbce6224f33160c9c1dd8ba9: Status 404 returned error can't find the container with id a95cdd2f0c5151ef2e5497c84157d1796d45b32cfbce6224f33160c9c1dd8ba9
Jul 28 04:24:43.999550 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:43.999515    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp" event={"ID":"69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3","Type":"ContainerStarted","Data":"a95cdd2f0c5151ef2e5497c84157d1796d45b32cfbce6224f33160c9c1dd8ba9"}
Jul 28 04:24:48.205295 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:48.205271    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 04:24:49.029990 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:49.029946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp" event={"ID":"69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3","Type":"ContainerStarted","Data":"ef548f5a7a6e2abf37297a98dbdf85bddff0821b2b23d375c6c410d8d50092f9"}
Jul 28 04:24:49.030173 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:49.030061    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"
Jul 28 04:24:49.043818 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:49.043773    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp" podStartSLOduration=1.345893381 podStartE2EDuration="6.043757589s" totalImagesPullingTime="4.697864208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:24:49.042189027 +0000 UTC m=+783.749671330" watchObservedRunningTime="2026-07-28 04:24:49.043757589 +0000 UTC m=+783.751239924"
Jul 28 04:24:55.064609 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:55.064579    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6gztp"
Jul 28 04:24:55.926245 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:55.926215    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85c5c4898-5kzzs"]
Jul 28 04:24:55.934342 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:55.934316    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85c5c4898-5kzzs"
Jul 28 04:24:55.936282 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:55.936255    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 04:24:55.936282 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:55.936266    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85c5c4898-5kzzs"]
Jul 28 04:24:56.026336 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:56.026307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-tls-cert\") pod \"authorino-85c5c4898-5kzzs\" (UID: \"75cd22a5-d856-42e4-8f14-e7f4ed427c2b\") " pod="kuadrant-system/authorino-85c5c4898-5kzzs"
Jul 28 04:24:56.026493 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:56.026392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkp48\" (UniqueName: \"kubernetes.io/projected/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-kube-api-access-pkp48\") pod \"authorino-85c5c4898-5kzzs\" (UID: \"75cd22a5-d856-42e4-8f14-e7f4ed427c2b\") " pod="kuadrant-system/authorino-85c5c4898-5kzzs"
Jul 28 04:24:56.127620 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:56.127590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkp48\" (UniqueName: \"kubernetes.io/projected/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-kube-api-access-pkp48\") pod \"authorino-85c5c4898-5kzzs\" (UID: \"75cd22a5-d856-42e4-8f14-e7f4ed427c2b\") " pod="kuadrant-system/authorino-85c5c4898-5kzzs"
Jul 28 04:24:56.127951 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:56.127649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-tls-cert\") pod \"authorino-85c5c4898-5kzzs\" (UID: \"75cd22a5-d856-42e4-8f14-e7f4ed427c2b\") " pod="kuadrant-system/authorino-85c5c4898-5kzzs"
Jul 28 04:24:56.129940 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:56.129922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-tls-cert\") pod \"authorino-85c5c4898-5kzzs\" (UID: \"75cd22a5-d856-42e4-8f14-e7f4ed427c2b\") " pod="kuadrant-system/authorino-85c5c4898-5kzzs"
Jul 28 04:24:56.134426 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:56.134401    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkp48\" (UniqueName: \"kubernetes.io/projected/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-kube-api-access-pkp48\") pod \"authorino-85c5c4898-5kzzs\" (UID: \"75cd22a5-d856-42e4-8f14-e7f4ed427c2b\") " pod="kuadrant-system/authorino-85c5c4898-5kzzs"
Jul 28 04:24:56.244766 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:56.244745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85c5c4898-5kzzs"
Jul 28 04:24:56.372009 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:56.371988    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85c5c4898-5kzzs"]
Jul 28 04:24:56.374072 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:24:56.374026    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75cd22a5_d856_42e4_8f14_e7f4ed427c2b.slice/crio-340f821eb25e3a0353c6b35aedac7831359484e9d5ae5e0881a310346b060126 WatchSource:0}: Error finding container 340f821eb25e3a0353c6b35aedac7831359484e9d5ae5e0881a310346b060126: Status 404 returned error can't find the container with id 340f821eb25e3a0353c6b35aedac7831359484e9d5ae5e0881a310346b060126
Jul 28 04:24:57.070252 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:57.070215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85c5c4898-5kzzs" event={"ID":"75cd22a5-d856-42e4-8f14-e7f4ed427c2b","Type":"ContainerStarted","Data":"340f821eb25e3a0353c6b35aedac7831359484e9d5ae5e0881a310346b060126"}
Jul 28 04:24:58.076760 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:58.076726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85c5c4898-5kzzs" event={"ID":"75cd22a5-d856-42e4-8f14-e7f4ed427c2b","Type":"ContainerStarted","Data":"96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612"}
Jul 28 04:24:58.092926 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:58.092878    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85c5c4898-5kzzs" podStartSLOduration=2.420085739 podStartE2EDuration="3.092861977s" totalImagesPullingTime="672.776238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:24:58.090812517 +0000 UTC m=+792.798294818" watchObservedRunningTime="2026-07-28 04:24:58.092861977 +0000 UTC m=+792.800344302"
Jul 28 04:24:58.116365 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:58.116335    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mk542"]
Jul 28 04:24:58.116504 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:58.116485    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-mk542" podUID="51973960-45dd-430d-b29d-e9d2a5db2d07" containerName="authorino" containerID="cri-o://42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678" gracePeriod=30
Jul 28 04:24:58.391556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:58.391529    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mk542"
Jul 28 04:24:58.549532 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:58.549498    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvbg8\" (UniqueName: \"kubernetes.io/projected/51973960-45dd-430d-b29d-e9d2a5db2d07-kube-api-access-lvbg8\") pod \"51973960-45dd-430d-b29d-e9d2a5db2d07\" (UID: \"51973960-45dd-430d-b29d-e9d2a5db2d07\") "
Jul 28 04:24:58.551515 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:58.551490    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51973960-45dd-430d-b29d-e9d2a5db2d07-kube-api-access-lvbg8" (OuterVolumeSpecName: "kube-api-access-lvbg8") pod "51973960-45dd-430d-b29d-e9d2a5db2d07" (UID: "51973960-45dd-430d-b29d-e9d2a5db2d07"). InnerVolumeSpecName "kube-api-access-lvbg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:24:58.650222 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:58.650170    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvbg8\" (UniqueName: \"kubernetes.io/projected/51973960-45dd-430d-b29d-e9d2a5db2d07-kube-api-access-lvbg8\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:24:59.085584 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:59.085545    2581 generic.go:356] "Generic (PLEG): container finished" podID="51973960-45dd-430d-b29d-e9d2a5db2d07" containerID="42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678" exitCode=0
Jul 28 04:24:59.086021 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:59.085585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mk542" event={"ID":"51973960-45dd-430d-b29d-e9d2a5db2d07","Type":"ContainerDied","Data":"42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678"}
Jul 28 04:24:59.086021 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:59.085647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mk542" event={"ID":"51973960-45dd-430d-b29d-e9d2a5db2d07","Type":"ContainerDied","Data":"069af2416e905387158e32726493e7df2a4919d66c2ab354f4929ea29e59070a"}
Jul 28 04:24:59.086021 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:59.085605    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mk542"
Jul 28 04:24:59.093511 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:59.085680    2581 scope.go:117] "RemoveContainer" containerID="42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678"
Jul 28 04:24:59.101957 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:59.101942    2581 scope.go:117] "RemoveContainer" containerID="42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678"
Jul 28 04:24:59.102288 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:24:59.102257    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678\": container with ID starting with 42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678 not found: ID does not exist" containerID="42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678"
Jul 28 04:24:59.102450 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:59.102300    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678"} err="failed to get container status \"42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678\": rpc error: code = NotFound desc = could not find container \"42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678\": container with ID starting with 42ed4a404f61956b98ce9590cbad10aa81a6d27f3ae7451c733e89c559d8e678 not found: ID does not exist"
Jul 28 04:24:59.104930 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:59.104908    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mk542"]
Jul 28 04:24:59.106741 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:59.106724    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mk542"]
Jul 28 04:24:59.838446 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:24:59.838408    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51973960-45dd-430d-b29d-e9d2a5db2d07" path="/var/lib/kubelet/pods/51973960-45dd-430d-b29d-e9d2a5db2d07/volumes"
Jul 28 04:25:40.058377 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.058341    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"]
Jul 28 04:25:40.058942 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.058830    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51973960-45dd-430d-b29d-e9d2a5db2d07" containerName="authorino"
Jul 28 04:25:40.058942 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.058848    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="51973960-45dd-430d-b29d-e9d2a5db2d07" containerName="authorino"
Jul 28 04:25:40.058942 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.058922    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="51973960-45dd-430d-b29d-e9d2a5db2d07" containerName="authorino"
Jul 28 04:25:40.061717 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.061690    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.063533 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.063510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 28 04:25:40.063637 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.063549    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gfn77\""
Jul 28 04:25:40.070736 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.070713    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"]
Jul 28 04:25:40.173021 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.172986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq6vk\" (UniqueName: \"kubernetes.io/projected/fa9b577f-37e3-4f87-9a51-5e2d6995956b-kube-api-access-mq6vk\") pod \"maas-api-676c68b8ff-8wzc6\" (UID: \"fa9b577f-37e3-4f87-9a51-5e2d6995956b\") " pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.173200 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.173056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9b577f-37e3-4f87-9a51-5e2d6995956b-maas-api-tls\") pod \"maas-api-676c68b8ff-8wzc6\" (UID: \"fa9b577f-37e3-4f87-9a51-5e2d6995956b\") " pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.173200 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.173081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9b577f-37e3-4f87-9a51-5e2d6995956b-openshift-service-ca\") pod \"maas-api-676c68b8ff-8wzc6\" (UID: \"fa9b577f-37e3-4f87-9a51-5e2d6995956b\") " pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.273844 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.273810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq6vk\" (UniqueName: \"kubernetes.io/projected/fa9b577f-37e3-4f87-9a51-5e2d6995956b-kube-api-access-mq6vk\") pod \"maas-api-676c68b8ff-8wzc6\" (UID: \"fa9b577f-37e3-4f87-9a51-5e2d6995956b\") " pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.273844 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.273850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9b577f-37e3-4f87-9a51-5e2d6995956b-maas-api-tls\") pod \"maas-api-676c68b8ff-8wzc6\" (UID: \"fa9b577f-37e3-4f87-9a51-5e2d6995956b\") " pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.274077 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.273867    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9b577f-37e3-4f87-9a51-5e2d6995956b-openshift-service-ca\") pod \"maas-api-676c68b8ff-8wzc6\" (UID: \"fa9b577f-37e3-4f87-9a51-5e2d6995956b\") " pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.274475 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.274457    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9b577f-37e3-4f87-9a51-5e2d6995956b-openshift-service-ca\") pod \"maas-api-676c68b8ff-8wzc6\" (UID: \"fa9b577f-37e3-4f87-9a51-5e2d6995956b\") " pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.276528 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.276506    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9b577f-37e3-4f87-9a51-5e2d6995956b-maas-api-tls\") pod \"maas-api-676c68b8ff-8wzc6\" (UID: \"fa9b577f-37e3-4f87-9a51-5e2d6995956b\") " pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.284090 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.284067    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq6vk\" (UniqueName: \"kubernetes.io/projected/fa9b577f-37e3-4f87-9a51-5e2d6995956b-kube-api-access-mq6vk\") pod \"maas-api-676c68b8ff-8wzc6\" (UID: \"fa9b577f-37e3-4f87-9a51-5e2d6995956b\") " pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.373469 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.373393    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:40.509622 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.509593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"]
Jul 28 04:25:40.511994 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:25:40.511964    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9b577f_37e3_4f87_9a51_5e2d6995956b.slice/crio-ef7c5d3feb733a56faae76c20a6fd1e8798190b83b9043151132cb0ee882f61c WatchSource:0}: Error finding container ef7c5d3feb733a56faae76c20a6fd1e8798190b83b9043151132cb0ee882f61c: Status 404 returned error can't find the container with id ef7c5d3feb733a56faae76c20a6fd1e8798190b83b9043151132cb0ee882f61c
Jul 28 04:25:40.513689 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.513672    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 04:25:40.566335 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.566305    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-jsgww"]
Jul 28 04:25:40.570793 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.570775    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww"
Jul 28 04:25:40.572781 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.572760    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 04:25:40.572860 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.572760    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hvzdq\""
Jul 28 04:25:40.579206 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.579185    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-jsgww"]
Jul 28 04:25:40.677556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.677489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tkkt\" (UniqueName: \"kubernetes.io/projected/8c6345ca-f31a-4de2-aca7-e32e2ff815d5-kube-api-access-2tkkt\") pod \"payload-processing-5cc6cd444b-jsgww\" (UID: \"8c6345ca-f31a-4de2-aca7-e32e2ff815d5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww"
Jul 28 04:25:40.677556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.677532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c6345ca-f31a-4de2-aca7-e32e2ff815d5-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-jsgww\" (UID: \"8c6345ca-f31a-4de2-aca7-e32e2ff815d5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww"
Jul 28 04:25:40.778676 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.778640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tkkt\" (UniqueName: \"kubernetes.io/projected/8c6345ca-f31a-4de2-aca7-e32e2ff815d5-kube-api-access-2tkkt\") pod \"payload-processing-5cc6cd444b-jsgww\" (UID: \"8c6345ca-f31a-4de2-aca7-e32e2ff815d5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww"
Jul 28 04:25:40.778826 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.778691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c6345ca-f31a-4de2-aca7-e32e2ff815d5-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-jsgww\" (UID: \"8c6345ca-f31a-4de2-aca7-e32e2ff815d5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww"
Jul 28 04:25:40.779427 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.779409    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c6345ca-f31a-4de2-aca7-e32e2ff815d5-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-jsgww\" (UID: \"8c6345ca-f31a-4de2-aca7-e32e2ff815d5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww"
Jul 28 04:25:40.785532 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.785510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tkkt\" (UniqueName: \"kubernetes.io/projected/8c6345ca-f31a-4de2-aca7-e32e2ff815d5-kube-api-access-2tkkt\") pod \"payload-processing-5cc6cd444b-jsgww\" (UID: \"8c6345ca-f31a-4de2-aca7-e32e2ff815d5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww"
Jul 28 04:25:40.882175 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:40.882142    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww"
Jul 28 04:25:41.008009 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:41.007980    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-jsgww"]
Jul 28 04:25:41.009985 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:25:41.009961    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6345ca_f31a_4de2_aca7_e32e2ff815d5.slice/crio-6d8a074199bea9cf542438a94663805125c8049392743ea7accbbb535dbc89c1 WatchSource:0}: Error finding container 6d8a074199bea9cf542438a94663805125c8049392743ea7accbbb535dbc89c1: Status 404 returned error can't find the container with id 6d8a074199bea9cf542438a94663805125c8049392743ea7accbbb535dbc89c1
Jul 28 04:25:41.291980 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:41.291899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww" event={"ID":"8c6345ca-f31a-4de2-aca7-e32e2ff815d5","Type":"ContainerStarted","Data":"6d8a074199bea9cf542438a94663805125c8049392743ea7accbbb535dbc89c1"}
Jul 28 04:25:41.293684 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:41.293602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6" event={"ID":"fa9b577f-37e3-4f87-9a51-5e2d6995956b","Type":"ContainerStarted","Data":"ef7c5d3feb733a56faae76c20a6fd1e8798190b83b9043151132cb0ee882f61c"}
Jul 28 04:25:45.321466 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:45.321428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww" event={"ID":"8c6345ca-f31a-4de2-aca7-e32e2ff815d5","Type":"ContainerStarted","Data":"319d40077cba06b8671d169f676eecf76b758014499ca2af4553e62eb504d064"}
Jul 28 04:25:45.321917 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:45.321502    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww"
Jul 28 04:25:45.322944 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:45.322921    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6" event={"ID":"fa9b577f-37e3-4f87-9a51-5e2d6995956b","Type":"ContainerStarted","Data":"f74d2ec0e1f49d14ebd7264c69da0f703765e990ad52577f06545ec15f00f1d9"}
Jul 28 04:25:45.323078 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:45.322972    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:45.337625 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:45.337576    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww" podStartSLOduration=1.8365344540000001 podStartE2EDuration="5.337559137s" totalImagesPullingTime="3.501024683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:25:45.33395164 +0000 UTC m=+840.041433943" watchObservedRunningTime="2026-07-28 04:25:45.337559137 +0000 UTC m=+840.045041439"
Jul 28 04:25:45.348368 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:45.348328    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6" podStartSLOduration=1.352628511 podStartE2EDuration="5.348314761s" totalImagesPullingTime="3.99568625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:25:45.346623195 +0000 UTC m=+840.054105496" watchObservedRunningTime="2026-07-28 04:25:45.348314761 +0000 UTC m=+840.055797062"
Jul 28 04:25:48.340398 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:48.340312    2581 generic.go:356] "Generic (PLEG): container finished" podID="81d6af87-000b-48e7-9e20-b840cb2be293" containerID="380775c88e59b27252caed932da7446562ce06f7977956ac0c49f4310da28c3c" exitCode=0
Jul 28 04:25:48.340868 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:48.340388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn" event={"ID":"81d6af87-000b-48e7-9e20-b840cb2be293","Type":"ContainerDied","Data":"380775c88e59b27252caed932da7446562ce06f7977956ac0c49f4310da28c3c"}
Jul 28 04:25:48.340868 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:48.340862    2581 scope.go:117] "RemoveContainer" containerID="380775c88e59b27252caed932da7446562ce06f7977956ac0c49f4310da28c3c"
Jul 28 04:25:48.341870 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:48.341842    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:25:48.341937 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:48.341907    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:25:48.341974 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:48.341937    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:25:49.350711 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:49.350676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn" event={"ID":"81d6af87-000b-48e7-9e20-b840cb2be293","Type":"ContainerStarted","Data":"e2a4798b761ed54a3a928e3cbf4f9aa6f5ae15955d358a04c0a018d6ba20cafb"}
Jul 28 04:25:49.698150 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:49.698056    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:25:49.698310 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:49.698290    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8b8fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 28 04:25:49.698391 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:49.698372    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn" podUID="81d6af87-000b-48e7-9e20-b840cb2be293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 28 04:25:50.699151 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:50.699108    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8b8fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 28 04:25:50.699641 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:50.699171    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn" podUID="81d6af87-000b-48e7-9e20-b840cb2be293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 28 04:25:51.346360 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:51.346327    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-676c68b8ff-8wzc6"
Jul 28 04:25:51.698980 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:51.698893    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8b8fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 28 04:25:51.698980 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:51.698953    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn" podUID="81d6af87-000b-48e7-9e20-b840cb2be293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 28 04:25:52.699254 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:52.699217    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8b8fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 28 04:25:52.699638 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:52.699275    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn" podUID="81d6af87-000b-48e7-9e20-b840cb2be293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 28 04:25:53.701920 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:53.701888    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:25:53.702411 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:53.702186    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:25:53.702976 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:53.702956    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b8fn"
Jul 28 04:25:56.331141 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:25:56.331111    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-jsgww"
Jul 28 04:26:16.087010 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.086978    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"]
Jul 28 04:26:16.090736 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.090715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.092866 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.092842    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 04:26:16.093002 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.092868    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 04:26:16.093495 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.093478    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gmrkq\""
Jul 28 04:26:16.093592 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.093547    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 28 04:26:16.101343 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.101316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"]
Jul 28 04:26:16.285610 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.285569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bdb29e0-b7ba-49c5-939d-35938928560e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.285780 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.285630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.285780 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.285704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.285780 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.285749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.285885 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.285832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.285885 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.285853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5882\" (UniqueName: \"kubernetes.io/projected/9bdb29e0-b7ba-49c5-939d-35938928560e-kube-api-access-t5882\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.387012 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.386922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bdb29e0-b7ba-49c5-939d-35938928560e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.387012 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.386993    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.387254 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.387025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.387254 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.387082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.387254 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.387114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.387254 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.387136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5882\" (UniqueName: \"kubernetes.io/projected/9bdb29e0-b7ba-49c5-939d-35938928560e-kube-api-access-t5882\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.387463 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.387426    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.387523 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.387445    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.387523 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.387495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.389398 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.389375    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bdb29e0-b7ba-49c5-939d-35938928560e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.389580 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.389563    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bdb29e0-b7ba-49c5-939d-35938928560e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.394278 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.394255    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5882\" (UniqueName: \"kubernetes.io/projected/9bdb29e0-b7ba-49c5-939d-35938928560e-kube-api-access-t5882\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bllnx\" (UID: \"9bdb29e0-b7ba-49c5-939d-35938928560e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.403195 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.403154    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:16.537438 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:16.537410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"]
Jul 28 04:26:16.539232 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:26:16.539192    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bdb29e0_b7ba_49c5_939d_35938928560e.slice/crio-e50891726a7737ad674df2a216c10edd8d89358fd1c45123d71578cfb899c08f WatchSource:0}: Error finding container e50891726a7737ad674df2a216c10edd8d89358fd1c45123d71578cfb899c08f: Status 404 returned error can't find the container with id e50891726a7737ad674df2a216c10edd8d89358fd1c45123d71578cfb899c08f
Jul 28 04:26:17.496690 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:17.496636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx" event={"ID":"9bdb29e0-b7ba-49c5-939d-35938928560e","Type":"ContainerStarted","Data":"e50891726a7737ad674df2a216c10edd8d89358fd1c45123d71578cfb899c08f"}
Jul 28 04:26:18.503629 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:18.503588    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx" event={"ID":"9bdb29e0-b7ba-49c5-939d-35938928560e","Type":"ContainerStarted","Data":"a5f45dfb908e8448040c4ad9930924c1affeddd84f00865a6349e471186beeb3"}
Jul 28 04:26:18.521566 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:18.521515    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx" podStartSLOduration=1.317277014 podStartE2EDuration="2.521500389s" totalImagesPullingTime="1.204223375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:26:18.521192888 +0000 UTC m=+873.228675189" watchObservedRunningTime="2026-07-28 04:26:18.521500389 +0000 UTC m=+873.228982694"
Jul 28 04:26:26.403737 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:26.403698    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:26.404212 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:26.403773    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:26.416475 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:26.416449    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:26.554937 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:26.554909    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bllnx"
Jul 28 04:26:45.769364 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:45.769284    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:26:45.769809 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:26:45.769406    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:28:35.783602 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:35.783566    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-575c4bbf47-8flm8"]
Jul 28 04:28:35.786977 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:35.786959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575c4bbf47-8flm8"
Jul 28 04:28:35.804202 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:35.804170    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-575c4bbf47-8flm8"]
Jul 28 04:28:35.869169 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:35.869135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eac10671-6539-4bd2-9f4e-eef0d68095a2-tls-cert\") pod \"authorino-575c4bbf47-8flm8\" (UID: \"eac10671-6539-4bd2-9f4e-eef0d68095a2\") " pod="kuadrant-system/authorino-575c4bbf47-8flm8"
Jul 28 04:28:35.869364 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:35.869203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56z5b\" (UniqueName: \"kubernetes.io/projected/eac10671-6539-4bd2-9f4e-eef0d68095a2-kube-api-access-56z5b\") pod \"authorino-575c4bbf47-8flm8\" (UID: \"eac10671-6539-4bd2-9f4e-eef0d68095a2\") " pod="kuadrant-system/authorino-575c4bbf47-8flm8"
Jul 28 04:28:35.969633 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:35.969602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eac10671-6539-4bd2-9f4e-eef0d68095a2-tls-cert\") pod \"authorino-575c4bbf47-8flm8\" (UID: \"eac10671-6539-4bd2-9f4e-eef0d68095a2\") " pod="kuadrant-system/authorino-575c4bbf47-8flm8"
Jul 28 04:28:35.969809 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:35.969664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56z5b\" (UniqueName: \"kubernetes.io/projected/eac10671-6539-4bd2-9f4e-eef0d68095a2-kube-api-access-56z5b\") pod \"authorino-575c4bbf47-8flm8\" (UID: \"eac10671-6539-4bd2-9f4e-eef0d68095a2\") " pod="kuadrant-system/authorino-575c4bbf47-8flm8"
Jul 28 04:28:35.972593 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:35.972560    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eac10671-6539-4bd2-9f4e-eef0d68095a2-tls-cert\") pod \"authorino-575c4bbf47-8flm8\" (UID: \"eac10671-6539-4bd2-9f4e-eef0d68095a2\") " pod="kuadrant-system/authorino-575c4bbf47-8flm8"
Jul 28 04:28:35.978349 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:35.978323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56z5b\" (UniqueName: \"kubernetes.io/projected/eac10671-6539-4bd2-9f4e-eef0d68095a2-kube-api-access-56z5b\") pod \"authorino-575c4bbf47-8flm8\" (UID: \"eac10671-6539-4bd2-9f4e-eef0d68095a2\") " pod="kuadrant-system/authorino-575c4bbf47-8flm8"
Jul 28 04:28:36.095652 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:36.095573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575c4bbf47-8flm8"
Jul 28 04:28:36.233747 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:36.233691    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-575c4bbf47-8flm8"]
Jul 28 04:28:36.235954 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:28:36.235933    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeac10671_6539_4bd2_9f4e_eef0d68095a2.slice/crio-6c71f8900fb4208950a7f6497550c0c855beadf92cf40adbfcc9a4c9b6d5c977 WatchSource:0}: Error finding container 6c71f8900fb4208950a7f6497550c0c855beadf92cf40adbfcc9a4c9b6d5c977: Status 404 returned error can't find the container with id 6c71f8900fb4208950a7f6497550c0c855beadf92cf40adbfcc9a4c9b6d5c977
Jul 28 04:28:37.215211 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.215174    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575c4bbf47-8flm8" event={"ID":"eac10671-6539-4bd2-9f4e-eef0d68095a2","Type":"ContainerStarted","Data":"1f542b71522cc87a3d66bde5b79f5f8509b910079d754b9f3f312f18965cd75d"}
Jul 28 04:28:37.215647 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.215223    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575c4bbf47-8flm8" event={"ID":"eac10671-6539-4bd2-9f4e-eef0d68095a2","Type":"ContainerStarted","Data":"6c71f8900fb4208950a7f6497550c0c855beadf92cf40adbfcc9a4c9b6d5c977"}
Jul 28 04:28:37.236003 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.235936    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-575c4bbf47-8flm8" podStartSLOduration=1.8091207950000001 podStartE2EDuration="2.235913787s" totalImagesPullingTime="426.792992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:28:37.234508909 +0000 UTC m=+1011.941991231" watchObservedRunningTime="2026-07-28 04:28:37.235913787 +0000 UTC m=+1011.943396089"
Jul 28 04:28:37.262738 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.262703    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85c5c4898-5kzzs"]
Jul 28 04:28:37.263172 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.263142    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-85c5c4898-5kzzs" podUID="75cd22a5-d856-42e4-8f14-e7f4ed427c2b" containerName="authorino" containerID="cri-o://96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612" gracePeriod=30
Jul 28 04:28:37.539682 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.539636    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85c5c4898-5kzzs"
Jul 28 04:28:37.583465 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.583434    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkp48\" (UniqueName: \"kubernetes.io/projected/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-kube-api-access-pkp48\") pod \"75cd22a5-d856-42e4-8f14-e7f4ed427c2b\" (UID: \"75cd22a5-d856-42e4-8f14-e7f4ed427c2b\") "
Jul 28 04:28:37.583641 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.583503    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-tls-cert\") pod \"75cd22a5-d856-42e4-8f14-e7f4ed427c2b\" (UID: \"75cd22a5-d856-42e4-8f14-e7f4ed427c2b\") "
Jul 28 04:28:37.586268 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.586235    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-kube-api-access-pkp48" (OuterVolumeSpecName: "kube-api-access-pkp48") pod "75cd22a5-d856-42e4-8f14-e7f4ed427c2b" (UID: "75cd22a5-d856-42e4-8f14-e7f4ed427c2b"). InnerVolumeSpecName "kube-api-access-pkp48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:28:37.595921 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.595893    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "75cd22a5-d856-42e4-8f14-e7f4ed427c2b" (UID: "75cd22a5-d856-42e4-8f14-e7f4ed427c2b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 04:28:37.684402 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.684353    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-tls-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:28:37.684402 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:37.684386    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkp48\" (UniqueName: \"kubernetes.io/projected/75cd22a5-d856-42e4-8f14-e7f4ed427c2b-kube-api-access-pkp48\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:28:38.221428 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:38.221340    2581 generic.go:356] "Generic (PLEG): container finished" podID="75cd22a5-d856-42e4-8f14-e7f4ed427c2b" containerID="96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612" exitCode=0
Jul 28 04:28:38.221837 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:38.221452    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85c5c4898-5kzzs"
Jul 28 04:28:38.221837 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:38.221492    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85c5c4898-5kzzs" event={"ID":"75cd22a5-d856-42e4-8f14-e7f4ed427c2b","Type":"ContainerDied","Data":"96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612"}
Jul 28 04:28:38.221837 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:38.221539    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85c5c4898-5kzzs" event={"ID":"75cd22a5-d856-42e4-8f14-e7f4ed427c2b","Type":"ContainerDied","Data":"340f821eb25e3a0353c6b35aedac7831359484e9d5ae5e0881a310346b060126"}
Jul 28 04:28:38.221837 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:38.221572    2581 scope.go:117] "RemoveContainer" containerID="96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612"
Jul 28 04:28:38.233008 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:38.232970    2581 scope.go:117] "RemoveContainer" containerID="96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612"
Jul 28 04:28:38.233543 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:28:38.233523    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612\": container with ID starting with 96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612 not found: ID does not exist" containerID="96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612"
Jul 28 04:28:38.233641 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:38.233551    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612"} err="failed to get container status \"96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612\": rpc error: code = NotFound desc = could not find container \"96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612\": container with ID starting with 96b7836fe49385e5e1124c7780e0862a18afc30707afb25dc4482a760e9c2612 not found: ID does not exist"
Jul 28 04:28:38.239789 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:38.239765    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85c5c4898-5kzzs"]
Jul 28 04:28:38.242064 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:38.242008    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85c5c4898-5kzzs"]
Jul 28 04:28:39.838207 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:28:39.838179    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75cd22a5-d856-42e4-8f14-e7f4ed427c2b" path="/var/lib/kubelet/pods/75cd22a5-d856-42e4-8f14-e7f4ed427c2b/volumes"
Jul 28 04:30:00.139937 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:00.139903    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753550-4zg4h"]
Jul 28 04:30:00.140370 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:00.140251    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75cd22a5-d856-42e4-8f14-e7f4ed427c2b" containerName="authorino"
Jul 28 04:30:00.140370 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:00.140263    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="75cd22a5-d856-42e4-8f14-e7f4ed427c2b" containerName="authorino"
Jul 28 04:30:00.140370 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:00.140337    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="75cd22a5-d856-42e4-8f14-e7f4ed427c2b" containerName="authorino"
Jul 28 04:30:00.143556 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:00.143540    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753550-4zg4h"
Jul 28 04:30:00.145362 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:00.145344    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-874h6\""
Jul 28 04:30:00.150252 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:00.150225    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753550-4zg4h"]
Jul 28 04:30:00.154932 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:00.154914    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753550-4zg4h"
Jul 28 04:30:00.292584 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:00.292556    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753550-4zg4h"]
Jul 28 04:30:00.294731 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:30:00.294705    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d3476d_200a_46c4_84ac_38b3c4da2694.slice/crio-ba397f21f10f30ed92367c2e00eedafb909bf4363459a938cdae09e2fe7d1f0d WatchSource:0}: Error finding container ba397f21f10f30ed92367c2e00eedafb909bf4363459a938cdae09e2fe7d1f0d: Status 404 returned error can't find the container with id ba397f21f10f30ed92367c2e00eedafb909bf4363459a938cdae09e2fe7d1f0d
Jul 28 04:30:00.655485 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:00.655445    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753550-4zg4h" event={"ID":"78d3476d-200a-46c4-84ac-38b3c4da2694","Type":"ContainerStarted","Data":"ba397f21f10f30ed92367c2e00eedafb909bf4363459a938cdae09e2fe7d1f0d"}
Jul 28 04:30:03.672816 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:03.672720    2581 generic.go:356] "Generic (PLEG): container finished" podID="78d3476d-200a-46c4-84ac-38b3c4da2694" containerID="b45ca3c9b7f5f8f897227de14e6f4659727851d7b77f746895efd64d7529c4fa" exitCode=0
Jul 28 04:30:03.673199 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:03.672805    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753550-4zg4h" event={"ID":"78d3476d-200a-46c4-84ac-38b3c4da2694","Type":"ContainerDied","Data":"b45ca3c9b7f5f8f897227de14e6f4659727851d7b77f746895efd64d7529c4fa"}
Jul 28 04:30:04.815616 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:04.815592    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753550-4zg4h"
Jul 28 04:30:05.685493 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:05.685461    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753550-4zg4h" event={"ID":"78d3476d-200a-46c4-84ac-38b3c4da2694","Type":"ContainerDied","Data":"ba397f21f10f30ed92367c2e00eedafb909bf4363459a938cdae09e2fe7d1f0d"}
Jul 28 04:30:05.685667 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:05.685540    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba397f21f10f30ed92367c2e00eedafb909bf4363459a938cdae09e2fe7d1f0d"
Jul 28 04:30:05.685667 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:30:05.685476    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753550-4zg4h"
Jul 28 04:31:45.806143 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:31:45.806115    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:31:45.808706 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:31:45.807665    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:36:40.983444 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:40.983406    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"]
Jul 28 04:36:40.984010 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:40.983872    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78d3476d-200a-46c4-84ac-38b3c4da2694" containerName="cleanup"
Jul 28 04:36:40.984010 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:40.983890    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78d3476d-200a-46c4-84ac-38b3c4da2694" containerName="cleanup"
Jul 28 04:36:40.984010 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:40.983982    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78d3476d-200a-46c4-84ac-38b3c4da2694" containerName="cleanup"
Jul 28 04:36:40.988481 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:40.988454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"
Jul 28 04:36:40.990462 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:40.990442    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s2lcg\""
Jul 28 04:36:40.990574 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:40.990467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81df367e-3bda-47ce-b00e-d6ca44fa9819-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q4j2c\" (UID: \"81df367e-3bda-47ce-b00e-d6ca44fa9819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"
Jul 28 04:36:40.990574 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:40.990504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2829\" (UniqueName: \"kubernetes.io/projected/81df367e-3bda-47ce-b00e-d6ca44fa9819-kube-api-access-j2829\") pod \"kuadrant-operator-controller-manager-86878c769f-q4j2c\" (UID: \"81df367e-3bda-47ce-b00e-d6ca44fa9819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"
Jul 28 04:36:40.997894 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:40.997872    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"]
Jul 28 04:36:41.091804 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:41.091769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81df367e-3bda-47ce-b00e-d6ca44fa9819-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q4j2c\" (UID: \"81df367e-3bda-47ce-b00e-d6ca44fa9819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"
Jul 28 04:36:41.091804 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:41.091813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2829\" (UniqueName: \"kubernetes.io/projected/81df367e-3bda-47ce-b00e-d6ca44fa9819-kube-api-access-j2829\") pod \"kuadrant-operator-controller-manager-86878c769f-q4j2c\" (UID: \"81df367e-3bda-47ce-b00e-d6ca44fa9819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"
Jul 28 04:36:41.092222 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:41.092201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81df367e-3bda-47ce-b00e-d6ca44fa9819-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q4j2c\" (UID: \"81df367e-3bda-47ce-b00e-d6ca44fa9819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"
Jul 28 04:36:41.100908 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:41.100885    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2829\" (UniqueName: \"kubernetes.io/projected/81df367e-3bda-47ce-b00e-d6ca44fa9819-kube-api-access-j2829\") pod \"kuadrant-operator-controller-manager-86878c769f-q4j2c\" (UID: \"81df367e-3bda-47ce-b00e-d6ca44fa9819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"
Jul 28 04:36:41.299621 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:41.299590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"
Jul 28 04:36:41.444606 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:41.444581    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"]
Jul 28 04:36:41.447467 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:36:41.447434    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81df367e_3bda_47ce_b00e_d6ca44fa9819.slice/crio-3357683e603bcf7e9ba721dd203fae1438d63b24be65b1c6a8f8b49df370e87e WatchSource:0}: Error finding container 3357683e603bcf7e9ba721dd203fae1438d63b24be65b1c6a8f8b49df370e87e: Status 404 returned error can't find the container with id 3357683e603bcf7e9ba721dd203fae1438d63b24be65b1c6a8f8b49df370e87e
Jul 28 04:36:41.737403 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:41.737370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c" event={"ID":"81df367e-3bda-47ce-b00e-d6ca44fa9819","Type":"ContainerStarted","Data":"0ca5c187d8d714dc54020142432348cd717d2173c7ab5eb64ce678d9bf12c789"}
Jul 28 04:36:41.737636 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:41.737424    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c" event={"ID":"81df367e-3bda-47ce-b00e-d6ca44fa9819","Type":"ContainerStarted","Data":"3357683e603bcf7e9ba721dd203fae1438d63b24be65b1c6a8f8b49df370e87e"}
Jul 28 04:36:41.737636 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:41.737495    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"
Jul 28 04:36:41.754756 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:41.754697    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c" podStartSLOduration=1.754679689 podStartE2EDuration="1.754679689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:36:41.753194378 +0000 UTC m=+1496.460676690" watchObservedRunningTime="2026-07-28 04:36:41.754679689 +0000 UTC m=+1496.462161994"
Jul 28 04:36:45.842597 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:45.842494    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:36:45.855789 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:45.845972    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:36:52.745747 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:36:52.745715    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4j2c"
Jul 28 04:41:45.875593 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:41:45.875498    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:41:45.880985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:41:45.880967    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:43:50.510096 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.510060    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"]
Jul 28 04:43:50.513648 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.513628    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.516123 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.516099    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ecc0dac1-openshift-default-dockercfg-smff5\""
Jul 28 04:43:50.533981 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.533950    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"]
Jul 28 04:43:50.565810 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.565778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-credential-socket\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.565810 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.565811    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-certs\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.566022 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.565830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-data\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.566022 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.565917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-socket\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.566022 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.565939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-podinfo\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.566022 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.565965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-envoy\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.566022 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.565984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9xl9\" (UniqueName: \"kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-kube-api-access-x9xl9\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.566022 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.566009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-token\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.566274 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.566075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istiod-ca-cert\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667016 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.666980    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-podinfo\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667220 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-envoy\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667220 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xl9\" (UniqueName: \"kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-kube-api-access-x9xl9\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667220 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-token\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667220 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istiod-ca-cert\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667220 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-credential-socket\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667220 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-certs\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667220 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-data\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667577 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-socket\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667632 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667603    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-certs\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667694 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-credential-socket\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667747 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-socket\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.667827 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-data\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.668012 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.667994    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istiod-ca-cert\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.669934 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.669915    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-envoy\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.670184 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.670160    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-podinfo\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.674542 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.674517    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9xl9\" (UniqueName: \"kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-kube-api-access-x9xl9\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.675068 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.675053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-token\") pod \"e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") " pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.824051 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.823941    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:50.969934 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.969911    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"]
Jul 28 04:43:50.972160 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:43:50.972127    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7c0c4b_1e7d_43da_ac22_95705e5b2544.slice/crio-a5047b602619e447d2e2c836beb1a38984e95f0faa29f6053e8f8fa61e873231 WatchSource:0}: Error finding container a5047b602619e447d2e2c836beb1a38984e95f0faa29f6053e8f8fa61e873231: Status 404 returned error can't find the container with id a5047b602619e447d2e2c836beb1a38984e95f0faa29f6053e8f8fa61e873231
Jul 28 04:43:50.974396 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.974355    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:43:50.974481 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.974446    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:43:50.974522 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:50.974487    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:43:51.026885 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:51.026857    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" event={"ID":"2a7c0c4b-1e7d-43da-ac22-95705e5b2544","Type":"ContainerStarted","Data":"a5047b602619e447d2e2c836beb1a38984e95f0faa29f6053e8f8fa61e873231"}
Jul 28 04:43:52.034109 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:52.034072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" event={"ID":"2a7c0c4b-1e7d-43da-ac22-95705e5b2544","Type":"ContainerStarted","Data":"b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c"}
Jul 28 04:43:52.055017 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:52.054966    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" podStartSLOduration=2.054948495 podStartE2EDuration="2.054948495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:43:52.052020129 +0000 UTC m=+1926.759502430" watchObservedRunningTime="2026-07-28 04:43:52.054948495 +0000 UTC m=+1926.762430795"
Jul 28 04:43:52.824542 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:52.824502    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:52.830141 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:52.830112    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:53.039959 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:53.039923    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:43:53.041088 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:43:53.041069    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:44:08.041584 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:08.041501    2581 patch_prober.go:28] interesting pod/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 28 04:44:08.041584 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:08.041557    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 28 04:44:08.126715 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:08.126680    2581 generic.go:356] "Generic (PLEG): container finished" podID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerID="b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c" exitCode=0
Jul 28 04:44:08.126889 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:08.126756    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" event={"ID":"2a7c0c4b-1e7d-43da-ac22-95705e5b2544","Type":"ContainerDied","Data":"b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c"}
Jul 28 04:44:08.127155 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:08.127139    2581 scope.go:117] "RemoveContainer" containerID="b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c"
Jul 28 04:44:08.128179 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:08.128147    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:44:08.128274 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:08.128223    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:44:08.128274 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:08.128256    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:44:09.137475 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:09.137428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" event={"ID":"2a7c0c4b-1e7d-43da-ac22-95705e5b2544","Type":"ContainerStarted","Data":"32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3"}
Jul 28 04:44:09.824187 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:09.824089    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:44:09.824407 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:09.824328    2581 patch_prober.go:28] interesting pod/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 28 04:44:09.824486 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:09.824401    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 28 04:44:10.825213 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:10.825174    2581 patch_prober.go:28] interesting pod/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 28 04:44:10.825745 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:10.825259    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 28 04:44:11.824871 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:11.824832    2581 patch_prober.go:28] interesting pod/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 28 04:44:11.825239 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:11.825198    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 28 04:44:12.825075 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:12.824608    2581 patch_prober.go:28] interesting pod/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 28 04:44:12.825075 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:12.824672    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 28 04:44:13.828635 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:13.828604    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:44:13.829060 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:13.829002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:44:13.829686 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:13.829672    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:44:34.347558 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:34.347516    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"]
Jul 28 04:44:34.348179 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:34.347756    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy" containerID="cri-o://32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3" gracePeriod=30
Jul 28 04:44:39.599802 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.599778    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:44:39.700775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.700686    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9xl9\" (UniqueName: \"kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-kube-api-access-x9xl9\") pod \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") "
Jul 28 04:44:39.700775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.700734    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-envoy\") pod \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") "
Jul 28 04:44:39.700775 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.700755    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-podinfo\") pod \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") "
Jul 28 04:44:39.701093 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.700803    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-credential-socket\") pod \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") "
Jul 28 04:44:39.701093 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.700819    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-data\") pod \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") "
Jul 28 04:44:39.701093 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.700835    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istiod-ca-cert\") pod \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") "
Jul 28 04:44:39.701093 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.700877    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-certs\") pod \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") "
Jul 28 04:44:39.701093 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.700921    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-socket\") pod \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") "
Jul 28 04:44:39.701093 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.700953    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-token\") pod \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\" (UID: \"2a7c0c4b-1e7d-43da-ac22-95705e5b2544\") "
Jul 28 04:44:39.701427 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.701139    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a7c0c4b-1e7d-43da-ac22-95705e5b2544" (UID: "2a7c0c4b-1e7d-43da-ac22-95705e5b2544"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:44:39.701427 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.701317    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a7c0c4b-1e7d-43da-ac22-95705e5b2544" (UID: "2a7c0c4b-1e7d-43da-ac22-95705e5b2544"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:44:39.701427 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.701338    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-credential-socket\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:44:39.701819 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.701499    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a7c0c4b-1e7d-43da-ac22-95705e5b2544" (UID: "2a7c0c4b-1e7d-43da-ac22-95705e5b2544"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:44:39.701819 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.701566    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a7c0c4b-1e7d-43da-ac22-95705e5b2544" (UID: "2a7c0c4b-1e7d-43da-ac22-95705e5b2544"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:44:39.702091 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.702065    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a7c0c4b-1e7d-43da-ac22-95705e5b2544" (UID: "2a7c0c4b-1e7d-43da-ac22-95705e5b2544"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:44:39.703312 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.703289    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a7c0c4b-1e7d-43da-ac22-95705e5b2544" (UID: "2a7c0c4b-1e7d-43da-ac22-95705e5b2544"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 04:44:39.703416 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.703348    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-kube-api-access-x9xl9" (OuterVolumeSpecName: "kube-api-access-x9xl9") pod "2a7c0c4b-1e7d-43da-ac22-95705e5b2544" (UID: "2a7c0c4b-1e7d-43da-ac22-95705e5b2544"). InnerVolumeSpecName "kube-api-access-x9xl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:44:39.703457 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.703426    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a7c0c4b-1e7d-43da-ac22-95705e5b2544" (UID: "2a7c0c4b-1e7d-43da-ac22-95705e5b2544"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:44:39.703574 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.703560    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a7c0c4b-1e7d-43da-ac22-95705e5b2544" (UID: "2a7c0c4b-1e7d-43da-ac22-95705e5b2544"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:44:39.801982 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.801945    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-socket\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:44:39.801982 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.801976    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-token\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:44:39.801982 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.801986    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9xl9\" (UniqueName: \"kubernetes.io/projected/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-kube-api-access-x9xl9\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:44:39.802263 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.801995    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-envoy\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:44:39.802263 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.802003    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-podinfo\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:44:39.802263 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.802011    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istio-data\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:44:39.802263 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.802019    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-istiod-ca-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:44:39.802263 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:39.802026    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0c4b-1e7d-43da-ac22-95705e5b2544-workload-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:44:40.309656 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.309617    2581 generic.go:356] "Generic (PLEG): container finished" podID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerID="32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3" exitCode=0
Jul 28 04:44:40.309831 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.309689    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"
Jul 28 04:44:40.309831 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.309698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" event={"ID":"2a7c0c4b-1e7d-43da-ac22-95705e5b2544","Type":"ContainerDied","Data":"32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3"}
Jul 28 04:44:40.309831 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.309752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c" event={"ID":"2a7c0c4b-1e7d-43da-ac22-95705e5b2544","Type":"ContainerDied","Data":"a5047b602619e447d2e2c836beb1a38984e95f0faa29f6053e8f8fa61e873231"}
Jul 28 04:44:40.309831 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.309774    2581 scope.go:117] "RemoveContainer" containerID="32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3"
Jul 28 04:44:40.319486 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.319468    2581 scope.go:117] "RemoveContainer" containerID="b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c"
Jul 28 04:44:40.326816 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.326789    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"]
Jul 28 04:44:40.328452 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.328431    2581 scope.go:117] "RemoveContainer" containerID="32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3"
Jul 28 04:44:40.328718 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:44:40.328699    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3\": container with ID starting with 32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3 not found: ID does not exist" containerID="32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3"
Jul 28 04:44:40.328801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.328731    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3"} err="failed to get container status \"32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3\": rpc error: code = NotFound desc = could not find container \"32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3\": container with ID starting with 32f99ced5676b07ead9f6ef75e95f17f1120cada4a2402befe711b30cfe041d3 not found: ID does not exist"
Jul 28 04:44:40.328801 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.328754    2581 scope.go:117] "RemoveContainer" containerID="b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c"
Jul 28 04:44:40.329045 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:44:40.329013    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c\": container with ID starting with b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c not found: ID does not exist" containerID="b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c"
Jul 28 04:44:40.329099 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.329054    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c"} err="failed to get container status \"b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c\": rpc error: code = NotFound desc = could not find container \"b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c\": container with ID starting with b41a3b3f44eeaf97ec3bb16d0020afe7bc2cf86f02f406b0bbb306eed44b230c not found: ID does not exist"
Jul 28 04:44:40.332695 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:40.332675    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ecc0dac1-openshift-default-7965f995bd-qnp5c"]
Jul 28 04:44:41.838892 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:44:41.838863    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" path="/var/lib/kubelet/pods/2a7c0c4b-1e7d-43da-ac22-95705e5b2544/volumes"
Jul 28 04:46:10.865574 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.865373    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"]
Jul 28 04:46:10.865971 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.865950    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy"
Jul 28 04:46:10.866015 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.865972    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy"
Jul 28 04:46:10.866095 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.866056    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy"
Jul 28 04:46:10.866095 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.866065    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy"
Jul 28 04:46:10.869134 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.869116    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:10.871171 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.871149    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-ac8148f2\""
Jul 28 04:46:10.871291 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.871271    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-ac8148f2-dockercfg-7l64z\""
Jul 28 04:46:10.877625 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.877601    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"]
Jul 28 04:46:10.923166 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.923130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84568235-a5cf-45f9-95f3-b37074b5a789-plugins-config-volume\") pod \"payload-processing-e2e-derive-ac8148f2-b544c7946-flv84\" (UID: \"84568235-a5cf-45f9-95f3-b37074b5a789\") " pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:10.923328 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:10.923199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vrnw\" (UniqueName: \"kubernetes.io/projected/84568235-a5cf-45f9-95f3-b37074b5a789-kube-api-access-6vrnw\") pod \"payload-processing-e2e-derive-ac8148f2-b544c7946-flv84\" (UID: \"84568235-a5cf-45f9-95f3-b37074b5a789\") " pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:11.024690 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:11.024651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vrnw\" (UniqueName: \"kubernetes.io/projected/84568235-a5cf-45f9-95f3-b37074b5a789-kube-api-access-6vrnw\") pod \"payload-processing-e2e-derive-ac8148f2-b544c7946-flv84\" (UID: \"84568235-a5cf-45f9-95f3-b37074b5a789\") " pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:11.024912 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:11.024741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84568235-a5cf-45f9-95f3-b37074b5a789-plugins-config-volume\") pod \"payload-processing-e2e-derive-ac8148f2-b544c7946-flv84\" (UID: \"84568235-a5cf-45f9-95f3-b37074b5a789\") " pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:11.025676 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:11.025640    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84568235-a5cf-45f9-95f3-b37074b5a789-plugins-config-volume\") pod \"payload-processing-e2e-derive-ac8148f2-b544c7946-flv84\" (UID: \"84568235-a5cf-45f9-95f3-b37074b5a789\") " pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:11.032757 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:11.032725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vrnw\" (UniqueName: \"kubernetes.io/projected/84568235-a5cf-45f9-95f3-b37074b5a789-kube-api-access-6vrnw\") pod \"payload-processing-e2e-derive-ac8148f2-b544c7946-flv84\" (UID: \"84568235-a5cf-45f9-95f3-b37074b5a789\") " pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:11.181309 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:11.181216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:11.327740 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:11.327716    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"]
Jul 28 04:46:11.330340 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:46:11.330307    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84568235_a5cf_45f9_95f3_b37074b5a789.slice/crio-25ec993068b01353c6fcfecaabd4d3d4312b8b13b0311c23904fcebd444c98e3 WatchSource:0}: Error finding container 25ec993068b01353c6fcfecaabd4d3d4312b8b13b0311c23904fcebd444c98e3: Status 404 returned error can't find the container with id 25ec993068b01353c6fcfecaabd4d3d4312b8b13b0311c23904fcebd444c98e3
Jul 28 04:46:11.799055 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:11.799004    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84" event={"ID":"84568235-a5cf-45f9-95f3-b37074b5a789","Type":"ContainerStarted","Data":"84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c"}
Jul 28 04:46:11.799238 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:11.799091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84" event={"ID":"84568235-a5cf-45f9-95f3-b37074b5a789","Type":"ContainerStarted","Data":"25ec993068b01353c6fcfecaabd4d3d4312b8b13b0311c23904fcebd444c98e3"}
Jul 28 04:46:11.799238 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:11.799113    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:11.814654 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:11.814597    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84" podStartSLOduration=1.814576947 podStartE2EDuration="1.814576947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:46:11.812522147 +0000 UTC m=+2066.520004448" watchObservedRunningTime="2026-07-28 04:46:11.814576947 +0000 UTC m=+2066.522059249"
Jul 28 04:46:22.806404 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:22.806367    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:29.806744 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:29.806708    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"]
Jul 28 04:46:29.807275 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:29.806931    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84" podUID="84568235-a5cf-45f9-95f3-b37074b5a789" containerName="payload-processing" containerID="cri-o://84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c" gracePeriod=30
Jul 28 04:46:30.065439 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.065380    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:30.205654 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.205621    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vrnw\" (UniqueName: \"kubernetes.io/projected/84568235-a5cf-45f9-95f3-b37074b5a789-kube-api-access-6vrnw\") pod \"84568235-a5cf-45f9-95f3-b37074b5a789\" (UID: \"84568235-a5cf-45f9-95f3-b37074b5a789\") "
Jul 28 04:46:30.205841 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.205716    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84568235-a5cf-45f9-95f3-b37074b5a789-plugins-config-volume\") pod \"84568235-a5cf-45f9-95f3-b37074b5a789\" (UID: \"84568235-a5cf-45f9-95f3-b37074b5a789\") "
Jul 28 04:46:30.206152 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.206124    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84568235-a5cf-45f9-95f3-b37074b5a789-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "84568235-a5cf-45f9-95f3-b37074b5a789" (UID: "84568235-a5cf-45f9-95f3-b37074b5a789"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:46:30.207897 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.207871    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84568235-a5cf-45f9-95f3-b37074b5a789-kube-api-access-6vrnw" (OuterVolumeSpecName: "kube-api-access-6vrnw") pod "84568235-a5cf-45f9-95f3-b37074b5a789" (UID: "84568235-a5cf-45f9-95f3-b37074b5a789"). InnerVolumeSpecName "kube-api-access-6vrnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:46:30.306785 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.306743    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vrnw\" (UniqueName: \"kubernetes.io/projected/84568235-a5cf-45f9-95f3-b37074b5a789-kube-api-access-6vrnw\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:46:30.306785 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.306777    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84568235-a5cf-45f9-95f3-b37074b5a789-plugins-config-volume\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:46:30.906980 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.906946    2581 generic.go:356] "Generic (PLEG): container finished" podID="84568235-a5cf-45f9-95f3-b37074b5a789" containerID="84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c" exitCode=0
Jul 28 04:46:30.907581 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.907000    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"
Jul 28 04:46:30.907581 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.907064    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84" event={"ID":"84568235-a5cf-45f9-95f3-b37074b5a789","Type":"ContainerDied","Data":"84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c"}
Jul 28 04:46:30.907581 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.907126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84" event={"ID":"84568235-a5cf-45f9-95f3-b37074b5a789","Type":"ContainerDied","Data":"25ec993068b01353c6fcfecaabd4d3d4312b8b13b0311c23904fcebd444c98e3"}
Jul 28 04:46:30.907581 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.907149    2581 scope.go:117] "RemoveContainer" containerID="84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c"
Jul 28 04:46:30.917242 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.917223    2581 scope.go:117] "RemoveContainer" containerID="84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c"
Jul 28 04:46:30.917503 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:46:30.917484    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c\": container with ID starting with 84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c not found: ID does not exist" containerID="84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c"
Jul 28 04:46:30.917559 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.917513    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c"} err="failed to get container status \"84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c\": rpc error: code = NotFound desc = could not find container \"84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c\": container with ID starting with 84d824010dae22f5895fc31a5e45eff5cc962426a705101485f121c87956375c not found: ID does not exist"
Jul 28 04:46:30.927471 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.927446    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"]
Jul 28 04:46:30.930630 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:30.930604    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ac8148f2-b544c7946-flv84"]
Jul 28 04:46:31.839586 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:31.839552    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84568235-a5cf-45f9-95f3-b37074b5a789" path="/var/lib/kubelet/pods/84568235-a5cf-45f9-95f3-b37074b5a789/volumes"
Jul 28 04:46:45.918576 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:45.918548    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:46:45.932006 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:46:45.931974    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:51:45.957711 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:51:45.957684    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:51:45.972663 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:51:45.972639    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:52:22.534548 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.534428    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"]
Jul 28 04:52:22.535202 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.534781    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy"
Jul 28 04:52:22.535202 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.534799    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a7c0c4b-1e7d-43da-ac22-95705e5b2544" containerName="istio-proxy"
Jul 28 04:52:22.535202 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.534816    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84568235-a5cf-45f9-95f3-b37074b5a789" containerName="payload-processing"
Jul 28 04:52:22.535202 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.534822    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="84568235-a5cf-45f9-95f3-b37074b5a789" containerName="payload-processing"
Jul 28 04:52:22.535202 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.534893    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="84568235-a5cf-45f9-95f3-b37074b5a789" containerName="payload-processing"
Jul 28 04:52:22.537989 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.537965    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.540101 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.540077    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1b1e7a-openshift-default-dockercfg-c4qcg\""
Jul 28 04:52:22.551570 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.551544    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"]
Jul 28 04:52:22.702911 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.702866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-token\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.703165 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.702919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-credential-socket\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.703165 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.702939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-podinfo\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.703165 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.702967    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-data\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.703165 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.703027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istiod-ca-cert\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.703165 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.703091    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-socket\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.703165 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.703119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-certs\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.703165 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.703135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl7bd\" (UniqueName: \"kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-kube-api-access-wl7bd\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.703418 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.703206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-envoy\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.804738 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.804642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-envoy\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.804738 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.804690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-token\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.804738 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.804730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-credential-socket\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805014 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.804751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-podinfo\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805014 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.804770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-data\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805014 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.804801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istiod-ca-cert\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805014 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.804843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-socket\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805014 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.804926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-certs\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805014 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.804952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl7bd\" (UniqueName: \"kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-kube-api-access-wl7bd\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805411 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.805247    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-data\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805411 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.805355    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-socket\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805411 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.805386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-certs\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805643 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.805549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-credential-socket\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.805703 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.805671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istiod-ca-cert\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.807231 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.807213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-envoy\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.807435 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.807419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-podinfo\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.812631 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.812606    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl7bd\" (UniqueName: \"kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-kube-api-access-wl7bd\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.813209 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.813191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-token\") pod \"e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") " pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.848705 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.848665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:22.996782 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:22.996759    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"]
Jul 28 04:52:22.999091 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:52:22.999065    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c724b7_c553_47c5_8dfd_dd4b9bffddbf.slice/crio-57bebc75e4a71c11deee88c496f67b43a79ab587bfe136c1cacb72a5aef383f9 WatchSource:0}: Error finding container 57bebc75e4a71c11deee88c496f67b43a79ab587bfe136c1cacb72a5aef383f9: Status 404 returned error can't find the container with id 57bebc75e4a71c11deee88c496f67b43a79ab587bfe136c1cacb72a5aef383f9
Jul 28 04:52:23.001701 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:23.001665    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:52:23.001809 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:23.001750    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:52:23.001809 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:23.001798    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:52:23.778422 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:23.778383    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" event={"ID":"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf","Type":"ContainerStarted","Data":"47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad"}
Jul 28 04:52:23.778817 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:23.778438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" event={"ID":"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf","Type":"ContainerStarted","Data":"57bebc75e4a71c11deee88c496f67b43a79ab587bfe136c1cacb72a5aef383f9"}
Jul 28 04:52:23.797763 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:23.797713    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" podStartSLOduration=1.7976985669999999 podStartE2EDuration="1.797698567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:52:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:52:23.796075104 +0000 UTC m=+2438.503557412" watchObservedRunningTime="2026-07-28 04:52:23.797698567 +0000 UTC m=+2438.505180867"
Jul 28 04:52:23.849608 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:23.849571    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:24.854403 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:24.854374    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:25.789927 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:25.789892    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:25.790864 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:25.790844    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:26.834816 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:26.834778    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"]
Jul 28 04:52:26.838627 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:26.838607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:52:26.840817 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:26.840796    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-1b1e7a\""
Jul 28 04:52:26.840922 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:26.840825    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-1b1e7a-dockercfg-vkp6b\""
Jul 28 04:52:26.848745 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:26.848716    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"]
Jul 28 04:52:26.943826 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:26.943788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzjrx\" (UniqueName: \"kubernetes.io/projected/17fa6da2-10a9-4829-8a35-28392bfe7c1c-kube-api-access-zzjrx\") pod \"payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9\" (UID: \"17fa6da2-10a9-4829-8a35-28392bfe7c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:52:26.943826 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:26.943841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17fa6da2-10a9-4829-8a35-28392bfe7c1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9\" (UID: \"17fa6da2-10a9-4829-8a35-28392bfe7c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:52:27.044993 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:27.044954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzjrx\" (UniqueName: \"kubernetes.io/projected/17fa6da2-10a9-4829-8a35-28392bfe7c1c-kube-api-access-zzjrx\") pod \"payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9\" (UID: \"17fa6da2-10a9-4829-8a35-28392bfe7c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:52:27.045189 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:27.045001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17fa6da2-10a9-4829-8a35-28392bfe7c1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9\" (UID: \"17fa6da2-10a9-4829-8a35-28392bfe7c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:52:27.045827 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:27.045801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17fa6da2-10a9-4829-8a35-28392bfe7c1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9\" (UID: \"17fa6da2-10a9-4829-8a35-28392bfe7c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:52:27.052708 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:27.052674    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzjrx\" (UniqueName: \"kubernetes.io/projected/17fa6da2-10a9-4829-8a35-28392bfe7c1c-kube-api-access-zzjrx\") pod \"payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9\" (UID: \"17fa6da2-10a9-4829-8a35-28392bfe7c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:52:27.150940 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:27.150839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:52:27.289573 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:27.289538    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"]
Jul 28 04:52:27.293314 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:52:27.293286    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17fa6da2_10a9_4829_8a35_28392bfe7c1c.slice/crio-4e6966dd5e683135a89b93955069a94875e861ed503f48f8f03b5ffeba49800b WatchSource:0}: Error finding container 4e6966dd5e683135a89b93955069a94875e861ed503f48f8f03b5ffeba49800b: Status 404 returned error can't find the container with id 4e6966dd5e683135a89b93955069a94875e861ed503f48f8f03b5ffeba49800b
Jul 28 04:52:27.803169 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:27.803131    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9" event={"ID":"17fa6da2-10a9-4829-8a35-28392bfe7c1c","Type":"ContainerStarted","Data":"509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0"}
Jul 28 04:52:27.803373 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:27.803187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9" event={"ID":"17fa6da2-10a9-4829-8a35-28392bfe7c1c","Type":"ContainerStarted","Data":"4e6966dd5e683135a89b93955069a94875e861ed503f48f8f03b5ffeba49800b"}
Jul 28 04:52:27.803373 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:27.803227    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:52:27.816712 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:27.816617    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9" podStartSLOduration=1.816555283 podStartE2EDuration="1.816555283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:52:27.816434672 +0000 UTC m=+2442.523916974" watchObservedRunningTime="2026-07-28 04:52:27.816555283 +0000 UTC m=+2442.524037597"
Jul 28 04:52:38.812253 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:38.812209    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:52:40.791788 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:40.791745    2581 patch_prober.go:28] interesting pod/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 28 04:52:40.792321 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:40.791816    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 28 04:52:40.888690 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:40.888656    2581 generic.go:356] "Generic (PLEG): container finished" podID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerID="47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad" exitCode=0
Jul 28 04:52:40.888874 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:40.888726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" event={"ID":"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf","Type":"ContainerDied","Data":"47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad"}
Jul 28 04:52:40.889128 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:40.889113    2581 scope.go:117] "RemoveContainer" containerID="47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad"
Jul 28 04:52:40.890148 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:40.890120    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:52:40.890257 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:40.890210    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:52:40.890322 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:40.890260    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:52:41.896499 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:41.896468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" event={"ID":"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf","Type":"ContainerStarted","Data":"acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a"}
Jul 28 04:52:42.849474 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:42.849439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:42.849891 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:42.849795    2581 patch_prober.go:28] interesting pod/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 28 04:52:42.850112 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:42.850087    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 28 04:52:43.849666 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:43.849624    2581 patch_prober.go:28] interesting pod/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 28 04:52:43.850292 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:43.850256    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 28 04:52:44.849833 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:44.849786    2581 patch_prober.go:28] interesting pod/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 28 04:52:44.850387 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:44.849854    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 28 04:52:45.849410 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:45.849376    2581 patch_prober.go:28] interesting pod/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 28 04:52:45.849590 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:45.849441    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 28 04:52:46.854085 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:46.854047    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:46.854607 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:46.854585    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:52:46.855323 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:52:46.855304    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:54:18.484009 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:18.483782    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"]
Jul 28 04:54:18.484691 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:18.484139    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9" podUID="17fa6da2-10a9-4829-8a35-28392bfe7c1c" containerName="payload-pre-processing" containerID="cri-o://509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0" gracePeriod=30
Jul 28 04:54:18.745289 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:18.745269    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:54:18.749990 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:18.749971    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17fa6da2-10a9-4829-8a35-28392bfe7c1c-plugins-config-volume\") pod \"17fa6da2-10a9-4829-8a35-28392bfe7c1c\" (UID: \"17fa6da2-10a9-4829-8a35-28392bfe7c1c\") "
Jul 28 04:54:18.750104 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:18.750092    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzjrx\" (UniqueName: \"kubernetes.io/projected/17fa6da2-10a9-4829-8a35-28392bfe7c1c-kube-api-access-zzjrx\") pod \"17fa6da2-10a9-4829-8a35-28392bfe7c1c\" (UID: \"17fa6da2-10a9-4829-8a35-28392bfe7c1c\") "
Jul 28 04:54:18.750325 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:18.750304    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17fa6da2-10a9-4829-8a35-28392bfe7c1c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "17fa6da2-10a9-4829-8a35-28392bfe7c1c" (UID: "17fa6da2-10a9-4829-8a35-28392bfe7c1c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:54:18.752267 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:18.752240    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17fa6da2-10a9-4829-8a35-28392bfe7c1c-kube-api-access-zzjrx" (OuterVolumeSpecName: "kube-api-access-zzjrx") pod "17fa6da2-10a9-4829-8a35-28392bfe7c1c" (UID: "17fa6da2-10a9-4829-8a35-28392bfe7c1c"). InnerVolumeSpecName "kube-api-access-zzjrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:54:18.850952 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:18.850916    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzjrx\" (UniqueName: \"kubernetes.io/projected/17fa6da2-10a9-4829-8a35-28392bfe7c1c-kube-api-access-zzjrx\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:18.850952 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:18.850944    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17fa6da2-10a9-4829-8a35-28392bfe7c1c-plugins-config-volume\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:19.449511 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:19.449468    2581 generic.go:356] "Generic (PLEG): container finished" podID="17fa6da2-10a9-4829-8a35-28392bfe7c1c" containerID="509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0" exitCode=0
Jul 28 04:54:19.449683 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:19.449515    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"
Jul 28 04:54:19.449683 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:19.449554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9" event={"ID":"17fa6da2-10a9-4829-8a35-28392bfe7c1c","Type":"ContainerDied","Data":"509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0"}
Jul 28 04:54:19.449683 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:19.449619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9" event={"ID":"17fa6da2-10a9-4829-8a35-28392bfe7c1c","Type":"ContainerDied","Data":"4e6966dd5e683135a89b93955069a94875e861ed503f48f8f03b5ffeba49800b"}
Jul 28 04:54:19.449683 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:19.449642    2581 scope.go:117] "RemoveContainer" containerID="509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0"
Jul 28 04:54:19.459573 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:19.459557    2581 scope.go:117] "RemoveContainer" containerID="509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0"
Jul 28 04:54:19.459835 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:54:19.459811    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0\": container with ID starting with 509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0 not found: ID does not exist" containerID="509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0"
Jul 28 04:54:19.459893 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:19.459845    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0"} err="failed to get container status \"509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0\": rpc error: code = NotFound desc = could not find container \"509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0\": container with ID starting with 509c399c70bd1383635390106e9fc8d7669856fc63a9aa09a8cd876feaa48be0 not found: ID does not exist"
Jul 28 04:54:19.470911 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:19.470890    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"]
Jul 28 04:54:19.474803 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:19.474783    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b1e7a-744c57fcb4-v6lb9"]
Jul 28 04:54:19.839174 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:19.839140    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17fa6da2-10a9-4829-8a35-28392bfe7c1c" path="/var/lib/kubelet/pods/17fa6da2-10a9-4829-8a35-28392bfe7c1c/volumes"
Jul 28 04:54:29.514990 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:29.514960    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"]
Jul 28 04:54:29.515463 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:29.515191    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy" containerID="cri-o://acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a" gracePeriod=30
Jul 28 04:54:31.856797 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:31.856761    2581 patch_prober.go:28] interesting pod/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 04:54:31.857220 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:31.856818    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 04:54:34.777792 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.777731    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:54:34.891741 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.891693    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-credential-socket\") pod \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") "
Jul 28 04:54:34.891935 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.891761    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-token\") pod \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") "
Jul 28 04:54:34.891935 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.891784    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-certs\") pod \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") "
Jul 28 04:54:34.891935 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.891812    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-data\") pod \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") "
Jul 28 04:54:34.891935 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.891835    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl7bd\" (UniqueName: \"kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-kube-api-access-wl7bd\") pod \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") "
Jul 28 04:54:34.891935 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.891864    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istiod-ca-cert\") pod \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") "
Jul 28 04:54:34.891935 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.891887    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-socket\") pod \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") "
Jul 28 04:54:34.892364 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.891952    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-podinfo\") pod \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") "
Jul 28 04:54:34.892364 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.892025    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" (UID: "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:54:34.892364 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.892093    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-envoy\") pod \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\" (UID: \"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf\") "
Jul 28 04:54:34.892364 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.892162    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" (UID: "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:54:34.892364 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.892268    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" (UID: "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:54:34.892629 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.892388    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-credential-socket\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:34.892629 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.892405    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:34.892629 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.892415    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-workload-socket\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:34.892773 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.892631    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" (UID: "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:54:34.893074 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.893049    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-data" (OuterVolumeSpecName: "istio-data") pod "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" (UID: "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:54:34.894300 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.894271    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-token" (OuterVolumeSpecName: "istio-token") pod "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" (UID: "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:54:34.894300 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.894279    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" (UID: "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 04:54:34.894671 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.894652    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" (UID: "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 04:54:34.894722 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.894699    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-kube-api-access-wl7bd" (OuterVolumeSpecName: "kube-api-access-wl7bd") pod "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" (UID: "b7c724b7-c553-47c5-8dfd-dd4b9bffddbf"). InnerVolumeSpecName "kube-api-access-wl7bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:54:34.993688 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.993653    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-envoy\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:34.993688 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.993682    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-token\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:34.993688 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.993692    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-data\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:34.993918 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.993701    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl7bd\" (UniqueName: \"kubernetes.io/projected/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-kube-api-access-wl7bd\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:34.993918 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.993710    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istiod-ca-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:34.993918 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:34.993719    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf-istio-podinfo\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:54:35.544603 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.544565    2581 generic.go:356] "Generic (PLEG): container finished" podID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerID="acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a" exitCode=0
Jul 28 04:54:35.544762 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.544624    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"
Jul 28 04:54:35.544762 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.544638    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" event={"ID":"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf","Type":"ContainerDied","Data":"acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a"}
Jul 28 04:54:35.544762 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.544695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn" event={"ID":"b7c724b7-c553-47c5-8dfd-dd4b9bffddbf","Type":"ContainerDied","Data":"57bebc75e4a71c11deee88c496f67b43a79ab587bfe136c1cacb72a5aef383f9"}
Jul 28 04:54:35.544762 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.544728    2581 scope.go:117] "RemoveContainer" containerID="acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a"
Jul 28 04:54:35.554758 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.554740    2581 scope.go:117] "RemoveContainer" containerID="47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad"
Jul 28 04:54:35.563421 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.563398    2581 scope.go:117] "RemoveContainer" containerID="acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a"
Jul 28 04:54:35.563757 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:54:35.563727    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a\": container with ID starting with acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a not found: ID does not exist" containerID="acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a"
Jul 28 04:54:35.563862 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.563767    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a"} err="failed to get container status \"acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a\": rpc error: code = NotFound desc = could not find container \"acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a\": container with ID starting with acef628634d7cf35082bb2004b97e7a7d6bbd4e9fc62881ac8442d76b2d1468a not found: ID does not exist"
Jul 28 04:54:35.563862 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.563794    2581 scope.go:117] "RemoveContainer" containerID="47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad"
Jul 28 04:54:35.564168 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:54:35.564147    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad\": container with ID starting with 47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad not found: ID does not exist" containerID="47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad"
Jul 28 04:54:35.564235 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.564173    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad"} err="failed to get container status \"47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad\": rpc error: code = NotFound desc = could not find container \"47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad\": container with ID starting with 47d2ba3a56b7d0b7468922b0d6ca28c5314f5b838589b60271aa115f593f97ad not found: ID does not exist"
Jul 28 04:54:35.565417 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.565397    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"]
Jul 28 04:54:35.569321 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.569301    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1b1e7a-openshift-default-64957f9d5d-4mvkn"]
Jul 28 04:54:35.839910 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:35.839832    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" path="/var/lib/kubelet/pods/b7c724b7-c553-47c5-8dfd-dd4b9bffddbf/volumes"
Jul 28 04:54:41.274004 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.273962    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"]
Jul 28 04:54:41.274535 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.274513    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17fa6da2-10a9-4829-8a35-28392bfe7c1c" containerName="payload-pre-processing"
Jul 28 04:54:41.274618 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.274538    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="17fa6da2-10a9-4829-8a35-28392bfe7c1c" containerName="payload-pre-processing"
Jul 28 04:54:41.274618 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.274556    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy"
Jul 28 04:54:41.274618 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.274564    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy"
Jul 28 04:54:41.274618 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.274586    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy"
Jul 28 04:54:41.274618 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.274594    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy"
Jul 28 04:54:41.274859 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.274689    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy"
Jul 28 04:54:41.274859 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.274701    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="17fa6da2-10a9-4829-8a35-28392bfe7c1c" containerName="payload-pre-processing"
Jul 28 04:54:41.277972 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.277950    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:41.280250 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.280229    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1b2859-serving-cert\""
Jul 28 04:54:41.288092 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.288066    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"]
Jul 28 04:54:41.349899 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.349860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98648848-e9cb-438a-b440-86ea45559869-openshift-service-ca\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:41.350077 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.349939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:41.350077 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.349977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdphq\" (UniqueName: \"kubernetes.io/projected/98648848-e9cb-438a-b440-86ea45559869-kube-api-access-rdphq\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:41.450847 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.450805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdphq\" (UniqueName: \"kubernetes.io/projected/98648848-e9cb-438a-b440-86ea45559869-kube-api-access-rdphq\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:41.451102 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.450887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98648848-e9cb-438a-b440-86ea45559869-openshift-service-ca\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:41.451102 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.450945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:41.451102 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:54:41.451083    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-serving-cert: secret "maas-api-e2e-api-b-1b2859-serving-cert" not found
Jul 28 04:54:41.451306 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:54:41.451164    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls podName:98648848-e9cb-438a-b440-86ea45559869 nodeName:}" failed. No retries permitted until 2026-07-28 04:54:41.951142447 +0000 UTC m=+2576.658624727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls") pod "maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw" (UID: "98648848-e9cb-438a-b440-86ea45559869") : secret "maas-api-e2e-api-b-1b2859-serving-cert" not found
Jul 28 04:54:41.451614 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.451590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98648848-e9cb-438a-b440-86ea45559869-openshift-service-ca\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:41.459286 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.459265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdphq\" (UniqueName: \"kubernetes.io/projected/98648848-e9cb-438a-b440-86ea45559869-kube-api-access-rdphq\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:41.956580 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:41.956540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:41.956757 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:54:41.956690    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-serving-cert: secret "maas-api-e2e-api-b-1b2859-serving-cert" not found
Jul 28 04:54:41.956757 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:54:41.956752    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls podName:98648848-e9cb-438a-b440-86ea45559869 nodeName:}" failed. No retries permitted until 2026-07-28 04:54:42.956733276 +0000 UTC m=+2577.664215575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls") pod "maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw" (UID: "98648848-e9cb-438a-b440-86ea45559869") : secret "maas-api-e2e-api-b-1b2859-serving-cert" not found
Jul 28 04:54:42.057300 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.057258    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"]
Jul 28 04:54:42.057770 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.057749    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7c724b7-c553-47c5-8dfd-dd4b9bffddbf" containerName="istio-proxy"
Jul 28 04:54:42.061143 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.061122    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:54:42.062858 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.062830    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-1b2859\""
Jul 28 04:54:42.062954 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.062931    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-1b2859-dockercfg-fjvfl\""
Jul 28 04:54:42.070588 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.070565    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"]
Jul 28 04:54:42.077908 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.077883    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"]
Jul 28 04:54:42.082303 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.082282    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:54:42.091839 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.091811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"]
Jul 28 04:54:42.158214 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.158178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5930836-01ba-4c57-a932-bb717fa935b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n\" (UID: \"d5930836-01ba-4c57-a932-bb717fa935b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:54:42.158398 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.158220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98e58a34-729f-449d-826b-f620e85b8de4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1b2859-84f6998448-cppr5\" (UID: \"98e58a34-729f-449d-826b-f620e85b8de4\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:54:42.158398 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.158250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9frq\" (UniqueName: \"kubernetes.io/projected/98e58a34-729f-449d-826b-f620e85b8de4-kube-api-access-k9frq\") pod \"payload-processing-e2e-api-b-1b2859-84f6998448-cppr5\" (UID: \"98e58a34-729f-449d-826b-f620e85b8de4\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:54:42.158398 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.158271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkksm\" (UniqueName: \"kubernetes.io/projected/d5930836-01ba-4c57-a932-bb717fa935b6-kube-api-access-hkksm\") pod \"payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n\" (UID: \"d5930836-01ba-4c57-a932-bb717fa935b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:54:42.259179 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.259144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5930836-01ba-4c57-a932-bb717fa935b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n\" (UID: \"d5930836-01ba-4c57-a932-bb717fa935b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:54:42.259396 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.259185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98e58a34-729f-449d-826b-f620e85b8de4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1b2859-84f6998448-cppr5\" (UID: \"98e58a34-729f-449d-826b-f620e85b8de4\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:54:42.259396 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.259209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9frq\" (UniqueName: \"kubernetes.io/projected/98e58a34-729f-449d-826b-f620e85b8de4-kube-api-access-k9frq\") pod \"payload-processing-e2e-api-b-1b2859-84f6998448-cppr5\" (UID: \"98e58a34-729f-449d-826b-f620e85b8de4\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:54:42.259396 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.259237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkksm\" (UniqueName: \"kubernetes.io/projected/d5930836-01ba-4c57-a932-bb717fa935b6-kube-api-access-hkksm\") pod \"payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n\" (UID: \"d5930836-01ba-4c57-a932-bb717fa935b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:54:42.259900 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.259875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5930836-01ba-4c57-a932-bb717fa935b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n\" (UID: \"d5930836-01ba-4c57-a932-bb717fa935b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:54:42.259997 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.259902    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98e58a34-729f-449d-826b-f620e85b8de4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1b2859-84f6998448-cppr5\" (UID: \"98e58a34-729f-449d-826b-f620e85b8de4\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:54:42.266552 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.266524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9frq\" (UniqueName: \"kubernetes.io/projected/98e58a34-729f-449d-826b-f620e85b8de4-kube-api-access-k9frq\") pod \"payload-processing-e2e-api-b-1b2859-84f6998448-cppr5\" (UID: \"98e58a34-729f-449d-826b-f620e85b8de4\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:54:42.266794 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.266780    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkksm\" (UniqueName: \"kubernetes.io/projected/d5930836-01ba-4c57-a932-bb717fa935b6-kube-api-access-hkksm\") pod \"payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n\" (UID: \"d5930836-01ba-4c57-a932-bb717fa935b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:54:42.373610 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.373578    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:54:42.394049 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.393988    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:54:42.550138 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.548717    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"]
Jul 28 04:54:42.550138 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:54:42.549338    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5930836_01ba_4c57_a932_bb717fa935b6.slice/crio-ee563d82461948c2ac440bb3670a3ee59d1e50e3509d48863f826154d48c1baf WatchSource:0}: Error finding container ee563d82461948c2ac440bb3670a3ee59d1e50e3509d48863f826154d48c1baf: Status 404 returned error can't find the container with id ee563d82461948c2ac440bb3670a3ee59d1e50e3509d48863f826154d48c1baf
Jul 28 04:54:42.575874 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.575845    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"]
Jul 28 04:54:42.576917 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:54:42.576888    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e58a34_729f_449d_826b_f620e85b8de4.slice/crio-200275b9763de3676dbfacf2609f80320562d6a1a865cdb34b36741c3770eea8 WatchSource:0}: Error finding container 200275b9763de3676dbfacf2609f80320562d6a1a865cdb34b36741c3770eea8: Status 404 returned error can't find the container with id 200275b9763de3676dbfacf2609f80320562d6a1a865cdb34b36741c3770eea8
Jul 28 04:54:42.588364 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.588335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n" event={"ID":"d5930836-01ba-4c57-a932-bb717fa935b6","Type":"ContainerStarted","Data":"ee563d82461948c2ac440bb3670a3ee59d1e50e3509d48863f826154d48c1baf"}
Jul 28 04:54:42.966324 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.966205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:42.969513 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:42.969487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls\") pod \"maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:43.090452 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.090414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:43.231365 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.231334    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"]
Jul 28 04:54:43.233985 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:54:43.233955    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98648848_e9cb_438a_b440_86ea45559869.slice/crio-6468a594e7f7aa91fa0def167bc04be3eb7bb49c95729c006584bba9a1afa93b WatchSource:0}: Error finding container 6468a594e7f7aa91fa0def167bc04be3eb7bb49c95729c006584bba9a1afa93b: Status 404 returned error can't find the container with id 6468a594e7f7aa91fa0def167bc04be3eb7bb49c95729c006584bba9a1afa93b
Jul 28 04:54:43.235552 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.235532    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 04:54:43.595502 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.595475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw" event={"ID":"98648848-e9cb-438a-b440-86ea45559869","Type":"ContainerStarted","Data":"6468a594e7f7aa91fa0def167bc04be3eb7bb49c95729c006584bba9a1afa93b"}
Jul 28 04:54:43.597094 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.597057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n" event={"ID":"d5930836-01ba-4c57-a932-bb717fa935b6","Type":"ContainerStarted","Data":"8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115"}
Jul 28 04:54:43.597219 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.597135    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:54:43.598796 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.598774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5" event={"ID":"98e58a34-729f-449d-826b-f620e85b8de4","Type":"ContainerStarted","Data":"b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe"}
Jul 28 04:54:43.598918 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.598817    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5" event={"ID":"98e58a34-729f-449d-826b-f620e85b8de4","Type":"ContainerStarted","Data":"200275b9763de3676dbfacf2609f80320562d6a1a865cdb34b36741c3770eea8"}
Jul 28 04:54:43.598918 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.598873    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:54:43.611485 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.611446    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n" podStartSLOduration=1.611434839 podStartE2EDuration="1.611434839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:54:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:54:43.610166379 +0000 UTC m=+2578.317648679" watchObservedRunningTime="2026-07-28 04:54:43.611434839 +0000 UTC m=+2578.318917140"
Jul 28 04:54:43.625928 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:43.625879    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5" podStartSLOduration=1.625860619 podStartE2EDuration="1.625860619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:54:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:54:43.622659369 +0000 UTC m=+2578.330141670" watchObservedRunningTime="2026-07-28 04:54:43.625860619 +0000 UTC m=+2578.333342923"
Jul 28 04:54:44.605644 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:44.605604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw" event={"ID":"98648848-e9cb-438a-b440-86ea45559869","Type":"ContainerStarted","Data":"fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4"}
Jul 28 04:54:44.606098 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:44.605740    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:44.621728 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:44.621680    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw" podStartSLOduration=3.279499781 podStartE2EDuration="3.621666316s" totalImagesPullingTime="342.166535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:54:44.619220186 +0000 UTC m=+2579.326702488" watchObservedRunningTime="2026-07-28 04:54:44.621666316 +0000 UTC m=+2579.329148616"
Jul 28 04:54:50.616944 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:50.616904    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:54:54.607647 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:54.607607    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:54:54.608048 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:54:54.607693    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:55:36.270721 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.270686    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"]
Jul 28 04:55:36.271261 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.270899    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw" podUID="98648848-e9cb-438a-b440-86ea45559869" containerName="maas-api" containerID="cri-o://fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4" gracePeriod=30
Jul 28 04:55:36.316168 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.315599    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"]
Jul 28 04:55:36.316168 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.315879    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5" podUID="98e58a34-729f-449d-826b-f620e85b8de4" containerName="payload-processing" containerID="cri-o://b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe" gracePeriod=30
Jul 28 04:55:36.323408 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.323374    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"]
Jul 28 04:55:36.323643 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.323611    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n" podUID="d5930836-01ba-4c57-a932-bb717fa935b6" containerName="payload-pre-processing" containerID="cri-o://8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115" gracePeriod=30
Jul 28 04:55:36.579931 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.579897    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:55:36.627259 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.627224    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:55:36.630752 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.630730    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:55:36.653695 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.653669    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98e58a34-729f-449d-826b-f620e85b8de4-plugins-config-volume\") pod \"98e58a34-729f-449d-826b-f620e85b8de4\" (UID: \"98e58a34-729f-449d-826b-f620e85b8de4\") "
Jul 28 04:55:36.653867 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.653709    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9frq\" (UniqueName: \"kubernetes.io/projected/98e58a34-729f-449d-826b-f620e85b8de4-kube-api-access-k9frq\") pod \"98e58a34-729f-449d-826b-f620e85b8de4\" (UID: \"98e58a34-729f-449d-826b-f620e85b8de4\") "
Jul 28 04:55:36.654083 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.654060    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98e58a34-729f-449d-826b-f620e85b8de4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98e58a34-729f-449d-826b-f620e85b8de4" (UID: "98e58a34-729f-449d-826b-f620e85b8de4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:55:36.655886 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.655864    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e58a34-729f-449d-826b-f620e85b8de4-kube-api-access-k9frq" (OuterVolumeSpecName: "kube-api-access-k9frq") pod "98e58a34-729f-449d-826b-f620e85b8de4" (UID: "98e58a34-729f-449d-826b-f620e85b8de4"). InnerVolumeSpecName "kube-api-access-k9frq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:55:36.755108 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.755069    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkksm\" (UniqueName: \"kubernetes.io/projected/d5930836-01ba-4c57-a932-bb717fa935b6-kube-api-access-hkksm\") pod \"d5930836-01ba-4c57-a932-bb717fa935b6\" (UID: \"d5930836-01ba-4c57-a932-bb717fa935b6\") "
Jul 28 04:55:36.755301 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.755147    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdphq\" (UniqueName: \"kubernetes.io/projected/98648848-e9cb-438a-b440-86ea45559869-kube-api-access-rdphq\") pod \"98648848-e9cb-438a-b440-86ea45559869\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") "
Jul 28 04:55:36.755301 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.755189    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5930836-01ba-4c57-a932-bb717fa935b6-plugins-config-volume\") pod \"d5930836-01ba-4c57-a932-bb717fa935b6\" (UID: \"d5930836-01ba-4c57-a932-bb717fa935b6\") "
Jul 28 04:55:36.755301 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.755250    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls\") pod \"98648848-e9cb-438a-b440-86ea45559869\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") "
Jul 28 04:55:36.755301 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.755290    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98648848-e9cb-438a-b440-86ea45559869-openshift-service-ca\") pod \"98648848-e9cb-438a-b440-86ea45559869\" (UID: \"98648848-e9cb-438a-b440-86ea45559869\") "
Jul 28 04:55:36.755586 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.755563    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9frq\" (UniqueName: \"kubernetes.io/projected/98e58a34-729f-449d-826b-f620e85b8de4-kube-api-access-k9frq\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:55:36.755586 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.755588    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98e58a34-729f-449d-826b-f620e85b8de4-plugins-config-volume\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:55:36.755948 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.755642    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5930836-01ba-4c57-a932-bb717fa935b6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d5930836-01ba-4c57-a932-bb717fa935b6" (UID: "d5930836-01ba-4c57-a932-bb717fa935b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:55:36.755948 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.755680    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98648848-e9cb-438a-b440-86ea45559869-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "98648848-e9cb-438a-b440-86ea45559869" (UID: "98648848-e9cb-438a-b440-86ea45559869"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 04:55:36.757405 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.757386    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5930836-01ba-4c57-a932-bb717fa935b6-kube-api-access-hkksm" (OuterVolumeSpecName: "kube-api-access-hkksm") pod "d5930836-01ba-4c57-a932-bb717fa935b6" (UID: "d5930836-01ba-4c57-a932-bb717fa935b6"). InnerVolumeSpecName "kube-api-access-hkksm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:55:36.757517 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.757501    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98648848-e9cb-438a-b440-86ea45559869-kube-api-access-rdphq" (OuterVolumeSpecName: "kube-api-access-rdphq") pod "98648848-e9cb-438a-b440-86ea45559869" (UID: "98648848-e9cb-438a-b440-86ea45559869"). InnerVolumeSpecName "kube-api-access-rdphq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 04:55:36.757562 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.757541    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "98648848-e9cb-438a-b440-86ea45559869" (UID: "98648848-e9cb-438a-b440-86ea45559869"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 04:55:36.856956 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.856868    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkksm\" (UniqueName: \"kubernetes.io/projected/d5930836-01ba-4c57-a932-bb717fa935b6-kube-api-access-hkksm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:55:36.856956 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.856901    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdphq\" (UniqueName: \"kubernetes.io/projected/98648848-e9cb-438a-b440-86ea45559869-kube-api-access-rdphq\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:55:36.856956 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.856915    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5930836-01ba-4c57-a932-bb717fa935b6-plugins-config-volume\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:55:36.856956 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.856930    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98648848-e9cb-438a-b440-86ea45559869-maas-api-tls\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:55:36.856956 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.856943    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98648848-e9cb-438a-b440-86ea45559869-openshift-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 04:55:36.902826 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.902787    2581 generic.go:356] "Generic (PLEG): container finished" podID="98648848-e9cb-438a-b440-86ea45559869" containerID="fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4" exitCode=0
Jul 28 04:55:36.902985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.902837    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"
Jul 28 04:55:36.902985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.902869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw" event={"ID":"98648848-e9cb-438a-b440-86ea45559869","Type":"ContainerDied","Data":"fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4"}
Jul 28 04:55:36.902985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.902926    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw" event={"ID":"98648848-e9cb-438a-b440-86ea45559869","Type":"ContainerDied","Data":"6468a594e7f7aa91fa0def167bc04be3eb7bb49c95729c006584bba9a1afa93b"}
Jul 28 04:55:36.902985 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.902956    2581 scope.go:117] "RemoveContainer" containerID="fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4"
Jul 28 04:55:36.904316 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.904294    2581 generic.go:356] "Generic (PLEG): container finished" podID="d5930836-01ba-4c57-a932-bb717fa935b6" containerID="8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115" exitCode=0
Jul 28 04:55:36.904434 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.904347    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"
Jul 28 04:55:36.904434 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.904398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n" event={"ID":"d5930836-01ba-4c57-a932-bb717fa935b6","Type":"ContainerDied","Data":"8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115"}
Jul 28 04:55:36.904548 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.904483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n" event={"ID":"d5930836-01ba-4c57-a932-bb717fa935b6","Type":"ContainerDied","Data":"ee563d82461948c2ac440bb3670a3ee59d1e50e3509d48863f826154d48c1baf"}
Jul 28 04:55:36.905770 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.905749    2581 generic.go:356] "Generic (PLEG): container finished" podID="98e58a34-729f-449d-826b-f620e85b8de4" containerID="b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe" exitCode=0
Jul 28 04:55:36.905896 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.905794    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"
Jul 28 04:55:36.905896 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.905833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5" event={"ID":"98e58a34-729f-449d-826b-f620e85b8de4","Type":"ContainerDied","Data":"b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe"}
Jul 28 04:55:36.905896 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.905869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5" event={"ID":"98e58a34-729f-449d-826b-f620e85b8de4","Type":"ContainerDied","Data":"200275b9763de3676dbfacf2609f80320562d6a1a865cdb34b36741c3770eea8"}
Jul 28 04:55:36.913103 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.913085    2581 scope.go:117] "RemoveContainer" containerID="fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4"
Jul 28 04:55:36.913440 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:55:36.913411    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4\": container with ID starting with fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4 not found: ID does not exist" containerID="fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4"
Jul 28 04:55:36.913531 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.913451    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4"} err="failed to get container status \"fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4\": rpc error: code = NotFound desc = could not find container \"fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4\": container with ID starting with fc14faae6375c31d9b171cfeffe705ad455c59ae797a4629a28183051211feb4 not found: ID does not exist"
Jul 28 04:55:36.913531 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.913477    2581 scope.go:117] "RemoveContainer" containerID="8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115"
Jul 28 04:55:36.922741 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.922725    2581 scope.go:117] "RemoveContainer" containerID="8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115"
Jul 28 04:55:36.922978 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:55:36.922960    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115\": container with ID starting with 8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115 not found: ID does not exist" containerID="8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115"
Jul 28 04:55:36.923020 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.922986    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115"} err="failed to get container status \"8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115\": rpc error: code = NotFound desc = could not find container \"8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115\": container with ID starting with 8e0a00c023432ca47afc9a28753f8b42cbef18613fd32af34b7ba815320c6115 not found: ID does not exist"
Jul 28 04:55:36.923020 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.923002    2581 scope.go:117] "RemoveContainer" containerID="b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe"
Jul 28 04:55:36.932636 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.932613    2581 scope.go:117] "RemoveContainer" containerID="b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe"
Jul 28 04:55:36.932930 ip-10-0-139-118 kubenswrapper[2581]: E0728 04:55:36.932908    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe\": container with ID starting with b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe not found: ID does not exist" containerID="b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe"
Jul 28 04:55:36.932984 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.932940    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe"} err="failed to get container status \"b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe\": rpc error: code = NotFound desc = could not find container \"b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe\": container with ID starting with b38923ba817b39cd762e044c8d1a8c2eb305caeb54748de827f3cb170a9873fe not found: ID does not exist"
Jul 28 04:55:36.933514 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.933496    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"]
Jul 28 04:55:36.938844 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.938821    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b2859-84f6998448-cppr5"]
Jul 28 04:55:36.948699 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.948675    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"]
Jul 28 04:55:36.952747 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.952728    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1b2859-6c69dcc8d4-g8dgw"]
Jul 28 04:55:36.961522 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.961502    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"]
Jul 28 04:55:36.965139 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:36.965117    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b2859-65f68d76b4-9cw9n"]
Jul 28 04:55:37.838839 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:37.838807    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98648848-e9cb-438a-b440-86ea45559869" path="/var/lib/kubelet/pods/98648848-e9cb-438a-b440-86ea45559869/volumes"
Jul 28 04:55:37.839224 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:37.839184    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98e58a34-729f-449d-826b-f620e85b8de4" path="/var/lib/kubelet/pods/98e58a34-729f-449d-826b-f620e85b8de4/volumes"
Jul 28 04:55:37.839495 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:37.839482    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5930836-01ba-4c57-a932-bb717fa935b6" path="/var/lib/kubelet/pods/d5930836-01ba-4c57-a932-bb717fa935b6/volumes"
Jul 28 04:55:56.694610 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.694578    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"]
Jul 28 04:55:56.695145 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.695126    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5930836-01ba-4c57-a932-bb717fa935b6" containerName="payload-pre-processing"
Jul 28 04:55:56.695226 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.695146    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5930836-01ba-4c57-a932-bb717fa935b6" containerName="payload-pre-processing"
Jul 28 04:55:56.695226 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.695173    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98648848-e9cb-438a-b440-86ea45559869" containerName="maas-api"
Jul 28 04:55:56.695226 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.695181    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="98648848-e9cb-438a-b440-86ea45559869" containerName="maas-api"
Jul 28 04:55:56.695226 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.695203    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e58a34-729f-449d-826b-f620e85b8de4" containerName="payload-processing"
Jul 28 04:55:56.695226 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.695213    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e58a34-729f-449d-826b-f620e85b8de4" containerName="payload-processing"
Jul 28 04:55:56.695469 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.695302    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e58a34-729f-449d-826b-f620e85b8de4" containerName="payload-processing"
Jul 28 04:55:56.695469 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.695313    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="98648848-e9cb-438a-b440-86ea45559869" containerName="maas-api"
Jul 28 04:55:56.695469 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.695323    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5930836-01ba-4c57-a932-bb717fa935b6" containerName="payload-pre-processing"
Jul 28 04:55:56.698426 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.698404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.700381 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.700355    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-92c557-openshift-default-dockercfg-2vq52\""
Jul 28 04:55:56.708916 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.708892    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"]
Jul 28 04:55:56.733787 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.733758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-data\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.733969 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.733799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-credential-socket\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.733969 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.733859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-envoy\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.733969 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.733889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-token\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.733969 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.733906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-podinfo\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.734224 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.733976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istiod-ca-cert\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.734224 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.733999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-socket\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.734224 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.734064    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-certs\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.734224 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.734087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr7cw\" (UniqueName: \"kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-kube-api-access-kr7cw\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835014 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.834970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istiod-ca-cert\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835014 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-socket\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835296 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-certs\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835296 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr7cw\" (UniqueName: \"kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-kube-api-access-kr7cw\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835407 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-data\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835407 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835398    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-credential-socket\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835519 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-socket\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835519 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835499    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-certs\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835519 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-envoy\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835669 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-token\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835669 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-podinfo\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835765 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835683    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-data\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835820 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-credential-socket\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.835820 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.835800    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istiod-ca-cert\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.837807 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.837783    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-envoy\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.838055 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.838015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-podinfo\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.842847 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.842817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-token\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:56.843293 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:56.843273    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr7cw\" (UniqueName: \"kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-kube-api-access-kr7cw\") pod \"e2e-shared-b-92c557-openshift-default-886956d48-9825n\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") " pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:57.009146 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:57.009108    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:57.158002 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:57.157941    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"]
Jul 28 04:55:57.159320 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:55:57.159286    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b7fc9f_f90a_4379_9cd8_ea1f7b05f984.slice/crio-a27bc149920ba167d35f9504167221df2444047737dfd322f6bf092ad663e46f WatchSource:0}: Error finding container a27bc149920ba167d35f9504167221df2444047737dfd322f6bf092ad663e46f: Status 404 returned error can't find the container with id a27bc149920ba167d35f9504167221df2444047737dfd322f6bf092ad663e46f
Jul 28 04:55:57.161338 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:57.161301    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:55:57.161439 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:57.161365    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:55:57.161439 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:57.161392    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:55:58.018545 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:58.018507    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" event={"ID":"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984","Type":"ContainerStarted","Data":"ab72840580618ce1c2ee3aee6a0fda205bf14d8be2017391043486c9ed29683d"}
Jul 28 04:55:58.019023 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:58.018564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" event={"ID":"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984","Type":"ContainerStarted","Data":"a27bc149920ba167d35f9504167221df2444047737dfd322f6bf092ad663e46f"}
Jul 28 04:55:58.039364 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:58.039300    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" podStartSLOduration=2.039277694 podStartE2EDuration="2.039277694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:55:58.036367928 +0000 UTC m=+2652.743850239" watchObservedRunningTime="2026-07-28 04:55:58.039277694 +0000 UTC m=+2652.746759995"
Jul 28 04:55:59.010182 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:59.010144    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:59.015136 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:59.015109    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:59.023806 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:59.023778    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:55:59.024708 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:55:59.024690    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:56:00.963800 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:00.963767    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"]
Jul 28 04:56:00.967490 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:00.967471    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 04:56:00.969298 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:00.969279    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-92c557\""
Jul 28 04:56:00.978654 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:00.978628    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"]
Jul 28 04:56:01.071133 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:01.071098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8982149a-4329-4eb8-a7f3-3f927e8fab76-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7\" (UID: \"8982149a-4329-4eb8-a7f3-3f927e8fab76\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 04:56:01.071363 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:01.071342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfgl8\" (UniqueName: \"kubernetes.io/projected/8982149a-4329-4eb8-a7f3-3f927e8fab76-kube-api-access-zfgl8\") pod \"payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7\" (UID: \"8982149a-4329-4eb8-a7f3-3f927e8fab76\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 04:56:01.172767 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:01.172722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8982149a-4329-4eb8-a7f3-3f927e8fab76-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7\" (UID: \"8982149a-4329-4eb8-a7f3-3f927e8fab76\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 04:56:01.172964 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:01.172798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfgl8\" (UniqueName: \"kubernetes.io/projected/8982149a-4329-4eb8-a7f3-3f927e8fab76-kube-api-access-zfgl8\") pod \"payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7\" (UID: \"8982149a-4329-4eb8-a7f3-3f927e8fab76\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 04:56:01.173438 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:01.173419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8982149a-4329-4eb8-a7f3-3f927e8fab76-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7\" (UID: \"8982149a-4329-4eb8-a7f3-3f927e8fab76\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 04:56:01.180120 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:01.180087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfgl8\" (UniqueName: \"kubernetes.io/projected/8982149a-4329-4eb8-a7f3-3f927e8fab76-kube-api-access-zfgl8\") pod \"payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7\" (UID: \"8982149a-4329-4eb8-a7f3-3f927e8fab76\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 04:56:01.279589 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:01.279555    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 04:56:01.420538 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:01.420506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"]
Jul 28 04:56:01.422283 ip-10-0-139-118 kubenswrapper[2581]: W0728 04:56:01.422245    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8982149a_4329_4eb8_a7f3_3f927e8fab76.slice/crio-bdedb8475b6cf92d84e55cb67319b4a25c2db04a39a04db869a0ad6e464fbf43 WatchSource:0}: Error finding container bdedb8475b6cf92d84e55cb67319b4a25c2db04a39a04db869a0ad6e464fbf43: Status 404 returned error can't find the container with id bdedb8475b6cf92d84e55cb67319b4a25c2db04a39a04db869a0ad6e464fbf43
Jul 28 04:56:02.042615 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:02.042578    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7" event={"ID":"8982149a-4329-4eb8-a7f3-3f927e8fab76","Type":"ContainerStarted","Data":"6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979"}
Jul 28 04:56:02.043129 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:02.042636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7" event={"ID":"8982149a-4329-4eb8-a7f3-3f927e8fab76","Type":"ContainerStarted","Data":"bdedb8475b6cf92d84e55cb67319b4a25c2db04a39a04db869a0ad6e464fbf43"}
Jul 28 04:56:02.043129 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:02.042797    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 04:56:02.057050 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:02.056995    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7" podStartSLOduration=2.05698047 podStartE2EDuration="2.05698047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 04:56:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 04:56:02.055619761 +0000 UTC m=+2656.763102062" watchObservedRunningTime="2026-07-28 04:56:02.05698047 +0000 UTC m=+2656.764462770"
Jul 28 04:56:13.050983 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:13.050945    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 04:56:15.066203 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:15.066164    2581 patch_prober.go:28] interesting pod/e2e-shared-b-92c557-openshift-default-886956d48-9825n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 04:56:15.066568 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:15.066240    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" podUID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 04:56:17.125780 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:17.125735    2581 generic.go:356] "Generic (PLEG): container finished" podID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerID="ab72840580618ce1c2ee3aee6a0fda205bf14d8be2017391043486c9ed29683d" exitCode=0
Jul 28 04:56:17.126295 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:17.125814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" event={"ID":"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984","Type":"ContainerDied","Data":"ab72840580618ce1c2ee3aee6a0fda205bf14d8be2017391043486c9ed29683d"}
Jul 28 04:56:17.126295 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:17.126274    2581 scope.go:117] "RemoveContainer" containerID="ab72840580618ce1c2ee3aee6a0fda205bf14d8be2017391043486c9ed29683d"
Jul 28 04:56:17.127433 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:17.127394    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:56:17.127533 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:17.127496    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:56:17.127580 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:17.127556    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 04:56:18.141489 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:18.141441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" event={"ID":"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984","Type":"ContainerStarted","Data":"6bd5b327e5661af4e9578a28468e3258441c82dc3e8b39e3312b56bef8209a03"}
Jul 28 04:56:19.009694 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:19.009655    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:56:19.009915 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:19.009892    2581 patch_prober.go:28] interesting pod/e2e-shared-b-92c557-openshift-default-886956d48-9825n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 28 04:56:19.010015 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:19.009996    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" podUID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 28 04:56:20.010022 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:20.009988    2581 patch_prober.go:28] interesting pod/e2e-shared-b-92c557-openshift-default-886956d48-9825n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 28 04:56:20.010427 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:20.010073    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" podUID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 28 04:56:21.009915 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:21.009878    2581 patch_prober.go:28] interesting pod/e2e-shared-b-92c557-openshift-default-886956d48-9825n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 28 04:56:21.010144 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:21.009934    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" podUID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 28 04:56:22.012984 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:22.012948    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:56:22.013390 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:22.013362    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:56:22.014028 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:22.014008    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 04:56:45.995187 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:45.995107    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 04:56:46.008105 ip-10-0-139-118 kubenswrapper[2581]: I0728 04:56:46.008077    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 05:01:46.035393 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:01:46.035365    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 05:01:46.049780 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:01:46.049757    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 05:04:57.665225 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:57.665185    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7574-140712837614896"]
Jul 28 05:04:57.668716 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:57.668698    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837614896"
Jul 28 05:04:57.670600 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:57.670577    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gmrc7\""
Jul 28 05:04:57.673125 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:57.673097    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140712837614896"]
Jul 28 05:04:57.745761 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:57.745726    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shrnn\" (UniqueName: \"kubernetes.io/projected/28ad0ca8-2292-4502-9c03-5a5b7ec38646-kube-api-access-shrnn\") pod \"test-curl-7574-140712837614896\" (UID: \"28ad0ca8-2292-4502-9c03-5a5b7ec38646\") " pod="opendatahub/test-curl-7574-140712837614896"
Jul 28 05:04:57.846924 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:57.846886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shrnn\" (UniqueName: \"kubernetes.io/projected/28ad0ca8-2292-4502-9c03-5a5b7ec38646-kube-api-access-shrnn\") pod \"test-curl-7574-140712837614896\" (UID: \"28ad0ca8-2292-4502-9c03-5a5b7ec38646\") " pod="opendatahub/test-curl-7574-140712837614896"
Jul 28 05:04:57.854606 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:57.854580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shrnn\" (UniqueName: \"kubernetes.io/projected/28ad0ca8-2292-4502-9c03-5a5b7ec38646-kube-api-access-shrnn\") pod \"test-curl-7574-140712837614896\" (UID: \"28ad0ca8-2292-4502-9c03-5a5b7ec38646\") " pod="opendatahub/test-curl-7574-140712837614896"
Jul 28 05:04:57.979642 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:57.979537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837614896"
Jul 28 05:04:58.115480 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:58.115452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140712837614896"]
Jul 28 05:04:58.116694 ip-10-0-139-118 kubenswrapper[2581]: W0728 05:04:58.116668    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28ad0ca8_2292_4502_9c03_5a5b7ec38646.slice/crio-ad2556a7d767fff0ee2d18c8bb3f5bdecea4849e221a28c98ea8c3390106f4a8 WatchSource:0}: Error finding container ad2556a7d767fff0ee2d18c8bb3f5bdecea4849e221a28c98ea8c3390106f4a8: Status 404 returned error can't find the container with id ad2556a7d767fff0ee2d18c8bb3f5bdecea4849e221a28c98ea8c3390106f4a8
Jul 28 05:04:58.118327 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:58.118305    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 05:04:58.941430 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:58.941400    2581 generic.go:356] "Generic (PLEG): container finished" podID="28ad0ca8-2292-4502-9c03-5a5b7ec38646" containerID="8116fb525ee1c097946c14db8e027788a4ed4a7d7d706d14b7eaff8329c5ef30" exitCode=0
Jul 28 05:04:58.941758 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:58.941480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140712837614896" event={"ID":"28ad0ca8-2292-4502-9c03-5a5b7ec38646","Type":"ContainerDied","Data":"8116fb525ee1c097946c14db8e027788a4ed4a7d7d706d14b7eaff8329c5ef30"}
Jul 28 05:04:58.941758 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:04:58.941523    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140712837614896" event={"ID":"28ad0ca8-2292-4502-9c03-5a5b7ec38646","Type":"ContainerStarted","Data":"ad2556a7d767fff0ee2d18c8bb3f5bdecea4849e221a28c98ea8c3390106f4a8"}
Jul 28 05:05:00.092295 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:00.092271    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837614896"
Jul 28 05:05:00.126457 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:00.126416    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7574-140712837614896_28ad0ca8-2292-4502-9c03-5a5b7ec38646/test-curl-7574-140712837614896/0.log"
Jul 28 05:05:00.151989 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:00.151957    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7574-140712837614896"]
Jul 28 05:05:00.154084 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:00.154061    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7574-140712837614896"]
Jul 28 05:05:00.167250 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:00.167227    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shrnn\" (UniqueName: \"kubernetes.io/projected/28ad0ca8-2292-4502-9c03-5a5b7ec38646-kube-api-access-shrnn\") pod \"28ad0ca8-2292-4502-9c03-5a5b7ec38646\" (UID: \"28ad0ca8-2292-4502-9c03-5a5b7ec38646\") "
Jul 28 05:05:00.169537 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:00.169513    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28ad0ca8-2292-4502-9c03-5a5b7ec38646-kube-api-access-shrnn" (OuterVolumeSpecName: "kube-api-access-shrnn") pod "28ad0ca8-2292-4502-9c03-5a5b7ec38646" (UID: "28ad0ca8-2292-4502-9c03-5a5b7ec38646"). InnerVolumeSpecName "kube-api-access-shrnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:05:00.268443 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:00.268406    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shrnn\" (UniqueName: \"kubernetes.io/projected/28ad0ca8-2292-4502-9c03-5a5b7ec38646-kube-api-access-shrnn\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:05:00.955371 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:00.955344    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad2556a7d767fff0ee2d18c8bb3f5bdecea4849e221a28c98ea8c3390106f4a8"
Jul 28 05:05:00.955544 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:00.955382    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837614896"
Jul 28 05:05:00.964609 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:05:00.964566    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7574-140712837614896\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="28ad0ca8-2292-4502-9c03-5a5b7ec38646" pod="opendatahub/test-curl-7574-140712837614896"
Jul 28 05:05:01.840136 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:01.840098    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28ad0ca8-2292-4502-9c03-5a5b7ec38646" path="/var/lib/kubelet/pods/28ad0ca8-2292-4502-9c03-5a5b7ec38646/volumes"
Jul 28 05:05:06.667117 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.667079    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7574-140712837499184"]
Jul 28 05:05:06.667535 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.667458    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ad0ca8-2292-4502-9c03-5a5b7ec38646" containerName="test-curl-7574-140712837614896"
Jul 28 05:05:06.667535 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.667469    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ad0ca8-2292-4502-9c03-5a5b7ec38646" containerName="test-curl-7574-140712837614896"
Jul 28 05:05:06.667535 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.667525    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ad0ca8-2292-4502-9c03-5a5b7ec38646" containerName="test-curl-7574-140712837614896"
Jul 28 05:05:06.670687 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.670670    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837499184"
Jul 28 05:05:06.672847 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.672819    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gmrc7\""
Jul 28 05:05:06.675712 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.675685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140712837499184"]
Jul 28 05:05:06.724175 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.724138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6624m\" (UniqueName: \"kubernetes.io/projected/954e4008-932c-4c5a-b100-8e3ed1e91d64-kube-api-access-6624m\") pod \"test-curl-7574-140712837499184\" (UID: \"954e4008-932c-4c5a-b100-8e3ed1e91d64\") " pod="opendatahub/test-curl-7574-140712837499184"
Jul 28 05:05:06.825321 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.825280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6624m\" (UniqueName: \"kubernetes.io/projected/954e4008-932c-4c5a-b100-8e3ed1e91d64-kube-api-access-6624m\") pod \"test-curl-7574-140712837499184\" (UID: \"954e4008-932c-4c5a-b100-8e3ed1e91d64\") " pod="opendatahub/test-curl-7574-140712837499184"
Jul 28 05:05:06.832985 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.832959    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6624m\" (UniqueName: \"kubernetes.io/projected/954e4008-932c-4c5a-b100-8e3ed1e91d64-kube-api-access-6624m\") pod \"test-curl-7574-140712837499184\" (UID: \"954e4008-932c-4c5a-b100-8e3ed1e91d64\") " pod="opendatahub/test-curl-7574-140712837499184"
Jul 28 05:05:06.981281 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:06.981190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837499184"
Jul 28 05:05:07.117082 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:07.117046    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140712837499184"]
Jul 28 05:05:07.120370 ip-10-0-139-118 kubenswrapper[2581]: W0728 05:05:07.120342    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod954e4008_932c_4c5a_b100_8e3ed1e91d64.slice/crio-9120194cdccb50d2e5cbed37935e65baf3226da387a5656e839a2d8744a17d38 WatchSource:0}: Error finding container 9120194cdccb50d2e5cbed37935e65baf3226da387a5656e839a2d8744a17d38: Status 404 returned error can't find the container with id 9120194cdccb50d2e5cbed37935e65baf3226da387a5656e839a2d8744a17d38
Jul 28 05:05:07.994109 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:07.994076    2581 generic.go:356] "Generic (PLEG): container finished" podID="954e4008-932c-4c5a-b100-8e3ed1e91d64" containerID="2cdb0a6ee6d8d662c7c1e530479476024fdff285c2aa28190cf08c7d0e96098d" exitCode=0
Jul 28 05:05:07.994457 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:07.994150    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140712837499184" event={"ID":"954e4008-932c-4c5a-b100-8e3ed1e91d64","Type":"ContainerDied","Data":"2cdb0a6ee6d8d662c7c1e530479476024fdff285c2aa28190cf08c7d0e96098d"}
Jul 28 05:05:07.994457 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:07.994177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140712837499184" event={"ID":"954e4008-932c-4c5a-b100-8e3ed1e91d64","Type":"ContainerStarted","Data":"9120194cdccb50d2e5cbed37935e65baf3226da387a5656e839a2d8744a17d38"}
Jul 28 05:05:09.139542 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.139513    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837499184"
Jul 28 05:05:09.158444 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.158412    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7574-140712837499184_954e4008-932c-4c5a-b100-8e3ed1e91d64/test-curl-7574-140712837499184/0.log"
Jul 28 05:05:09.185311 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.185276    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7574-140712837499184"]
Jul 28 05:05:09.188692 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.188666    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7574-140712837499184"]
Jul 28 05:05:09.248490 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.248456    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6624m\" (UniqueName: \"kubernetes.io/projected/954e4008-932c-4c5a-b100-8e3ed1e91d64-kube-api-access-6624m\") pod \"954e4008-932c-4c5a-b100-8e3ed1e91d64\" (UID: \"954e4008-932c-4c5a-b100-8e3ed1e91d64\") "
Jul 28 05:05:09.250744 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.250688    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/954e4008-932c-4c5a-b100-8e3ed1e91d64-kube-api-access-6624m" (OuterVolumeSpecName: "kube-api-access-6624m") pod "954e4008-932c-4c5a-b100-8e3ed1e91d64" (UID: "954e4008-932c-4c5a-b100-8e3ed1e91d64"). InnerVolumeSpecName "kube-api-access-6624m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:05:09.324578 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.324546    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7574-140712837500768"]
Jul 28 05:05:09.325130 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.325112    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954e4008-932c-4c5a-b100-8e3ed1e91d64" containerName="test-curl-7574-140712837499184"
Jul 28 05:05:09.325215 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.325133    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="954e4008-932c-4c5a-b100-8e3ed1e91d64" containerName="test-curl-7574-140712837499184"
Jul 28 05:05:09.325268 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.325218    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="954e4008-932c-4c5a-b100-8e3ed1e91d64" containerName="test-curl-7574-140712837499184"
Jul 28 05:05:09.328933 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.328912    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837500768"
Jul 28 05:05:09.331471 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.331451    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140712837500768"]
Jul 28 05:05:09.350124 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.350100    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6624m\" (UniqueName: \"kubernetes.io/projected/954e4008-932c-4c5a-b100-8e3ed1e91d64-kube-api-access-6624m\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:05:09.450908 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.450874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckpn9\" (UniqueName: \"kubernetes.io/projected/a232404b-f648-4b55-891b-568a56246a1d-kube-api-access-ckpn9\") pod \"test-curl-7574-140712837500768\" (UID: \"a232404b-f648-4b55-891b-568a56246a1d\") " pod="opendatahub/test-curl-7574-140712837500768"
Jul 28 05:05:09.552338 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.552251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckpn9\" (UniqueName: \"kubernetes.io/projected/a232404b-f648-4b55-891b-568a56246a1d-kube-api-access-ckpn9\") pod \"test-curl-7574-140712837500768\" (UID: \"a232404b-f648-4b55-891b-568a56246a1d\") " pod="opendatahub/test-curl-7574-140712837500768"
Jul 28 05:05:09.559975 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.559954    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckpn9\" (UniqueName: \"kubernetes.io/projected/a232404b-f648-4b55-891b-568a56246a1d-kube-api-access-ckpn9\") pod \"test-curl-7574-140712837500768\" (UID: \"a232404b-f648-4b55-891b-568a56246a1d\") " pod="opendatahub/test-curl-7574-140712837500768"
Jul 28 05:05:09.640056 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.640007    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837500768"
Jul 28 05:05:09.776467 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.776439    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140712837500768"]
Jul 28 05:05:09.779245 ip-10-0-139-118 kubenswrapper[2581]: W0728 05:05:09.779214    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda232404b_f648_4b55_891b_568a56246a1d.slice/crio-8dead143794117fe4142655fa0358fdf028805bf659394656253dca50ab16fb0 WatchSource:0}: Error finding container 8dead143794117fe4142655fa0358fdf028805bf659394656253dca50ab16fb0: Status 404 returned error can't find the container with id 8dead143794117fe4142655fa0358fdf028805bf659394656253dca50ab16fb0
Jul 28 05:05:09.841759 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:09.841711    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="954e4008-932c-4c5a-b100-8e3ed1e91d64" path="/var/lib/kubelet/pods/954e4008-932c-4c5a-b100-8e3ed1e91d64/volumes"
Jul 28 05:05:10.006126 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:10.006093    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837499184"
Jul 28 05:05:10.006126 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:10.006117    2581 scope.go:117] "RemoveContainer" containerID="2cdb0a6ee6d8d662c7c1e530479476024fdff285c2aa28190cf08c7d0e96098d"
Jul 28 05:05:10.007549 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:10.007427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140712837500768" event={"ID":"a232404b-f648-4b55-891b-568a56246a1d","Type":"ContainerStarted","Data":"8dead143794117fe4142655fa0358fdf028805bf659394656253dca50ab16fb0"}
Jul 28 05:05:11.015119 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:11.015084    2581 generic.go:356] "Generic (PLEG): container finished" podID="a232404b-f648-4b55-891b-568a56246a1d" containerID="01dc3b6094ea5f805ce919dacf99966f2d68eb8456e8700279cfedc825537525" exitCode=0
Jul 28 05:05:11.015585 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:11.015179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140712837500768" event={"ID":"a232404b-f648-4b55-891b-568a56246a1d","Type":"ContainerDied","Data":"01dc3b6094ea5f805ce919dacf99966f2d68eb8456e8700279cfedc825537525"}
Jul 28 05:05:12.168935 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:12.168909    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837500768"
Jul 28 05:05:12.188873 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:12.188845    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7574-140712837500768_a232404b-f648-4b55-891b-568a56246a1d/test-curl-7574-140712837500768/0.log"
Jul 28 05:05:12.215247 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:12.215210    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7574-140712837500768"]
Jul 28 05:05:12.218853 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:12.218814    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7574-140712837500768"]
Jul 28 05:05:12.278098 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:12.277981    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckpn9\" (UniqueName: \"kubernetes.io/projected/a232404b-f648-4b55-891b-568a56246a1d-kube-api-access-ckpn9\") pod \"a232404b-f648-4b55-891b-568a56246a1d\" (UID: \"a232404b-f648-4b55-891b-568a56246a1d\") "
Jul 28 05:05:12.280272 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:12.280248    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a232404b-f648-4b55-891b-568a56246a1d-kube-api-access-ckpn9" (OuterVolumeSpecName: "kube-api-access-ckpn9") pod "a232404b-f648-4b55-891b-568a56246a1d" (UID: "a232404b-f648-4b55-891b-568a56246a1d"). InnerVolumeSpecName "kube-api-access-ckpn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:05:12.378732 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:12.378695    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckpn9\" (UniqueName: \"kubernetes.io/projected/a232404b-f648-4b55-891b-568a56246a1d-kube-api-access-ckpn9\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:05:13.028650 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:13.028618    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140712837500768"
Jul 28 05:05:13.028834 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:13.028665    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8dead143794117fe4142655fa0358fdf028805bf659394656253dca50ab16fb0"
Jul 28 05:05:13.038445 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:05:13.038414    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7574-140712837500768\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="a232404b-f648-4b55-891b-568a56246a1d" pod="opendatahub/test-curl-7574-140712837500768"
Jul 28 05:05:13.838797 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:13.838762    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a232404b-f648-4b55-891b-568a56246a1d" path="/var/lib/kubelet/pods/a232404b-f648-4b55-891b-568a56246a1d/volumes"
Jul 28 05:05:18.516889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.516847    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"]
Jul 28 05:05:18.518009 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.517977    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a232404b-f648-4b55-891b-568a56246a1d" containerName="test-curl-7574-140712837500768"
Jul 28 05:05:18.518122 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.518012    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a232404b-f648-4b55-891b-568a56246a1d" containerName="test-curl-7574-140712837500768"
Jul 28 05:05:18.518183 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.518168    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a232404b-f648-4b55-891b-568a56246a1d" containerName="test-curl-7574-140712837500768"
Jul 28 05:05:18.521889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.521865    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.523983 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.523965    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-dc1efb-serving-cert\""
Jul 28 05:05:18.529415 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.529380    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"]
Jul 28 05:05:18.636564 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.636524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcxpp\" (UniqueName: \"kubernetes.io/projected/9264f902-6965-40e4-8b0c-e8edb7f31400-kube-api-access-bcxpp\") pod \"maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.636760 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.636588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9264f902-6965-40e4-8b0c-e8edb7f31400-maas-api-tls\") pod \"maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.636760 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.636689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9264f902-6965-40e4-8b0c-e8edb7f31400-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.737310 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.737275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9264f902-6965-40e4-8b0c-e8edb7f31400-maas-api-tls\") pod \"maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.737476 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.737319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9264f902-6965-40e4-8b0c-e8edb7f31400-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.737476 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.737379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcxpp\" (UniqueName: \"kubernetes.io/projected/9264f902-6965-40e4-8b0c-e8edb7f31400-kube-api-access-bcxpp\") pod \"maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.738071 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.738046    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9264f902-6965-40e4-8b0c-e8edb7f31400-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.739787 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.739761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9264f902-6965-40e4-8b0c-e8edb7f31400-maas-api-tls\") pod \"maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.744879 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.744853    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcxpp\" (UniqueName: \"kubernetes.io/projected/9264f902-6965-40e4-8b0c-e8edb7f31400-kube-api-access-bcxpp\") pod \"maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.837679 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.837592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:18.977014 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:18.976990    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"]
Jul 28 05:05:18.979022 ip-10-0-139-118 kubenswrapper[2581]: W0728 05:05:18.978995    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9264f902_6965_40e4_8b0c_e8edb7f31400.slice/crio-fcd66a928895be9df84b37d41b5dd2147b91d5b609a2765dca5c6512566dcd49 WatchSource:0}: Error finding container fcd66a928895be9df84b37d41b5dd2147b91d5b609a2765dca5c6512566dcd49: Status 404 returned error can't find the container with id fcd66a928895be9df84b37d41b5dd2147b91d5b609a2765dca5c6512566dcd49
Jul 28 05:05:19.063225 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.063191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv" event={"ID":"9264f902-6965-40e4-8b0c-e8edb7f31400","Type":"ContainerStarted","Data":"fcd66a928895be9df84b37d41b5dd2147b91d5b609a2765dca5c6512566dcd49"}
Jul 28 05:05:19.285541 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.285504    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"]
Jul 28 05:05:19.290353 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.290329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:05:19.292480 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.292461    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-dc1efb\""
Jul 28 05:05:19.292592 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.292530    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-dc1efb-dockercfg-7tcpk\""
Jul 28 05:05:19.299837 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.299777    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"]
Jul 28 05:05:19.443958 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.443931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p\" (UID: \"d8409371-78bc-4e2c-b4c8-087b4ff7dde6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:05:19.444069 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.443997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqpvl\" (UniqueName: \"kubernetes.io/projected/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-kube-api-access-hqpvl\") pod \"payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p\" (UID: \"d8409371-78bc-4e2c-b4c8-087b4ff7dde6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:05:19.545097 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.545012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p\" (UID: \"d8409371-78bc-4e2c-b4c8-087b4ff7dde6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:05:19.545097 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.545078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpvl\" (UniqueName: \"kubernetes.io/projected/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-kube-api-access-hqpvl\") pod \"payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p\" (UID: \"d8409371-78bc-4e2c-b4c8-087b4ff7dde6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:05:19.545765 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.545741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p\" (UID: \"d8409371-78bc-4e2c-b4c8-087b4ff7dde6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:05:19.553678 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.553654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqpvl\" (UniqueName: \"kubernetes.io/projected/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-kube-api-access-hqpvl\") pod \"payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p\" (UID: \"d8409371-78bc-4e2c-b4c8-087b4ff7dde6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:05:19.602290 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.602253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:05:19.947560 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:19.947534    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"]
Jul 28 05:05:19.949323 ip-10-0-139-118 kubenswrapper[2581]: W0728 05:05:19.949294    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8409371_78bc_4e2c_b4c8_087b4ff7dde6.slice/crio-90d2ab7716dd5a0ffbf7e46e12e14b936e09a12f383d220c12552b276086931b WatchSource:0}: Error finding container 90d2ab7716dd5a0ffbf7e46e12e14b936e09a12f383d220c12552b276086931b: Status 404 returned error can't find the container with id 90d2ab7716dd5a0ffbf7e46e12e14b936e09a12f383d220c12552b276086931b
Jul 28 05:05:20.069946 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:20.069913    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv" event={"ID":"9264f902-6965-40e4-8b0c-e8edb7f31400","Type":"ContainerStarted","Data":"33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953"}
Jul 28 05:05:20.070153 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:20.069981    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:20.071504 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:20.071470    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p" event={"ID":"d8409371-78bc-4e2c-b4c8-087b4ff7dde6","Type":"ContainerStarted","Data":"dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901"}
Jul 28 05:05:20.071629 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:20.071512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p" event={"ID":"d8409371-78bc-4e2c-b4c8-087b4ff7dde6","Type":"ContainerStarted","Data":"90d2ab7716dd5a0ffbf7e46e12e14b936e09a12f383d220c12552b276086931b"}
Jul 28 05:05:20.071629 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:20.071588    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:05:20.087634 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:20.087590    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv" podStartSLOduration=1.641226581 podStartE2EDuration="2.087576901s" totalImagesPullingTime="446.35032ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 05:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 05:05:20.08410608 +0000 UTC m=+3214.791588381" watchObservedRunningTime="2026-07-28 05:05:20.087576901 +0000 UTC m=+3214.795059202"
Jul 28 05:05:20.098715 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:20.098659    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p" podStartSLOduration=1.09864092 podStartE2EDuration="1.09864092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 05:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 05:05:20.098182819 +0000 UTC m=+3214.805665121" watchObservedRunningTime="2026-07-28 05:05:20.09864092 +0000 UTC m=+3214.806123225"
Jul 28 05:05:26.083307 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:26.083276    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:05:31.080096 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:31.080060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:05:34.270520 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.270484    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"]
Jul 28 05:05:34.276578 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.276544    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.278565 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.278542    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-9b749c-openshift-default-dockercfg-zbfhh\""
Jul 28 05:05:34.283690 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.283666    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"]
Jul 28 05:05:34.392653 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.392599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5432cc78-2732-42f5-8ac3-3b003e8738b2-istiod-ca-cert\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.392937 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.392643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp6zs\" (UniqueName: \"kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-kube-api-access-jp6zs\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.392937 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.392876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-envoy\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.392937 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.392902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-token\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.393272 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.392958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-podinfo\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.393272 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.392991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-certs\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.393272 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.393027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-socket\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.393272 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.393135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-credential-socket\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.393272 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.393166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-data\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.493806 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.493755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-credential-socket\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494018 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.493814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-data\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494018 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.493878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5432cc78-2732-42f5-8ac3-3b003e8738b2-istiod-ca-cert\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494018 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.493904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp6zs\" (UniqueName: \"kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-kube-api-access-jp6zs\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494018 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.493963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-envoy\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494018 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.493986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-token\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494365 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.494073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-podinfo\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494365 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.494108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-certs\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494365 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.494145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-socket\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494365 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.494292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-credential-socket\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494591 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.494389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-data\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494591 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.494489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-socket\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494591 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.494552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-certs\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.494712 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.494628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5432cc78-2732-42f5-8ac3-3b003e8738b2-istiod-ca-cert\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.496515 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.496489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-envoy\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.496627 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.496585    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-podinfo\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.501782 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.501756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-token\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.501989 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.501972    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp6zs\" (UniqueName: \"kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-kube-api-access-jp6zs\") pod \"e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") " pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.588887 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.588811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:34.739203 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.739178    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"]
Jul 28 05:05:34.741065 ip-10-0-139-118 kubenswrapper[2581]: W0728 05:05:34.741018    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5432cc78_2732_42f5_8ac3_3b003e8738b2.slice/crio-e75add6e852c63482fe6a61a3ad1b5c07626a789aed793fcc8c613491b11885b WatchSource:0}: Error finding container e75add6e852c63482fe6a61a3ad1b5c07626a789aed793fcc8c613491b11885b: Status 404 returned error can't find the container with id e75add6e852c63482fe6a61a3ad1b5c07626a789aed793fcc8c613491b11885b
Jul 28 05:05:34.743434 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.743400    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 05:05:34.743537 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.743485    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 05:05:34.743537 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:34.743527    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 05:05:35.163001 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:35.162964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" event={"ID":"5432cc78-2732-42f5-8ac3-3b003e8738b2","Type":"ContainerStarted","Data":"84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246"}
Jul 28 05:05:35.163214 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:35.163028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" event={"ID":"5432cc78-2732-42f5-8ac3-3b003e8738b2","Type":"ContainerStarted","Data":"e75add6e852c63482fe6a61a3ad1b5c07626a789aed793fcc8c613491b11885b"}
Jul 28 05:05:35.182856 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:35.182803    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" podStartSLOduration=1.1827879860000001 podStartE2EDuration="1.182787986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 05:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 05:05:35.180578343 +0000 UTC m=+3229.888060643" watchObservedRunningTime="2026-07-28 05:05:35.182787986 +0000 UTC m=+3229.890270286"
Jul 28 05:05:35.589844 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:35.589807    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:35.595125 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:35.595100    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:36.169338 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:36.169307    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:36.170179 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:36.170158    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:37.374613 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.374579    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"]
Jul 28 05:05:37.378476 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.378454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:37.380310 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.380281    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-9b749c-serving-cert\""
Jul 28 05:05:37.386216 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.386194    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"]
Jul 28 05:05:37.421385 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.421350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060ebafb-531e-44f4-a675-ddb2d0dedd28-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:37.421556 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.421395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qwj5\" (UniqueName: \"kubernetes.io/projected/060ebafb-531e-44f4-a675-ddb2d0dedd28-kube-api-access-9qwj5\") pod \"maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:37.421556 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.421469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/060ebafb-531e-44f4-a675-ddb2d0dedd28-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:37.522842 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.522807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060ebafb-531e-44f4-a675-ddb2d0dedd28-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:37.523052 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.522852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qwj5\" (UniqueName: \"kubernetes.io/projected/060ebafb-531e-44f4-a675-ddb2d0dedd28-kube-api-access-9qwj5\") pod \"maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:37.523052 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.522898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/060ebafb-531e-44f4-a675-ddb2d0dedd28-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:37.523052 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:05:37.522988    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-serving-cert: secret "maas-api-e2e-ipp-b-9b749c-serving-cert" not found
Jul 28 05:05:37.523176 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:05:37.523114    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/060ebafb-531e-44f4-a675-ddb2d0dedd28-maas-api-tls podName:060ebafb-531e-44f4-a675-ddb2d0dedd28 nodeName:}" failed. No retries permitted until 2026-07-28 05:05:38.023089133 +0000 UTC m=+3232.730571427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/060ebafb-531e-44f4-a675-ddb2d0dedd28-maas-api-tls") pod "maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9" (UID: "060ebafb-531e-44f4-a675-ddb2d0dedd28") : secret "maas-api-e2e-ipp-b-9b749c-serving-cert" not found
Jul 28 05:05:37.523656 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.523638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/060ebafb-531e-44f4-a675-ddb2d0dedd28-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:37.535711 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:37.535682    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qwj5\" (UniqueName: \"kubernetes.io/projected/060ebafb-531e-44f4-a675-ddb2d0dedd28-kube-api-access-9qwj5\") pod \"maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:38.028062 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:38.028005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060ebafb-531e-44f4-a675-ddb2d0dedd28-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:38.030704 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:38.030674    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060ebafb-531e-44f4-a675-ddb2d0dedd28-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:38.295681 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:38.293199    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:38.443850 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:38.443823    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"]
Jul 28 05:05:38.445952 ip-10-0-139-118 kubenswrapper[2581]: W0728 05:05:38.445925    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060ebafb_531e_44f4_a675_ddb2d0dedd28.slice/crio-be23901b0427defcbe224257b3c6f3e7328ea7d47c9875bd24a5b1721f96cd0e WatchSource:0}: Error finding container be23901b0427defcbe224257b3c6f3e7328ea7d47c9875bd24a5b1721f96cd0e: Status 404 returned error can't find the container with id be23901b0427defcbe224257b3c6f3e7328ea7d47c9875bd24a5b1721f96cd0e
Jul 28 05:05:39.194524 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:39.194424    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9" event={"ID":"060ebafb-531e-44f4-a675-ddb2d0dedd28","Type":"ContainerStarted","Data":"3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b"}
Jul 28 05:05:39.194524 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:39.194519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9" event={"ID":"060ebafb-531e-44f4-a675-ddb2d0dedd28","Type":"ContainerStarted","Data":"be23901b0427defcbe224257b3c6f3e7328ea7d47c9875bd24a5b1721f96cd0e"}
Jul 28 05:05:39.194731 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:39.194547    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:39.217388 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:39.217329    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9" podStartSLOduration=1.886398276 podStartE2EDuration="2.217314715s" totalImagesPullingTime="330.916439ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 05:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 05:05:39.214353297 +0000 UTC m=+3233.921835597" watchObservedRunningTime="2026-07-28 05:05:39.217314715 +0000 UTC m=+3233.924797016"
Jul 28 05:05:45.204830 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:45.204799    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:05:55.291593 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:55.291558    2581 generic.go:356] "Generic (PLEG): container finished" podID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerID="84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246" exitCode=0
Jul 28 05:05:55.292061 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:55.291646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" event={"ID":"5432cc78-2732-42f5-8ac3-3b003e8738b2","Type":"ContainerDied","Data":"84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246"}
Jul 28 05:05:55.292199 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:55.292182    2581 scope.go:117] "RemoveContainer" containerID="84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246"
Jul 28 05:05:55.293357 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:55.293322    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 05:05:55.293452 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:55.293397    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 05:05:55.293452 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:55.293428    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 28 05:05:56.298615 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:56.298577    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" event={"ID":"5432cc78-2732-42f5-8ac3-3b003e8738b2","Type":"ContainerStarted","Data":"86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a"}
Jul 28 05:05:56.590003 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:56.589902    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:05:56.590270 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:56.590194    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 05:05:56.590342 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:56.590286    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 05:05:57.589803 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:57.589764    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 05:05:57.590328 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:57.589842    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 05:05:58.590101 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:58.590058    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 05:05:58.590581 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:58.590122    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 05:05:59.122218 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:59.122188    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-jsgww_8c6345ca-f31a-4de2-aca7-e32e2ff815d5/payload-processing/0.log"
Jul 28 05:05:59.590122 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:59.590084    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 05:05:59.590510 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:05:59.590138    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 05:06:00.592912 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:06:00.592874    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:06:00.593373 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:06:00.593354    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:06:00.594095 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:06:00.594079    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:06:46.076767 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:06:46.076736    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 05:06:46.089205 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:06:46.089182    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pggtj_7101fac5-991a-47d3-b2be-bdcde548d303/ovn-acl-logging/0.log"
Jul 28 05:06:56.772314 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:06:56.772274    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-jsgww_8c6345ca-f31a-4de2-aca7-e32e2ff815d5/payload-processing/0.log"
Jul 28 05:07:01.175256 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.175214    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"]
Jul 28 05:07:01.179393 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.179370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.182271 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.182243    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-29b6e5-serving-cert\""
Jul 28 05:07:01.186924 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.186896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"]
Jul 28 05:07:01.217112 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.217084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e84a7754-f20d-4576-855c-f6834c366de0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.217284 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.217121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h8qc\" (UniqueName: \"kubernetes.io/projected/e84a7754-f20d-4576-855c-f6834c366de0-kube-api-access-8h8qc\") pod \"maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.217284 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.217229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e84a7754-f20d-4576-855c-f6834c366de0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.317926 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.317866    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e84a7754-f20d-4576-855c-f6834c366de0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.317926 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.317924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h8qc\" (UniqueName: \"kubernetes.io/projected/e84a7754-f20d-4576-855c-f6834c366de0-kube-api-access-8h8qc\") pod \"maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.318261 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.317982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e84a7754-f20d-4576-855c-f6834c366de0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.318681 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.318659    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e84a7754-f20d-4576-855c-f6834c366de0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.320497 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.320473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e84a7754-f20d-4576-855c-f6834c366de0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.327626 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.327603    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h8qc\" (UniqueName: \"kubernetes.io/projected/e84a7754-f20d-4576-855c-f6834c366de0-kube-api-access-8h8qc\") pod \"maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.493845 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.493812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:01.634053 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.634006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"]
Jul 28 05:07:01.636602 ip-10-0-139-118 kubenswrapper[2581]: W0728 05:07:01.636571    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode84a7754_f20d_4576_855c_f6834c366de0.slice/crio-0c13d706ae8f4407d97a5b21826d19e2efacfd81ca9356c3dcb1e4aab18fc8a9 WatchSource:0}: Error finding container 0c13d706ae8f4407d97a5b21826d19e2efacfd81ca9356c3dcb1e4aab18fc8a9: Status 404 returned error can't find the container with id 0c13d706ae8f4407d97a5b21826d19e2efacfd81ca9356c3dcb1e4aab18fc8a9
Jul 28 05:07:01.677499 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.677464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c" event={"ID":"e84a7754-f20d-4576-855c-f6834c366de0","Type":"ContainerStarted","Data":"0c13d706ae8f4407d97a5b21826d19e2efacfd81ca9356c3dcb1e4aab18fc8a9"}
Jul 28 05:07:01.960495 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.960390    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"]
Jul 28 05:07:01.968681 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.968647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:01.971303 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.971264    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-29b6e5-dockercfg-rqmm5\""
Jul 28 05:07:01.971488 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.971468    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-29b6e5\""
Jul 28 05:07:01.973144 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:01.973107    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"]
Jul 28 05:07:02.026531 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.026483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf9vp\" (UniqueName: \"kubernetes.io/projected/232c9044-f327-42c2-95de-18592e9fac5b-kube-api-access-xf9vp\") pod \"payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5\" (UID: \"232c9044-f327-42c2-95de-18592e9fac5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:02.026704 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.026589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/232c9044-f327-42c2-95de-18592e9fac5b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5\" (UID: \"232c9044-f327-42c2-95de-18592e9fac5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:02.127956 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.127912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf9vp\" (UniqueName: \"kubernetes.io/projected/232c9044-f327-42c2-95de-18592e9fac5b-kube-api-access-xf9vp\") pod \"payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5\" (UID: \"232c9044-f327-42c2-95de-18592e9fac5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:02.128192 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.127975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/232c9044-f327-42c2-95de-18592e9fac5b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5\" (UID: \"232c9044-f327-42c2-95de-18592e9fac5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:02.128666 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.128643    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/232c9044-f327-42c2-95de-18592e9fac5b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5\" (UID: \"232c9044-f327-42c2-95de-18592e9fac5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:02.136340 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.136316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf9vp\" (UniqueName: \"kubernetes.io/projected/232c9044-f327-42c2-95de-18592e9fac5b-kube-api-access-xf9vp\") pod \"payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5\" (UID: \"232c9044-f327-42c2-95de-18592e9fac5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:02.282497 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.282471    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:02.433004 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.432977    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"]
Jul 28 05:07:02.435811 ip-10-0-139-118 kubenswrapper[2581]: W0728 05:07:02.435782    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232c9044_f327_42c2_95de_18592e9fac5b.slice/crio-7ef32bc6778e988505a4d54821afde4e30e42eabd3ae6d73627c0ba2daf49c44 WatchSource:0}: Error finding container 7ef32bc6778e988505a4d54821afde4e30e42eabd3ae6d73627c0ba2daf49c44: Status 404 returned error can't find the container with id 7ef32bc6778e988505a4d54821afde4e30e42eabd3ae6d73627c0ba2daf49c44
Jul 28 05:07:02.685395 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.685346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c" event={"ID":"e84a7754-f20d-4576-855c-f6834c366de0","Type":"ContainerStarted","Data":"77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8"}
Jul 28 05:07:02.685616 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.685497    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:02.687012 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.686988    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5" event={"ID":"232c9044-f327-42c2-95de-18592e9fac5b","Type":"ContainerStarted","Data":"47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840"}
Jul 28 05:07:02.687150 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.687027    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5" event={"ID":"232c9044-f327-42c2-95de-18592e9fac5b","Type":"ContainerStarted","Data":"7ef32bc6778e988505a4d54821afde4e30e42eabd3ae6d73627c0ba2daf49c44"}
Jul 28 05:07:02.687150 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.687097    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:02.704688 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.704636    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c" podStartSLOduration=1.146805448 podStartE2EDuration="1.704620613s" totalImagesPullingTime="557.815165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 05:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 05:07:02.702526641 +0000 UTC m=+3317.410008943" watchObservedRunningTime="2026-07-28 05:07:02.704620613 +0000 UTC m=+3317.412102913"
Jul 28 05:07:02.719451 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:02.719396    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5" podStartSLOduration=1.719380167 podStartE2EDuration="1.719380167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 05:07:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 05:07:02.716933538 +0000 UTC m=+3317.424415840" watchObservedRunningTime="2026-07-28 05:07:02.719380167 +0000 UTC m=+3317.426862465"
Jul 28 05:07:08.699065 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:08.698978    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:13.694660 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:13.694626    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:27.030184 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.030145    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"]
Jul 28 05:07:27.030733 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.030450    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c" podUID="e84a7754-f20d-4576-855c-f6834c366de0" containerName="maas-api" containerID="cri-o://77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8" gracePeriod=30
Jul 28 05:07:27.107540 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.107502    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"]
Jul 28 05:07:27.107840 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.107784    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5" podUID="232c9044-f327-42c2-95de-18592e9fac5b" containerName="payload-pre-processing" containerID="cri-o://47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840" gracePeriod=30
Jul 28 05:07:27.375540 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.375514    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:27.405661 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.405635    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:27.459644 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.459605    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e84a7754-f20d-4576-855c-f6834c366de0-openshift-service-ca\") pod \"e84a7754-f20d-4576-855c-f6834c366de0\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") "
Jul 28 05:07:27.459644 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.459644    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e84a7754-f20d-4576-855c-f6834c366de0-maas-api-tls\") pod \"e84a7754-f20d-4576-855c-f6834c366de0\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") "
Jul 28 05:07:27.459879 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.459707    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h8qc\" (UniqueName: \"kubernetes.io/projected/e84a7754-f20d-4576-855c-f6834c366de0-kube-api-access-8h8qc\") pod \"e84a7754-f20d-4576-855c-f6834c366de0\" (UID: \"e84a7754-f20d-4576-855c-f6834c366de0\") "
Jul 28 05:07:27.460170 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.460133    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e84a7754-f20d-4576-855c-f6834c366de0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e84a7754-f20d-4576-855c-f6834c366de0" (UID: "e84a7754-f20d-4576-855c-f6834c366de0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 05:07:27.462454 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.462429    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e84a7754-f20d-4576-855c-f6834c366de0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e84a7754-f20d-4576-855c-f6834c366de0" (UID: "e84a7754-f20d-4576-855c-f6834c366de0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 05:07:27.462454 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.462437    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e84a7754-f20d-4576-855c-f6834c366de0-kube-api-access-8h8qc" (OuterVolumeSpecName: "kube-api-access-8h8qc") pod "e84a7754-f20d-4576-855c-f6834c366de0" (UID: "e84a7754-f20d-4576-855c-f6834c366de0"). InnerVolumeSpecName "kube-api-access-8h8qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:07:27.561113 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.561079    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf9vp\" (UniqueName: \"kubernetes.io/projected/232c9044-f327-42c2-95de-18592e9fac5b-kube-api-access-xf9vp\") pod \"232c9044-f327-42c2-95de-18592e9fac5b\" (UID: \"232c9044-f327-42c2-95de-18592e9fac5b\") "
Jul 28 05:07:27.561283 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.561209    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/232c9044-f327-42c2-95de-18592e9fac5b-plugins-config-volume\") pod \"232c9044-f327-42c2-95de-18592e9fac5b\" (UID: \"232c9044-f327-42c2-95de-18592e9fac5b\") "
Jul 28 05:07:27.561481 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.561462    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e84a7754-f20d-4576-855c-f6834c366de0-openshift-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:07:27.561526 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.561491    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e84a7754-f20d-4576-855c-f6834c366de0-maas-api-tls\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:07:27.561526 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.561506    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h8qc\" (UniqueName: \"kubernetes.io/projected/e84a7754-f20d-4576-855c-f6834c366de0-kube-api-access-8h8qc\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:07:27.561625 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.561605    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/232c9044-f327-42c2-95de-18592e9fac5b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "232c9044-f327-42c2-95de-18592e9fac5b" (UID: "232c9044-f327-42c2-95de-18592e9fac5b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 05:07:27.563386 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.563361    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/232c9044-f327-42c2-95de-18592e9fac5b-kube-api-access-xf9vp" (OuterVolumeSpecName: "kube-api-access-xf9vp") pod "232c9044-f327-42c2-95de-18592e9fac5b" (UID: "232c9044-f327-42c2-95de-18592e9fac5b"). InnerVolumeSpecName "kube-api-access-xf9vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:07:27.662246 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.662157    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf9vp\" (UniqueName: \"kubernetes.io/projected/232c9044-f327-42c2-95de-18592e9fac5b-kube-api-access-xf9vp\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:07:27.662246 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.662188    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/232c9044-f327-42c2-95de-18592e9fac5b-plugins-config-volume\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:07:27.828395 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.828356    2581 generic.go:356] "Generic (PLEG): container finished" podID="e84a7754-f20d-4576-855c-f6834c366de0" containerID="77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8" exitCode=0
Jul 28 05:07:27.828566 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.828406    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"
Jul 28 05:07:27.828566 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.828451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c" event={"ID":"e84a7754-f20d-4576-855c-f6834c366de0","Type":"ContainerDied","Data":"77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8"}
Jul 28 05:07:27.828566 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.828513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c" event={"ID":"e84a7754-f20d-4576-855c-f6834c366de0","Type":"ContainerDied","Data":"0c13d706ae8f4407d97a5b21826d19e2efacfd81ca9356c3dcb1e4aab18fc8a9"}
Jul 28 05:07:27.828566 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.828543    2581 scope.go:117] "RemoveContainer" containerID="77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8"
Jul 28 05:07:27.830053 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.830008    2581 generic.go:356] "Generic (PLEG): container finished" podID="232c9044-f327-42c2-95de-18592e9fac5b" containerID="47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840" exitCode=0
Jul 28 05:07:27.830165 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.830052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5" event={"ID":"232c9044-f327-42c2-95de-18592e9fac5b","Type":"ContainerDied","Data":"47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840"}
Jul 28 05:07:27.830165 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.830091    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"
Jul 28 05:07:27.830165 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.830099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5" event={"ID":"232c9044-f327-42c2-95de-18592e9fac5b","Type":"ContainerDied","Data":"7ef32bc6778e988505a4d54821afde4e30e42eabd3ae6d73627c0ba2daf49c44"}
Jul 28 05:07:27.841060 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.840930    2581 scope.go:117] "RemoveContainer" containerID="77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8"
Jul 28 05:07:27.841281 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:07:27.841254    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8\": container with ID starting with 77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8 not found: ID does not exist" containerID="77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8"
Jul 28 05:07:27.841281 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.841291    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8"} err="failed to get container status \"77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8\": rpc error: code = NotFound desc = could not find container \"77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8\": container with ID starting with 77e84f32327a445dbb902333183732dfc7d29a66fc80ccde3afe582ae27aaeb8 not found: ID does not exist"
Jul 28 05:07:27.841489 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.841317    2581 scope.go:117] "RemoveContainer" containerID="47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840"
Jul 28 05:07:27.850409 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.850389    2581 scope.go:117] "RemoveContainer" containerID="47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840"
Jul 28 05:07:27.850701 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:07:27.850680    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840\": container with ID starting with 47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840 not found: ID does not exist" containerID="47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840"
Jul 28 05:07:27.850766 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.850711    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840"} err="failed to get container status \"47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840\": rpc error: code = NotFound desc = could not find container \"47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840\": container with ID starting with 47050c09600139608ae366da97a63cb1f052ccf91e9cb5395a29295d8d5d5840 not found: ID does not exist"
Jul 28 05:07:27.854657 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.854633    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"]
Jul 28 05:07:27.857292 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.857272    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-29b6e5-5957f656dc-67r7c"]
Jul 28 05:07:27.864785 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.864764    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"]
Jul 28 05:07:27.866808 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:27.866789    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29b6e5-557786c876-ntrq5"]
Jul 28 05:07:29.848930 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:29.848894    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="232c9044-f327-42c2-95de-18592e9fac5b" path="/var/lib/kubelet/pods/232c9044-f327-42c2-95de-18592e9fac5b/volumes"
Jul 28 05:07:29.849339 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:29.849299    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e84a7754-f20d-4576-855c-f6834c366de0" path="/var/lib/kubelet/pods/e84a7754-f20d-4576-855c-f6834c366de0/volumes"
Jul 28 05:07:57.330306 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.330265    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"]
Jul 28 05:07:57.330885 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.330529    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv" podUID="9264f902-6965-40e4-8b0c-e8edb7f31400" containerName="maas-api" containerID="cri-o://33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953" gracePeriod=30
Jul 28 05:07:57.387984 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.387940    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"]
Jul 28 05:07:57.388260 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.388236    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p" podUID="d8409371-78bc-4e2c-b4c8-087b4ff7dde6" containerName="payload-pre-processing" containerID="cri-o://dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901" gracePeriod=30
Jul 28 05:07:57.649256 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.649231    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:07:57.690349 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.690322    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:07:57.741272 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.741239    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9264f902-6965-40e4-8b0c-e8edb7f31400-maas-api-tls\") pod \"9264f902-6965-40e4-8b0c-e8edb7f31400\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") "
Jul 28 05:07:57.741272 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.741273    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-plugins-config-volume\") pod \"d8409371-78bc-4e2c-b4c8-087b4ff7dde6\" (UID: \"d8409371-78bc-4e2c-b4c8-087b4ff7dde6\") "
Jul 28 05:07:57.741493 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.741337    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9264f902-6965-40e4-8b0c-e8edb7f31400-openshift-service-ca\") pod \"9264f902-6965-40e4-8b0c-e8edb7f31400\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") "
Jul 28 05:07:57.741493 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.741362    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcxpp\" (UniqueName: \"kubernetes.io/projected/9264f902-6965-40e4-8b0c-e8edb7f31400-kube-api-access-bcxpp\") pod \"9264f902-6965-40e4-8b0c-e8edb7f31400\" (UID: \"9264f902-6965-40e4-8b0c-e8edb7f31400\") "
Jul 28 05:07:57.741493 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.741437    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqpvl\" (UniqueName: \"kubernetes.io/projected/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-kube-api-access-hqpvl\") pod \"d8409371-78bc-4e2c-b4c8-087b4ff7dde6\" (UID: \"d8409371-78bc-4e2c-b4c8-087b4ff7dde6\") "
Jul 28 05:07:57.741754 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.741725    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9264f902-6965-40e4-8b0c-e8edb7f31400-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9264f902-6965-40e4-8b0c-e8edb7f31400" (UID: "9264f902-6965-40e4-8b0c-e8edb7f31400"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 05:07:57.741754 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.741735    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8409371-78bc-4e2c-b4c8-087b4ff7dde6" (UID: "d8409371-78bc-4e2c-b4c8-087b4ff7dde6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 05:07:57.743526 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.743498    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9264f902-6965-40e4-8b0c-e8edb7f31400-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9264f902-6965-40e4-8b0c-e8edb7f31400" (UID: "9264f902-6965-40e4-8b0c-e8edb7f31400"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 05:07:57.743617 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.743564    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9264f902-6965-40e4-8b0c-e8edb7f31400-kube-api-access-bcxpp" (OuterVolumeSpecName: "kube-api-access-bcxpp") pod "9264f902-6965-40e4-8b0c-e8edb7f31400" (UID: "9264f902-6965-40e4-8b0c-e8edb7f31400"). InnerVolumeSpecName "kube-api-access-bcxpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:07:57.743617 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.743585    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-kube-api-access-hqpvl" (OuterVolumeSpecName: "kube-api-access-hqpvl") pod "d8409371-78bc-4e2c-b4c8-087b4ff7dde6" (UID: "d8409371-78bc-4e2c-b4c8-087b4ff7dde6"). InnerVolumeSpecName "kube-api-access-hqpvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:07:57.842245 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.842211    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqpvl\" (UniqueName: \"kubernetes.io/projected/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-kube-api-access-hqpvl\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:07:57.842245 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.842237    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9264f902-6965-40e4-8b0c-e8edb7f31400-maas-api-tls\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:07:57.842452 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.842255    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8409371-78bc-4e2c-b4c8-087b4ff7dde6-plugins-config-volume\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:07:57.842452 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.842264    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9264f902-6965-40e4-8b0c-e8edb7f31400-openshift-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:07:57.842452 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:57.842272    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcxpp\" (UniqueName: \"kubernetes.io/projected/9264f902-6965-40e4-8b0c-e8edb7f31400-kube-api-access-bcxpp\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:07:58.003665 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.003283    2581 generic.go:356] "Generic (PLEG): container finished" podID="9264f902-6965-40e4-8b0c-e8edb7f31400" containerID="33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953" exitCode=0
Jul 28 05:07:58.003665 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.003529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv" event={"ID":"9264f902-6965-40e4-8b0c-e8edb7f31400","Type":"ContainerDied","Data":"33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953"}
Jul 28 05:07:58.003665 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.003575    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"
Jul 28 05:07:58.003665 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.003631    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv" event={"ID":"9264f902-6965-40e4-8b0c-e8edb7f31400","Type":"ContainerDied","Data":"fcd66a928895be9df84b37d41b5dd2147b91d5b609a2765dca5c6512566dcd49"}
Jul 28 05:07:58.004016 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.003677    2581 scope.go:117] "RemoveContainer" containerID="33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953"
Jul 28 05:07:58.010982 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.010887    2581 generic.go:356] "Generic (PLEG): container finished" podID="d8409371-78bc-4e2c-b4c8-087b4ff7dde6" containerID="dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901" exitCode=0
Jul 28 05:07:58.011148 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.011072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p" event={"ID":"d8409371-78bc-4e2c-b4c8-087b4ff7dde6","Type":"ContainerDied","Data":"dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901"}
Jul 28 05:07:58.011148 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.011088    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"
Jul 28 05:07:58.011148 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.011132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p" event={"ID":"d8409371-78bc-4e2c-b4c8-087b4ff7dde6","Type":"ContainerDied","Data":"90d2ab7716dd5a0ffbf7e46e12e14b936e09a12f383d220c12552b276086931b"}
Jul 28 05:07:58.018886 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.018863    2581 scope.go:117] "RemoveContainer" containerID="33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953"
Jul 28 05:07:58.019184 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:07:58.019165    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953\": container with ID starting with 33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953 not found: ID does not exist" containerID="33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953"
Jul 28 05:07:58.019252 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.019193    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953"} err="failed to get container status \"33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953\": rpc error: code = NotFound desc = could not find container \"33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953\": container with ID starting with 33930ece6f03d4a8f9fcf345ca7e305c4d5c29bdc27a2dbdc353ffbf2ad0f953 not found: ID does not exist"
Jul 28 05:07:58.019252 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.019209    2581 scope.go:117] "RemoveContainer" containerID="dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901"
Jul 28 05:07:58.021730 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.021707    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"]
Jul 28 05:07:58.027244 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.027222    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-dc1efb-5c4dd8f4cd-q5pzv"]
Jul 28 05:07:58.029971 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.029954    2581 scope.go:117] "RemoveContainer" containerID="dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901"
Jul 28 05:07:58.030276 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:07:58.030250    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901\": container with ID starting with dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901 not found: ID does not exist" containerID="dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901"
Jul 28 05:07:58.030353 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.030278    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901"} err="failed to get container status \"dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901\": rpc error: code = NotFound desc = could not find container \"dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901\": container with ID starting with dfd4de391674efdafe28a20e47746260bf0ce3e0ebc7e82c57de759d110af901 not found: ID does not exist"
Jul 28 05:07:58.035519 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.035496    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"]
Jul 28 05:07:58.040241 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:58.040223    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dc1efb-b88f6756d-cww5p"]
Jul 28 05:07:59.839409 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:59.839372    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9264f902-6965-40e4-8b0c-e8edb7f31400" path="/var/lib/kubelet/pods/9264f902-6965-40e4-8b0c-e8edb7f31400/volumes"
Jul 28 05:07:59.839934 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:07:59.839732    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8409371-78bc-4e2c-b4c8-087b4ff7dde6" path="/var/lib/kubelet/pods/d8409371-78bc-4e2c-b4c8-087b4ff7dde6/volumes"
Jul 28 05:09:00.888800 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:00.888766    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"]
Jul 28 05:09:00.889328 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:00.889118    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9" podUID="060ebafb-531e-44f4-a675-ddb2d0dedd28" containerName="maas-api" containerID="cri-o://3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b" gracePeriod=30
Jul 28 05:09:01.146606 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.146533    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:09:01.333885 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.333850    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qwj5\" (UniqueName: \"kubernetes.io/projected/060ebafb-531e-44f4-a675-ddb2d0dedd28-kube-api-access-9qwj5\") pod \"060ebafb-531e-44f4-a675-ddb2d0dedd28\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") "
Jul 28 05:09:01.334097 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.333896    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/060ebafb-531e-44f4-a675-ddb2d0dedd28-openshift-service-ca\") pod \"060ebafb-531e-44f4-a675-ddb2d0dedd28\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") "
Jul 28 05:09:01.334097 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.334063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060ebafb-531e-44f4-a675-ddb2d0dedd28-maas-api-tls\") pod \"060ebafb-531e-44f4-a675-ddb2d0dedd28\" (UID: \"060ebafb-531e-44f4-a675-ddb2d0dedd28\") "
Jul 28 05:09:01.334301 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.334260    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/060ebafb-531e-44f4-a675-ddb2d0dedd28-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "060ebafb-531e-44f4-a675-ddb2d0dedd28" (UID: "060ebafb-531e-44f4-a675-ddb2d0dedd28"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 05:09:01.336184 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.336151    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/060ebafb-531e-44f4-a675-ddb2d0dedd28-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "060ebafb-531e-44f4-a675-ddb2d0dedd28" (UID: "060ebafb-531e-44f4-a675-ddb2d0dedd28"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 05:09:01.336318 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.336222    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/060ebafb-531e-44f4-a675-ddb2d0dedd28-kube-api-access-9qwj5" (OuterVolumeSpecName: "kube-api-access-9qwj5") pod "060ebafb-531e-44f4-a675-ddb2d0dedd28" (UID: "060ebafb-531e-44f4-a675-ddb2d0dedd28"). InnerVolumeSpecName "kube-api-access-9qwj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:09:01.369836 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.369798    2581 generic.go:356] "Generic (PLEG): container finished" podID="060ebafb-531e-44f4-a675-ddb2d0dedd28" containerID="3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b" exitCode=0
Jul 28 05:09:01.369978 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.369845    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"
Jul 28 05:09:01.369978 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.369849    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9" event={"ID":"060ebafb-531e-44f4-a675-ddb2d0dedd28","Type":"ContainerDied","Data":"3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b"}
Jul 28 05:09:01.369978 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.369953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9" event={"ID":"060ebafb-531e-44f4-a675-ddb2d0dedd28","Type":"ContainerDied","Data":"be23901b0427defcbe224257b3c6f3e7328ea7d47c9875bd24a5b1721f96cd0e"}
Jul 28 05:09:01.369978 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.369976    2581 scope.go:117] "RemoveContainer" containerID="3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b"
Jul 28 05:09:01.382702 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.382672    2581 scope.go:117] "RemoveContainer" containerID="3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b"
Jul 28 05:09:01.382986 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:09:01.382965    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b\": container with ID starting with 3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b not found: ID does not exist" containerID="3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b"
Jul 28 05:09:01.383061 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.382997    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b"} err="failed to get container status \"3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b\": rpc error: code = NotFound desc = could not find container \"3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b\": container with ID starting with 3c7bd131ee369069cbadbded525730eef7149246f98bfaa2e61c81a2cecce74b not found: ID does not exist"
Jul 28 05:09:01.394238 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.394209    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"]
Jul 28 05:09:01.396969 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.396907    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9b749c-59bcb568bb-w4gg9"]
Jul 28 05:09:01.434978 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.434929    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060ebafb-531e-44f4-a675-ddb2d0dedd28-maas-api-tls\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:01.434978 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.434973    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qwj5\" (UniqueName: \"kubernetes.io/projected/060ebafb-531e-44f4-a675-ddb2d0dedd28-kube-api-access-9qwj5\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:01.434978 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.434983    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/060ebafb-531e-44f4-a675-ddb2d0dedd28-openshift-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:01.840182 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:01.840150    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="060ebafb-531e-44f4-a675-ddb2d0dedd28" path="/var/lib/kubelet/pods/060ebafb-531e-44f4-a675-ddb2d0dedd28/volumes"
Jul 28 05:09:11.841609 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:11.841575    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"]
Jul 28 05:09:11.842112 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:11.841806    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerName="istio-proxy" containerID="cri-o://86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a" gracePeriod=30
Jul 28 05:09:15.595491 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:15.595452    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 05:09:15.595880 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:15.595512    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 05:09:17.110084 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.110015    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:09:17.176244 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176215    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-envoy\") pod \"5432cc78-2732-42f5-8ac3-3b003e8738b2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") "
Jul 28 05:09:17.176409 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176263    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp6zs\" (UniqueName: \"kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-kube-api-access-jp6zs\") pod \"5432cc78-2732-42f5-8ac3-3b003e8738b2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") "
Jul 28 05:09:17.176409 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176309    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5432cc78-2732-42f5-8ac3-3b003e8738b2-istiod-ca-cert\") pod \"5432cc78-2732-42f5-8ac3-3b003e8738b2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") "
Jul 28 05:09:17.176409 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176329    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-data\") pod \"5432cc78-2732-42f5-8ac3-3b003e8738b2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") "
Jul 28 05:09:17.176409 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176344    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-token\") pod \"5432cc78-2732-42f5-8ac3-3b003e8738b2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") "
Jul 28 05:09:17.176409 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176365    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-podinfo\") pod \"5432cc78-2732-42f5-8ac3-3b003e8738b2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") "
Jul 28 05:09:17.176657 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176410    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-credential-socket\") pod \"5432cc78-2732-42f5-8ac3-3b003e8738b2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") "
Jul 28 05:09:17.176657 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176470    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-certs\") pod \"5432cc78-2732-42f5-8ac3-3b003e8738b2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") "
Jul 28 05:09:17.176657 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176516    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-socket\") pod \"5432cc78-2732-42f5-8ac3-3b003e8738b2\" (UID: \"5432cc78-2732-42f5-8ac3-3b003e8738b2\") "
Jul 28 05:09:17.176835 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176764    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5432cc78-2732-42f5-8ac3-3b003e8738b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5432cc78-2732-42f5-8ac3-3b003e8738b2" (UID: "5432cc78-2732-42f5-8ac3-3b003e8738b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 05:09:17.177351 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.176966    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5432cc78-2732-42f5-8ac3-3b003e8738b2" (UID: "5432cc78-2732-42f5-8ac3-3b003e8738b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 05:09:17.177351 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.177017    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5432cc78-2732-42f5-8ac3-3b003e8738b2" (UID: "5432cc78-2732-42f5-8ac3-3b003e8738b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 05:09:17.177351 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.177142    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5432cc78-2732-42f5-8ac3-3b003e8738b2" (UID: "5432cc78-2732-42f5-8ac3-3b003e8738b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 05:09:17.177609 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.177578    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "5432cc78-2732-42f5-8ac3-3b003e8738b2" (UID: "5432cc78-2732-42f5-8ac3-3b003e8738b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 05:09:17.178756 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.178731    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "5432cc78-2732-42f5-8ac3-3b003e8738b2" (UID: "5432cc78-2732-42f5-8ac3-3b003e8738b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:09:17.178864 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.178753    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5432cc78-2732-42f5-8ac3-3b003e8738b2" (UID: "5432cc78-2732-42f5-8ac3-3b003e8738b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 05:09:17.179175 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.179147    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5432cc78-2732-42f5-8ac3-3b003e8738b2" (UID: "5432cc78-2732-42f5-8ac3-3b003e8738b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 05:09:17.179175 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.179155    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-kube-api-access-jp6zs" (OuterVolumeSpecName: "kube-api-access-jp6zs") pod "5432cc78-2732-42f5-8ac3-3b003e8738b2" (UID: "5432cc78-2732-42f5-8ac3-3b003e8738b2"). InnerVolumeSpecName "kube-api-access-jp6zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:09:17.278235 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.278201    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp6zs\" (UniqueName: \"kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-kube-api-access-jp6zs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:17.278235 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.278231    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5432cc78-2732-42f5-8ac3-3b003e8738b2-istiod-ca-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:17.278235 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.278241    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-data\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:17.278451 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.278249    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-token\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:17.278451 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.278257    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-podinfo\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:17.278451 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.278264    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-credential-socket\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:17.278451 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.278272    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:17.278451 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.278279    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-workload-socket\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:17.278451 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.278287    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5432cc78-2732-42f5-8ac3-3b003e8738b2-istio-envoy\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:17.469212 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.469121    2581 generic.go:356] "Generic (PLEG): container finished" podID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerID="86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a" exitCode=0
Jul 28 05:09:17.469212 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.469166    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"
Jul 28 05:09:17.469212 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.469180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" event={"ID":"5432cc78-2732-42f5-8ac3-3b003e8738b2","Type":"ContainerDied","Data":"86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a"}
Jul 28 05:09:17.469462 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.469257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2" event={"ID":"5432cc78-2732-42f5-8ac3-3b003e8738b2","Type":"ContainerDied","Data":"e75add6e852c63482fe6a61a3ad1b5c07626a789aed793fcc8c613491b11885b"}
Jul 28 05:09:17.469462 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.469284    2581 scope.go:117] "RemoveContainer" containerID="86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a"
Jul 28 05:09:17.479536 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.479515    2581 scope.go:117] "RemoveContainer" containerID="84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246"
Jul 28 05:09:17.489200 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.489178    2581 scope.go:117] "RemoveContainer" containerID="86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a"
Jul 28 05:09:17.489457 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:09:17.489438    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a\": container with ID starting with 86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a not found: ID does not exist" containerID="86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a"
Jul 28 05:09:17.489509 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.489467    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a"} err="failed to get container status \"86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a\": rpc error: code = NotFound desc = could not find container \"86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a\": container with ID starting with 86948a6e8f9574d3171ae100a94bd5577332365b21e0654123a075da7206509a not found: ID does not exist"
Jul 28 05:09:17.489509 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.489486    2581 scope.go:117] "RemoveContainer" containerID="84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246"
Jul 28 05:09:17.489747 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:09:17.489728    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246\": container with ID starting with 84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246 not found: ID does not exist" containerID="84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246"
Jul 28 05:09:17.489790 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.489754    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246"} err="failed to get container status \"84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246\": rpc error: code = NotFound desc = could not find container \"84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246\": container with ID starting with 84c123edc277b6c8a68c737a4e54f1c02e595e924c7dd3314a4b7d9353bf9246 not found: ID does not exist"
Jul 28 05:09:17.491414 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.491395    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"]
Jul 28 05:09:17.493697 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.493677    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-9b749c-openshift-default-54b78f7676-chxw2"]
Jul 28 05:09:17.838996 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:17.838967    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" path="/var/lib/kubelet/pods/5432cc78-2732-42f5-8ac3-3b003e8738b2/volumes"
Jul 28 05:09:44.628764 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:44.628730    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"]
Jul 28 05:09:44.629709 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:44.628980    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7" podUID="8982149a-4329-4eb8-a7f3-3f927e8fab76" containerName="payload-pre-processing" containerID="cri-o://6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979" gracePeriod=30
Jul 28 05:09:44.886382 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:44.886324    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 05:09:45.033309 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.033269    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8982149a-4329-4eb8-a7f3-3f927e8fab76-plugins-config-volume\") pod \"8982149a-4329-4eb8-a7f3-3f927e8fab76\" (UID: \"8982149a-4329-4eb8-a7f3-3f927e8fab76\") "
Jul 28 05:09:45.033486 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.033326    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfgl8\" (UniqueName: \"kubernetes.io/projected/8982149a-4329-4eb8-a7f3-3f927e8fab76-kube-api-access-zfgl8\") pod \"8982149a-4329-4eb8-a7f3-3f927e8fab76\" (UID: \"8982149a-4329-4eb8-a7f3-3f927e8fab76\") "
Jul 28 05:09:45.033626 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.033605    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8982149a-4329-4eb8-a7f3-3f927e8fab76-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8982149a-4329-4eb8-a7f3-3f927e8fab76" (UID: "8982149a-4329-4eb8-a7f3-3f927e8fab76"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 05:09:45.035674 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.035651    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8982149a-4329-4eb8-a7f3-3f927e8fab76-kube-api-access-zfgl8" (OuterVolumeSpecName: "kube-api-access-zfgl8") pod "8982149a-4329-4eb8-a7f3-3f927e8fab76" (UID: "8982149a-4329-4eb8-a7f3-3f927e8fab76"). InnerVolumeSpecName "kube-api-access-zfgl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:09:45.134591 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.134560    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfgl8\" (UniqueName: \"kubernetes.io/projected/8982149a-4329-4eb8-a7f3-3f927e8fab76-kube-api-access-zfgl8\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:45.134591 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.134587    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8982149a-4329-4eb8-a7f3-3f927e8fab76-plugins-config-volume\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:09:45.633080 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.633020    2581 generic.go:356] "Generic (PLEG): container finished" podID="8982149a-4329-4eb8-a7f3-3f927e8fab76" containerID="6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979" exitCode=0
Jul 28 05:09:45.633545 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.633105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7" event={"ID":"8982149a-4329-4eb8-a7f3-3f927e8fab76","Type":"ContainerDied","Data":"6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979"}
Jul 28 05:09:45.633545 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.633184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7" event={"ID":"8982149a-4329-4eb8-a7f3-3f927e8fab76","Type":"ContainerDied","Data":"bdedb8475b6cf92d84e55cb67319b4a25c2db04a39a04db869a0ad6e464fbf43"}
Jul 28 05:09:45.633545 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.633116    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"
Jul 28 05:09:45.633545 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.633206    2581 scope.go:117] "RemoveContainer" containerID="6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979"
Jul 28 05:09:45.642682 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.642665    2581 scope.go:117] "RemoveContainer" containerID="6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979"
Jul 28 05:09:45.642971 ip-10-0-139-118 kubenswrapper[2581]: E0728 05:09:45.642951    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979\": container with ID starting with 6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979 not found: ID does not exist" containerID="6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979"
Jul 28 05:09:45.643085 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.642979    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979"} err="failed to get container status \"6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979\": rpc error: code = NotFound desc = could not find container \"6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979\": container with ID starting with 6fba5dd80bd93781b6e468b1ab73c1097e3b9700554b2600cc0691bbcb552979 not found: ID does not exist"
Jul 28 05:09:45.656797 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.656775    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"]
Jul 28 05:09:45.660050 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.660016    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-92c557-66cf84bf6d-zjkp7"]
Jul 28 05:09:45.839445 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:45.839413    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8982149a-4329-4eb8-a7f3-3f927e8fab76" path="/var/lib/kubelet/pods/8982149a-4329-4eb8-a7f3-3f927e8fab76/volumes"
Jul 28 05:09:55.558155 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:55.558119    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"]
Jul 28 05:09:55.558589 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:55.558415    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" podUID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerName="istio-proxy" containerID="cri-o://6bd5b327e5661af4e9578a28468e3258441c82dc3e8b39e3312b56bef8209a03" gracePeriod=30
Jul 28 05:09:56.278790 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:09:56.278753    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-575c4bbf47-8flm8_eac10671-6539-4bd2-9f4e-eef0d68095a2/authorino/0.log"
Jul 28 05:10:00.719307 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.719277    2581 generic.go:356] "Generic (PLEG): container finished" podID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerID="6bd5b327e5661af4e9578a28468e3258441c82dc3e8b39e3312b56bef8209a03" exitCode=0
Jul 28 05:10:00.719704 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.719319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" event={"ID":"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984","Type":"ContainerDied","Data":"6bd5b327e5661af4e9578a28468e3258441c82dc3e8b39e3312b56bef8209a03"}
Jul 28 05:10:00.719704 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.719377    2581 scope.go:117] "RemoveContainer" containerID="ab72840580618ce1c2ee3aee6a0fda205bf14d8be2017391043486c9ed29683d"
Jul 28 05:10:00.817433 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.817409    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 05:10:00.870260 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870165    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-token\") pod \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") "
Jul 28 05:10:00.870260 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870222    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-data\") pod \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") "
Jul 28 05:10:00.870260 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870248    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istiod-ca-cert\") pod \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") "
Jul 28 05:10:00.870538 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870288    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr7cw\" (UniqueName: \"kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-kube-api-access-kr7cw\") pod \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") "
Jul 28 05:10:00.870538 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870328    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-socket\") pod \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") "
Jul 28 05:10:00.870538 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870362    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-credential-socket\") pod \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") "
Jul 28 05:10:00.870538 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870395    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-certs\") pod \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") "
Jul 28 05:10:00.870538 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870438    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-podinfo\") pod \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") "
Jul 28 05:10:00.870538 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870472    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-envoy\") pod \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\" (UID: \"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984\") "
Jul 28 05:10:00.870852 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870702    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" (UID: "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 05:10:00.870852 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870715    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" (UID: "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 05:10:00.870852 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870729    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" (UID: "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 05:10:00.870852 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870807    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-socket\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:10:00.870852 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870828    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-credential-socket\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:10:00.870852 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870843    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-workload-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:10:00.871358 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.870880    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" (UID: "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 05:10:00.871358 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.871212    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" (UID: "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 05:10:00.872574 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.872542    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" (UID: "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:10:00.872687 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.872619    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-kube-api-access-kr7cw" (OuterVolumeSpecName: "kube-api-access-kr7cw") pod "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" (UID: "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984"). InnerVolumeSpecName "kube-api-access-kr7cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 05:10:00.873297 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.873275    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" (UID: "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 05:10:00.873297 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.873281    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" (UID: "c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 05:10:00.971490 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.971454    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-podinfo\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:10:00.971490 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.971483    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-envoy\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:10:00.971490 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.971492    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-token\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:10:00.971490 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.971499    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istio-data\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:10:00.971742 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.971507    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-istiod-ca-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:10:00.971742 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:00.971515    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr7cw\" (UniqueName: \"kubernetes.io/projected/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984-kube-api-access-kr7cw\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 28 05:10:01.725766 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:01.725734    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"
Jul 28 05:10:01.726209 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:01.725778    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n" event={"ID":"c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984","Type":"ContainerDied","Data":"a27bc149920ba167d35f9504167221df2444047737dfd322f6bf092ad663e46f"}
Jul 28 05:10:01.726209 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:01.725837    2581 scope.go:117] "RemoveContainer" containerID="6bd5b327e5661af4e9578a28468e3258441c82dc3e8b39e3312b56bef8209a03"
Jul 28 05:10:01.750481 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:01.750458    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"]
Jul 28 05:10:01.754233 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:01.754195    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-92c557-openshift-default-886956d48-9825n"]
Jul 28 05:10:01.838927 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:01.838880    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" path="/var/lib/kubelet/pods/c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984/volumes"
Jul 28 05:10:02.591162 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:02.591130    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d65f9dd8-gntlm_9db6461d-a4fe-4933-a4f8-1bef077eb1db/copy-manifests/0.log"
Jul 28 05:10:02.598436 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:02.598414    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d65f9dd8-gntlm_9db6461d-a4fe-4933-a4f8-1bef077eb1db/manager/0.log"
Jul 28 05:10:03.228968 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:03.228936    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-676c68b8ff-8wzc6_fa9b577f-37e3-4f87-9a51-5e2d6995956b/maas-api/0.log"
Jul 28 05:10:03.351861 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:03.351833    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753550-4zg4h_78d3476d-200a-46c4-84ac-38b3c4da2694/cleanup/0.log"
Jul 28 05:10:03.711780 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:03.711745    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6gztp_69af385e-f8f9-4cd9-b4cf-5dbcb8aaf2d3/postgres/0.log"
Jul 28 05:10:04.560901 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.560870    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w_9f27435c-c2ec-40e4-9206-10bf2d00cf76/util/0.log"
Jul 28 05:10:04.566577 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.566554    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w_9f27435c-c2ec-40e4-9206-10bf2d00cf76/pull/0.log"
Jul 28 05:10:04.572198 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.572177    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w_9f27435c-c2ec-40e4-9206-10bf2d00cf76/extract/0.log"
Jul 28 05:10:04.692971 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.692944    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2_31874a7a-4e52-49d8-bf2e-b393101557a5/extract/0.log"
Jul 28 05:10:04.699026 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.699001    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2_31874a7a-4e52-49d8-bf2e-b393101557a5/util/0.log"
Jul 28 05:10:04.705001 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.704980    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2_31874a7a-4e52-49d8-bf2e-b393101557a5/pull/0.log"
Jul 28 05:10:04.824008 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.823931    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm_020dbab7-7534-4d2a-82fe-22b02e9e4a87/util/0.log"
Jul 28 05:10:04.830468 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.830447    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm_020dbab7-7534-4d2a-82fe-22b02e9e4a87/pull/0.log"
Jul 28 05:10:04.837154 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.837137    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm_020dbab7-7534-4d2a-82fe-22b02e9e4a87/extract/0.log"
Jul 28 05:10:04.959354 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.959326    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt_45001788-1043-4c7a-a6b2-7179c23987d5/util/0.log"
Jul 28 05:10:04.965276 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.965260    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt_45001788-1043-4c7a-a6b2-7179c23987d5/pull/0.log"
Jul 28 05:10:04.970639 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:04.970617    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt_45001788-1043-4c7a-a6b2-7179c23987d5/extract/0.log"
Jul 28 05:10:05.104825 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:05.104756    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-575c4bbf47-8flm8_eac10671-6539-4bd2-9f4e-eef0d68095a2/authorino/0.log"
Jul 28 05:10:05.227147 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:05.227119    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zskhd_b6d9775c-d1f4-47ea-92cd-25f782818ed4/manager/0.log"
Jul 28 05:10:05.470629 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:05.470551    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-trrmt_16380f34-4cc8-449a-95fc-57df5cb06a50/kuadrant-console-plugin/0.log"
Jul 28 05:10:05.591831 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:05.591799    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dfs2v_dcf57feb-6db5-4757-8ffb-66ca742d31b3/registry-server/0.log"
Jul 28 05:10:05.718757 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:05.718728    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q4j2c_81df367e-3bda-47ce-b00e-d6ca44fa9819/manager/0.log"
Jul 28 05:10:06.344443 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:06.344371    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r_1cb2bb2e-32b6-4a51-a1d6-8affb0430870/istio-proxy/0.log"
Jul 28 05:10:06.859499 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:06.859467    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8b8fn_81d6af87-000b-48e7-9e20-b840cb2be293/istio-proxy/1.log"
Jul 28 05:10:07.116344 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:07.116251    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-jsgww_8c6345ca-f31a-4de2-aca7-e32e2ff815d5/payload-processing/0.log"
Jul 28 05:10:07.728220 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:07.728192    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bllnx_9bdb29e0-b7ba-49c5-939d-35938928560e/main/0.log"
Jul 28 05:10:16.877266 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:16.877229    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q99nq_66596be3-19df-47a0-b3e7-8733521981fa/global-pull-secret-syncer/0.log"
Jul 28 05:10:17.027943 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:17.027909    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-skww4_274bf2d5-1311-4b5e-9201-c88c31386088/konnectivity-agent/0.log"
Jul 28 05:10:17.157756 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:17.157662    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-118.ec2.internal_839373d01f4d4231aa21f422395e27a5/haproxy/0.log"
Jul 28 05:10:21.564295 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.564267    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w_9f27435c-c2ec-40e4-9206-10bf2d00cf76/extract/0.log"
Jul 28 05:10:21.586052 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.586012    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w_9f27435c-c2ec-40e4-9206-10bf2d00cf76/util/0.log"
Jul 28 05:10:21.611068 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.611025    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mzj6w_9f27435c-c2ec-40e4-9206-10bf2d00cf76/pull/0.log"
Jul 28 05:10:21.637744 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.637717    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2_31874a7a-4e52-49d8-bf2e-b393101557a5/extract/0.log"
Jul 28 05:10:21.660001 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.659974    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2_31874a7a-4e52-49d8-bf2e-b393101557a5/util/0.log"
Jul 28 05:10:21.687360 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.687331    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l4hl2_31874a7a-4e52-49d8-bf2e-b393101557a5/pull/0.log"
Jul 28 05:10:21.716704 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.716675    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm_020dbab7-7534-4d2a-82fe-22b02e9e4a87/extract/0.log"
Jul 28 05:10:21.743746 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.743719    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm_020dbab7-7534-4d2a-82fe-22b02e9e4a87/util/0.log"
Jul 28 05:10:21.767366 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.767340    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvkfm_020dbab7-7534-4d2a-82fe-22b02e9e4a87/pull/0.log"
Jul 28 05:10:21.801372 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.801345    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt_45001788-1043-4c7a-a6b2-7179c23987d5/extract/0.log"
Jul 28 05:10:21.821545 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.821475    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt_45001788-1043-4c7a-a6b2-7179c23987d5/util/0.log"
Jul 28 05:10:21.844737 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:21.844708    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vdbpt_45001788-1043-4c7a-a6b2-7179c23987d5/pull/0.log"
Jul 28 05:10:22.175298 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:22.175207    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-575c4bbf47-8flm8_eac10671-6539-4bd2-9f4e-eef0d68095a2/authorino/0.log"
Jul 28 05:10:22.245796 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:22.245767    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zskhd_b6d9775c-d1f4-47ea-92cd-25f782818ed4/manager/0.log"
Jul 28 05:10:22.315247 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:22.315217    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-trrmt_16380f34-4cc8-449a-95fc-57df5cb06a50/kuadrant-console-plugin/0.log"
Jul 28 05:10:22.360639 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:22.360609    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dfs2v_dcf57feb-6db5-4757-8ffb-66ca742d31b3/registry-server/0.log"
Jul 28 05:10:22.484596 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:22.484492    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q4j2c_81df367e-3bda-47ce-b00e-d6ca44fa9819/manager/0.log"
Jul 28 05:10:24.489369 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:24.489342    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2scw5_df9eb54e-a6c7-4774-a46c-689e173bf6a6/kube-state-metrics/0.log"
Jul 28 05:10:24.511714 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:24.511688    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2scw5_df9eb54e-a6c7-4774-a46c-689e173bf6a6/kube-rbac-proxy-main/0.log"
Jul 28 05:10:24.531468 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:24.531442    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2scw5_df9eb54e-a6c7-4774-a46c-689e173bf6a6/kube-rbac-proxy-self/0.log"
Jul 28 05:10:24.713000 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:24.712975    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9h4gf_c22cf685-12aa-463c-b3b4-196cc9d620c0/node-exporter/0.log"
Jul 28 05:10:24.735586 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:24.735562    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9h4gf_c22cf685-12aa-463c-b3b4-196cc9d620c0/kube-rbac-proxy/0.log"
Jul 28 05:10:24.756387 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:24.756324    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9h4gf_c22cf685-12aa-463c-b3b4-196cc9d620c0/init-textfile/0.log"
Jul 28 05:10:25.193755 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:25.193673    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-ghblb_457a2f44-18cb-4cfa-870f-e786164d927d/prometheus-operator-admission-webhook/0.log"
Jul 28 05:10:27.253942 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.253908    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"]
Jul 28 05:10:27.254569 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254481    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerName="istio-proxy"
Jul 28 05:10:27.254569 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254498    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerName="istio-proxy"
Jul 28 05:10:27.254569 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254511    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e84a7754-f20d-4576-855c-f6834c366de0" containerName="maas-api"
Jul 28 05:10:27.254569 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254517    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e84a7754-f20d-4576-855c-f6834c366de0" containerName="maas-api"
Jul 28 05:10:27.254569 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254529    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerName="istio-proxy"
Jul 28 05:10:27.254569 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254534    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerName="istio-proxy"
Jul 28 05:10:27.254569 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254544    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8409371-78bc-4e2c-b4c8-087b4ff7dde6" containerName="payload-pre-processing"
Jul 28 05:10:27.254569 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254549    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8409371-78bc-4e2c-b4c8-087b4ff7dde6" containerName="payload-pre-processing"
Jul 28 05:10:27.254569 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254562    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8982149a-4329-4eb8-a7f3-3f927e8fab76" containerName="payload-pre-processing"
Jul 28 05:10:27.254569 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254570    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8982149a-4329-4eb8-a7f3-3f927e8fab76" containerName="payload-pre-processing"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254588    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="060ebafb-531e-44f4-a675-ddb2d0dedd28" containerName="maas-api"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254594    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="060ebafb-531e-44f4-a675-ddb2d0dedd28" containerName="maas-api"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254601    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232c9044-f327-42c2-95de-18592e9fac5b" containerName="payload-pre-processing"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254606    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="232c9044-f327-42c2-95de-18592e9fac5b" containerName="payload-pre-processing"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254616    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9264f902-6965-40e4-8b0c-e8edb7f31400" containerName="maas-api"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254621    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9264f902-6965-40e4-8b0c-e8edb7f31400" containerName="maas-api"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254681    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8982149a-4329-4eb8-a7f3-3f927e8fab76" containerName="payload-pre-processing"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254688    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerName="istio-proxy"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254694    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5432cc78-2732-42f5-8ac3-3b003e8738b2" containerName="istio-proxy"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254699    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="060ebafb-531e-44f4-a675-ddb2d0dedd28" containerName="maas-api"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254705    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerName="istio-proxy"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254710    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e84a7754-f20d-4576-855c-f6834c366de0" containerName="maas-api"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254717    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b7fc9f-f90a-4379-9cd8-ea1f7b05f984" containerName="istio-proxy"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254723    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9264f902-6965-40e4-8b0c-e8edb7f31400" containerName="maas-api"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254728    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8409371-78bc-4e2c-b4c8-087b4ff7dde6" containerName="payload-pre-processing"
Jul 28 05:10:27.254889 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.254733    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="232c9044-f327-42c2-95de-18592e9fac5b" containerName="payload-pre-processing"
Jul 28 05:10:27.259259 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.259241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.261144 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.261121    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5wtbr\"/\"default-dockercfg-8sxlx\""
Jul 28 05:10:27.261264 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.261148    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wtbr\"/\"openshift-service-ca.crt\""
Jul 28 05:10:27.261666 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.261648    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wtbr\"/\"kube-root-ca.crt\""
Jul 28 05:10:27.266516 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.265932    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"]
Jul 28 05:10:27.406092 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.406058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-proc\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.406303 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.406116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-lib-modules\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.406303 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.406140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-podres\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.406303 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.406174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4rp9\" (UniqueName: \"kubernetes.io/projected/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-kube-api-access-v4rp9\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.406303 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.406270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-sys\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.507471 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.507380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-lib-modules\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.507471 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.507417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-podres\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.507471 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.507449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4rp9\" (UniqueName: \"kubernetes.io/projected/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-kube-api-access-v4rp9\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.507734 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.507503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-sys\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.507734 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.507571    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-lib-modules\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.507734 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.507578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-sys\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.507734 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.507572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-podres\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.507734 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.507654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-proc\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.507734 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.507705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-proc\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.514920 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.514896    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4rp9\" (UniqueName: \"kubernetes.io/projected/b9ec2ad8-34b6-44df-9b5d-0365e02e92e6-kube-api-access-v4rp9\") pod \"perf-node-gather-daemonset-4kj4n\" (UID: \"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6\") " pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.570692 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.570637    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.704756 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.704722    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"]
Jul 28 05:10:27.708010 ip-10-0-139-118 kubenswrapper[2581]: W0728 05:10:27.707969    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb9ec2ad8_34b6_44df_9b5d_0365e02e92e6.slice/crio-13fbce65e6e466706e2492a70579e3a8b8259f0915f6439ea89a145432d5ca37 WatchSource:0}: Error finding container 13fbce65e6e466706e2492a70579e3a8b8259f0915f6439ea89a145432d5ca37: Status 404 returned error can't find the container with id 13fbce65e6e466706e2492a70579e3a8b8259f0915f6439ea89a145432d5ca37
Jul 28 05:10:27.864065 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.863992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n" event={"ID":"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6","Type":"ContainerStarted","Data":"6e2a10d5236f940c7d934cf1e38d81790bbb7e124ec64967048869626f3805df"}
Jul 28 05:10:27.864065 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.864068    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:27.864315 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.864084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n" event={"ID":"b9ec2ad8-34b6-44df-9b5d-0365e02e92e6","Type":"ContainerStarted","Data":"13fbce65e6e466706e2492a70579e3a8b8259f0915f6439ea89a145432d5ca37"}
Jul 28 05:10:27.878317 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:27.878260    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n" podStartSLOduration=0.878244149 podStartE2EDuration="878.244149ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 05:10:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 05:10:27.876911307 +0000 UTC m=+3522.584393609" watchObservedRunningTime="2026-07-28 05:10:27.878244149 +0000 UTC m=+3522.585726450"
Jul 28 05:10:28.502733 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:28.502701    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-6kb5q_f9194231-1c7e-48f8-b3d7-c64d8f9f2350/volume-data-source-validator/0.log"
Jul 28 05:10:29.483269 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:29.483238    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ftv8z_6ec8f2fb-b989-439f-b0dc-f0e98d36a44f/dns/0.log"
Jul 28 05:10:29.502571 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:29.502547    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ftv8z_6ec8f2fb-b989-439f-b0dc-f0e98d36a44f/kube-rbac-proxy/0.log"
Jul 28 05:10:29.620867 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:29.620838    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ljczk_61a3863a-3bf9-4a7a-915c-7106f2e93df7/dns-node-resolver/0.log"
Jul 28 05:10:30.165946 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:30.165918    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6f44d6dcf-ctqgj_7b6c4b67-5bed-43e2-95b3-911833682ea7/registry/0.log"
Jul 28 05:10:30.177993 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:30.177970    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6f44d6dcf-ctqgj_7b6c4b67-5bed-43e2-95b3-911833682ea7/registry/1.log"
Jul 28 05:10:30.245093 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:30.245069    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqlft_03e6400b-8dcc-4525-9e3f-3166a169f06f/node-ca/0.log"
Jul 28 05:10:31.154137 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:31.154109    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r_1cb2bb2e-32b6-4a51-a1d6-8affb0430870/istio-proxy/0.log"
Jul 28 05:10:31.372092 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:31.372063    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8b8fn_81d6af87-000b-48e7-9e20-b840cb2be293/istio-proxy/0.log"
Jul 28 05:10:31.396695 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:31.396670    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8b8fn_81d6af87-000b-48e7-9e20-b840cb2be293/istio-proxy/1.log"
Jul 28 05:10:31.461508 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:31.461433    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-jsgww_8c6345ca-f31a-4de2-aca7-e32e2ff815d5/payload-processing/0.log"
Jul 28 05:10:32.266691 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:32.266666    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gw442_37aba33f-561c-475a-b57f-9f31035b8967/serve-healthcheck-canary/0.log"
Jul 28 05:10:32.930970 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:32.930922    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgv9v_0f379dcb-16d1-409f-a2ab-dae029ab2f1b/kube-rbac-proxy/0.log"
Jul 28 05:10:32.950118 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:32.950097    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgv9v_0f379dcb-16d1-409f-a2ab-dae029ab2f1b/exporter/0.log"
Jul 28 05:10:32.970255 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:32.970233    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgv9v_0f379dcb-16d1-409f-a2ab-dae029ab2f1b/extractor/0.log"
Jul 28 05:10:33.879984 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:33.879950    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5wtbr/perf-node-gather-daemonset-4kj4n"
Jul 28 05:10:35.532213 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:35.532188    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d65f9dd8-gntlm_9db6461d-a4fe-4933-a4f8-1bef077eb1db/manager/0.log"
Jul 28 05:10:35.551827 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:35.551799    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d65f9dd8-gntlm_9db6461d-a4fe-4933-a4f8-1bef077eb1db/copy-manifests/0.log"
Jul 28 05:10:37.121811 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:37.121777    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7796f8d956-jm9kj_5a326803-1700-48ef-9190-60c1921c2e50/manager/0.log"
Jul 28 05:10:37.716870 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:37.716788    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r_1cb2bb2e-32b6-4a51-a1d6-8affb0430870/istio-proxy/0.log"
Jul 28 05:10:37.900417 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:37.900391    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8b8fn_81d6af87-000b-48e7-9e20-b840cb2be293/istio-proxy/0.log"
Jul 28 05:10:37.928027 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:37.927998    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8b8fn_81d6af87-000b-48e7-9e20-b840cb2be293/istio-proxy/1.log"
Jul 28 05:10:37.969321 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:37.969247    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-jsgww_8c6345ca-f31a-4de2-aca7-e32e2ff815d5/payload-processing/0.log"
Jul 28 05:10:39.348131 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:39.348102    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cq2p4r_1cb2bb2e-32b6-4a51-a1d6-8affb0430870/istio-proxy/0.log"
Jul 28 05:10:39.523844 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:39.523812    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8b8fn_81d6af87-000b-48e7-9e20-b840cb2be293/istio-proxy/0.log"
Jul 28 05:10:39.552319 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:39.552286    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8b8fn_81d6af87-000b-48e7-9e20-b840cb2be293/istio-proxy/1.log"
Jul 28 05:10:39.599371 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:39.599303    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-jsgww_8c6345ca-f31a-4de2-aca7-e32e2ff815d5/payload-processing/0.log"
Jul 28 05:10:42.216013 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:42.215982    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-x94xd_bce371a2-8aad-4342-87c3-1cf9fe9d3e55/migrator/0.log"
Jul 28 05:10:42.233859 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:42.233833    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-x94xd_bce371a2-8aad-4342-87c3-1cf9fe9d3e55/graceful-termination/0.log"
Jul 28 05:10:43.538158 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:43.538126    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6mwzc_200bdc65-dd3a-445c-a8eb-1d2996896486/kube-multus/0.log"
Jul 28 05:10:43.567441 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:43.567412    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tllh_db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd/kube-multus-additional-cni-plugins/0.log"
Jul 28 05:10:43.587598 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:43.587571    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tllh_db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd/egress-router-binary-copy/0.log"
Jul 28 05:10:43.606497 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:43.606476    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tllh_db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd/cni-plugins/0.log"
Jul 28 05:10:43.626109 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:43.626085    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tllh_db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd/bond-cni-plugin/0.log"
Jul 28 05:10:43.645864 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:43.645842    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tllh_db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd/routeoverride-cni/0.log"
Jul 28 05:10:43.664484 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:43.664460    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tllh_db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd/whereabouts-cni-bincopy/0.log"
Jul 28 05:10:43.683253 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:43.683227    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tllh_db16db9c-a7c1-48cb-ae6e-f6ee94f3fabd/whereabouts-cni/0.log"
Jul 28 05:10:44.083709 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:44.083674    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g86tz_63fd0789-69d2-487c-b10b-b66deba1de75/network-metrics-daemon/0.log"
Jul 28 05:10:44.101470 ip-10-0-139-118 kubenswrapper[2581]: I0728 05:10:44.101440    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g86tz_63fd0789-69d2-487c-b10b-b66deba1de75/kube-rbac-proxy/0.log"