Jul 29 20:24:50.036122 ip-10-0-137-228 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 20:24:50.408082 ip-10-0-137-228 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 20:24:50.408082 ip-10-0-137-228 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 20:24:50.408082 ip-10-0-137-228 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 20:24:50.408082 ip-10-0-137-228 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 20:24:50.408082 ip-10-0-137-228 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 20:24:50.408649 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.408139    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 20:24:50.414089 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414065    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 20:24:50.414089 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414081    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 20:24:50.414089 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414084    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 20:24:50.414089 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414087    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 20:24:50.414089 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414090    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 20:24:50.414089 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414093    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 20:24:50.414089 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414096    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 20:24:50.414089 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414099    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414102    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414105    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414108    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414110    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414113    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414115    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414118    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414121    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414123    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414125    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414128    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414130    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414133    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414136    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414138    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414140    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414144    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414146    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 20:24:50.414343 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414149    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414151    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414154    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414156    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414158    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414161    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414163    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414166    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414168    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414170    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414173    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414175    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414178    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414180    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414183    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414186    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414189    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414192    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414194    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414197    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 20:24:50.414790 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414199    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414202    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414204    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414207    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414210    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414213    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414216    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414221    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414225    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414228    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414230    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414233    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414236    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414238    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414241    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414243    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414246    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414248    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414250    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 20:24:50.415297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414254    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414258    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414262    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414265    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414268    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414271    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414273    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414276    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414280    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414283    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414285    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414288    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414290    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414295    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414297    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414300    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414302    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414305    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414308    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414310    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 20:24:50.415769 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414312    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414316    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414320    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414322    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414325    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414327    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414330    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414332    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414335    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414338    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414340    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414342    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414345    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.414347    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415003    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415010    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415012    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415015    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415018    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415020    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 20:24:50.416258 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415024    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415026    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415029    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415031    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415034    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415036    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415039    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415041    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415044    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415047    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415049    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415052    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415055    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415057    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415060    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415063    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415065    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415068    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415070    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415073    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 20:24:50.416755 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415075    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415078    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415080    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415083    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415086    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415088    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415090    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415093    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415095    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415097    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415100    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415102    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415106    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415109    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415111    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415114    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415116    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415119    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415121    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415124    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 20:24:50.417246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415127    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415130    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415133    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415135    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415138    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415140    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415143    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415145    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415148    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415151    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415153    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415156    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415158    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415161    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415163    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415166    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415168    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415171    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415175    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 20:24:50.417744 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415179    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415182    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415185    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415187    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415190    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415194    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415196    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415199    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415201    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415204    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415206    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415209    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415212    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415214    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415217    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415219    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415221    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415224    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415227    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 20:24:50.418217 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415229    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415231    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415235    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415238    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415241    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415244    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415246    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415249    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415251    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415254    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415256    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415258    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415261    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415263    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415266    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415625    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415630    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415634    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415637    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415641    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 20:24:50.418681 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415644    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415646    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415649    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415652    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415655    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415657    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415660    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415662    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415665    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415668    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415670    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415673    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415677    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415680    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415684    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415688    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415691    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415694    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415696    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 20:24:50.419229 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415699    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415701    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415704    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415707    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415709    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415711    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415714    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415716    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415720    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415724    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415727    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415729    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415732    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415735    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415737    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415739    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415742    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415744    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415747    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 20:24:50.419682 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415749    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415751    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415754    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415756    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415758    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415761    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415764    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415767    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415769    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415772    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415775    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415778    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415781    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415783    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415786    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415789    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415791    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415793    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415796    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415798    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 20:24:50.420147 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415800    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415803    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415805    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415807    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415810    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415812    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415815    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415817    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415820    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415822    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415824    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415827    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415845    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415848    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415850    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415852    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415855    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415857    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415859    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415863    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 20:24:50.420627 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415865    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415868    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415870    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415873    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415876    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415878    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415881    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415884    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415887    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415889    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415892    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415894    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415897    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415900    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415902    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.415905    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.415969    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.415975    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.415986    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.415992    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.415998    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 20:24:50.421106 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416002    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416005    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416009    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416012    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416015    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416018    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416021    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416024    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416027    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416030    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416033    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416036    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416039    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416043    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416045    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416048    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416051    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416054    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416058    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416060    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416063    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416067    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416070    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416072    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 20:24:50.421600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416076    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416079    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416081    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416089    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416092    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416095    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416097    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416100    2557 flags.go:64] FLAG: --enable-server="true"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416103    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416107    2557 flags.go:64] FLAG: --event-burst="100"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416117    2557 flags.go:64] FLAG: --event-qps="50"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416120    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416124    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416127    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416130    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416136    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416139    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416142    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416145    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416147    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416150    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416153    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416156    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416158    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416161    2557 flags.go:64] FLAG: --feature-gates=""
Jul 29 20:24:50.422185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416164    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416167    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416170    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416173    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416176    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416179    2557 flags.go:64] FLAG: --help="false"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416181    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416184    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416187    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416190    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416193    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416196    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416199    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416202    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416204    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416207    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416210    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416213    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416216    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416218    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416221    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416224    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416228    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416231    2557 flags.go:64] FLAG: --lock-file=""
Jul 29 20:24:50.422819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416233    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416236    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416239    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416244    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416247    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416250    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416253    2557 flags.go:64] FLAG: --logging-format="text"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416255    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416260    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416262    2557 flags.go:64] FLAG: --manifest-url=""
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416265    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416269    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416272    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416276    2557 flags.go:64] FLAG: --max-pods="110"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416279    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416281    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416284    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416287    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416290    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416293    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416295    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416302    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416305    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416308    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 20:24:50.423403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416311    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416313    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416319    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416322    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416325    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416327    2557 flags.go:64] FLAG: --port="10250"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416330    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416334    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09ab3cabeb0d79bf0"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416337    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416340    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416343    2557 flags.go:64] FLAG: --register-node="true"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416345    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416349    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416352    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416355    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416357    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416362    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416365    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416367    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416370    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416373    2557 flags.go:64] FLAG: --runonce="false"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416375    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416378    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416381    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416384    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 20:24:50.423976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416387    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416390    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416392    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416395    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416398    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416400    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416403    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416406    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416409    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416412    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416414    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416419    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416422    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416424    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416430    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416432    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416435    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416437    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416440    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416443    2557 flags.go:64] FLAG: --v="2"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416446    2557 flags.go:64] FLAG: --version="false"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416450    2557 flags.go:64] FLAG: --vmodule=""
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416454    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.416459    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416574    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 20:24:50.424570 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416577    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416580    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416583    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416586    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416588    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416591    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416593    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416595    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416598    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416600    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416603    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416605    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416608    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416610    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416612    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416615    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416618    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416620    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416622    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416625    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 20:24:50.425158 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416627    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416631    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416633    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416635    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416638    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416640    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416642    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416645    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416647    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416650    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416654    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416656    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416659    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416663    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416666    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416669    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416672    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416675    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416677    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416680    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 20:24:50.425641 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416682    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416685    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416687    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416690    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416692    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416695    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416697    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416700    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416703    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416706    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416709    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416712    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416715    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416719    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416721    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416724    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416727    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416729    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416731    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416734    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 20:24:50.426144 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416736    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416739    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416743    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416746    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416748    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416751    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416754    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416757    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416761    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416764    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416766    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416769    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416771    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416773    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416776    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416778    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416781    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416783    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416786    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 20:24:50.426665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416788    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416791    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416793    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416796    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416798    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416800    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416804    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416806    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416809    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416812    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416814    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416817    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416819    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416821    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416824    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416827    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416845    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416849    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 20:24:50.427126 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.416852    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.417486    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.423371    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.423384    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.423402    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.423407    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423458    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423463    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423466    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423469    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423472    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423474    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423477    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423480    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 20:24:50.427538 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423483    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423485    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423488    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423491    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423493    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423496    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423499    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423501    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423504    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423507    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423510    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423512    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423515    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423517    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423520    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423522    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423525    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423527    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423530    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423532    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 20:24:50.427932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423535    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423539    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423541    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423544    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423547    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423549    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423553    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423557    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423559    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423562    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423565    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423568    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423570    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423573    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423575    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423578    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423581    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423583    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423586    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 20:24:50.428407 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423588    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423592    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423595    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423598    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423601    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423604    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423607    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423609    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423611    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423614    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423616    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423619    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423622    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423625    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423627    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423631    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423633    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423635    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423638    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 20:24:50.428867 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423640    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423643    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423645    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423648    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423650    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423653    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423655    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423658    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423660    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423663    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423666    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423670    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423673    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423675    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423678    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423680    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423683    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423685    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423688    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 20:24:50.429319 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423690    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423692    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423695    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423697    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423700    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423702    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423705    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423707    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423709    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423712    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423715    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423717    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423719    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423722    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.423727    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 20:24:50.429756 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423844    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423849    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423852    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423855    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423858    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423861    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423863    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423866    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423868    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423871    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423873    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423876    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423878    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423881    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423883    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423886    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423888    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423891    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423893    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 20:24:50.430132 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423896    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423898    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423901    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423903    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423906    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423908    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423910    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423913    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423916    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423919    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423921    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423924    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423926    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423929    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423931    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423934    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423936    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423938    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423941    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423943    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 20:24:50.430575 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423946    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423948    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423950    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423953    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423955    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423958    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423960    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423963    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423965    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423967    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423970    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423972    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423974    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423977    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423979    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423982    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423985    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423987    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423990    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423993    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 20:24:50.431108 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423995    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.423998    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424001    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424004    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424007    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424009    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424011    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424014    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424017    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424021    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424023    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424026    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424029    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424032    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424034    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424036    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424039    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424041    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424044    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 20:24:50.431582 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424046    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424049    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424051    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424053    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424056    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424058    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424061    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424063    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424066    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424069    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424072    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424074    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424077    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424080    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424082    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424085    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424088    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424090    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424093    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424096    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 20:24:50.432039 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:50.424100    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 20:24:50.432513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.424104    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 20:24:50.432513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.424197    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 20:24:50.432513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.427103    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 20:24:50.432513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.428421    2557 server.go:1019] "Starting client certificate rotation"
Jul 29 20:24:50.432513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.428515    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 20:24:50.432513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.428572    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 20:24:50.432513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.431375    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 20:24:50.432816 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.432655    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 20:24:50.444214 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.444199    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 29 20:24:50.445991 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.445979    2557 log.go:25] "Validated CRI v1 image API"
Jul 29 20:24:50.448705 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.448687    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 20:24:50.451096 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.451079    2557 fs.go:135] Filesystem UUIDs: map[239faaa4-3334-47d1-ac5e-7aeb1a1feeb1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e433bbeb-800b-4477-b819-e6943a2ba278:/dev/nvme0n1p4]
Jul 29 20:24:50.451153 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.451095    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 20:24:50.456618 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.456523    2557 manager.go:216] Machine: {Timestamp:2026-07-29 20:24:50.455215044 +0000 UTC m=+0.306715715 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201740 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2027ae1bda323e741e99509b3b57ff SystemUUID:ec2027ae-1bda-323e-741e-99509b3b57ff BootID:ca1d9a34-593b-4316-820f-763cdac2aa92 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:21:2d:82:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:21:2d:82:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:6b:38:17:dc:c2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 20:24:50.456618 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.456617    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 20:24:50.456725 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.456714    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 20:24:50.459713 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.459689    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 20:24:50.459827 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.459716    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 20:24:50.460379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.460369    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 20:24:50.460409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.460382    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 20:24:50.460409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.460389    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 20:24:50.461095 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.461085    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 20:24:50.461151 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.461136    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 20:24:50.462288 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.462279    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 20:24:50.464031 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.464021    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 20:24:50.464150 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.464140    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 20:24:50.464183 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.464168    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 20:24:50.464183 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.464180    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 20:24:50.464236 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.464194    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 20:24:50.464236 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.464203    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 29 20:24:50.464236 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.464211    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 20:24:50.464507 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.464496    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 20:24:50.464567 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.464512    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 20:24:50.466469 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.466449    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 20:24:50.468294 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.468281    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 20:24:50.468347 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.468310    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 20:24:50.469741 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469730    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 20:24:50.469786 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469746    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 20:24:50.469786 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469752    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 20:24:50.469786 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469757    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 20:24:50.469786 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469765    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 20:24:50.469786 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469770    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 20:24:50.469786 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469778    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 20:24:50.469786 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469782    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 20:24:50.469786 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469789    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 20:24:50.469995 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469794    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 20:24:50.469995 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469802    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 20:24:50.469995 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.469806    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 20:24:50.470653 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.470644    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 20:24:50.470653 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.470653    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 20:24:50.474327 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.474307    2557 server.go:1268] "Started kubelet"
Jul 29 20:24:50.474464 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.474437    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 20:24:50.474881 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.474558    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 20:24:50.474881 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.474628    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 20:24:50.475072 ip-10-0-137-228 systemd[1]: Started Kubernetes Kubelet.
Jul 29 20:24:50.476275 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.476213    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 20:24:50.477141 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.477114    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 20:24:50.477239 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.477166    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 20:24:50.477352 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.477321    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 20:24:50.477657 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.477644    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 20:24:50.479576 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.479549    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 20:24:50.482156 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.481249    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-228.ec2.internal.18c6dc7365162359  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-228.ec2.internal,UID:ip-10-0-137-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-228.ec2.internal,},FirstTimestamp:2026-07-29 20:24:50.474279769 +0000 UTC m=+0.325780438,LastTimestamp:2026-07-29 20:24:50.474279769 +0000 UTC m=+0.325780438,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-228.ec2.internal,}"
Jul 29 20:24:50.483258 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.483245    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 20:24:50.483327 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.483262    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 20:24:50.483327 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.483310    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:50.483895 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.483804    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 20:24:50.483895 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.483887    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 20:24:50.484024 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.483900    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 20:24:50.484024 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.483968    2557 factory.go:55] Registering systemd factory
Jul 29 20:24:50.484024 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.483983    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 29 20:24:50.484024 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.483983    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 20:24:50.484024 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.484026    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 20:24:50.484244 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.484229    2557 factory.go:153] Registering CRI-O factory
Jul 29 20:24:50.484244 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.484243    2557 factory.go:223] Registration of the crio container factory successfully
Jul 29 20:24:50.484336 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.484287    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 20:24:50.484336 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.484305    2557 factory.go:103] Registering Raw factory
Jul 29 20:24:50.484336 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.484314    2557 manager.go:1196] Started watching for new ooms in manager
Jul 29 20:24:50.484612 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.484597    2557 manager.go:349] Starting recovery of all containers
Jul 29 20:24:50.486353 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.486336    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bl2r6"
Jul 29 20:24:50.491405 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.491381    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 20:24:50.491405 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.491382    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 20:24:50.495107 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.495088    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bl2r6"
Jul 29 20:24:50.495910 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.495895    2557 manager.go:354] Recovery completed
Jul 29 20:24:50.500656 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.500645    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 20:24:50.502390 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.502375    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 20:24:50.502455 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.502402    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 20:24:50.502455 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.502411    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID"
Jul 29 20:24:50.502906 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.502890    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 20:24:50.502906 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.502906    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 20:24:50.503038 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.502923    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 20:24:50.503038 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.502896    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 20:24:50.503586 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.503571    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 20:24:50.503664 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.503597    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 20:24:50.503664 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.503609    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID"
Jul 29 20:24:50.504618 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.504604    2557 policy_none.go:49] "None policy: Start"
Jul 29 20:24:50.504676 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.504625    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 20:24:50.504676 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.504643    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 20:24:50.504917 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.504858    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-228.ec2.internal.18c6dc7366c31044  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-228.ec2.internal,UID:ip-10-0-137-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-228.ec2.internal,},FirstTimestamp:2026-07-29 20:24:50.502389828 +0000 UTC m=+0.353890491,LastTimestamp:2026-07-29 20:24:50.502389828 +0000 UTC m=+0.353890491,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-228.ec2.internal,}"
Jul 29 20:24:50.505804 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.505790    2557 policy_none.go:47] "Start"
Jul 29 20:24:50.544345 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.544328    2557 manager.go:337] "Starting Device Plugin manager"
Jul 29 20:24:50.544417 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.544356    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 20:24:50.544417 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.544364    2557 server.go:87] "Starting device plugin registration server"
Jul 29 20:24:50.544581 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.544569    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 20:24:50.544630 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.544581    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 20:24:50.544703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.544687    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 20:24:50.545033 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.544772    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 20:24:50.545033 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.544783    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 20:24:50.545159 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.545148    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 20:24:50.545208 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.545186    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:50.613775 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.613746    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 20:24:50.614918 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.614902    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 20:24:50.614971 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.614945    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 20:24:50.614971 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.614966    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 20:24:50.615066 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.614997    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 20:24:50.617190 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.617168    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 20:24:50.645028 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.644997    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 20:24:50.646410 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.646395    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 20:24:50.646476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.646424    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 20:24:50.646476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.646438    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID"
Jul 29 20:24:50.646476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.646457    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.654279 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.654267    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.654335 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.654284    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-228.ec2.internal\": node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:50.673337 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.673279    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:50.715503 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.715485    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal"]
Jul 29 20:24:50.715567 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.715533    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 20:24:50.716886 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.716873    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 20:24:50.716950 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.716896    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 20:24:50.716950 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.716906    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID"
Jul 29 20:24:50.718290 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.718278    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 20:24:50.718458 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.718444    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.718517 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.718476    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 20:24:50.719909 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.719891    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 20:24:50.719981 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.719914    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 20:24:50.719981 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.719928    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID"
Jul 29 20:24:50.720506 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.720493    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 20:24:50.720564 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.720517    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 20:24:50.720564 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.720530    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID"
Jul 29 20:24:50.721700 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.721689    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.721741 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.721711    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 20:24:50.722401 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.722389    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 20:24:50.722455 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.722411    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 20:24:50.722455 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.722420    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID"
Jul 29 20:24:50.743330 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.743313    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-228.ec2.internal\" not found" node="ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.747263 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.747247    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-228.ec2.internal\" not found" node="ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.773907 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.773887    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:50.786103 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.786083    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19fd5d16ce8c194e1822ccd076caf998-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"19fd5d16ce8c194e1822ccd076caf998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.786188 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.786110    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19fd5d16ce8c194e1822ccd076caf998-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"19fd5d16ce8c194e1822ccd076caf998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.786188 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.786129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e51e885d9de0c47fa459d70fe2d1f945-config\") pod \"kube-apiserver-proxy-ip-10-0-137-228.ec2.internal\" (UID: \"e51e885d9de0c47fa459d70fe2d1f945\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.874400 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.874377    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:50.886523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.886507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19fd5d16ce8c194e1822ccd076caf998-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"19fd5d16ce8c194e1822ccd076caf998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.886595 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.886527    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19fd5d16ce8c194e1822ccd076caf998-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"19fd5d16ce8c194e1822ccd076caf998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.886595 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.886544    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e51e885d9de0c47fa459d70fe2d1f945-config\") pod \"kube-apiserver-proxy-ip-10-0-137-228.ec2.internal\" (UID: \"e51e885d9de0c47fa459d70fe2d1f945\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.886595 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.886580    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e51e885d9de0c47fa459d70fe2d1f945-config\") pod \"kube-apiserver-proxy-ip-10-0-137-228.ec2.internal\" (UID: \"e51e885d9de0c47fa459d70fe2d1f945\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.886719 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.886603    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19fd5d16ce8c194e1822ccd076caf998-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"19fd5d16ce8c194e1822ccd076caf998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.886719 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:50.886628    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19fd5d16ce8c194e1822ccd076caf998-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"19fd5d16ce8c194e1822ccd076caf998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:50.975461 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:50.975412    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:51.049427 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.049406    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:51.050585 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.050571    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:51.076082 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.075952    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:51.181980 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.181945    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:51.283144 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.283121    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:51.384598 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.384566    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found"
Jul 29 20:24:51.403320 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.403295    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 20:24:51.412982 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.412964    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 20:24:51.428041 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.428018    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 20:24:51.428168 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.428149    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 20:24:51.428221 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.428178    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 20:24:51.428221 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.428178    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 20:24:51.464689 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.464667    2557 apiserver.go:52] "Watching apiserver"
Jul 29 20:24:51.484365 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.484340    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 20:24:51.484473 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.484346    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:51.487992 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.487970    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 20:24:51.488366 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.488344    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-8xvgl","openshift-multus/network-metrics-daemon-zkjgg","openshift-network-diagnostics/network-check-target-n4bt5","openshift-ovn-kubernetes/ovnkube-node-288tq","kube-system/global-pull-secret-syncer-knpwg","kube-system/konnectivity-agent-pfr9g","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp","openshift-dns/node-resolver-hzht2","openshift-image-registry/node-ca-z7xkh","openshift-multus/multus-additional-cni-plugins-kfxpl","openshift-multus/multus-dz2nm","openshift-network-operator/iptables-alerter-mlzr9"]
Jul 29 20:24:51.489672 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.489652    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.492586 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.492560    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 20:24:51.492586 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.492572    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xr5b6\""
Jul 29 20:24:51.492739 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.492640    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 20:24:51.492739 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.492717    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:51.492867 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.492777    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:24:51.493862 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.493831    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:51.493947 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.493900    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:24:51.494393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.494377    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 20:24:51.494450 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.494439    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal"
Jul 29 20:24:51.495229 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.495216    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.496467 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.496450    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:51.496544 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.496502    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:24:51.497497 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.497477    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 20:24:51.497781 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.497766    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:24:51.498824 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.498799    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 20:24:51.498955 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.498782    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 20:19:50 +0000 UTC" deadline="2028-04-12 01:40:23.09247143 +0000 UTC"
Jul 29 20:24:51.498955 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.498849    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14933h15m31.593626832s"
Jul 29 20:24:51.498955 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.498895    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 20:24:51.498955 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.498937    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 20:24:51.498955 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.498938    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8sxln\""
Jul 29 20:24:51.499200 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.498957    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 20:24:51.499200 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.499074    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 20:24:51.499200 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.499119    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 20:24:51.499347 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.499241    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.500438 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.500416    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b5l2g\""
Jul 29 20:24:51.500561 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.500545    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 20:24:51.500651 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.500634    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 20:24:51.500985 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.500967    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.502121 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.502105    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-shf7z\""
Jul 29 20:24:51.502540 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.502309    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.502540 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.502329    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 20:24:51.502540 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.502340    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 20:24:51.502540 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.502348    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 20:24:51.503555 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.503535    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 20:24:51.503555 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.503543    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 20:24:51.503688 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.503646    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6slhk\""
Jul 29 20:24:51.503827 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.503808    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.505121 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.505105    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 20:24:51.505210 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.505187    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s4w5v\""
Jul 29 20:24:51.505271 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.505256    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.505382 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.505361    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 20:24:51.505446 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.505127    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 20:24:51.507041 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.507022    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal"]
Jul 29 20:24:51.507138 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.507108    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.507395 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.507375    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 20:24:51.507638 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.507625    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 20:24:51.508059 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.508042    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 20:24:51.508307 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.508277    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 20:24:51.508307 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.508286    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 20:24:51.508449 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.508286    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 20:24:51.508449 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.508422    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ldwqz\""
Jul 29 20:24:51.508802 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.508782    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 20:24:51.508899 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.508807    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lfp9q\""
Jul 29 20:24:51.509385 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.509360    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal"]
Jul 29 20:24:51.511591 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.511566    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 20:24:51.511591 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.511582    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mxl9m\""
Jul 29 20:24:51.511762 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.511608    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 20:24:51.511762 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.511583    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 20:24:51.521140 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.521121    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vxd57"
Jul 29 20:24:51.537337 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.537320    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vxd57"
Jul 29 20:24:51.577551 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.577524    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fd5d16ce8c194e1822ccd076caf998.slice/crio-6dddb7291aaca869e10e8b9b664d243a6b44932d4f4e66e5a6d241571272ebb0 WatchSource:0}: Error finding container 6dddb7291aaca869e10e8b9b664d243a6b44932d4f4e66e5a6d241571272ebb0: Status 404 returned error can't find the container with id 6dddb7291aaca869e10e8b9b664d243a6b44932d4f4e66e5a6d241571272ebb0
Jul 29 20:24:51.577898 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.577881    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51e885d9de0c47fa459d70fe2d1f945.slice/crio-bdff5456dbdb8c290046865bc78bcae2b87274479eb26b3904f267cec1a4e006 WatchSource:0}: Error finding container bdff5456dbdb8c290046865bc78bcae2b87274479eb26b3904f267cec1a4e006: Status 404 returned error can't find the container with id bdff5456dbdb8c290046865bc78bcae2b87274479eb26b3904f267cec1a4e006
Jul 29 20:24:51.583137 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.583117    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 20:24:51.584781 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.584765    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 20:24:51.590443 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590426    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-socket-dir-parent\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.590529 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77637794-0ae7-4164-9117-68def5c157bc-host-slash\") pod \"iptables-alerter-mlzr9\" (UID: \"77637794-0ae7-4164-9117-68def5c157bc\") " pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.590529 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-sysctl-conf\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.590529 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-node-log\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.590529 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-system-cni-dir\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.590688 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-systemd\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.590688 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-socket-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.590688 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590636    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-registration-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.590688 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590651    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-cni-dir\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.590688 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590666    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-cni-bin\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.590870 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590698    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-host\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.590870 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590728    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ft2m\" (UniqueName: \"kubernetes.io/projected/4ac085ad-d967-429f-97ea-1c5c2d0e4284-kube-api-access-5ft2m\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.590870 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590758    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbjvx\" (UniqueName: \"kubernetes.io/projected/f72d1a44-c5d3-4907-a445-6dc4e5129713-kube-api-access-dbjvx\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.590870 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590782    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87qcr\" (UniqueName: \"kubernetes.io/projected/9f929d08-18ca-42de-b80c-4395c73e9293-kube-api-access-87qcr\") pod \"node-ca-z7xkh\" (UID: \"9f929d08-18ca-42de-b80c-4395c73e9293\") " pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.590870 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590807    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-system-cni-dir\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.590870 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590831    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-slash\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590875    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-log-socket\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590898    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-cni-netd\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590925    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-modprobe-d\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.591102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-cnibin\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.591102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590972    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.591102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.590999    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-systemd-units\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c330c3b6-c273-4544-9233-0002fd74a823-env-overrides\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591043    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-daemon-config\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591067    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-sysctl-d\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7trdc\" (UniqueName: \"kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc\") pod \"network-check-target-n4bt5\" (UID: \"f7de3f6a-cfef-4581-ac7f-5bccfd34152e\") " pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-var-lib-openvswitch\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591153    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-etc-openvswitch\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591189    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e56f612-eb45-4aef-acff-46673cd9a779-dbus\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591204    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-sys\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591227    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f929d08-18ca-42de-b80c-4395c73e9293-host\") pod \"node-ca-z7xkh\" (UID: \"9f929d08-18ca-42de-b80c-4395c73e9293\") " pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591245    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-cnibin\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-var-lib-kubelet\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-kubelet\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591312    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-run-systemd\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591327    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591345    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b9d713d-351f-440b-b69d-07ef0ef69141-cni-binary-copy\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591360    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-run-k8s-cni-cncf-io\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591381    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-etc-kubernetes\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591419    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-run\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591451    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591490    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-run-netns\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591516    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-var-lib-cni-bin\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591550    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-var-lib-cni-multus\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-device-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591588    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-sys-fs\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591612    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlc22\" (UniqueName: \"kubernetes.io/projected/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-kube-api-access-rlc22\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591655    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-run-multus-certs\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591674    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-tuned\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591695    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-run-openvswitch\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591710    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c330c3b6-c273-4544-9233-0002fd74a823-ovnkube-script-lib\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-lib-modules\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-hostroot\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.591817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591770    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-run-ovn\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f929d08-18ca-42de-b80c-4395c73e9293-serviceca\") pod \"node-ca-z7xkh\" (UID: \"9f929d08-18ca-42de-b80c-4395c73e9293\") " pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591875    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-run-netns\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591904    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c330c3b6-c273-4544-9233-0002fd74a823-ovnkube-config\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c330c3b6-c273-4544-9233-0002fd74a823-ovn-node-metrics-cert\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591945    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4e2a3d5-4194-45d3-9898-5d9d2e0f4546-konnectivity-ca\") pod \"konnectivity-agent-pfr9g\" (UID: \"e4e2a3d5-4194-45d3-9898-5d9d2e0f4546\") " pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-kubernetes\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac085ad-d967-429f-97ea-1c5c2d0e4284-tmp\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.591990    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl5jr\" (UniqueName: \"kubernetes.io/projected/8cd20bda-e613-45d4-8fff-0a7ddc584f56-kube-api-access-hl5jr\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592011    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-etc-selinux\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592039    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25-hosts-file\") pod \"node-resolver-hzht2\" (UID: \"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25\") " pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592061    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-os-release\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592076    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-cni-binary-copy\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592106    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-sysconfig\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-var-lib-kubelet\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.592339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592168    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25-tmp-dir\") pod \"node-resolver-hzht2\" (UID: \"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25\") " pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592193    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmqgt\" (UniqueName: \"kubernetes.io/projected/a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25-kube-api-access-zmqgt\") pod \"node-resolver-hzht2\" (UID: \"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25\") " pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592237    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9svrf\" (UniqueName: \"kubernetes.io/projected/c330c3b6-c273-4544-9233-0002fd74a823-kube-api-access-9svrf\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e56f612-eb45-4aef-acff-46673cd9a779-kubelet-config\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592304    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4e2a3d5-4194-45d3-9898-5d9d2e0f4546-agent-certs\") pod \"konnectivity-agent-pfr9g\" (UID: \"e4e2a3d5-4194-45d3-9898-5d9d2e0f4546\") " pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592320    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77637794-0ae7-4164-9117-68def5c157bc-iptables-alerter-script\") pod \"iptables-alerter-mlzr9\" (UID: \"77637794-0ae7-4164-9117-68def5c157bc\") " pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-os-release\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592375    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-conf-dir\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592390    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx4nz\" (UniqueName: \"kubernetes.io/projected/2b9d713d-351f-440b-b69d-07ef0ef69141-kube-api-access-nx4nz\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592405    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-946lz\" (UniqueName: \"kubernetes.io/projected/77637794-0ae7-4164-9117-68def5c157bc-kube-api-access-946lz\") pod \"iptables-alerter-mlzr9\" (UID: \"77637794-0ae7-4164-9117-68def5c157bc\") " pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.593004 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.592455    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-run-ovn-kubernetes\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.610699 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.610682    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 20:24:51.618366 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.618331    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" event={"ID":"e51e885d9de0c47fa459d70fe2d1f945","Type":"ContainerStarted","Data":"bdff5456dbdb8c290046865bc78bcae2b87274479eb26b3904f267cec1a4e006"}
Jul 29 20:24:51.619349 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.619326    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" event={"ID":"19fd5d16ce8c194e1822ccd076caf998","Type":"ContainerStarted","Data":"6dddb7291aaca869e10e8b9b664d243a6b44932d4f4e66e5a6d241571272ebb0"}
Jul 29 20:24:51.693684 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693666    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-var-lib-cni-bin\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.693777 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693690    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-var-lib-cni-multus\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.693777 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693706    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-device-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.693777 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-sys-fs\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.693777 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693736    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.693925 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693795    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-device-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.693925 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693794    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-var-lib-cni-bin\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.693925 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693794    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-var-lib-cni-multus\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.693925 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693822    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlc22\" (UniqueName: \"kubernetes.io/projected/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-kube-api-access-rlc22\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.693925 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693817    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-sys-fs\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.693925 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693870    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-run-multus-certs\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.693925 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693913    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-run-multus-certs\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.693977    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-tuned\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-run-openvswitch\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694017    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c330c3b6-c273-4544-9233-0002fd74a823-ovnkube-script-lib\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-lib-modules\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694053    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-hostroot\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694078    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-run-ovn\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694093    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-run-openvswitch\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694104    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694127    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f929d08-18ca-42de-b80c-4395c73e9293-serviceca\") pod \"node-ca-z7xkh\" (UID: \"9f929d08-18ca-42de-b80c-4395c73e9293\") " pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694141    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-hostroot\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.694172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694152    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-run-netns\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694151    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-run-ovn\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-run-netns\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-lib-modules\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.694238    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694256    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c330c3b6-c273-4544-9233-0002fd74a823-ovnkube-config\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c330c3b6-c273-4544-9233-0002fd74a823-ovn-node-metrics-cert\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.694323    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs podName:8cd20bda-e613-45d4-8fff-0a7ddc584f56 nodeName:}" failed. No retries permitted until 2026-07-29 20:24:52.194302627 +0000 UTC m=+2.045803297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs") pod "network-metrics-daemon-zkjgg" (UID: "8cd20bda-e613-45d4-8fff-0a7ddc584f56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694314    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4e2a3d5-4194-45d3-9898-5d9d2e0f4546-konnectivity-ca\") pod \"konnectivity-agent-pfr9g\" (UID: \"e4e2a3d5-4194-45d3-9898-5d9d2e0f4546\") " pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694382    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-kubernetes\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694430    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-kubernetes\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694450    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac085ad-d967-429f-97ea-1c5c2d0e4284-tmp\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694479    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl5jr\" (UniqueName: \"kubernetes.io/projected/8cd20bda-e613-45d4-8fff-0a7ddc584f56-kube-api-access-hl5jr\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694504    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-etc-selinux\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.694703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694527    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25-hosts-file\") pod \"node-resolver-hzht2\" (UID: \"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25\") " pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694815    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-os-release\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694846    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-cni-binary-copy\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694871    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-sysconfig\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694669    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-etc-selinux\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694896    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-var-lib-kubelet\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694906    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c330c3b6-c273-4544-9233-0002fd74a823-ovnkube-script-lib\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694769    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25-hosts-file\") pod \"node-resolver-hzht2\" (UID: \"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25\") " pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694610    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f929d08-18ca-42de-b80c-4395c73e9293-serviceca\") pod \"node-ca-z7xkh\" (UID: \"9f929d08-18ca-42de-b80c-4395c73e9293\") " pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25-tmp-dir\") pod \"node-resolver-hzht2\" (UID: \"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25\") " pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694974    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmqgt\" (UniqueName: \"kubernetes.io/projected/a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25-kube-api-access-zmqgt\") pod \"node-resolver-hzht2\" (UID: \"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25\") " pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694985    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-var-lib-kubelet\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694995    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9svrf\" (UniqueName: \"kubernetes.io/projected/c330c3b6-c273-4544-9233-0002fd74a823-kube-api-access-9svrf\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.694999    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-os-release\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695017    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e56f612-eb45-4aef-acff-46673cd9a779-kubelet-config\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695021    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4e2a3d5-4194-45d3-9898-5d9d2e0f4546-konnectivity-ca\") pod \"konnectivity-agent-pfr9g\" (UID: \"e4e2a3d5-4194-45d3-9898-5d9d2e0f4546\") " pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695082    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c330c3b6-c273-4544-9233-0002fd74a823-ovnkube-config\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.695487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695095    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-sysconfig\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695303    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4e2a3d5-4194-45d3-9898-5d9d2e0f4546-agent-certs\") pod \"konnectivity-agent-pfr9g\" (UID: \"e4e2a3d5-4194-45d3-9898-5d9d2e0f4546\") " pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695318    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25-tmp-dir\") pod \"node-resolver-hzht2\" (UID: \"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25\") " pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695331    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77637794-0ae7-4164-9117-68def5c157bc-iptables-alerter-script\") pod \"iptables-alerter-mlzr9\" (UID: \"77637794-0ae7-4164-9117-68def5c157bc\") " pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695354    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-os-release\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695305    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e56f612-eb45-4aef-acff-46673cd9a779-kubelet-config\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695395    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-conf-dir\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695426    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4nz\" (UniqueName: \"kubernetes.io/projected/2b9d713d-351f-440b-b69d-07ef0ef69141-kube-api-access-nx4nz\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695452    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-946lz\" (UniqueName: \"kubernetes.io/projected/77637794-0ae7-4164-9117-68def5c157bc-kube-api-access-946lz\") pod \"iptables-alerter-mlzr9\" (UID: \"77637794-0ae7-4164-9117-68def5c157bc\") " pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695477    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695495    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-conf-dir\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695503    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-run-ovn-kubernetes\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695542    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-cni-binary-copy\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695564    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-socket-dir-parent\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695605    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77637794-0ae7-4164-9117-68def5c157bc-host-slash\") pod \"iptables-alerter-mlzr9\" (UID: \"77637794-0ae7-4164-9117-68def5c157bc\") " pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695642    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-sysctl-conf\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695549    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-run-ovn-kubernetes\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.696820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-node-log\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695689    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77637794-0ae7-4164-9117-68def5c157bc-host-slash\") pod \"iptables-alerter-mlzr9\" (UID: \"77637794-0ae7-4164-9117-68def5c157bc\") " pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695691    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-socket-dir-parent\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695852    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77637794-0ae7-4164-9117-68def5c157bc-iptables-alerter-script\") pod \"iptables-alerter-mlzr9\" (UID: \"77637794-0ae7-4164-9117-68def5c157bc\") " pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695857    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-system-cni-dir\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695788    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-sysctl-conf\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695597    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695899    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-node-log\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695919    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-systemd\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695948    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-system-cni-dir\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695953    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-socket-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695711    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-os-release\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695983    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-registration-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.695995    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-systemd\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696009    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-cni-dir\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696034    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-cni-bin\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696051    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-socket-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696070    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-host\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.697714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696092    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ft2m\" (UniqueName: \"kubernetes.io/projected/4ac085ad-d967-429f-97ea-1c5c2d0e4284-kube-api-access-5ft2m\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696119    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbjvx\" (UniqueName: \"kubernetes.io/projected/f72d1a44-c5d3-4907-a445-6dc4e5129713-kube-api-access-dbjvx\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696122    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-cni-dir\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696132    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-cni-bin\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696142    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-host\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696144    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87qcr\" (UniqueName: \"kubernetes.io/projected/9f929d08-18ca-42de-b80c-4395c73e9293-kube-api-access-87qcr\") pod \"node-ca-z7xkh\" (UID: \"9f929d08-18ca-42de-b80c-4395c73e9293\") " pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696186    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-system-cni-dir\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696245    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-slash\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696272    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f72d1a44-c5d3-4907-a445-6dc4e5129713-registration-dir\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696280    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-system-cni-dir\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696274    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-log-socket\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-cni-netd\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696341    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-log-socket\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696301    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-slash\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696354    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-modprobe-d\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696406    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-cnibin\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696432    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-modprobe-d\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.698430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696435    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696409    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-cni-netd\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-systemd-units\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696443    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-cnibin\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696491    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c330c3b6-c273-4544-9233-0002fd74a823-env-overrides\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696533    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-daemon-config\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696578    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-sysctl-d\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696586    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-systemd-units\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696629    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trdc\" (UniqueName: \"kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc\") pod \"network-check-target-n4bt5\" (UID: \"f7de3f6a-cfef-4581-ac7f-5bccfd34152e\") " pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696663    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-var-lib-openvswitch\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696689    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-etc-openvswitch\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696714    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e56f612-eb45-4aef-acff-46673cd9a779-dbus\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696772    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-sys\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696795    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f929d08-18ca-42de-b80c-4395c73e9293-host\") pod \"node-ca-z7xkh\" (UID: \"9f929d08-18ca-42de-b80c-4395c73e9293\") " pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696838    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f929d08-18ca-42de-b80c-4395c73e9293-host\") pod \"node-ca-z7xkh\" (UID: \"9f929d08-18ca-42de-b80c-4395c73e9293\") " pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696836    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-var-lib-openvswitch\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696858    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-cnibin\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.698946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696913    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-etc-openvswitch\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696917    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-var-lib-kubelet\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696943    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-kubelet\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696958    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696966    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-run-systemd\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696983    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697013    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e56f612-eb45-4aef-acff-46673cd9a779-dbus\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697059    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-cnibin\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.697074    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697080    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-sys\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697105    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-var-lib-kubelet\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.697132    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret podName:0e56f612-eb45-4aef-acff-46673cd9a779 nodeName:}" failed. No retries permitted until 2026-07-29 20:24:52.197116282 +0000 UTC m=+2.048616955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret") pod "global-pull-secret-syncer-knpwg" (UID: "0e56f612-eb45-4aef-acff-46673cd9a779") : object "kube-system"/"original-pull-secret" not registered
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.696991    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697143    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-host-kubelet\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b9d713d-351f-440b-b69d-07ef0ef69141-cni-binary-copy\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697186    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c330c3b6-c273-4544-9233-0002fd74a823-run-systemd\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697199    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-run-k8s-cni-cncf-io\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699447 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697224    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-etc-kubernetes\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697246    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-run\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697271    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697275    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-sysctl-d\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697297    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-run-netns\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697362    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-run-netns\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697489    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-etc-kubernetes\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697540    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b9d713d-351f-440b-b69d-07ef0ef69141-host-run-k8s-cni-cncf-io\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ac085ad-d967-429f-97ea-1c5c2d0e4284-run\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697681    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697709    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c330c3b6-c273-4544-9233-0002fd74a823-env-overrides\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.697902    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b9d713d-351f-440b-b69d-07ef0ef69141-multus-daemon-config\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.698112    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b9d713d-351f-440b-b69d-07ef0ef69141-cni-binary-copy\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.698143    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ac085ad-d967-429f-97ea-1c5c2d0e4284-etc-tuned\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.698310    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c330c3b6-c273-4544-9233-0002fd74a823-ovn-node-metrics-cert\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.698752    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac085ad-d967-429f-97ea-1c5c2d0e4284-tmp\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.699954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.698995    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4e2a3d5-4194-45d3-9898-5d9d2e0f4546-agent-certs\") pod \"konnectivity-agent-pfr9g\" (UID: \"e4e2a3d5-4194-45d3-9898-5d9d2e0f4546\") " pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:24:51.704576 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.704552    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlc22\" (UniqueName: \"kubernetes.io/projected/236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb-kube-api-access-rlc22\") pod \"multus-additional-cni-plugins-kfxpl\" (UID: \"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb\") " pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.705711 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.705686    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl5jr\" (UniqueName: \"kubernetes.io/projected/8cd20bda-e613-45d4-8fff-0a7ddc584f56-kube-api-access-hl5jr\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:51.705822 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.705696    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 20:24:51.705822 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.705756    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 20:24:51.705822 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.705772    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7trdc for pod openshift-network-diagnostics/network-check-target-n4bt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:24:51.706048 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:51.705822    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc podName:f7de3f6a-cfef-4581-ac7f-5bccfd34152e nodeName:}" failed. No retries permitted until 2026-07-29 20:24:52.205806713 +0000 UTC m=+2.057307379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7trdc" (UniqueName: "kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc") pod "network-check-target-n4bt5" (UID: "f7de3f6a-cfef-4581-ac7f-5bccfd34152e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:24:51.706356 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.706330    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbjvx\" (UniqueName: \"kubernetes.io/projected/f72d1a44-c5d3-4907-a445-6dc4e5129713-kube-api-access-dbjvx\") pod \"aws-ebs-csi-driver-node-t7tvp\" (UID: \"f72d1a44-c5d3-4907-a445-6dc4e5129713\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.707387 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.707357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ft2m\" (UniqueName: \"kubernetes.io/projected/4ac085ad-d967-429f-97ea-1c5c2d0e4284-kube-api-access-5ft2m\") pod \"tuned-8xvgl\" (UID: \"4ac085ad-d967-429f-97ea-1c5c2d0e4284\") " pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.708163 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.708137    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9svrf\" (UniqueName: \"kubernetes.io/projected/c330c3b6-c273-4544-9233-0002fd74a823-kube-api-access-9svrf\") pod \"ovnkube-node-288tq\" (UID: \"c330c3b6-c273-4544-9233-0002fd74a823\") " pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.708379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.708361    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87qcr\" (UniqueName: \"kubernetes.io/projected/9f929d08-18ca-42de-b80c-4395c73e9293-kube-api-access-87qcr\") pod \"node-ca-z7xkh\" (UID: \"9f929d08-18ca-42de-b80c-4395c73e9293\") " pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.708497 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.708481    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx4nz\" (UniqueName: \"kubernetes.io/projected/2b9d713d-351f-440b-b69d-07ef0ef69141-kube-api-access-nx4nz\") pod \"multus-dz2nm\" (UID: \"2b9d713d-351f-440b-b69d-07ef0ef69141\") " pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.708763 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.708748    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-946lz\" (UniqueName: \"kubernetes.io/projected/77637794-0ae7-4164-9117-68def5c157bc-kube-api-access-946lz\") pod \"iptables-alerter-mlzr9\" (UID: \"77637794-0ae7-4164-9117-68def5c157bc\") " pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.708812 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.708759    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmqgt\" (UniqueName: \"kubernetes.io/projected/a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25-kube-api-access-zmqgt\") pod \"node-resolver-hzht2\" (UID: \"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25\") " pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.816020 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.815969    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8xvgl"
Jul 29 20:24:51.824413 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.824394    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac085ad_d967_429f_97ea_1c5c2d0e4284.slice/crio-a5e9cd54f3cbcee44a11f98c8e687865434a8d4049e292bfdf0fe6b1f144b6eb WatchSource:0}: Error finding container a5e9cd54f3cbcee44a11f98c8e687865434a8d4049e292bfdf0fe6b1f144b6eb: Status 404 returned error can't find the container with id a5e9cd54f3cbcee44a11f98c8e687865434a8d4049e292bfdf0fe6b1f144b6eb
Jul 29 20:24:51.831688 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.831669    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:24:51.837608 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.837588    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:24:51.839042 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.839023    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc330c3b6_c273_4544_9233_0002fd74a823.slice/crio-253547dddeceb6b9482f1da7927ad54f6b75489042906a1196ffb8898f438134 WatchSource:0}: Error finding container 253547dddeceb6b9482f1da7927ad54f6b75489042906a1196ffb8898f438134: Status 404 returned error can't find the container with id 253547dddeceb6b9482f1da7927ad54f6b75489042906a1196ffb8898f438134
Jul 29 20:24:51.844782 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.844759    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e2a3d5_4194_45d3_9898_5d9d2e0f4546.slice/crio-c0f13bc709c656cc28318fccec837f13779b65ff13cdb6a8511f22f24997df61 WatchSource:0}: Error finding container c0f13bc709c656cc28318fccec837f13779b65ff13cdb6a8511f22f24997df61: Status 404 returned error can't find the container with id c0f13bc709c656cc28318fccec837f13779b65ff13cdb6a8511f22f24997df61
Jul 29 20:24:51.872287 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.872258    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp"
Jul 29 20:24:51.879048 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.879028    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72d1a44_c5d3_4907_a445_6dc4e5129713.slice/crio-79ba83972243c2872dd19048de708ccb5c89147c3eec744b15b810a0e7745566 WatchSource:0}: Error finding container 79ba83972243c2872dd19048de708ccb5c89147c3eec744b15b810a0e7745566: Status 404 returned error can't find the container with id 79ba83972243c2872dd19048de708ccb5c89147c3eec744b15b810a0e7745566
Jul 29 20:24:51.879705 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.879689    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hzht2"
Jul 29 20:24:51.886058 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.886037    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z7xkh"
Jul 29 20:24:51.886297 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.886277    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68fc4eb_49d9_4406_a5c9_5bfce7a9ba25.slice/crio-7e976e42a2838fb5a7dcbe38a739240cd59eba4309fde5fb7ea412313744b2e7 WatchSource:0}: Error finding container 7e976e42a2838fb5a7dcbe38a739240cd59eba4309fde5fb7ea412313744b2e7: Status 404 returned error can't find the container with id 7e976e42a2838fb5a7dcbe38a739240cd59eba4309fde5fb7ea412313744b2e7
Jul 29 20:24:51.892400 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.892380    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kfxpl"
Jul 29 20:24:51.892591 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.892570    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f929d08_18ca_42de_b80c_4395c73e9293.slice/crio-cd1ab130545aac77df21943be7088c65c2e7472a72cd9b0b02ff3a4ee8f946c5 WatchSource:0}: Error finding container cd1ab130545aac77df21943be7088c65c2e7472a72cd9b0b02ff3a4ee8f946c5: Status 404 returned error can't find the container with id cd1ab130545aac77df21943be7088c65c2e7472a72cd9b0b02ff3a4ee8f946c5
Jul 29 20:24:51.898755 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.898735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dz2nm"
Jul 29 20:24:51.899471 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.899448    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236b7ae6_6e4e_4a86_8ded_0ea4d873dbdb.slice/crio-771b847f8fea1e104ed5c8578f346827b32dd2ee3b5c3e3aa5672a65878f9120 WatchSource:0}: Error finding container 771b847f8fea1e104ed5c8578f346827b32dd2ee3b5c3e3aa5672a65878f9120: Status 404 returned error can't find the container with id 771b847f8fea1e104ed5c8578f346827b32dd2ee3b5c3e3aa5672a65878f9120
Jul 29 20:24:51.905835 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.905815    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9d713d_351f_440b_b69d_07ef0ef69141.slice/crio-21133476666db533e1c019e26d7905621bc2899665f29d37997928f03fbf5717 WatchSource:0}: Error finding container 21133476666db533e1c019e26d7905621bc2899665f29d37997928f03fbf5717: Status 404 returned error can't find the container with id 21133476666db533e1c019e26d7905621bc2899665f29d37997928f03fbf5717
Jul 29 20:24:51.905917 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:51.905832    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mlzr9"
Jul 29 20:24:51.913032 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:24:51.913013    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77637794_0ae7_4164_9117_68def5c157bc.slice/crio-9f82b458b9a5209a61b1ef2dd886387b0b8630a09a92a02dd6f284bcfda2fe0b WatchSource:0}: Error finding container 9f82b458b9a5209a61b1ef2dd886387b0b8630a09a92a02dd6f284bcfda2fe0b: Status 404 returned error can't find the container with id 9f82b458b9a5209a61b1ef2dd886387b0b8630a09a92a02dd6f284bcfda2fe0b
Jul 29 20:24:52.201459 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.201380    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:52.201459 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.201439    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:52.201682 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:52.201571    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:24:52.201682 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:52.201628    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs podName:8cd20bda-e613-45d4-8fff-0a7ddc584f56 nodeName:}" failed. No retries permitted until 2026-07-29 20:24:53.201610198 +0000 UTC m=+3.053110864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs") pod "network-metrics-daemon-zkjgg" (UID: "8cd20bda-e613-45d4-8fff-0a7ddc584f56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:24:52.201806 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:52.201691    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 20:24:52.201806 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:52.201727    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret podName:0e56f612-eb45-4aef-acff-46673cd9a779 nodeName:}" failed. No retries permitted until 2026-07-29 20:24:53.201715013 +0000 UTC m=+3.053215684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret") pod "global-pull-secret-syncer-knpwg" (UID: "0e56f612-eb45-4aef-acff-46673cd9a779") : object "kube-system"/"original-pull-secret" not registered
Jul 29 20:24:52.302103 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.302071    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trdc\" (UniqueName: \"kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc\") pod \"network-check-target-n4bt5\" (UID: \"f7de3f6a-cfef-4581-ac7f-5bccfd34152e\") " pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:52.302288 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:52.302273    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 20:24:52.302357 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:52.302295    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 20:24:52.302357 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:52.302308    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7trdc for pod openshift-network-diagnostics/network-check-target-n4bt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:24:52.302459 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:52.302361    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc podName:f7de3f6a-cfef-4581-ac7f-5bccfd34152e nodeName:}" failed. No retries permitted until 2026-07-29 20:24:53.302345254 +0000 UTC m=+3.153845919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7trdc" (UniqueName: "kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc") pod "network-check-target-n4bt5" (UID: "f7de3f6a-cfef-4581-ac7f-5bccfd34152e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:24:52.539464 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.539396    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 20:19:51 +0000 UTC" deadline="2028-03-27 04:14:39.649858212 +0000 UTC"
Jul 29 20:24:52.539464 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.539462    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14551h49m47.110400117s"
Jul 29 20:24:52.617875 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.617844    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:52.618041 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:52.617964    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:24:52.633907 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.633874    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pfr9g" event={"ID":"e4e2a3d5-4194-45d3-9898-5d9d2e0f4546","Type":"ContainerStarted","Data":"c0f13bc709c656cc28318fccec837f13779b65ff13cdb6a8511f22f24997df61"}
Jul 29 20:24:52.647382 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.647344    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" event={"ID":"c330c3b6-c273-4544-9233-0002fd74a823","Type":"ContainerStarted","Data":"253547dddeceb6b9482f1da7927ad54f6b75489042906a1196ffb8898f438134"}
Jul 29 20:24:52.662392 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.662226    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8xvgl" event={"ID":"4ac085ad-d967-429f-97ea-1c5c2d0e4284","Type":"ContainerStarted","Data":"a5e9cd54f3cbcee44a11f98c8e687865434a8d4049e292bfdf0fe6b1f144b6eb"}
Jul 29 20:24:52.674340 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.674291    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mlzr9" event={"ID":"77637794-0ae7-4164-9117-68def5c157bc","Type":"ContainerStarted","Data":"9f82b458b9a5209a61b1ef2dd886387b0b8630a09a92a02dd6f284bcfda2fe0b"}
Jul 29 20:24:52.678538 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.678514    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dz2nm" event={"ID":"2b9d713d-351f-440b-b69d-07ef0ef69141","Type":"ContainerStarted","Data":"21133476666db533e1c019e26d7905621bc2899665f29d37997928f03fbf5717"}
Jul 29 20:24:52.686276 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.686251    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfxpl" event={"ID":"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb","Type":"ContainerStarted","Data":"771b847f8fea1e104ed5c8578f346827b32dd2ee3b5c3e3aa5672a65878f9120"}
Jul 29 20:24:52.702586 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.702514    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z7xkh" event={"ID":"9f929d08-18ca-42de-b80c-4395c73e9293","Type":"ContainerStarted","Data":"cd1ab130545aac77df21943be7088c65c2e7472a72cd9b0b02ff3a4ee8f946c5"}
Jul 29 20:24:52.715027 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.715002    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hzht2" event={"ID":"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25","Type":"ContainerStarted","Data":"7e976e42a2838fb5a7dcbe38a739240cd59eba4309fde5fb7ea412313744b2e7"}
Jul 29 20:24:52.727073 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.727053    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp" event={"ID":"f72d1a44-c5d3-4907-a445-6dc4e5129713","Type":"ContainerStarted","Data":"79ba83972243c2872dd19048de708ccb5c89147c3eec744b15b810a0e7745566"}
Jul 29 20:24:52.759536 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:52.759514    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 20:24:53.209357 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:53.209323    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:53.209520 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:53.209377    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:53.209520 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:53.209515    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:24:53.209635 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:53.209579    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs podName:8cd20bda-e613-45d4-8fff-0a7ddc584f56 nodeName:}" failed. No retries permitted until 2026-07-29 20:24:55.209561865 +0000 UTC m=+5.061062535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs") pod "network-metrics-daemon-zkjgg" (UID: "8cd20bda-e613-45d4-8fff-0a7ddc584f56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:24:53.209998 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:53.209980    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 20:24:53.210083 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:53.210071    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret podName:0e56f612-eb45-4aef-acff-46673cd9a779 nodeName:}" failed. No retries permitted until 2026-07-29 20:24:55.210056399 +0000 UTC m=+5.061557054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret") pod "global-pull-secret-syncer-knpwg" (UID: "0e56f612-eb45-4aef-acff-46673cd9a779") : object "kube-system"/"original-pull-secret" not registered
Jul 29 20:24:53.310720 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:53.310684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trdc\" (UniqueName: \"kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc\") pod \"network-check-target-n4bt5\" (UID: \"f7de3f6a-cfef-4581-ac7f-5bccfd34152e\") " pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:53.310898 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:53.310854    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 20:24:53.310898 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:53.310874    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 20:24:53.310898 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:53.310887    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7trdc for pod openshift-network-diagnostics/network-check-target-n4bt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:24:53.311069 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:53.310937    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc podName:f7de3f6a-cfef-4581-ac7f-5bccfd34152e nodeName:}" failed. No retries permitted until 2026-07-29 20:24:55.310921167 +0000 UTC m=+5.162421831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7trdc" (UniqueName: "kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc") pod "network-check-target-n4bt5" (UID: "f7de3f6a-cfef-4581-ac7f-5bccfd34152e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:24:53.540088 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:53.540051    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 20:19:51 +0000 UTC" deadline="2028-01-25 23:29:56.590084937 +0000 UTC"
Jul 29 20:24:53.540088 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:53.540088    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13083h5m3.050002215s"
Jul 29 20:24:53.615974 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:53.615510    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:53.615974 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:53.615649    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:24:53.615974 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:53.615703    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:53.615974 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:53.615816    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:24:53.740424 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:53.740398    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 20:24:53.989434 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:53.989360    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 20:24:54.620240 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:54.619397    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:54.620240 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:54.619530    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:24:55.225770 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:55.225693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:55.225770 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:55.225751    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:55.225998 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:55.225849    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 20:24:55.225998 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:55.225880    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:24:55.225998 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:55.225914    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret podName:0e56f612-eb45-4aef-acff-46673cd9a779 nodeName:}" failed. No retries permitted until 2026-07-29 20:24:59.225896142 +0000 UTC m=+9.077396792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret") pod "global-pull-secret-syncer-knpwg" (UID: "0e56f612-eb45-4aef-acff-46673cd9a779") : object "kube-system"/"original-pull-secret" not registered
Jul 29 20:24:55.225998 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:55.225933    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs podName:8cd20bda-e613-45d4-8fff-0a7ddc584f56 nodeName:}" failed. No retries permitted until 2026-07-29 20:24:59.225923768 +0000 UTC m=+9.077424421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs") pod "network-metrics-daemon-zkjgg" (UID: "8cd20bda-e613-45d4-8fff-0a7ddc584f56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:24:55.326402 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:55.326369    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trdc\" (UniqueName: \"kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc\") pod \"network-check-target-n4bt5\" (UID: \"f7de3f6a-cfef-4581-ac7f-5bccfd34152e\") " pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:55.326562 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:55.326540    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 20:24:55.326699 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:55.326569    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 20:24:55.326699 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:55.326582    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7trdc for pod openshift-network-diagnostics/network-check-target-n4bt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:24:55.326699 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:55.326640    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc podName:f7de3f6a-cfef-4581-ac7f-5bccfd34152e nodeName:}" failed. No retries permitted until 2026-07-29 20:24:59.326621412 +0000 UTC m=+9.178122086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7trdc" (UniqueName: "kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc") pod "network-check-target-n4bt5" (UID: "f7de3f6a-cfef-4581-ac7f-5bccfd34152e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:24:55.615441 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:55.615405    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:55.615629 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:55.615599    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:24:55.615691 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:55.615663    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:55.615827 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:55.615778    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:24:56.616532 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:56.616500    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:56.617126 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:56.616624    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:24:57.615187 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:57.615154    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:57.615374 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:57.615292    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:24:57.615792 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:57.615647    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:57.615792 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:57.615743    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:24:58.616010 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:58.615591    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:58.616010 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:58.615718    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:24:59.260571 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:59.259971    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:59.260571 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:59.260062    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:59.260571 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:59.260189    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 20:24:59.260571 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:59.260250    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret podName:0e56f612-eb45-4aef-acff-46673cd9a779 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:07.260230639 +0000 UTC m=+17.111731311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret") pod "global-pull-secret-syncer-knpwg" (UID: "0e56f612-eb45-4aef-acff-46673cd9a779") : object "kube-system"/"original-pull-secret" not registered
Jul 29 20:24:59.260571 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:59.260273    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:24:59.260571 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:59.260312    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs podName:8cd20bda-e613-45d4-8fff-0a7ddc584f56 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:07.260299238 +0000 UTC m=+17.111799891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs") pod "network-metrics-daemon-zkjgg" (UID: "8cd20bda-e613-45d4-8fff-0a7ddc584f56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:24:59.360747 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:59.360643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trdc\" (UniqueName: \"kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc\") pod \"network-check-target-n4bt5\" (UID: \"f7de3f6a-cfef-4581-ac7f-5bccfd34152e\") " pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:24:59.360936 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:59.360856    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 20:24:59.360936 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:59.360882    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 20:24:59.360936 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:59.360897    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7trdc for pod openshift-network-diagnostics/network-check-target-n4bt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:24:59.361145 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:59.360958    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc podName:f7de3f6a-cfef-4581-ac7f-5bccfd34152e nodeName:}" failed. No retries permitted until 2026-07-29 20:25:07.360940474 +0000 UTC m=+17.212441142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7trdc" (UniqueName: "kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc") pod "network-check-target-n4bt5" (UID: "f7de3f6a-cfef-4581-ac7f-5bccfd34152e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:24:59.616326 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:59.616050    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:24:59.616326 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:24:59.616167    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:24:59.616326 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:59.616171    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:24:59.616326 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:24:59.616246    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:00.616846 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:00.616805    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:00.617258 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:00.616915    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:01.616190 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:01.616160    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:01.616375 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:01.616291    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:01.616375 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:01.616328    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:01.616483 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:01.616399    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:02.615622 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:02.615589    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:02.616015 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:02.615701    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:03.615158 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:03.615127    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:03.615335 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:03.615251    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:03.615335 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:03.615307    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:03.615423 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:03.615397    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:04.615300 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:04.615271    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:04.615756 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:04.615382    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:05.616175 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:05.616140    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:05.616557 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:05.616249    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:05.616557 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:05.616316    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:05.616557 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:05.616410    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:06.615681 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:06.615648    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:06.615842 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:06.615769    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:07.314549 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:07.314514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:07.314996 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:07.314594    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:07.314996 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:07.314668    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:25:07.314996 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:07.314733    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs podName:8cd20bda-e613-45d4-8fff-0a7ddc584f56 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:23.314710808 +0000 UTC m=+33.166211462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs") pod "network-metrics-daemon-zkjgg" (UID: "8cd20bda-e613-45d4-8fff-0a7ddc584f56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:25:07.314996 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:07.314673    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 20:25:07.314996 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:07.314774    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret podName:0e56f612-eb45-4aef-acff-46673cd9a779 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:23.314767668 +0000 UTC m=+33.166268319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret") pod "global-pull-secret-syncer-knpwg" (UID: "0e56f612-eb45-4aef-acff-46673cd9a779") : object "kube-system"/"original-pull-secret" not registered
Jul 29 20:25:07.414975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:07.414941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trdc\" (UniqueName: \"kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc\") pod \"network-check-target-n4bt5\" (UID: \"f7de3f6a-cfef-4581-ac7f-5bccfd34152e\") " pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:07.415140 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:07.415077    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 20:25:07.415140 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:07.415095    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 20:25:07.415140 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:07.415106    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7trdc for pod openshift-network-diagnostics/network-check-target-n4bt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:25:07.415276 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:07.415152    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc podName:f7de3f6a-cfef-4581-ac7f-5bccfd34152e nodeName:}" failed. No retries permitted until 2026-07-29 20:25:23.415138005 +0000 UTC m=+33.266638676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7trdc" (UniqueName: "kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc") pod "network-check-target-n4bt5" (UID: "f7de3f6a-cfef-4581-ac7f-5bccfd34152e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:25:07.616124 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:07.616038    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:07.616277 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:07.616053    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:07.616277 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:07.616162    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:07.616359 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:07.616278    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:08.616130 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:08.616095    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:08.616535 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:08.616220    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:09.615749 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:09.615719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:09.615926 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:09.615818    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:09.615926 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:09.615907    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:09.616047 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:09.616029    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:10.616434 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:10.616397    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:10.616874 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:10.616476    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:11.615587 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.615290    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:11.615742 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.615330    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:11.615742 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:11.615639    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:11.615742 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:11.615707    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:11.767896 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.767862    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" event={"ID":"e51e885d9de0c47fa459d70fe2d1f945","Type":"ContainerStarted","Data":"90cd89f585a55607117bd5894380fd577a9650bedda897820496e16cf18d00fa"}
Jul 29 20:25:11.769515 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.769486    2557 generic.go:356] "Generic (PLEG): container finished" podID="19fd5d16ce8c194e1822ccd076caf998" containerID="2fc853a9c9b03842b065a3c21a0a2b0c1994e961db2da2ffa691fa48364fafae" exitCode=0
Jul 29 20:25:11.769636 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.769571    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" event={"ID":"19fd5d16ce8c194e1822ccd076caf998","Type":"ContainerDied","Data":"2fc853a9c9b03842b065a3c21a0a2b0c1994e961db2da2ffa691fa48364fafae"}
Jul 29 20:25:11.771375 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.771351    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dz2nm" event={"ID":"2b9d713d-351f-440b-b69d-07ef0ef69141","Type":"ContainerStarted","Data":"2dff79f2e2d1fc84e9a2a1dc4103996bd3a3fb524bba493f7e67e8227cbb707f"}
Jul 29 20:25:11.772811 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.772793    2557 generic.go:356] "Generic (PLEG): container finished" podID="236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb" containerID="ea66699ccfff5338fa2681bd604b1561a62cd1cadfb77c45f3fbafb65e4a4c87" exitCode=0
Jul 29 20:25:11.772936 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.772867    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfxpl" event={"ID":"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb","Type":"ContainerDied","Data":"ea66699ccfff5338fa2681bd604b1561a62cd1cadfb77c45f3fbafb65e4a4c87"}
Jul 29 20:25:11.774309 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.774286    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z7xkh" event={"ID":"9f929d08-18ca-42de-b80c-4395c73e9293","Type":"ContainerStarted","Data":"6e17a9bebe0bb65408438486d127c3e60e485e5da07f6685041c581fc3a36ff7"}
Jul 29 20:25:11.775744 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.775716    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hzht2" event={"ID":"a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25","Type":"ContainerStarted","Data":"0283fdec0f461347c55452a1f63fff9cc2d13d00f59296c5ec11cec7405b34b5"}
Jul 29 20:25:11.777093 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.777072    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp" event={"ID":"f72d1a44-c5d3-4907-a445-6dc4e5129713","Type":"ContainerStarted","Data":"0527e47a460b53bbf525386d139909183a7ca2e84ac824d2fa60a98c181c8ac2"}
Jul 29 20:25:11.778446 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.778420    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pfr9g" event={"ID":"e4e2a3d5-4194-45d3-9898-5d9d2e0f4546","Type":"ContainerStarted","Data":"7a103c4384e9b89baf7bc1af64b97c6020c874487b07aba9847d05adaabca35b"}
Jul 29 20:25:11.781013 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.780997    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:25:11.781304 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.781289    2557 generic.go:356] "Generic (PLEG): container finished" podID="c330c3b6-c273-4544-9233-0002fd74a823" containerID="b93d19460d8ee69770179361c93d65bf27358e0ae36feb685f907060d984273c" exitCode=1
Jul 29 20:25:11.781379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.781340    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" event={"ID":"c330c3b6-c273-4544-9233-0002fd74a823","Type":"ContainerStarted","Data":"f9cf78d4806d701a81cf881707a3de4f6b2394cb57e777b4f71b3fe1a219ef99"}
Jul 29 20:25:11.781471 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.781427    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" event={"ID":"c330c3b6-c273-4544-9233-0002fd74a823","Type":"ContainerStarted","Data":"b2c879f411c1958533f13569a992f62c2bedd85c57b0f5abe1fe22e556ffb0c0"}
Jul 29 20:25:11.781516 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.781479    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" event={"ID":"c330c3b6-c273-4544-9233-0002fd74a823","Type":"ContainerStarted","Data":"0b5d7411cdf89f242560c4f4157a0502c270e726fe74b42eaef976f08ec34f3c"}
Jul 29 20:25:11.781564 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.781525    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" event={"ID":"c330c3b6-c273-4544-9233-0002fd74a823","Type":"ContainerStarted","Data":"0d60bba6b1f1d9a336130189cbe019fbffad0c5b89606ee9de2ee4fa2d774c9e"}
Jul 29 20:25:11.781564 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.781555    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" event={"ID":"c330c3b6-c273-4544-9233-0002fd74a823","Type":"ContainerDied","Data":"b93d19460d8ee69770179361c93d65bf27358e0ae36feb685f907060d984273c"}
Jul 29 20:25:11.781628 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.781583    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" event={"ID":"c330c3b6-c273-4544-9233-0002fd74a823","Type":"ContainerStarted","Data":"a68f0deb8e501b76508015b5cef251cb5730d90a852b20413fd3bd776f5efc61"}
Jul 29 20:25:11.782295 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.782261    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" podStartSLOduration=20.782250613 podStartE2EDuration="20.782250613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:11.78175573 +0000 UTC m=+21.633256402" watchObservedRunningTime="2026-07-29 20:25:11.782250613 +0000 UTC m=+21.633751287"
Jul 29 20:25:11.782679 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.782661    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8xvgl" event={"ID":"4ac085ad-d967-429f-97ea-1c5c2d0e4284","Type":"ContainerStarted","Data":"c7229dc695e85bc4a1106e9fb4ebd4212e8c3eb8f2926db58ad9e5e61aa9c9c2"}
Jul 29 20:25:11.841040 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.841002    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dz2nm" podStartSLOduration=2.76003332 podStartE2EDuration="21.840987319s" totalImagesPullingTime="19.080953999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:11.82621712 +0000 UTC m=+21.677717794" watchObservedRunningTime="2026-07-29 20:25:11.840987319 +0000 UTC m=+21.692487992"
Jul 29 20:25:11.886629 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.886438    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pfr9g" podStartSLOduration=3.005175135 podStartE2EDuration="21.886423712s" totalImagesPullingTime="18.881248577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:11.869148026 +0000 UTC m=+21.720648704" watchObservedRunningTime="2026-07-29 20:25:11.886423712 +0000 UTC m=+21.737924382"
Jul 29 20:25:11.904693 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.904645    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hzht2" podStartSLOduration=3.063108054 podStartE2EDuration="21.904630517s" totalImagesPullingTime="18.841522463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:11.886849585 +0000 UTC m=+21.738350253" watchObservedRunningTime="2026-07-29 20:25:11.904630517 +0000 UTC m=+21.756131189"
Jul 29 20:25:11.928480 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.928439    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z7xkh" podStartSLOduration=3.092681873 podStartE2EDuration="21.928424669s" totalImagesPullingTime="18.835742796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:11.904755547 +0000 UTC m=+21.756256220" watchObservedRunningTime="2026-07-29 20:25:11.928424669 +0000 UTC m=+21.779925344"
Jul 29 20:25:11.928665 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:11.928644    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8xvgl" podStartSLOduration=3.022922823 podStartE2EDuration="21.928638784s" totalImagesPullingTime="18.905715961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:11.928413461 +0000 UTC m=+21.779914134" watchObservedRunningTime="2026-07-29 20:25:11.928638784 +0000 UTC m=+21.780139457"
Jul 29 20:25:12.615810 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:12.615520    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:12.615810 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:12.615633    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:12.721554 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:12.721527    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 20:25:12.786724 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:12.786690    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" event={"ID":"19fd5d16ce8c194e1822ccd076caf998","Type":"ContainerStarted","Data":"f093bfc914a072f3769bec2716c6d0b959c30eb61eb0fc9d54145283ac073f83"}
Jul 29 20:25:12.788489 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:12.788463    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mlzr9" event={"ID":"77637794-0ae7-4164-9117-68def5c157bc","Type":"ContainerStarted","Data":"86b17e8704065a3235c421e4016346637e40b7ac551a2e3b732e652ce7c15e59"}
Jul 29 20:25:12.790557 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:12.790527    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp" event={"ID":"f72d1a44-c5d3-4907-a445-6dc4e5129713","Type":"ContainerStarted","Data":"d77e6c5932a71b8d1accd40e697ffc12f9845728706bc87eeebcc815939534e5"}
Jul 29 20:25:12.805777 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:12.805727    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" podStartSLOduration=21.805709849 podStartE2EDuration="21.805709849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:12.805084714 +0000 UTC m=+22.656585387" watchObservedRunningTime="2026-07-29 20:25:12.805709849 +0000 UTC m=+22.657210523"
Jul 29 20:25:12.821957 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:12.821914    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mlzr9" podStartSLOduration=4.006950416 podStartE2EDuration="22.821902128s" totalImagesPullingTime="18.814951712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:12.821471403 +0000 UTC m=+22.672972078" watchObservedRunningTime="2026-07-29 20:25:12.821902128 +0000 UTC m=+22.673402798"
Jul 29 20:25:13.559492 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:13.559400    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T20:25:12.721549154Z","UUID":"2f251d2d-be77-431d-96bd-892661520149","Handler":null,"Name":"","Endpoint":""}
Jul 29 20:25:13.561335 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:13.561314    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 20:25:13.561460 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:13.561355    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 20:25:13.615323 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:13.615302    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:13.615420 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:13.615334    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:13.615481 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:13.615422    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:13.615578 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:13.615556    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:13.796649 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:13.796627    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:25:13.797051 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:13.796994    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" event={"ID":"c330c3b6-c273-4544-9233-0002fd74a823","Type":"ContainerStarted","Data":"fa48985b974f20af7a216d689f2ef683235fbd470589acbb101d35edda242992"}
Jul 29 20:25:14.369056 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:14.369021    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:25:14.369660 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:14.369636    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:25:14.618728 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:14.618704    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:14.618952 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:14.618792    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:14.814424 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:14.814392    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp" event={"ID":"f72d1a44-c5d3-4907-a445-6dc4e5129713","Type":"ContainerStarted","Data":"b7f59a1496ce837dfb4d1cdcc1d56a0b1add073e300b72142cc22c01912764c9"}
Jul 29 20:25:15.616156 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:15.616122    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:15.616156 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:15.616146    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:15.616393 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:15.616253    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:15.616393 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:15.616368    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:16.615936 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:16.615746    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:16.616541 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:16.616022    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:16.820556 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:16.820523    2557 generic.go:356] "Generic (PLEG): container finished" podID="236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb" containerID="12b5464b216674e0b57698e6f14df2780fa51113c03a9a63fa94662b1075cb41" exitCode=0
Jul 29 20:25:16.820729 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:16.820610    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfxpl" event={"ID":"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb","Type":"ContainerDied","Data":"12b5464b216674e0b57698e6f14df2780fa51113c03a9a63fa94662b1075cb41"}
Jul 29 20:25:16.823806 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:16.823782    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:25:16.824172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:16.824154    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" event={"ID":"c330c3b6-c273-4544-9233-0002fd74a823","Type":"ContainerStarted","Data":"b02fe27054490f8f8f56276c65ff8b8e09f670400532c050587499b0148a6ca4"}
Jul 29 20:25:16.824440 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:16.824423    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:25:16.824584 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:16.824572    2557 scope.go:117] "RemoveContainer" containerID="b93d19460d8ee69770179361c93d65bf27358e0ae36feb685f907060d984273c"
Jul 29 20:25:16.840570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:16.840549    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:25:16.845805 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:16.845769    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7tvp" podStartSLOduration=5.500016364 podStartE2EDuration="26.845758031s" totalImagesPullingTime="21.345741667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:14.834511449 +0000 UTC m=+24.686012122" watchObservedRunningTime="2026-07-29 20:25:16.845758031 +0000 UTC m=+26.697258703"
Jul 29 20:25:17.615713 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:17.615682    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:17.615857 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:17.615816    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:17.615934 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:17.615875    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:17.616055 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:17.616017    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:17.830196 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:17.830125    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:25:17.830494 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:17.830473    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" event={"ID":"c330c3b6-c273-4544-9233-0002fd74a823","Type":"ContainerStarted","Data":"8e41692166f32ab942842a4b999a3c640dbefe574f3076cfaaa8743a6fa75010"}
Jul 29 20:25:17.830770 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:17.830750    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:25:17.830874 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:17.830860    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:25:17.832700 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:17.832679    2557 generic.go:356] "Generic (PLEG): container finished" podID="236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb" containerID="aea89acfb1f63774aa729f507a7c9b4cd9a22327f488ed679f389bb7bd61ed15" exitCode=0
Jul 29 20:25:17.832801 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:17.832712    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfxpl" event={"ID":"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb","Type":"ContainerDied","Data":"aea89acfb1f63774aa729f507a7c9b4cd9a22327f488ed679f389bb7bd61ed15"}
Jul 29 20:25:17.846325 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:17.846298    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:25:17.858787 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:17.858745    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-288tq" podStartSLOduration=8.929160826 podStartE2EDuration="27.858731142s" totalImagesPullingTime="18.929570316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:17.857399488 +0000 UTC m=+27.708900165" watchObservedRunningTime="2026-07-29 20:25:17.858731142 +0000 UTC m=+27.710231814"
Jul 29 20:25:18.372155 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:18.371958    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:25:18.372314 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:18.372279    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 29 20:25:18.372547 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:18.372528    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pfr9g"
Jul 29 20:25:18.401545 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:18.401514    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-knpwg"]
Jul 29 20:25:18.401709 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:18.401624    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:18.401755 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:18.401703    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:18.402289 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:18.402271    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zkjgg"]
Jul 29 20:25:18.402382 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:18.402359    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:18.402469 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:18.402453    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:18.403007 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:18.402979    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n4bt5"]
Jul 29 20:25:18.403083 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:18.403064    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:18.403164 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:18.403145    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:19.615135 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:19.615104    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:19.615600 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:19.615199    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:19.839665 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:19.839635    2557 generic.go:356] "Generic (PLEG): container finished" podID="236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb" containerID="40a161bb8c0c35515c5aa4762af932b833c1f0bf830689750a59b9c9bc8762f0" exitCode=0
Jul 29 20:25:19.839780 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:19.839719    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfxpl" event={"ID":"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb","Type":"ContainerDied","Data":"40a161bb8c0c35515c5aa4762af932b833c1f0bf830689750a59b9c9bc8762f0"}
Jul 29 20:25:20.616804 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:20.616573    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:20.617240 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:20.617058    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:20.617240 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:20.617173    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:20.617240 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:20.617221    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:21.615183 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:21.615151    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:21.615339 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:21.615248    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:22.615685 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:22.615650    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:22.616100 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:22.615655    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:22.616100 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:22.615781    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:22.616100 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:22.615853    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:23.335034 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:23.334993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:23.335210 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:23.335048    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:23.335210 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:23.335190    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 20:25:23.335301 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:23.335238    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:25:23.335301 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:23.335268    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret podName:0e56f612-eb45-4aef-acff-46673cd9a779 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:55.335247207 +0000 UTC m=+65.186747862 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret") pod "global-pull-secret-syncer-knpwg" (UID: "0e56f612-eb45-4aef-acff-46673cd9a779") : object "kube-system"/"original-pull-secret" not registered
Jul 29 20:25:23.335383 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:23.335300    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs podName:8cd20bda-e613-45d4-8fff-0a7ddc584f56 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:55.335286892 +0000 UTC m=+65.186787543 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs") pod "network-metrics-daemon-zkjgg" (UID: "8cd20bda-e613-45d4-8fff-0a7ddc584f56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 20:25:23.436166 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:23.436127    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trdc\" (UniqueName: \"kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc\") pod \"network-check-target-n4bt5\" (UID: \"f7de3f6a-cfef-4581-ac7f-5bccfd34152e\") " pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:23.436356 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:23.436297    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 20:25:23.436356 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:23.436323    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 20:25:23.436356 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:23.436337    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7trdc for pod openshift-network-diagnostics/network-check-target-n4bt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:25:23.436614 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:23.436392    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc podName:f7de3f6a-cfef-4581-ac7f-5bccfd34152e nodeName:}" failed. No retries permitted until 2026-07-29 20:25:55.436374926 +0000 UTC m=+65.287875602 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7trdc" (UniqueName: "kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc") pod "network-check-target-n4bt5" (UID: "f7de3f6a-cfef-4581-ac7f-5bccfd34152e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 20:25:23.615662 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:23.615585    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:23.615863 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:23.615718    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4bt5" podUID="f7de3f6a-cfef-4581-ac7f-5bccfd34152e"
Jul 29 20:25:24.616156 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:24.615995    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:24.616542 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:24.615995    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:24.616542 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:24.616234    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-knpwg" podUID="0e56f612-eb45-4aef-acff-46673cd9a779"
Jul 29 20:25:24.616542 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:24.616301    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkjgg" podUID="8cd20bda-e613-45d4-8fff-0a7ddc584f56"
Jul 29 20:25:24.852470 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:24.852442    2557 generic.go:356] "Generic (PLEG): container finished" podID="236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb" containerID="3e10b67ec5601678edfd9c0daabc00220e42870a87b73c027ff592231675cb41" exitCode=0
Jul 29 20:25:24.852614 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:24.852501    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfxpl" event={"ID":"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb","Type":"ContainerDied","Data":"3e10b67ec5601678edfd9c0daabc00220e42870a87b73c027ff592231675cb41"}
Jul 29 20:25:24.963370 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:24.963344    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeReady"
Jul 29 20:25:24.963481 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:24.963466    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 20:25:25.011319 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.011295    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b58fv"]
Jul 29 20:25:25.029270 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.029237    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-85hjr"]
Jul 29 20:25:25.029388 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.029370    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.032043 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.032017    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 20:25:25.032206 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.032131    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 20:25:25.032412 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.032397    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xpqnl\""
Jul 29 20:25:25.037257 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.037229    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b58fv"]
Jul 29 20:25:25.037350 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.037277    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-85hjr"]
Jul 29 20:25:25.037408 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.037356    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-85hjr"
Jul 29 20:25:25.040111 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.040088    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 20:25:25.040201 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.040098    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 20:25:25.040201 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.040194    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cs4sn\""
Jul 29 20:25:25.040313 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.040299    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 20:25:25.150281 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.150220    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kb22\" (UniqueName: \"kubernetes.io/projected/f4854a11-af39-4d3c-88fc-7d67a9189d01-kube-api-access-7kb22\") pod \"ingress-canary-85hjr\" (UID: \"f4854a11-af39-4d3c-88fc-7d67a9189d01\") " pod="openshift-ingress-canary/ingress-canary-85hjr"
Jul 29 20:25:25.150281 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.150257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.150445 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.150289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54871aa4-68a9-4d32-95ab-739033a2ed18-config-volume\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.150445 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.150341    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54871aa4-68a9-4d32-95ab-739033a2ed18-tmp-dir\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.150445 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.150366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4fx2\" (UniqueName: \"kubernetes.io/projected/54871aa4-68a9-4d32-95ab-739033a2ed18-kube-api-access-l4fx2\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.150445 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.150390    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4854a11-af39-4d3c-88fc-7d67a9189d01-cert\") pod \"ingress-canary-85hjr\" (UID: \"f4854a11-af39-4d3c-88fc-7d67a9189d01\") " pod="openshift-ingress-canary/ingress-canary-85hjr"
Jul 29 20:25:25.251503 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.251471    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54871aa4-68a9-4d32-95ab-739033a2ed18-tmp-dir\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.251503 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.251504    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4fx2\" (UniqueName: \"kubernetes.io/projected/54871aa4-68a9-4d32-95ab-739033a2ed18-kube-api-access-l4fx2\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.251665 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.251524    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4854a11-af39-4d3c-88fc-7d67a9189d01-cert\") pod \"ingress-canary-85hjr\" (UID: \"f4854a11-af39-4d3c-88fc-7d67a9189d01\") " pod="openshift-ingress-canary/ingress-canary-85hjr"
Jul 29 20:25:25.251861 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.251782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kb22\" (UniqueName: \"kubernetes.io/projected/f4854a11-af39-4d3c-88fc-7d67a9189d01-kube-api-access-7kb22\") pod \"ingress-canary-85hjr\" (UID: \"f4854a11-af39-4d3c-88fc-7d67a9189d01\") " pod="openshift-ingress-canary/ingress-canary-85hjr"
Jul 29 20:25:25.251861 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.251824    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.251988 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.251885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54871aa4-68a9-4d32-95ab-739033a2ed18-config-volume\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.251988 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.251937    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54871aa4-68a9-4d32-95ab-739033a2ed18-tmp-dir\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.252079 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:25.251993    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 20:25:25.252129 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:25.252078    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls podName:54871aa4-68a9-4d32-95ab-739033a2ed18 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:25.75205561 +0000 UTC m=+35.603556277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls") pod "dns-default-b58fv" (UID: "54871aa4-68a9-4d32-95ab-739033a2ed18") : secret "dns-default-metrics-tls" not found
Jul 29 20:25:25.252272 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.252254    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54871aa4-68a9-4d32-95ab-739033a2ed18-config-volume\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.255818 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.255791    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4854a11-af39-4d3c-88fc-7d67a9189d01-cert\") pod \"ingress-canary-85hjr\" (UID: \"f4854a11-af39-4d3c-88fc-7d67a9189d01\") " pod="openshift-ingress-canary/ingress-canary-85hjr"
Jul 29 20:25:25.260496 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.260476    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kb22\" (UniqueName: \"kubernetes.io/projected/f4854a11-af39-4d3c-88fc-7d67a9189d01-kube-api-access-7kb22\") pod \"ingress-canary-85hjr\" (UID: \"f4854a11-af39-4d3c-88fc-7d67a9189d01\") " pod="openshift-ingress-canary/ingress-canary-85hjr"
Jul 29 20:25:25.260791 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.260776    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4fx2\" (UniqueName: \"kubernetes.io/projected/54871aa4-68a9-4d32-95ab-739033a2ed18-kube-api-access-l4fx2\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.390108 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.390075    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-85hjr"
Jul 29 20:25:25.583074 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.583026    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-85hjr"]
Jul 29 20:25:25.586431 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:25:25.586406    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4854a11_af39_4d3c_88fc_7d67a9189d01.slice/crio-2d202f5762a862a03592052f61d4351403942166254747c200ab4fc077112545 WatchSource:0}: Error finding container 2d202f5762a862a03592052f61d4351403942166254747c200ab4fc077112545: Status 404 returned error can't find the container with id 2d202f5762a862a03592052f61d4351403942166254747c200ab4fc077112545
Jul 29 20:25:25.616121 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.616097    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:25.619236 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.619216    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkp42\""
Jul 29 20:25:25.619792 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.619265    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 20:25:25.619792 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.619296    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 20:25:25.754710 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.754655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:25.754802 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:25.754788    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 20:25:25.754869 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:25.754855    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls podName:54871aa4-68a9-4d32-95ab-739033a2ed18 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:26.754825565 +0000 UTC m=+36.606326232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls") pod "dns-default-b58fv" (UID: "54871aa4-68a9-4d32-95ab-739033a2ed18") : secret "dns-default-metrics-tls" not found
Jul 29 20:25:25.860400 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.860372    2557 generic.go:356] "Generic (PLEG): container finished" podID="236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb" containerID="b83e58fa776c41a13ab92867164eed6f05f08b9137e51b35cbec529c2e956576" exitCode=0
Jul 29 20:25:25.860471 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.860451    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfxpl" event={"ID":"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb","Type":"ContainerDied","Data":"b83e58fa776c41a13ab92867164eed6f05f08b9137e51b35cbec529c2e956576"}
Jul 29 20:25:25.861533 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:25.861512    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-85hjr" event={"ID":"f4854a11-af39-4d3c-88fc-7d67a9189d01","Type":"ContainerStarted","Data":"2d202f5762a862a03592052f61d4351403942166254747c200ab4fc077112545"}
Jul 29 20:25:26.615930 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:26.615708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:26.616112 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:26.615782    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:26.619210 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:26.619188    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 20:25:26.619346 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:26.619304    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 20:25:26.620176 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:26.620156    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7tqs\""
Jul 29 20:25:26.763690 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:26.763661    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:26.763903 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:26.763828    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 20:25:26.763965 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:26.763918    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls podName:54871aa4-68a9-4d32-95ab-739033a2ed18 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:28.763896815 +0000 UTC m=+38.615397479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls") pod "dns-default-b58fv" (UID: "54871aa4-68a9-4d32-95ab-739033a2ed18") : secret "dns-default-metrics-tls" not found
Jul 29 20:25:26.871299 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:26.871218    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfxpl" event={"ID":"236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb","Type":"ContainerStarted","Data":"a7c79773dbdb9c6e209bfe99579f96ad3745d42772fdd14376dc852426655b60"}
Jul 29 20:25:26.896294 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:26.896243    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kfxpl" podStartSLOduration=7.230656258 podStartE2EDuration="36.896223817s" totalImagesPullingTime="29.665567559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:26.89495748 +0000 UTC m=+36.746458154" watchObservedRunningTime="2026-07-29 20:25:26.896223817 +0000 UTC m=+36.747724492"
Jul 29 20:25:28.779258 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:28.779226    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:28.779617 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:28.779350    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 20:25:28.779617 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:28.779401    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls podName:54871aa4-68a9-4d32-95ab-739033a2ed18 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:32.779388542 +0000 UTC m=+42.630889193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls") pod "dns-default-b58fv" (UID: "54871aa4-68a9-4d32-95ab-739033a2ed18") : secret "dns-default-metrics-tls" not found
Jul 29 20:25:28.877178 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:28.877134    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-85hjr" event={"ID":"f4854a11-af39-4d3c-88fc-7d67a9189d01","Type":"ContainerStarted","Data":"5430da8677aaf8213104a905328f3f477199e95f44c0bd66b93dd5743eb2d5d1"}
Jul 29 20:25:28.895849 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:28.895798    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-85hjr" podStartSLOduration=2.24696606 podStartE2EDuration="4.895784268s" totalImagesPullingTime="2.648818208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:28.895125871 +0000 UTC m=+38.746626544" watchObservedRunningTime="2026-07-29 20:25:28.895784268 +0000 UTC m=+38.747284941"
Jul 29 20:25:32.804865 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:32.804818    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:32.805270 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:32.804967    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 20:25:32.805270 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:32.805021    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls podName:54871aa4-68a9-4d32-95ab-739033a2ed18 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:40.805004206 +0000 UTC m=+50.656504868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls") pod "dns-default-b58fv" (UID: "54871aa4-68a9-4d32-95ab-739033a2ed18") : secret "dns-default-metrics-tls" not found
Jul 29 20:25:40.862329 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:40.862274    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:40.862802 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:40.862427    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 20:25:40.862802 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:40.862489    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls podName:54871aa4-68a9-4d32-95ab-739033a2ed18 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:56.862473295 +0000 UTC m=+66.713973950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls") pod "dns-default-b58fv" (UID: "54871aa4-68a9-4d32-95ab-739033a2ed18") : secret "dns-default-metrics-tls" not found
Jul 29 20:25:49.856698 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:49.856669    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-288tq"
Jul 29 20:25:55.360247 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.360208    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:25:55.360664 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.360291    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:55.362781 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.362762    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 20:25:55.362907 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.362891    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 20:25:55.370860 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:55.370844    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 20:25:55.370934 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:55.370925    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs podName:8cd20bda-e613-45d4-8fff-0a7ddc584f56 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:59.370910228 +0000 UTC m=+129.222410882 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs") pod "network-metrics-daemon-zkjgg" (UID: "8cd20bda-e613-45d4-8fff-0a7ddc584f56") : secret "metrics-daemon-secret" not found
Jul 29 20:25:55.374153 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.374136    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e56f612-eb45-4aef-acff-46673cd9a779-original-pull-secret\") pod \"global-pull-secret-syncer-knpwg\" (UID: \"0e56f612-eb45-4aef-acff-46673cd9a779\") " pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:55.433769 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.433745    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-knpwg"
Jul 29 20:25:55.461337 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.461314    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trdc\" (UniqueName: \"kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc\") pod \"network-check-target-n4bt5\" (UID: \"f7de3f6a-cfef-4581-ac7f-5bccfd34152e\") " pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:55.463948 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.463932    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 20:25:55.474200 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.474180    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 20:25:55.504634 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.504605    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7trdc\" (UniqueName: \"kubernetes.io/projected/f7de3f6a-cfef-4581-ac7f-5bccfd34152e-kube-api-access-7trdc\") pod \"network-check-target-n4bt5\" (UID: \"f7de3f6a-cfef-4581-ac7f-5bccfd34152e\") " pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:55.576861 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.576823    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-knpwg"]
Jul 29 20:25:55.580425 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:25:55.580396    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e56f612_eb45_4aef_acff_46673cd9a779.slice/crio-43bbb1c3642137990d0ce891198306055c0a28477dda04e9eee58a361e649b53 WatchSource:0}: Error finding container 43bbb1c3642137990d0ce891198306055c0a28477dda04e9eee58a361e649b53: Status 404 returned error can't find the container with id 43bbb1c3642137990d0ce891198306055c0a28477dda04e9eee58a361e649b53
Jul 29 20:25:55.627959 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.627910    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkp42\""
Jul 29 20:25:55.636029 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.636011    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:25:55.703787 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.703764    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr"]
Jul 29 20:25:55.705624 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.705607    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr"
Jul 29 20:25:55.708479 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.708454    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 20:25:55.708577 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.708454    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rbtcm\""
Jul 29 20:25:55.708577 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.708455    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 20:25:55.727100 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.727077    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr"]
Jul 29 20:25:55.761815 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.761793    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n4bt5"]
Jul 29 20:25:55.763309 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.763290    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2knx\" (UniqueName: \"kubernetes.io/projected/2ff3c073-347c-499a-ad34-33d881a5a1ec-kube-api-access-j2knx\") pod \"volume-data-source-validator-549c6d54cf-25sqr\" (UID: \"2ff3c073-347c-499a-ad34-33d881a5a1ec\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr"
Jul 29 20:25:55.765025 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:25:55.765001    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7de3f6a_cfef_4581_ac7f_5bccfd34152e.slice/crio-948c6fbb75b6e5b9d01fb4539f547b84f6854fe09ddedd7529fb6efb7b1f7441 WatchSource:0}: Error finding container 948c6fbb75b6e5b9d01fb4539f547b84f6854fe09ddedd7529fb6efb7b1f7441: Status 404 returned error can't find the container with id 948c6fbb75b6e5b9d01fb4539f547b84f6854fe09ddedd7529fb6efb7b1f7441
Jul 29 20:25:55.806223 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.806202    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh"]
Jul 29 20:25:55.808118 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.808102    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh"
Jul 29 20:25:55.809910 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.809877    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"]
Jul 29 20:25:55.811520 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.811502    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56f74bf69c-f78lr"]
Jul 29 20:25:55.811623 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.811606    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:25:55.813063 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.813046    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.817121 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.817105    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 20:25:55.817121 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.817110    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 29 20:25:55.817268 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.817171    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 20:25:55.817268 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.817195    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 20:25:55.817414 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.817400    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 20:25:55.817482 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.817462    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2w4dp\""
Jul 29 20:25:55.817539 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.817518    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 29 20:25:55.817591 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.817580    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-s8wmw\""
Jul 29 20:25:55.817779 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.817762    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 20:25:55.817979 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.817966    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 20:25:55.819733 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.819708    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cp7r6\""
Jul 29 20:25:55.822041 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.822011    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh"]
Jul 29 20:25:55.831368 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.831346    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"]
Jul 29 20:25:55.833192 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.833139    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56f74bf69c-f78lr"]
Jul 29 20:25:55.863562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.863538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-default-certificate\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.863652 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.863569    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2knx\" (UniqueName: \"kubernetes.io/projected/2ff3c073-347c-499a-ad34-33d881a5a1ec-kube-api-access-j2knx\") pod \"volume-data-source-validator-549c6d54cf-25sqr\" (UID: \"2ff3c073-347c-499a-ad34-33d881a5a1ec\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr"
Jul 29 20:25:55.863652 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.863589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-stats-auth\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.863652 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.863607    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:25:55.863763 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.863745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.863822 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.863800    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.863886 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.863847    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8hbv\" (UniqueName: \"kubernetes.io/projected/95d50892-1cfa-47c2-a1d4-9aef77704cc7-kube-api-access-f8hbv\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.863886 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.863869    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz2dv\" (UniqueName: \"kubernetes.io/projected/a12abb73-6386-46e1-bf1d-35a6bacf4adc-kube-api-access-jz2dv\") pod \"network-check-source-7d88cb55d8-lxbhh\" (UID: \"a12abb73-6386-46e1-bf1d-35a6bacf4adc\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh"
Jul 29 20:25:55.863946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.863894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e19b3f58-74da-489b-9c3d-8c45d9c64a55-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:25:55.870932 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.870914    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2knx\" (UniqueName: \"kubernetes.io/projected/2ff3c073-347c-499a-ad34-33d881a5a1ec-kube-api-access-j2knx\") pod \"volume-data-source-validator-549c6d54cf-25sqr\" (UID: \"2ff3c073-347c-499a-ad34-33d881a5a1ec\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr"
Jul 29 20:25:55.941824 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.940081    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n4bt5" event={"ID":"f7de3f6a-cfef-4581-ac7f-5bccfd34152e","Type":"ContainerStarted","Data":"948c6fbb75b6e5b9d01fb4539f547b84f6854fe09ddedd7529fb6efb7b1f7441"}
Jul 29 20:25:55.942007 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.941978    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-knpwg" event={"ID":"0e56f612-eb45-4aef-acff-46673cd9a779","Type":"ContainerStarted","Data":"43bbb1c3642137990d0ce891198306055c0a28477dda04e9eee58a361e649b53"}
Jul 29 20:25:55.964418 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.964396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz2dv\" (UniqueName: \"kubernetes.io/projected/a12abb73-6386-46e1-bf1d-35a6bacf4adc-kube-api-access-jz2dv\") pod \"network-check-source-7d88cb55d8-lxbhh\" (UID: \"a12abb73-6386-46e1-bf1d-35a6bacf4adc\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh"
Jul 29 20:25:55.964499 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.964424    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e19b3f58-74da-489b-9c3d-8c45d9c64a55-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:25:55.964499 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.964444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-default-certificate\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.964499 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.964463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-stats-auth\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.964499 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.964485    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:25:55.964669 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.964526    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.964669 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.964576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.964669 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:55.964611    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 20:25:55.964812 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:55.964687    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert podName:e19b3f58-74da-489b-9c3d-8c45d9c64a55 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:56.464665892 +0000 UTC m=+66.316166550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-qh7wc" (UID: "e19b3f58-74da-489b-9c3d-8c45d9c64a55") : secret "networking-console-plugin-cert" not found
Jul 29 20:25:55.964812 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:55.964717    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 20:25:55.964812 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.964600    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hbv\" (UniqueName: \"kubernetes.io/projected/95d50892-1cfa-47c2-a1d4-9aef77704cc7-kube-api-access-f8hbv\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.964812 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:55.964720    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:56.464699101 +0000 UTC m=+66.316199770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : configmap references non-existent config key: service-ca.crt
Jul 29 20:25:55.964812 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:55.964777    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:56.46476038 +0000 UTC m=+66.316261030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : secret "router-metrics-certs-default" not found
Jul 29 20:25:55.965070 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.965051    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e19b3f58-74da-489b-9c3d-8c45d9c64a55-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:25:55.966652 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.966636    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-default-certificate\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.966698 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.966678    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-stats-auth\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:55.975241 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.975223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz2dv\" (UniqueName: \"kubernetes.io/projected/a12abb73-6386-46e1-bf1d-35a6bacf4adc-kube-api-access-jz2dv\") pod \"network-check-source-7d88cb55d8-lxbhh\" (UID: \"a12abb73-6386-46e1-bf1d-35a6bacf4adc\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh"
Jul 29 20:25:55.975324 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:55.975261    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8hbv\" (UniqueName: \"kubernetes.io/projected/95d50892-1cfa-47c2-a1d4-9aef77704cc7-kube-api-access-f8hbv\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:56.019979 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:56.019961    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr"
Jul 29 20:25:56.118138 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:56.118113    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh"
Jul 29 20:25:56.131724 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:56.131700    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr"]
Jul 29 20:25:56.135248 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:25:56.135223    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff3c073_347c_499a_ad34_33d881a5a1ec.slice/crio-5432b478dc153f50416d8fb84fb4ba3282732735c89ee13537d79b71ce33e419 WatchSource:0}: Error finding container 5432b478dc153f50416d8fb84fb4ba3282732735c89ee13537d79b71ce33e419: Status 404 returned error can't find the container with id 5432b478dc153f50416d8fb84fb4ba3282732735c89ee13537d79b71ce33e419
Jul 29 20:25:56.240430 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:56.240399    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh"]
Jul 29 20:25:56.243178 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:25:56.243150    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda12abb73_6386_46e1_bf1d_35a6bacf4adc.slice/crio-fe175c086a796d6862bfdff664a04169bdb7b83d750eda6a6b425a3a935b7523 WatchSource:0}: Error finding container fe175c086a796d6862bfdff664a04169bdb7b83d750eda6a6b425a3a935b7523: Status 404 returned error can't find the container with id fe175c086a796d6862bfdff664a04169bdb7b83d750eda6a6b425a3a935b7523
Jul 29 20:25:56.469986 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:56.469912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:56.470400 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:56.469982    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:25:56.470400 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:56.470027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:56.470400 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:56.470107    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:57.470082615 +0000 UTC m=+67.321583286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : configmap references non-existent config key: service-ca.crt
Jul 29 20:25:56.470400 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:56.470135    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 20:25:56.470400 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:56.470187    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert podName:e19b3f58-74da-489b-9c3d-8c45d9c64a55 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:57.470172499 +0000 UTC m=+67.321673167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-qh7wc" (UID: "e19b3f58-74da-489b-9c3d-8c45d9c64a55") : secret "networking-console-plugin-cert" not found
Jul 29 20:25:56.470400 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:56.470135    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 20:25:56.470400 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:56.470234    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:57.470223736 +0000 UTC m=+67.321724406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : secret "router-metrics-certs-default" not found
Jul 29 20:25:56.873149 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:56.873116    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:25:56.873398 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:56.873274    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 20:25:56.873398 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:56.873343    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls podName:54871aa4-68a9-4d32-95ab-739033a2ed18 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:28.873324244 +0000 UTC m=+98.724824916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls") pod "dns-default-b58fv" (UID: "54871aa4-68a9-4d32-95ab-739033a2ed18") : secret "dns-default-metrics-tls" not found
Jul 29 20:25:56.947267 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:56.947231    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr" event={"ID":"2ff3c073-347c-499a-ad34-33d881a5a1ec","Type":"ContainerStarted","Data":"5432b478dc153f50416d8fb84fb4ba3282732735c89ee13537d79b71ce33e419"}
Jul 29 20:25:56.949298 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:56.949241    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh" event={"ID":"a12abb73-6386-46e1-bf1d-35a6bacf4adc","Type":"ContainerStarted","Data":"fe175c086a796d6862bfdff664a04169bdb7b83d750eda6a6b425a3a935b7523"}
Jul 29 20:25:57.480350 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:57.479463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:57.480350 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:57.479534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:57.480350 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:57.479598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:25:57.480350 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:57.479722    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 20:25:57.480350 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:57.479783    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert podName:e19b3f58-74da-489b-9c3d-8c45d9c64a55 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:59.479764634 +0000 UTC m=+69.331265308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-qh7wc" (UID: "e19b3f58-74da-489b-9c3d-8c45d9c64a55") : secret "networking-console-plugin-cert" not found
Jul 29 20:25:57.480350 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:57.480197    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 20:25:57.480350 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:57.480250    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:59.480233166 +0000 UTC m=+69.331733823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : secret "router-metrics-certs-default" not found
Jul 29 20:25:57.480350 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:57.480316    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:25:59.480305963 +0000 UTC m=+69.331806619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : configmap references non-existent config key: service-ca.crt
Jul 29 20:25:58.956912 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:58.956874    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr" event={"ID":"2ff3c073-347c-499a-ad34-33d881a5a1ec","Type":"ContainerStarted","Data":"e433c366f683e61a972150dfc9bb7139e4a8949b80bd524127806546eb6fdbf2"}
Jul 29 20:25:58.973226 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:58.973174    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25sqr" podStartSLOduration=2.02717464 podStartE2EDuration="3.973158812s" totalImagesPullingTime="1.945984172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:25:58.97288556 +0000 UTC m=+68.824386227" watchObservedRunningTime="2026-07-29 20:25:58.973158812 +0000 UTC m=+68.824659487"
Jul 29 20:25:59.496554 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:59.496514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:59.496726 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:59.496577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:25:59.496726 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:25:59.496619    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:25:59.496726 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:59.496708    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:03.496686057 +0000 UTC m=+73.348186730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : configmap references non-existent config key: service-ca.crt
Jul 29 20:25:59.496903 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:59.496739    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 20:25:59.496903 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:59.496784    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert podName:e19b3f58-74da-489b-9c3d-8c45d9c64a55 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:03.496770663 +0000 UTC m=+73.348271333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-qh7wc" (UID: "e19b3f58-74da-489b-9c3d-8c45d9c64a55") : secret "networking-console-plugin-cert" not found
Jul 29 20:25:59.496903 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:59.496740    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 20:25:59.496903 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:25:59.496824    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:03.496814117 +0000 UTC m=+73.348314797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : secret "router-metrics-certs-default" not found
Jul 29 20:26:00.477408 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.477374    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zxwgp"]
Jul 29 20:26:00.479506 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.479484    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.490397 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.490378    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 20:26:00.493940 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.493918    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 20:26:00.493940 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.493935    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 20:26:00.494052 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.493918    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 20:26:00.494278 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.494264    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bvgmt\""
Jul 29 20:26:00.505534 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.505505    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.505636 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.505614    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/adfde4e5-4550-46b8-8795-f6ddc2a24978-data-volume\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.505718 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.505656    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxq2w\" (UniqueName: \"kubernetes.io/projected/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-api-access-vxq2w\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.505775 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.505730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.505775 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.505769    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/adfde4e5-4550-46b8-8795-f6ddc2a24978-crio-socket\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.526164 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.526099    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zxwgp"]
Jul 29 20:26:00.606716 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.606689    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/adfde4e5-4550-46b8-8795-f6ddc2a24978-data-volume\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.606864 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.606723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxq2w\" (UniqueName: \"kubernetes.io/projected/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-api-access-vxq2w\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.606864 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.606788    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.606864 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.606808    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/adfde4e5-4550-46b8-8795-f6ddc2a24978-crio-socket\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.607006 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.606869    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.607006 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:00.606922    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 20:26:00.607006 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:00.606979    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:01.106961095 +0000 UTC m=+70.958461757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : configmap "kube-rbac-proxy" not found
Jul 29 20:26:00.607006 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:00.607001    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:00.607157 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:00.607035    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:01.107024235 +0000 UTC m=+70.958524887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:00.607157 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.607085    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/adfde4e5-4550-46b8-8795-f6ddc2a24978-data-volume\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.607157 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.607090    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/adfde4e5-4550-46b8-8795-f6ddc2a24978-crio-socket\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.616378 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.616349    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxq2w\" (UniqueName: \"kubernetes.io/projected/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-api-access-vxq2w\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:00.964409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.964367    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n4bt5" event={"ID":"f7de3f6a-cfef-4581-ac7f-5bccfd34152e","Type":"ContainerStarted","Data":"e45092ac9d34de2e3075e3ddfd21990e95bf575bc525fddb263331e97061d8c7"}
Jul 29 20:26:00.964610 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.964486    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:26:00.966277 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.966249    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh" event={"ID":"a12abb73-6386-46e1-bf1d-35a6bacf4adc","Type":"ContainerStarted","Data":"138d6c84dd92aa7e2d49d08cf6e951c863f77660c008ce615607e2fde5d72c99"}
Jul 29 20:26:00.967774 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.967755    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-knpwg" event={"ID":"0e56f612-eb45-4aef-acff-46673cd9a779","Type":"ContainerStarted","Data":"101803201bcdf49a0c29b71f671ea5b7b296b6aecfd4e3abc17fe86474aec90e"}
Jul 29 20:26:00.981730 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.981660    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n4bt5" podStartSLOduration=66.014656064 podStartE2EDuration="1m10.981649591s" totalImagesPullingTime="4.966993527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:26:00.980696209 +0000 UTC m=+70.832196872" watchObservedRunningTime="2026-07-29 20:26:00.981649591 +0000 UTC m=+70.833150304"
Jul 29 20:26:00.999777 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:00.999740    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lxbhh" podStartSLOduration=1.513590383 podStartE2EDuration="5.999729097s" totalImagesPullingTime="4.486138714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:26:00.998958402 +0000 UTC m=+70.850459074" watchObservedRunningTime="2026-07-29 20:26:00.999729097 +0000 UTC m=+70.851229771"
Jul 29 20:26:01.015375 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:01.015335    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-knpwg" podStartSLOduration=65.862374724 podStartE2EDuration="1m11.015320475s" totalImagesPullingTime="5.152945751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:26:01.014706328 +0000 UTC m=+70.866207000" watchObservedRunningTime="2026-07-29 20:26:01.015320475 +0000 UTC m=+70.866821148"
Jul 29 20:26:01.110748 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:01.110729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:01.110868 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:01.110769    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:01.110868 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:01.110857    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 20:26:01.110961 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:01.110867    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:01.110961 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:01.110910    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:02.110899202 +0000 UTC m=+71.962399854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:01.110961 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:01.110924    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:02.110916996 +0000 UTC m=+71.962417646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : configmap "kube-rbac-proxy" not found
Jul 29 20:26:02.118468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.118425    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:02.118894 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.118510    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:02.118894 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:02.118561    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 20:26:02.118894 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:02.118641    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:04.11862081 +0000 UTC m=+73.970121477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : configmap "kube-rbac-proxy" not found
Jul 29 20:26:02.118894 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:02.118644    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:02.118894 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:02.118688    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:04.118675729 +0000 UTC m=+73.970176390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:02.189287 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.189253    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65"]
Jul 29 20:26:02.191359 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.191343    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65"
Jul 29 20:26:02.193869 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.193842    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 29 20:26:02.193995 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.193893    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 29 20:26:02.195124 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.195106    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9tgnt\""
Jul 29 20:26:02.200229 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.200209    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65"]
Jul 29 20:26:02.218914 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.218894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj6m9\" (UniqueName: \"kubernetes.io/projected/667ca380-f4d7-476e-a3fb-d7e9eb106206-kube-api-access-bj6m9\") pod \"migrator-6865c9967-bhp65\" (UID: \"667ca380-f4d7-476e-a3fb-d7e9eb106206\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65"
Jul 29 20:26:02.320162 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.320135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj6m9\" (UniqueName: \"kubernetes.io/projected/667ca380-f4d7-476e-a3fb-d7e9eb106206-kube-api-access-bj6m9\") pod \"migrator-6865c9967-bhp65\" (UID: \"667ca380-f4d7-476e-a3fb-d7e9eb106206\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65"
Jul 29 20:26:02.328568 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.328549    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj6m9\" (UniqueName: \"kubernetes.io/projected/667ca380-f4d7-476e-a3fb-d7e9eb106206-kube-api-access-bj6m9\") pod \"migrator-6865c9967-bhp65\" (UID: \"667ca380-f4d7-476e-a3fb-d7e9eb106206\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65"
Jul 29 20:26:02.428511 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.428446    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hzht2_a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25/dns-node-resolver/0.log"
Jul 29 20:26:02.500314 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.500292    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65"
Jul 29 20:26:02.619671 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.619651    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65"]
Jul 29 20:26:02.621086 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:26:02.621057    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667ca380_f4d7_476e_a3fb_d7e9eb106206.slice/crio-96a79e78c82006c795fc5350e04b74ae963e278b19b119a405868725a9b93794 WatchSource:0}: Error finding container 96a79e78c82006c795fc5350e04b74ae963e278b19b119a405868725a9b93794: Status 404 returned error can't find the container with id 96a79e78c82006c795fc5350e04b74ae963e278b19b119a405868725a9b93794
Jul 29 20:26:02.974580 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:02.974549    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65" event={"ID":"667ca380-f4d7-476e-a3fb-d7e9eb106206","Type":"ContainerStarted","Data":"96a79e78c82006c795fc5350e04b74ae963e278b19b119a405868725a9b93794"}
Jul 29 20:26:03.430690 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:03.430667    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z7xkh_9f929d08-18ca-42de-b80c-4395c73e9293/node-ca/0.log"
Jul 29 20:26:03.527667 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:03.527633    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:26:03.527828 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:03.527688    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:03.527828 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:03.527747    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 20:26:03.527828 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:03.527819    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert podName:e19b3f58-74da-489b-9c3d-8c45d9c64a55 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:11.527800378 +0000 UTC m=+81.379301030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-qh7wc" (UID: "e19b3f58-74da-489b-9c3d-8c45d9c64a55") : secret "networking-console-plugin-cert" not found
Jul 29 20:26:03.527828 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:03.527841    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 20:26:03.528084 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:03.527865    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:11.52784961 +0000 UTC m=+81.379350282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : configmap references non-existent config key: service-ca.crt
Jul 29 20:26:03.528084 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:03.527754    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:03.528084 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:03.527888    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:11.527877506 +0000 UTC m=+81.379378162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : secret "router-metrics-certs-default" not found
Jul 29 20:26:03.979653 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:03.979587    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65" event={"ID":"667ca380-f4d7-476e-a3fb-d7e9eb106206","Type":"ContainerStarted","Data":"51879b36920c714dcff50fd0a502d1efb161921a79ae2db0aeb7cf7ee28c662e"}
Jul 29 20:26:03.979750 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:03.979663    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65" event={"ID":"667ca380-f4d7-476e-a3fb-d7e9eb106206","Type":"ContainerStarted","Data":"6193033b4f09c5fb8c6141bfb7a75c3138224dab6b6089ea7041418f6f290a2c"}
Jul 29 20:26:04.000376 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:04.000335    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bhp65" podStartSLOduration=0.978233744 podStartE2EDuration="2.000322131s" totalImagesPullingTime="1.022088387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:26:03.998864159 +0000 UTC m=+73.850364829" watchObservedRunningTime="2026-07-29 20:26:04.000322131 +0000 UTC m=+73.851822826"
Jul 29 20:26:04.028611 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:04.028595    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-85hjr_f4854a11-af39-4d3c-88fc-7d67a9189d01/serve-healthcheck-canary/0.log"
Jul 29 20:26:04.133778 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:04.133756    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:04.133908 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:04.133826    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:04.133908 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:04.133904    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 20:26:04.134019 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:04.133917    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:04.134019 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:04.133951    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:08.133938349 +0000 UTC m=+77.985439001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : configmap "kube-rbac-proxy" not found
Jul 29 20:26:04.134019 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:04.133973    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:08.1339565 +0000 UTC m=+77.985457155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:08.160284 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:08.160256    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:08.160656 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:08.160310    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:08.160656 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:08.160376    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 20:26:08.160656 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:08.160400    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:08.160656 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:08.160434    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:16.160418664 +0000 UTC m=+86.011919315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : configmap "kube-rbac-proxy" not found
Jul 29 20:26:08.160656 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:08.160449    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:16.160443355 +0000 UTC m=+86.011944007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:11.584097 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:11.584064    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:11.584437 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:11.584121    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:26:11.584437 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:11.584148    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:11.584437 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:11.584234    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle podName:95d50892-1cfa-47c2-a1d4-9aef77704cc7 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:27.584213588 +0000 UTC m=+97.435714256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle") pod "router-default-56f74bf69c-f78lr" (UID: "95d50892-1cfa-47c2-a1d4-9aef77704cc7") : configmap references non-existent config key: service-ca.crt
Jul 29 20:26:11.584437 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:11.584266    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 20:26:11.584437 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:11.584321    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert podName:e19b3f58-74da-489b-9c3d-8c45d9c64a55 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:27.584309123 +0000 UTC m=+97.435809773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-qh7wc" (UID: "e19b3f58-74da-489b-9c3d-8c45d9c64a55") : secret "networking-console-plugin-cert" not found
Jul 29 20:26:11.586214 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:11.586198    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95d50892-1cfa-47c2-a1d4-9aef77704cc7-metrics-certs\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:16.218612 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:16.218476    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:16.218612 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:16.218575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:16.219232 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:16.218621    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:16.219232 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:26:16.218682    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls podName:adfde4e5-4550-46b8-8795-f6ddc2a24978 nodeName:}" failed. No retries permitted until 2026-07-29 20:26:32.218667162 +0000 UTC m=+102.070167814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxwgp" (UID: "adfde4e5-4550-46b8-8795-f6ddc2a24978") : secret "insights-runtime-extractor-tls" not found
Jul 29 20:26:16.219232 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:16.219149    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfde4e5-4550-46b8-8795-f6ddc2a24978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:21.782233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.782201    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"]
Jul 29 20:26:21.786787 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.786772    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.789409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.789357    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 20:26:21.789598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.789584    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 29 20:26:21.790697 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.790674    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 20:26:21.790816 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.790731    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 29 20:26:21.790816 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.790773    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 20:26:21.790816 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.790740    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 29 20:26:21.791012 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.790736    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 29 20:26:21.800390 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.800369    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"]
Jul 29 20:26:21.862487 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.862462    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.862600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.862512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-ca\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.862600 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.862585    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.862725 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.862646    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz86n\" (UniqueName: \"kubernetes.io/projected/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-kube-api-access-gz86n\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.862725 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.862685    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.862725 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.862710    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-hub\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.963377 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.963355    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz86n\" (UniqueName: \"kubernetes.io/projected/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-kube-api-access-gz86n\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.963472 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.963383    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.963472 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.963400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-hub\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.963472 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.963432    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.963625 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.963551    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-ca\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.963625 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.963587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.964114 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.964090    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.965930 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.965903    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-ca\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.966030 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.965990    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.966077 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.966027    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-hub\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.966168 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.966153    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:21.971328 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:21.971306    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz86n\" (UniqueName: \"kubernetes.io/projected/09b173cc-70c8-4ee1-b852-ff1e9b1ae02b-kube-api-access-gz86n\") pod \"cluster-proxy-proxy-agent-55886f4dd6-fgchx\" (UID: \"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:22.111520 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:22.111466    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"
Jul 29 20:26:22.236681 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:22.236651    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx"]
Jul 29 20:26:22.240728 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:26:22.240698    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09b173cc_70c8_4ee1_b852_ff1e9b1ae02b.slice/crio-1ad9aed01fe71b9812c8f0288e09120825ac12c81f374d346f624c322f666605 WatchSource:0}: Error finding container 1ad9aed01fe71b9812c8f0288e09120825ac12c81f374d346f624c322f666605: Status 404 returned error can't find the container with id 1ad9aed01fe71b9812c8f0288e09120825ac12c81f374d346f624c322f666605
Jul 29 20:26:23.034924 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:23.034892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx" event={"ID":"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b","Type":"ContainerStarted","Data":"1ad9aed01fe71b9812c8f0288e09120825ac12c81f374d346f624c322f666605"}
Jul 29 20:26:27.055407 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.055370    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx" event={"ID":"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b","Type":"ContainerStarted","Data":"4a5fc86d617e642af7b5e50258c5a4e38d1dcb201620bc3fdc161a624a7a218e"}
Jul 29 20:26:27.055770 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.055414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx" event={"ID":"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b","Type":"ContainerStarted","Data":"37b69c2f6143fb65b236db1eeeff316294634a24b8235c447cee0399bd108b65"}
Jul 29 20:26:27.055770 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.055427    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx" event={"ID":"09b173cc-70c8-4ee1-b852-ff1e9b1ae02b","Type":"ContainerStarted","Data":"9d3054dacba32b33625b942cd7d9415a13627a7e0a0c5215bd9c4615ba814b3a"}
Jul 29 20:26:27.076088 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.076043    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55886f4dd6-fgchx" podStartSLOduration=2.302476847 podStartE2EDuration="6.076027473s" totalImagesPullingTime="3.773550626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:26:27.074309404 +0000 UTC m=+96.925810078" watchObservedRunningTime="2026-07-29 20:26:27.076027473 +0000 UTC m=+96.927528147"
Jul 29 20:26:27.608328 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.608289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:26:27.608497 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.608339    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:27.608954 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.608931    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d50892-1cfa-47c2-a1d4-9aef77704cc7-service-ca-bundle\") pod \"router-default-56f74bf69c-f78lr\" (UID: \"95d50892-1cfa-47c2-a1d4-9aef77704cc7\") " pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:27.610691 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.610672    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e19b3f58-74da-489b-9c3d-8c45d9c64a55-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-qh7wc\" (UID: \"e19b3f58-74da-489b-9c3d-8c45d9c64a55\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:26:27.624070 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.624052    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"
Jul 29 20:26:27.628990 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.628966    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:27.755308 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.755240    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56f74bf69c-f78lr"]
Jul 29 20:26:27.759655 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:26:27.759631    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d50892_1cfa_47c2_a1d4_9aef77704cc7.slice/crio-76d13cd4711cb83a670bbdea02f13d07728069a24b84eb0722b366f22d30bcc4 WatchSource:0}: Error finding container 76d13cd4711cb83a670bbdea02f13d07728069a24b84eb0722b366f22d30bcc4: Status 404 returned error can't find the container with id 76d13cd4711cb83a670bbdea02f13d07728069a24b84eb0722b366f22d30bcc4
Jul 29 20:26:27.767698 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:27.767647    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc"]
Jul 29 20:26:27.770792 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:26:27.770765    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19b3f58_74da_489b_9c3d_8c45d9c64a55.slice/crio-9101fe8281a50d70ba651b1e32f66a4aaf658522c3407d593bb6645bf7cd1271 WatchSource:0}: Error finding container 9101fe8281a50d70ba651b1e32f66a4aaf658522c3407d593bb6645bf7cd1271: Status 404 returned error can't find the container with id 9101fe8281a50d70ba651b1e32f66a4aaf658522c3407d593bb6645bf7cd1271
Jul 29 20:26:28.059615 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:28.059579    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56f74bf69c-f78lr" event={"ID":"95d50892-1cfa-47c2-a1d4-9aef77704cc7","Type":"ContainerStarted","Data":"457785532bb0a508a720e6bb3f64119329b1f7d48a5ffd9a76871af14e58de9f"}
Jul 29 20:26:28.060034 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:28.059633    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56f74bf69c-f78lr" event={"ID":"95d50892-1cfa-47c2-a1d4-9aef77704cc7","Type":"ContainerStarted","Data":"76d13cd4711cb83a670bbdea02f13d07728069a24b84eb0722b366f22d30bcc4"}
Jul 29 20:26:28.060721 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:28.060699    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc" event={"ID":"e19b3f58-74da-489b-9c3d-8c45d9c64a55","Type":"ContainerStarted","Data":"9101fe8281a50d70ba651b1e32f66a4aaf658522c3407d593bb6645bf7cd1271"}
Jul 29 20:26:28.083134 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:28.083093    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56f74bf69c-f78lr" podStartSLOduration=33.08308068 podStartE2EDuration="33.08308068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:25:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:26:28.082290907 +0000 UTC m=+97.933791581" watchObservedRunningTime="2026-07-29 20:26:28.08308068 +0000 UTC m=+97.934581361"
Jul 29 20:26:28.629905 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:28.629874    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:28.632723 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:28.632701    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:28.918341 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:28.918271    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:26:28.920807 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:28.920781    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54871aa4-68a9-4d32-95ab-739033a2ed18-metrics-tls\") pod \"dns-default-b58fv\" (UID: \"54871aa4-68a9-4d32-95ab-739033a2ed18\") " pod="openshift-dns/dns-default-b58fv"
Jul 29 20:26:28.987619 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:28.987595    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xpqnl\""
Jul 29 20:26:28.994884 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:28.994862    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b58fv"
Jul 29 20:26:29.064962 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:29.064937    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:29.066428 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:29.066408    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56f74bf69c-f78lr"
Jul 29 20:26:29.244946 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:29.244921    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b58fv"]
Jul 29 20:26:29.247700 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:26:29.247677    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54871aa4_68a9_4d32_95ab_739033a2ed18.slice/crio-d62d0c4abfba533282548cfa34042bee2b93f5361d3a6c02200b57e56c04924c WatchSource:0}: Error finding container d62d0c4abfba533282548cfa34042bee2b93f5361d3a6c02200b57e56c04924c: Status 404 returned error can't find the container with id d62d0c4abfba533282548cfa34042bee2b93f5361d3a6c02200b57e56c04924c
Jul 29 20:26:30.069181 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:30.069150    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc" event={"ID":"e19b3f58-74da-489b-9c3d-8c45d9c64a55","Type":"ContainerStarted","Data":"5141237a1c2a5d5737b9dc4b6532bd5291706c01f474fa26c0948bf7e1a6dbdc"}
Jul 29 20:26:30.070513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:30.070477    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b58fv" event={"ID":"54871aa4-68a9-4d32-95ab-739033a2ed18","Type":"ContainerStarted","Data":"d62d0c4abfba533282548cfa34042bee2b93f5361d3a6c02200b57e56c04924c"}
Jul 29 20:26:30.098916 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:30.098868    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-qh7wc" podStartSLOduration=33.694360211 podStartE2EDuration="35.098854275s" totalImagesPullingTime="1.404494064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:26:30.09832602 +0000 UTC m=+99.949826694" watchObservedRunningTime="2026-07-29 20:26:30.098854275 +0000 UTC m=+99.950354945"
Jul 29 20:26:31.972510 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:31.972489    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n4bt5"
Jul 29 20:26:32.079039 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:32.078974    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b58fv" event={"ID":"54871aa4-68a9-4d32-95ab-739033a2ed18","Type":"ContainerStarted","Data":"839838f732a4d5a139c138f58769bf013f117973494c8b64de6e4a0a64786164"}
Jul 29 20:26:32.079039 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:32.079020    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b58fv" event={"ID":"54871aa4-68a9-4d32-95ab-739033a2ed18","Type":"ContainerStarted","Data":"0bf5fbca3f8405a3f48536e0e6804f76acb018192ff72658f9441f86ede8095c"}
Jul 29 20:26:32.079205 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:32.079107    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b58fv"
Jul 29 20:26:32.096805 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:32.096765    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b58fv" podStartSLOduration=65.575688632 podStartE2EDuration="1m8.096751968s" totalImagesPullingTime="2.521063336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:26:32.095535014 +0000 UTC m=+101.947035685" watchObservedRunningTime="2026-07-29 20:26:32.096751968 +0000 UTC m=+101.948252640"
Jul 29 20:26:32.244761 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:32.244731    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:32.247101 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:32.247076    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfde4e5-4550-46b8-8795-f6ddc2a24978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxwgp\" (UID: \"adfde4e5-4550-46b8-8795-f6ddc2a24978\") " pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:32.289133 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:32.289104    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zxwgp"
Jul 29 20:26:32.420182 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:32.420154    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zxwgp"]
Jul 29 20:26:32.423212 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:26:32.423189    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadfde4e5_4550_46b8_8795_f6ddc2a24978.slice/crio-2e0da6b234866f88180cf32a59035ea6a1080350e4e57ac389ba2da8f54a94a0 WatchSource:0}: Error finding container 2e0da6b234866f88180cf32a59035ea6a1080350e4e57ac389ba2da8f54a94a0: Status 404 returned error can't find the container with id 2e0da6b234866f88180cf32a59035ea6a1080350e4e57ac389ba2da8f54a94a0
Jul 29 20:26:33.084144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:33.084109    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxwgp" event={"ID":"adfde4e5-4550-46b8-8795-f6ddc2a24978","Type":"ContainerStarted","Data":"2e0da6b234866f88180cf32a59035ea6a1080350e4e57ac389ba2da8f54a94a0"}
Jul 29 20:26:38.105614 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:38.105575    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxwgp" event={"ID":"adfde4e5-4550-46b8-8795-f6ddc2a24978","Type":"ContainerStarted","Data":"e80dbd69a84e3a58746fd99d37093d800ab877fec0992e16f935e7c1dbb69fae"}
Jul 29 20:26:40.845791 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:40.845769    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wqxth"]
Jul 29 20:26:40.848386 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:40.848369    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:40.852858 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:40.852782    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t564f\""
Jul 29 20:26:40.852858 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:40.852786    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 20:26:40.853003 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:40.852888    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 20:26:40.853822 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:40.853790    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 20:26:40.853949 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:40.853881    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 20:26:40.853949 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:40.853929    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 20:26:40.854059 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:40.853881    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 20:26:41.014280 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.014252    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-wtmp\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.014394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.014287    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-accelerators-collector-config\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.014394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.014310    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llkjc\" (UniqueName: \"kubernetes.io/projected/8df5c6f1-cdd2-4817-a06f-bee05705c74a-kube-api-access-llkjc\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.014394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.014326    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df5c6f1-cdd2-4817-a06f-bee05705c74a-sys\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.014394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.014374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8df5c6f1-cdd2-4817-a06f-bee05705c74a-metrics-client-ca\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.014527 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.014408    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-textfile\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.014527 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.014436    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.014588 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.014525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8df5c6f1-cdd2-4817-a06f-bee05705c74a-root\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.014588 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.014551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-tls\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115291 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-wtmp\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115291 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115254    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-accelerators-collector-config\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115291 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115290    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llkjc\" (UniqueName: \"kubernetes.io/projected/8df5c6f1-cdd2-4817-a06f-bee05705c74a-kube-api-access-llkjc\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115314    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df5c6f1-cdd2-4817-a06f-bee05705c74a-sys\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8df5c6f1-cdd2-4817-a06f-bee05705c74a-metrics-client-ca\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115362    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-textfile\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115381    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115392    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-wtmp\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8df5c6f1-cdd2-4817-a06f-bee05705c74a-root\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115448    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8df5c6f1-cdd2-4817-a06f-bee05705c74a-root\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.115523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115459    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-tls\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.116066 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.115950    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-accelerators-collector-config\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.116066 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.116008    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-textfile\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.116066 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.116021    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df5c6f1-cdd2-4817-a06f-bee05705c74a-sys\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.116220 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.116138    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8df5c6f1-cdd2-4817-a06f-bee05705c74a-metrics-client-ca\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.117998 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.117966    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxwgp" event={"ID":"adfde4e5-4550-46b8-8795-f6ddc2a24978","Type":"ContainerStarted","Data":"cf17694c1bc680d3c9e8c85dcc45b75f02afd4d2dca7aa750bb79a1070d9dba2"}
Jul 29 20:26:41.118220 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.118201    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.118439 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.118417    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8df5c6f1-cdd2-4817-a06f-bee05705c74a-node-exporter-tls\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.124873 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.124852    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llkjc\" (UniqueName: \"kubernetes.io/projected/8df5c6f1-cdd2-4817-a06f-bee05705c74a-kube-api-access-llkjc\") pod \"node-exporter-wqxth\" (UID: \"8df5c6f1-cdd2-4817-a06f-bee05705c74a\") " pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.157793 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:41.157774    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wqxth"
Jul 29 20:26:41.166737 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:26:41.166714    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df5c6f1_cdd2_4817_a06f_bee05705c74a.slice/crio-38cc0b8137b0331611ae647d9793fa97b25a7b0aa90219f96d80de04cafe612c WatchSource:0}: Error finding container 38cc0b8137b0331611ae647d9793fa97b25a7b0aa90219f96d80de04cafe612c: Status 404 returned error can't find the container with id 38cc0b8137b0331611ae647d9793fa97b25a7b0aa90219f96d80de04cafe612c
Jul 29 20:26:42.086518 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:42.086485    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b58fv"
Jul 29 20:26:42.124102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:42.124065    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wqxth" event={"ID":"8df5c6f1-cdd2-4817-a06f-bee05705c74a","Type":"ContainerStarted","Data":"38cc0b8137b0331611ae647d9793fa97b25a7b0aa90219f96d80de04cafe612c"}
Jul 29 20:26:43.129494 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:43.129446    2557 generic.go:356] "Generic (PLEG): container finished" podID="8df5c6f1-cdd2-4817-a06f-bee05705c74a" containerID="3bbbda418ee6cb99563542ac6cea890c1dc9d24f560bcc1b831148e2f5bf332e" exitCode=0
Jul 29 20:26:43.129875 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:43.129538    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wqxth" event={"ID":"8df5c6f1-cdd2-4817-a06f-bee05705c74a","Type":"ContainerDied","Data":"3bbbda418ee6cb99563542ac6cea890c1dc9d24f560bcc1b831148e2f5bf332e"}
Jul 29 20:26:45.138429 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:45.138396    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxwgp" event={"ID":"adfde4e5-4550-46b8-8795-f6ddc2a24978","Type":"ContainerStarted","Data":"7f7da57fa9a4899cb6f2ff4c459c3fee5a207add5fdc7a195cc7e3afdf30dd12"}
Jul 29 20:26:45.140411 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:45.140388    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wqxth" event={"ID":"8df5c6f1-cdd2-4817-a06f-bee05705c74a","Type":"ContainerStarted","Data":"a00279629e6fd976ff3b05ccaa0dc564518a7f42449138465f159b48e93dd702"}
Jul 29 20:26:45.140525 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:45.140427    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wqxth" event={"ID":"8df5c6f1-cdd2-4817-a06f-bee05705c74a","Type":"ContainerStarted","Data":"411a05b70bddf24cf4f42a113eb2538dc556a057e912cbbe7ba241637fba7952"}
Jul 29 20:26:45.158730 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:45.158688    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zxwgp" podStartSLOduration=33.43159815 podStartE2EDuration="45.158675483s" totalImagesPullingTime="11.727077333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:26:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:26:45.157650344 +0000 UTC m=+115.009151042" watchObservedRunningTime="2026-07-29 20:26:45.158675483 +0000 UTC m=+115.010176156"
Jul 29 20:26:45.181266 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:45.181231    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wqxth" podStartSLOduration=4.148884228 podStartE2EDuration="5.181219178s" totalImagesPullingTime="957.479679ms" totalInitContainerRuntime="74.855271ms" isStatefulPod=true podCreationTimestamp="2026-07-29 20:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:26:45.180081995 +0000 UTC m=+115.031582667" watchObservedRunningTime="2026-07-29 20:26:45.181219178 +0000 UTC m=+115.032719889"
Jul 29 20:26:59.452966 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:59.452932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:26:59.455096 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:59.455074    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cd20bda-e613-45d4-8fff-0a7ddc584f56-metrics-certs\") pod \"network-metrics-daemon-zkjgg\" (UID: \"8cd20bda-e613-45d4-8fff-0a7ddc584f56\") " pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:26:59.630933 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:59.630912    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7tqs\""
Jul 29 20:26:59.639073 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:59.639052    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkjgg"
Jul 29 20:26:59.761676 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:26:59.761647    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zkjgg"]
Jul 29 20:26:59.764511 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:26:59.764483    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd20bda_e613_45d4_8fff_0a7ddc584f56.slice/crio-df2d37db95aba4092d28e082efa9a32d4e396b527d5472c9ab83216da2a66fad WatchSource:0}: Error finding container df2d37db95aba4092d28e082efa9a32d4e396b527d5472c9ab83216da2a66fad: Status 404 returned error can't find the container with id df2d37db95aba4092d28e082efa9a32d4e396b527d5472c9ab83216da2a66fad
Jul 29 20:27:00.187141 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:00.187112    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zkjgg" event={"ID":"8cd20bda-e613-45d4-8fff-0a7ddc584f56","Type":"ContainerStarted","Data":"df2d37db95aba4092d28e082efa9a32d4e396b527d5472c9ab83216da2a66fad"}
Jul 29 20:27:01.191614 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:01.191581    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zkjgg" event={"ID":"8cd20bda-e613-45d4-8fff-0a7ddc584f56","Type":"ContainerStarted","Data":"c37151dc098e6d83fe719caf85af0476d1a556d5beb11e330d51f1a66e87e8f1"}
Jul 29 20:27:01.192013 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:01.191637    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zkjgg" event={"ID":"8cd20bda-e613-45d4-8fff-0a7ddc584f56","Type":"ContainerStarted","Data":"66cf1e719dd029f8cd8bd198c12c39ef7cb7c4f725f2c8300c5d4d2e7f15b511"}
Jul 29 20:27:01.208067 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:01.208026    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zkjgg" podStartSLOduration=130.240982575 podStartE2EDuration="2m11.208012429s" totalImagesPullingTime="967.029854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:27:01.207902008 +0000 UTC m=+131.059402683" watchObservedRunningTime="2026-07-29 20:27:01.208012429 +0000 UTC m=+131.059513102"
Jul 29 20:27:14.133883 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.133853    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57bd49c64b-j4l9j"]
Jul 29 20:27:14.194547 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.194515    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57bd49c64b-j4l9j"]
Jul 29 20:27:14.194691 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.194618    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.197702 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.197681    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g2zcr\""
Jul 29 20:27:14.197702 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.197697    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 20:27:14.198827 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.198811    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 20:27:14.198895 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.198858    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 20:27:14.199099 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.199082    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 20:27:14.199186 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.199091    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 20:27:14.199244 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.199100    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 20:27:14.199244 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.199105    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 20:27:14.204286 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.204263    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 20:27:14.249096 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.249070    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4pdg\" (UniqueName: \"kubernetes.io/projected/d56189cb-672e-4de8-b0b0-3590462d256d-kube-api-access-w4pdg\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.249207 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.249107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-oauth-serving-cert\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.249207 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.249130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-oauth-config\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.249344 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.249202    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-console-config\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.249344 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.249235    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-service-ca\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.249344 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.249254    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-trusted-ca-bundle\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.249344 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.249285    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-serving-cert\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.350239 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.350209    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-oauth-config\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.350393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.350247    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-console-config\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.350393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.350264    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-service-ca\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.350393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.350280    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-trusted-ca-bundle\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.350393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.350305    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-serving-cert\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.350393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.350340    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4pdg\" (UniqueName: \"kubernetes.io/projected/d56189cb-672e-4de8-b0b0-3590462d256d-kube-api-access-w4pdg\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.350393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.350374    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-oauth-serving-cert\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.351041 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.351018    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-console-config\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.351141 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.351106    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-service-ca\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.351186 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.351132    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-oauth-serving-cert\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.351220 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.351201    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-trusted-ca-bundle\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.353134 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.353110    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-oauth-config\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.353217 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.353192    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-serving-cert\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.360850 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.360818    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4pdg\" (UniqueName: \"kubernetes.io/projected/d56189cb-672e-4de8-b0b0-3590462d256d-kube-api-access-w4pdg\") pod \"console-57bd49c64b-j4l9j\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") " pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.504360 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.504274    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:14.681298 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:14.681270    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57bd49c64b-j4l9j"]
Jul 29 20:27:14.684190 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:27:14.684162    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56189cb_672e_4de8_b0b0_3590462d256d.slice/crio-e886956aa8a24130682f4910336b6046c7ac84c2a6fec6b773eb497aefb244be WatchSource:0}: Error finding container e886956aa8a24130682f4910336b6046c7ac84c2a6fec6b773eb497aefb244be: Status 404 returned error can't find the container with id e886956aa8a24130682f4910336b6046c7ac84c2a6fec6b773eb497aefb244be
Jul 29 20:27:15.238590 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:15.238556    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57bd49c64b-j4l9j" event={"ID":"d56189cb-672e-4de8-b0b0-3590462d256d","Type":"ContainerStarted","Data":"e886956aa8a24130682f4910336b6046c7ac84c2a6fec6b773eb497aefb244be"}
Jul 29 20:27:18.254404 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:18.254369    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57bd49c64b-j4l9j" event={"ID":"d56189cb-672e-4de8-b0b0-3590462d256d","Type":"ContainerStarted","Data":"dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020"}
Jul 29 20:27:18.275652 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:18.275607    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57bd49c64b-j4l9j" podStartSLOduration=1.418199234 podStartE2EDuration="4.27559421s" totalImagesPullingTime="2.857394976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:27:18.274286145 +0000 UTC m=+148.125786819" watchObservedRunningTime="2026-07-29 20:27:18.27559421 +0000 UTC m=+148.127094883"
Jul 29 20:27:24.504726 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:24.504693    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:24.505274 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:24.504783    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:24.509342 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:24.509319    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:27:25.283572 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:27:25.283540    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:28:07.946337 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:07.946264    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57bd49c64b-j4l9j"]
Jul 29 20:28:32.967163 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:32.967104    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57bd49c64b-j4l9j" podUID="d56189cb-672e-4de8-b0b0-3590462d256d" containerName="console" containerID="cri-o://dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020" gracePeriod=15
Jul 29 20:28:33.204164 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.204140    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:28:33.289892 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.289869    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4pdg\" (UniqueName: \"kubernetes.io/projected/d56189cb-672e-4de8-b0b0-3590462d256d-kube-api-access-w4pdg\") pod \"d56189cb-672e-4de8-b0b0-3590462d256d\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") "
Jul 29 20:28:33.289990 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.289907    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-console-config\") pod \"d56189cb-672e-4de8-b0b0-3590462d256d\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") "
Jul 29 20:28:33.289990 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.289927    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-serving-cert\") pod \"d56189cb-672e-4de8-b0b0-3590462d256d\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") "
Jul 29 20:28:33.289990 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.289963    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-trusted-ca-bundle\") pod \"d56189cb-672e-4de8-b0b0-3590462d256d\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") "
Jul 29 20:28:33.290120 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.289997    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-oauth-config\") pod \"d56189cb-672e-4de8-b0b0-3590462d256d\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") "
Jul 29 20:28:33.290120 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.290020    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-service-ca\") pod \"d56189cb-672e-4de8-b0b0-3590462d256d\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") "
Jul 29 20:28:33.290220 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.290121    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-oauth-serving-cert\") pod \"d56189cb-672e-4de8-b0b0-3590462d256d\" (UID: \"d56189cb-672e-4de8-b0b0-3590462d256d\") "
Jul 29 20:28:33.290377 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.290347    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-console-config" (OuterVolumeSpecName: "console-config") pod "d56189cb-672e-4de8-b0b0-3590462d256d" (UID: "d56189cb-672e-4de8-b0b0-3590462d256d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:28:33.290377 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.290363    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-service-ca" (OuterVolumeSpecName: "service-ca") pod "d56189cb-672e-4de8-b0b0-3590462d256d" (UID: "d56189cb-672e-4de8-b0b0-3590462d256d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:28:33.290560 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.290394    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d56189cb-672e-4de8-b0b0-3590462d256d" (UID: "d56189cb-672e-4de8-b0b0-3590462d256d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:28:33.290623 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.290566    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d56189cb-672e-4de8-b0b0-3590462d256d" (UID: "d56189cb-672e-4de8-b0b0-3590462d256d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:28:33.292079 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.292052    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d56189cb-672e-4de8-b0b0-3590462d256d" (UID: "d56189cb-672e-4de8-b0b0-3590462d256d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:28:33.292162 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.292081    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d56189cb-672e-4de8-b0b0-3590462d256d" (UID: "d56189cb-672e-4de8-b0b0-3590462d256d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:28:33.292162 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.292153    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56189cb-672e-4de8-b0b0-3590462d256d-kube-api-access-w4pdg" (OuterVolumeSpecName: "kube-api-access-w4pdg") pod "d56189cb-672e-4de8-b0b0-3590462d256d" (UID: "d56189cb-672e-4de8-b0b0-3590462d256d"). InnerVolumeSpecName "kube-api-access-w4pdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:28:33.391293 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.391272    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4pdg\" (UniqueName: \"kubernetes.io/projected/d56189cb-672e-4de8-b0b0-3590462d256d-kube-api-access-w4pdg\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:28:33.391293 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.391292    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-console-config\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:28:33.391409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.391302    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-serving-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:28:33.391409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.391310    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-trusted-ca-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:28:33.391409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.391318    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d56189cb-672e-4de8-b0b0-3590462d256d-console-oauth-config\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:28:33.391409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.391338    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:28:33.391409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.391346    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d56189cb-672e-4de8-b0b0-3590462d256d-oauth-serving-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:28:33.499642 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.499614    2557 generic.go:356] "Generic (PLEG): container finished" podID="d56189cb-672e-4de8-b0b0-3590462d256d" containerID="dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020" exitCode=0
Jul 29 20:28:33.499731 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.499664    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57bd49c64b-j4l9j"
Jul 29 20:28:33.499731 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.499671    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57bd49c64b-j4l9j" event={"ID":"d56189cb-672e-4de8-b0b0-3590462d256d","Type":"ContainerDied","Data":"dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020"}
Jul 29 20:28:33.499731 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.499721    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57bd49c64b-j4l9j" event={"ID":"d56189cb-672e-4de8-b0b0-3590462d256d","Type":"ContainerDied","Data":"e886956aa8a24130682f4910336b6046c7ac84c2a6fec6b773eb497aefb244be"}
Jul 29 20:28:33.499825 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.499749    2557 scope.go:117] "RemoveContainer" containerID="dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020"
Jul 29 20:28:33.507658 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.507643    2557 scope.go:117] "RemoveContainer" containerID="dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020"
Jul 29 20:28:33.507912 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:28:33.507893    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020\": container with ID starting with dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020 not found: ID does not exist" containerID="dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020"
Jul 29 20:28:33.507963 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.507921    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020"} err="failed to get container status \"dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020\": rpc error: code = NotFound desc = could not find container \"dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020\": container with ID starting with dbc35e98c94332656c5367d80428d5e6ff99f12082f699bf029afaaa5cdd4020 not found: ID does not exist"
Jul 29 20:28:33.520685 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.520665    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57bd49c64b-j4l9j"]
Jul 29 20:28:33.524082 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:33.524062    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57bd49c64b-j4l9j"]
Jul 29 20:28:34.623039 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:28:34.620701    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d56189cb-672e-4de8-b0b0-3590462d256d" path="/var/lib/kubelet/pods/d56189cb-672e-4de8-b0b0-3590462d256d/volumes"
Jul 29 20:29:31.650540 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.650505    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"]
Jul 29 20:29:31.650995 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.650776    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56189cb-672e-4de8-b0b0-3590462d256d" containerName="console"
Jul 29 20:29:31.650995 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.650786    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56189cb-672e-4de8-b0b0-3590462d256d" containerName="console"
Jul 29 20:29:31.650995 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.650857    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d56189cb-672e-4de8-b0b0-3590462d256d" containerName="console"
Jul 29 20:29:31.653585 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.653556    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:31.657260 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.657240    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 20:29:31.657370 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.657341    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 20:29:31.658421 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.658404    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dhfxx\""
Jul 29 20:29:31.675650 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.675611    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"]
Jul 29 20:29:31.696657 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.694740    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:31.696657 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.694822    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:31.696657 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.694886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdgxb\" (UniqueName: \"kubernetes.io/projected/5c5ac5d0-2d3a-443c-8447-892faa93be19-kube-api-access-cdgxb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:31.795619 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.795575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgxb\" (UniqueName: \"kubernetes.io/projected/5c5ac5d0-2d3a-443c-8447-892faa93be19-kube-api-access-cdgxb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:31.795822 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.795649    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:31.795822 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.795706    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:31.796079 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.796054    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:31.796138 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.796086    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:31.808953 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.808929    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdgxb\" (UniqueName: \"kubernetes.io/projected/5c5ac5d0-2d3a-443c-8447-892faa93be19-kube-api-access-cdgxb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:31.962324 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:31.962224    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:32.090414 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:32.090391    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"]
Jul 29 20:29:32.093113 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:29:32.093086    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5ac5d0_2d3a_443c_8447_892faa93be19.slice/crio-7ab6d6b86a2b885f7e5d5731e6ecbf1699b6ba1d49f63884db4d0ec20cebff46 WatchSource:0}: Error finding container 7ab6d6b86a2b885f7e5d5731e6ecbf1699b6ba1d49f63884db4d0ec20cebff46: Status 404 returned error can't find the container with id 7ab6d6b86a2b885f7e5d5731e6ecbf1699b6ba1d49f63884db4d0ec20cebff46
Jul 29 20:29:32.699629 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:32.699590    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b" event={"ID":"5c5ac5d0-2d3a-443c-8447-892faa93be19","Type":"ContainerStarted","Data":"7ab6d6b86a2b885f7e5d5731e6ecbf1699b6ba1d49f63884db4d0ec20cebff46"}
Jul 29 20:29:34.168594 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.168552    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"]
Jul 29 20:29:34.171646 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.171618    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"
Jul 29 20:29:34.175667 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.175641    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ltczv\""
Jul 29 20:29:34.175667 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.175656    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 20:29:34.176809 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.176791    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 20:29:34.189050 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.189026    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"]
Jul 29 20:29:34.218073 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.218037    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc4bd87-d584-40e4-83d5-569738c49ec7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-znmsp\" (UID: \"5cc4bd87-d584-40e4-83d5-569738c49ec7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"
Jul 29 20:29:34.218249 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.218079    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs29w\" (UniqueName: \"kubernetes.io/projected/5cc4bd87-d584-40e4-83d5-569738c49ec7-kube-api-access-zs29w\") pod \"cert-manager-cainjector-559cdd8c87-znmsp\" (UID: \"5cc4bd87-d584-40e4-83d5-569738c49ec7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"
Jul 29 20:29:34.319278 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.319233    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc4bd87-d584-40e4-83d5-569738c49ec7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-znmsp\" (UID: \"5cc4bd87-d584-40e4-83d5-569738c49ec7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"
Jul 29 20:29:34.319278 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.319273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs29w\" (UniqueName: \"kubernetes.io/projected/5cc4bd87-d584-40e4-83d5-569738c49ec7-kube-api-access-zs29w\") pod \"cert-manager-cainjector-559cdd8c87-znmsp\" (UID: \"5cc4bd87-d584-40e4-83d5-569738c49ec7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"
Jul 29 20:29:34.329797 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.329762    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc4bd87-d584-40e4-83d5-569738c49ec7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-znmsp\" (UID: \"5cc4bd87-d584-40e4-83d5-569738c49ec7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"
Jul 29 20:29:34.330705 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.330680    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs29w\" (UniqueName: \"kubernetes.io/projected/5cc4bd87-d584-40e4-83d5-569738c49ec7-kube-api-access-zs29w\") pod \"cert-manager-cainjector-559cdd8c87-znmsp\" (UID: \"5cc4bd87-d584-40e4-83d5-569738c49ec7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"
Jul 29 20:29:34.481964 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.481878    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"
Jul 29 20:29:34.623718 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.623684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-znmsp"]
Jul 29 20:29:34.627246 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:29:34.627215    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cc4bd87_d584_40e4_83d5_569738c49ec7.slice/crio-6061aa980f7cfd3838b05eb51deb455f2c1469b450ca33c5ac19c8529cbf4e7e WatchSource:0}: Error finding container 6061aa980f7cfd3838b05eb51deb455f2c1469b450ca33c5ac19c8529cbf4e7e: Status 404 returned error can't find the container with id 6061aa980f7cfd3838b05eb51deb455f2c1469b450ca33c5ac19c8529cbf4e7e
Jul 29 20:29:34.708570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:34.708526    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp" event={"ID":"5cc4bd87-d584-40e4-83d5-569738c49ec7","Type":"ContainerStarted","Data":"6061aa980f7cfd3838b05eb51deb455f2c1469b450ca33c5ac19c8529cbf4e7e"}
Jul 29 20:29:40.732504 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:40.732467    2557 generic.go:356] "Generic (PLEG): container finished" podID="5c5ac5d0-2d3a-443c-8447-892faa93be19" containerID="38c564809756b324b60c95ba498feeba4c7258640b6075d775e608521abbbb94" exitCode=0
Jul 29 20:29:40.732947 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:40.732566    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b" event={"ID":"5c5ac5d0-2d3a-443c-8447-892faa93be19","Type":"ContainerDied","Data":"38c564809756b324b60c95ba498feeba4c7258640b6075d775e608521abbbb94"}
Jul 29 20:29:40.734254 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:40.734230    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp" event={"ID":"5cc4bd87-d584-40e4-83d5-569738c49ec7","Type":"ContainerStarted","Data":"195c0eca174095434e761031056e297e311346ae8ce8b23f8560410c1865674e"}
Jul 29 20:29:40.766289 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:40.766227    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znmsp" podStartSLOduration=1.481236998 podStartE2EDuration="6.766210882s" totalImagesPullingTime="5.284973884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:29:40.764612869 +0000 UTC m=+290.616113543" watchObservedRunningTime="2026-07-29 20:29:40.766210882 +0000 UTC m=+290.617711556"
Jul 29 20:29:43.746211 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:43.746171    2557 generic.go:356] "Generic (PLEG): container finished" podID="5c5ac5d0-2d3a-443c-8447-892faa93be19" containerID="7d810c850b56a8558903f9b1ebd19c26db59116bfbe6ef0ea0f6dfcae75b3d20" exitCode=0
Jul 29 20:29:43.746580 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:43.746259    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b" event={"ID":"5c5ac5d0-2d3a-443c-8447-892faa93be19","Type":"ContainerDied","Data":"7d810c850b56a8558903f9b1ebd19c26db59116bfbe6ef0ea0f6dfcae75b3d20"}
Jul 29 20:29:50.501153 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:50.501123    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:29:50.502216 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:50.502186    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:29:50.504806 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:50.504784    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 20:29:50.776348 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:50.776317    2557 generic.go:356] "Generic (PLEG): container finished" podID="5c5ac5d0-2d3a-443c-8447-892faa93be19" containerID="15f104de6cfdec734330c1a5afa464f3427f91c2496833098d2a7fa93378c2d2" exitCode=0
Jul 29 20:29:50.782542 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:50.776387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b" event={"ID":"5c5ac5d0-2d3a-443c-8447-892faa93be19","Type":"ContainerDied","Data":"15f104de6cfdec734330c1a5afa464f3427f91c2496833098d2a7fa93378c2d2"}
Jul 29 20:29:51.905029 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:51.905005    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:52.062893 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.062818    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-util\") pod \"5c5ac5d0-2d3a-443c-8447-892faa93be19\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") "
Jul 29 20:29:52.062893 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.062876    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-bundle\") pod \"5c5ac5d0-2d3a-443c-8447-892faa93be19\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") "
Jul 29 20:29:52.063079 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.062907    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdgxb\" (UniqueName: \"kubernetes.io/projected/5c5ac5d0-2d3a-443c-8447-892faa93be19-kube-api-access-cdgxb\") pod \"5c5ac5d0-2d3a-443c-8447-892faa93be19\" (UID: \"5c5ac5d0-2d3a-443c-8447-892faa93be19\") "
Jul 29 20:29:52.063282 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.063259    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-bundle" (OuterVolumeSpecName: "bundle") pod "5c5ac5d0-2d3a-443c-8447-892faa93be19" (UID: "5c5ac5d0-2d3a-443c-8447-892faa93be19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:29:52.064960 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.064934    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c5ac5d0-2d3a-443c-8447-892faa93be19-kube-api-access-cdgxb" (OuterVolumeSpecName: "kube-api-access-cdgxb") pod "5c5ac5d0-2d3a-443c-8447-892faa93be19" (UID: "5c5ac5d0-2d3a-443c-8447-892faa93be19"). InnerVolumeSpecName "kube-api-access-cdgxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:29:52.067911 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.067891    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-util" (OuterVolumeSpecName: "util") pod "5c5ac5d0-2d3a-443c-8447-892faa93be19" (UID: "5c5ac5d0-2d3a-443c-8447-892faa93be19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:29:52.163696 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.163661    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-util\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:29:52.163696 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.163692    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5ac5d0-2d3a-443c-8447-892faa93be19-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:29:52.163696 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.163702    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdgxb\" (UniqueName: \"kubernetes.io/projected/5c5ac5d0-2d3a-443c-8447-892faa93be19-kube-api-access-cdgxb\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:29:52.783995 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.783972    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b"
Jul 29 20:29:52.784139 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.783995    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5262b" event={"ID":"5c5ac5d0-2d3a-443c-8447-892faa93be19","Type":"ContainerDied","Data":"7ab6d6b86a2b885f7e5d5731e6ecbf1699b6ba1d49f63884db4d0ec20cebff46"}
Jul 29 20:29:52.784139 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:29:52.784042    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ab6d6b86a2b885f7e5d5731e6ecbf1699b6ba1d49f63884db4d0ec20cebff46"
Jul 29 20:30:01.650770 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.650733    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"]
Jul 29 20:30:01.651253 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.650997    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5ac5d0-2d3a-443c-8447-892faa93be19" containerName="pull"
Jul 29 20:30:01.651253 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.651007    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5ac5d0-2d3a-443c-8447-892faa93be19" containerName="pull"
Jul 29 20:30:01.651253 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.651015    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5ac5d0-2d3a-443c-8447-892faa93be19" containerName="extract"
Jul 29 20:30:01.651253 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.651021    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5ac5d0-2d3a-443c-8447-892faa93be19" containerName="extract"
Jul 29 20:30:01.651253 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.651035    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5ac5d0-2d3a-443c-8447-892faa93be19" containerName="util"
Jul 29 20:30:01.651253 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.651042    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5ac5d0-2d3a-443c-8447-892faa93be19" containerName="util"
Jul 29 20:30:01.651253 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.651084    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c5ac5d0-2d3a-443c-8447-892faa93be19" containerName="extract"
Jul 29 20:30:01.657211 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.657189    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:01.659917 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.659890    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 20:30:01.660910 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.660887    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 20:30:01.661048 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.660887    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dhfxx\""
Jul 29 20:30:01.663305 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.663283    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"]
Jul 29 20:30:01.825598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.825561    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:01.825598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.825600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jspfp\" (UniqueName: \"kubernetes.io/projected/5e507e25-c435-4976-ab76-47680c038b03-kube-api-access-jspfp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:01.825824 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.825619    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:01.926555 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.926470    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:01.926555 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.926512    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jspfp\" (UniqueName: \"kubernetes.io/projected/5e507e25-c435-4976-ab76-47680c038b03-kube-api-access-jspfp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:01.926555 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.926533    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:01.926890 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.926872    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:01.926988 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.926966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:01.939391 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.939352    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jspfp\" (UniqueName: \"kubernetes.io/projected/5e507e25-c435-4976-ab76-47680c038b03-kube-api-access-jspfp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:01.966545 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:01.966506    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:02.107146 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:02.107122    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"]
Jul 29 20:30:02.109648 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:30:02.109606    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e507e25_c435_4976_ab76_47680c038b03.slice/crio-a17d06d220857a5a699381e1695c97a42b577d0ce8f2189665dcbee9a6bfbf37 WatchSource:0}: Error finding container a17d06d220857a5a699381e1695c97a42b577d0ce8f2189665dcbee9a6bfbf37: Status 404 returned error can't find the container with id a17d06d220857a5a699381e1695c97a42b577d0ce8f2189665dcbee9a6bfbf37
Jul 29 20:30:02.818646 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:02.818604    2557 generic.go:356] "Generic (PLEG): container finished" podID="5e507e25-c435-4976-ab76-47680c038b03" containerID="d27a7109cc016ec9e40d8ed44f6ea99dac073aa7d999bdc9258184a12f3a3355" exitCode=0
Jul 29 20:30:02.819047 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:02.818685    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m" event={"ID":"5e507e25-c435-4976-ab76-47680c038b03","Type":"ContainerDied","Data":"d27a7109cc016ec9e40d8ed44f6ea99dac073aa7d999bdc9258184a12f3a3355"}
Jul 29 20:30:02.819047 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:02.818735    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m" event={"ID":"5e507e25-c435-4976-ab76-47680c038b03","Type":"ContainerStarted","Data":"a17d06d220857a5a699381e1695c97a42b577d0ce8f2189665dcbee9a6bfbf37"}
Jul 29 20:30:02.819147 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:02.819133    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 20:30:03.825200 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:03.825165    2557 generic.go:356] "Generic (PLEG): container finished" podID="5e507e25-c435-4976-ab76-47680c038b03" containerID="b0337b91bf8f1ee657791f3ef84b96687935e270d2f6bb3267d9480464b855f4" exitCode=0
Jul 29 20:30:03.825587 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:03.825244    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m" event={"ID":"5e507e25-c435-4976-ab76-47680c038b03","Type":"ContainerDied","Data":"b0337b91bf8f1ee657791f3ef84b96687935e270d2f6bb3267d9480464b855f4"}
Jul 29 20:30:04.831561 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:04.831520    2557 generic.go:356] "Generic (PLEG): container finished" podID="5e507e25-c435-4976-ab76-47680c038b03" containerID="253e79017d4fcd60f0f62b2a961d23b85933a7bed58996b314b392945a1dea17" exitCode=0
Jul 29 20:30:04.831986 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:04.831610    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m" event={"ID":"5e507e25-c435-4976-ab76-47680c038b03","Type":"ContainerDied","Data":"253e79017d4fcd60f0f62b2a961d23b85933a7bed58996b314b392945a1dea17"}
Jul 29 20:30:05.956720 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:05.956692    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:06.057614 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.057577    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jspfp\" (UniqueName: \"kubernetes.io/projected/5e507e25-c435-4976-ab76-47680c038b03-kube-api-access-jspfp\") pod \"5e507e25-c435-4976-ab76-47680c038b03\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") "
Jul 29 20:30:06.057614 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.057619    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-util\") pod \"5e507e25-c435-4976-ab76-47680c038b03\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") "
Jul 29 20:30:06.057859 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.057765    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-bundle\") pod \"5e507e25-c435-4976-ab76-47680c038b03\" (UID: \"5e507e25-c435-4976-ab76-47680c038b03\") "
Jul 29 20:30:06.058460 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.058428    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-bundle" (OuterVolumeSpecName: "bundle") pod "5e507e25-c435-4976-ab76-47680c038b03" (UID: "5e507e25-c435-4976-ab76-47680c038b03"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:30:06.059737 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.059716    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e507e25-c435-4976-ab76-47680c038b03-kube-api-access-jspfp" (OuterVolumeSpecName: "kube-api-access-jspfp") pod "5e507e25-c435-4976-ab76-47680c038b03" (UID: "5e507e25-c435-4976-ab76-47680c038b03"). InnerVolumeSpecName "kube-api-access-jspfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:30:06.063224 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.063201    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-util" (OuterVolumeSpecName: "util") pod "5e507e25-c435-4976-ab76-47680c038b03" (UID: "5e507e25-c435-4976-ab76-47680c038b03"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:30:06.159096 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.158999    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:30:06.159096 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.159035    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jspfp\" (UniqueName: \"kubernetes.io/projected/5e507e25-c435-4976-ab76-47680c038b03-kube-api-access-jspfp\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:30:06.159096 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.159047    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e507e25-c435-4976-ab76-47680c038b03-util\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:30:06.842138 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.842102    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m" event={"ID":"5e507e25-c435-4976-ab76-47680c038b03","Type":"ContainerDied","Data":"a17d06d220857a5a699381e1695c97a42b577d0ce8f2189665dcbee9a6bfbf37"}
Jul 29 20:30:06.842296 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.842158    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a17d06d220857a5a699381e1695c97a42b577d0ce8f2189665dcbee9a6bfbf37"
Jul 29 20:30:06.842296 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:06.842111    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsp2m"
Jul 29 20:30:17.826467 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.826434    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"]
Jul 29 20:30:17.826975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.826675    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e507e25-c435-4976-ab76-47680c038b03" containerName="extract"
Jul 29 20:30:17.826975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.826686    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e507e25-c435-4976-ab76-47680c038b03" containerName="extract"
Jul 29 20:30:17.826975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.826701    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e507e25-c435-4976-ab76-47680c038b03" containerName="util"
Jul 29 20:30:17.826975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.826707    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e507e25-c435-4976-ab76-47680c038b03" containerName="util"
Jul 29 20:30:17.826975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.826714    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e507e25-c435-4976-ab76-47680c038b03" containerName="pull"
Jul 29 20:30:17.826975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.826719    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e507e25-c435-4976-ab76-47680c038b03" containerName="pull"
Jul 29 20:30:17.826975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.826765    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e507e25-c435-4976-ab76-47680c038b03" containerName="extract"
Jul 29 20:30:17.828674 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.828654    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.832269 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.832248    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k4bvh\""
Jul 29 20:30:17.832503 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.832481    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 20:30:17.848606 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.848574    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 20:30:17.848606 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.848574    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 20:30:17.848779 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.848614    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 20:30:17.849968 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.849949    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fd88db1-e87e-429f-a1ce-aa6e840875eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.850027 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.849985    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2fd88db1-e87e-429f-a1ce-aa6e840875eb-manifests\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.850027 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.850004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2fd88db1-e87e-429f-a1ce-aa6e840875eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.850089 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.850059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q77x\" (UniqueName: \"kubernetes.io/projected/2fd88db1-e87e-429f-a1ce-aa6e840875eb-kube-api-access-2q77x\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.850125 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.850099    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fd88db1-e87e-429f-a1ce-aa6e840875eb-tmp\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.858431 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.858408    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"]
Jul 29 20:30:17.950466 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.950425    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fd88db1-e87e-429f-a1ce-aa6e840875eb-tmp\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.950646 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.950484    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fd88db1-e87e-429f-a1ce-aa6e840875eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.950646 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.950520    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2fd88db1-e87e-429f-a1ce-aa6e840875eb-manifests\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.950646 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.950537    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2fd88db1-e87e-429f-a1ce-aa6e840875eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.950646 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.950559    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q77x\" (UniqueName: \"kubernetes.io/projected/2fd88db1-e87e-429f-a1ce-aa6e840875eb-kube-api-access-2q77x\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.950970 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.950949    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2fd88db1-e87e-429f-a1ce-aa6e840875eb-manifests\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.952920 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.952889    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fd88db1-e87e-429f-a1ce-aa6e840875eb-tmp\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.953044 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.953030    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fd88db1-e87e-429f-a1ce-aa6e840875eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.953088 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.953056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2fd88db1-e87e-429f-a1ce-aa6e840875eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:17.964625 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:17.964596    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q77x\" (UniqueName: \"kubernetes.io/projected/2fd88db1-e87e-429f-a1ce-aa6e840875eb-kube-api-access-2q77x\") pod \"opendatahub-operator-controller-manager-74f7855d79-wx5zt\" (UID: \"2fd88db1-e87e-429f-a1ce-aa6e840875eb\") " pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:18.138662 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:18.138579    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:18.278744 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:18.278720    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"]
Jul 29 20:30:18.280896 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:30:18.280872    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd88db1_e87e_429f_a1ce_aa6e840875eb.slice/crio-04b2fda55fcc966acfe4781262a1524a29b60425b474e9ea2b67636884f4e8bb WatchSource:0}: Error finding container 04b2fda55fcc966acfe4781262a1524a29b60425b474e9ea2b67636884f4e8bb: Status 404 returned error can't find the container with id 04b2fda55fcc966acfe4781262a1524a29b60425b474e9ea2b67636884f4e8bb
Jul 29 20:30:18.885305 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:18.885265    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt" event={"ID":"2fd88db1-e87e-429f-a1ce-aa6e840875eb","Type":"ContainerStarted","Data":"04b2fda55fcc966acfe4781262a1524a29b60425b474e9ea2b67636884f4e8bb"}
Jul 29 20:30:22.903100 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:22.903055    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt" event={"ID":"2fd88db1-e87e-429f-a1ce-aa6e840875eb","Type":"ContainerStarted","Data":"82534e1267f9d92f7e151395bd156073e9ae7a0c19e1afd3aef2bb87d3d784ee"}
Jul 29 20:30:23.907756 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:23.907722    2557 generic.go:356] "Generic (PLEG): container finished" podID="2fd88db1-e87e-429f-a1ce-aa6e840875eb" containerID="82534e1267f9d92f7e151395bd156073e9ae7a0c19e1afd3aef2bb87d3d784ee" exitCode=0
Jul 29 20:30:23.907756 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:23.907762    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt" event={"ID":"2fd88db1-e87e-429f-a1ce-aa6e840875eb","Type":"ContainerDied","Data":"82534e1267f9d92f7e151395bd156073e9ae7a0c19e1afd3aef2bb87d3d784ee"}
Jul 29 20:30:24.912975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:24.912938    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt" event={"ID":"2fd88db1-e87e-429f-a1ce-aa6e840875eb","Type":"ContainerStarted","Data":"8558b532cfe55585172c16beb186e65f1645cb1030faa884c21192f7b29b7377"}
Jul 29 20:30:24.913348 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:24.913077    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:24.936422 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:24.936372    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt" podStartSLOduration=2.629621331 podStartE2EDuration="7.936356719s" totalImagesPullingTime="4.316539084s" totalInitContainerRuntime="990.196304ms" isStatefulPod=false podCreationTimestamp="2026-07-29 20:30:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:30:24.935376312 +0000 UTC m=+334.786876984" watchObservedRunningTime="2026-07-29 20:30:24.936356719 +0000 UTC m=+334.787857391"
Jul 29 20:30:35.919642 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:35.919611    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74f7855d79-wx5zt"
Jul 29 20:30:38.073316 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.073284    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"]
Jul 29 20:30:38.078766 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.078748    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.081840 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.081809    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 20:30:38.081931 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.081863    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 20:30:38.083068 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.083053    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bbg5t\""
Jul 29 20:30:38.094631 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.094613    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76e1e37e-c08a-4518-ad99-7ed75310d0dd-tls-certs\") pod \"kube-auth-proxy-6b588c995f-mhxpn\" (UID: \"76e1e37e-c08a-4518-ad99-7ed75310d0dd\") " pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.094707 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.094638    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jspqf\" (UniqueName: \"kubernetes.io/projected/76e1e37e-c08a-4518-ad99-7ed75310d0dd-kube-api-access-jspqf\") pod \"kube-auth-proxy-6b588c995f-mhxpn\" (UID: \"76e1e37e-c08a-4518-ad99-7ed75310d0dd\") " pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.094707 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.094697    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e1e37e-c08a-4518-ad99-7ed75310d0dd-tmp\") pod \"kube-auth-proxy-6b588c995f-mhxpn\" (UID: \"76e1e37e-c08a-4518-ad99-7ed75310d0dd\") " pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.101232 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.101212    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"]
Jul 29 20:30:38.195235 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.195211    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e1e37e-c08a-4518-ad99-7ed75310d0dd-tmp\") pod \"kube-auth-proxy-6b588c995f-mhxpn\" (UID: \"76e1e37e-c08a-4518-ad99-7ed75310d0dd\") " pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.195334 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.195238    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76e1e37e-c08a-4518-ad99-7ed75310d0dd-tls-certs\") pod \"kube-auth-proxy-6b588c995f-mhxpn\" (UID: \"76e1e37e-c08a-4518-ad99-7ed75310d0dd\") " pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.195334 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.195256    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jspqf\" (UniqueName: \"kubernetes.io/projected/76e1e37e-c08a-4518-ad99-7ed75310d0dd-kube-api-access-jspqf\") pod \"kube-auth-proxy-6b588c995f-mhxpn\" (UID: \"76e1e37e-c08a-4518-ad99-7ed75310d0dd\") " pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.197515 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.197483    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e1e37e-c08a-4518-ad99-7ed75310d0dd-tmp\") pod \"kube-auth-proxy-6b588c995f-mhxpn\" (UID: \"76e1e37e-c08a-4518-ad99-7ed75310d0dd\") " pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.197668 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.197654    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76e1e37e-c08a-4518-ad99-7ed75310d0dd-tls-certs\") pod \"kube-auth-proxy-6b588c995f-mhxpn\" (UID: \"76e1e37e-c08a-4518-ad99-7ed75310d0dd\") " pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.213782 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.213759    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jspqf\" (UniqueName: \"kubernetes.io/projected/76e1e37e-c08a-4518-ad99-7ed75310d0dd-kube-api-access-jspqf\") pod \"kube-auth-proxy-6b588c995f-mhxpn\" (UID: \"76e1e37e-c08a-4518-ad99-7ed75310d0dd\") " pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.306062 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.306039    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xpzr6"]
Jul 29 20:30:38.308026 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.308012    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6"
Jul 29 20:30:38.311173 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.311155    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 29 20:30:38.311244 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.311215    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6p26p\""
Jul 29 20:30:38.324246 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.324200    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xpzr6"]
Jul 29 20:30:38.387526 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.387501    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"
Jul 29 20:30:38.396407 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.396367    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33408537-b79a-459f-a7e2-ec571f5feeb5-cert\") pod \"odh-model-controller-7998c67dc4-xpzr6\" (UID: \"33408537-b79a-459f-a7e2-ec571f5feeb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6"
Jul 29 20:30:38.396529 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.396423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l6rh\" (UniqueName: \"kubernetes.io/projected/33408537-b79a-459f-a7e2-ec571f5feeb5-kube-api-access-9l6rh\") pod \"odh-model-controller-7998c67dc4-xpzr6\" (UID: \"33408537-b79a-459f-a7e2-ec571f5feeb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6"
Jul 29 20:30:38.497161 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.497123    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l6rh\" (UniqueName: \"kubernetes.io/projected/33408537-b79a-459f-a7e2-ec571f5feeb5-kube-api-access-9l6rh\") pod \"odh-model-controller-7998c67dc4-xpzr6\" (UID: \"33408537-b79a-459f-a7e2-ec571f5feeb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6"
Jul 29 20:30:38.497298 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.497262    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33408537-b79a-459f-a7e2-ec571f5feeb5-cert\") pod \"odh-model-controller-7998c67dc4-xpzr6\" (UID: \"33408537-b79a-459f-a7e2-ec571f5feeb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6"
Jul 29 20:30:38.499983 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.499956    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33408537-b79a-459f-a7e2-ec571f5feeb5-cert\") pod \"odh-model-controller-7998c67dc4-xpzr6\" (UID: \"33408537-b79a-459f-a7e2-ec571f5feeb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6"
Jul 29 20:30:38.505412 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.505388    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l6rh\" (UniqueName: \"kubernetes.io/projected/33408537-b79a-459f-a7e2-ec571f5feeb5-kube-api-access-9l6rh\") pod \"odh-model-controller-7998c67dc4-xpzr6\" (UID: \"33408537-b79a-459f-a7e2-ec571f5feeb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6"
Jul 29 20:30:38.520602 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.520579    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn"]
Jul 29 20:30:38.523480 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:30:38.523456    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e1e37e_c08a_4518_ad99_7ed75310d0dd.slice/crio-a6d5a9424f4c4bd5a449b04a60ddc3a7b68c9a5bb8683581e4b38c18a922c152 WatchSource:0}: Error finding container a6d5a9424f4c4bd5a449b04a60ddc3a7b68c9a5bb8683581e4b38c18a922c152: Status 404 returned error can't find the container with id a6d5a9424f4c4bd5a449b04a60ddc3a7b68c9a5bb8683581e4b38c18a922c152
Jul 29 20:30:38.617404 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.617343    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6"
Jul 29 20:30:38.749300 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.749272    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xpzr6"]
Jul 29 20:30:38.751576 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:30:38.751553    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33408537_b79a_459f_a7e2_ec571f5feeb5.slice/crio-abfd0e4266d1d9c258cae2ff08acd7ff8f255d5c6b1d1675a1def7f0cf57a246 WatchSource:0}: Error finding container abfd0e4266d1d9c258cae2ff08acd7ff8f255d5c6b1d1675a1def7f0cf57a246: Status 404 returned error can't find the container with id abfd0e4266d1d9c258cae2ff08acd7ff8f255d5c6b1d1675a1def7f0cf57a246
Jul 29 20:30:38.964590 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.964502    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn" event={"ID":"76e1e37e-c08a-4518-ad99-7ed75310d0dd","Type":"ContainerStarted","Data":"a6d5a9424f4c4bd5a449b04a60ddc3a7b68c9a5bb8683581e4b38c18a922c152"}
Jul 29 20:30:38.965720 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:38.965695    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6" event={"ID":"33408537-b79a-459f-a7e2-ec571f5feeb5","Type":"ContainerStarted","Data":"abfd0e4266d1d9c258cae2ff08acd7ff8f255d5c6b1d1675a1def7f0cf57a246"}
Jul 29 20:30:39.272124 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.272095    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cwnjm"]
Jul 29 20:30:39.274314 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.274296    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:30:39.276862 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.276824    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 29 20:30:39.277103 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.277086    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-ps8bs\""
Jul 29 20:30:39.289686 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.289664    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cwnjm"]
Jul 29 20:30:39.304325 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.304303    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b3cf15-3ff5-4e13-b14a-f22d102a26a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-cwnjm\" (UID: \"77b3cf15-3ff5-4e13-b14a-f22d102a26a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:30:39.304442 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.304378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvpgl\" (UniqueName: \"kubernetes.io/projected/77b3cf15-3ff5-4e13-b14a-f22d102a26a0-kube-api-access-kvpgl\") pod \"model-serving-api-54d89bd5fc-cwnjm\" (UID: \"77b3cf15-3ff5-4e13-b14a-f22d102a26a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:30:39.405581 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.405399    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvpgl\" (UniqueName: \"kubernetes.io/projected/77b3cf15-3ff5-4e13-b14a-f22d102a26a0-kube-api-access-kvpgl\") pod \"model-serving-api-54d89bd5fc-cwnjm\" (UID: \"77b3cf15-3ff5-4e13-b14a-f22d102a26a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:30:39.405581 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.405467    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b3cf15-3ff5-4e13-b14a-f22d102a26a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-cwnjm\" (UID: \"77b3cf15-3ff5-4e13-b14a-f22d102a26a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:30:39.405755 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:30:39.405619    2557 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 29 20:30:39.405755 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:30:39.405735    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b3cf15-3ff5-4e13-b14a-f22d102a26a0-tls-certs podName:77b3cf15-3ff5-4e13-b14a-f22d102a26a0 nodeName:}" failed. No retries permitted until 2026-07-29 20:30:39.905665027 +0000 UTC m=+349.757165694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/77b3cf15-3ff5-4e13-b14a-f22d102a26a0-tls-certs") pod "model-serving-api-54d89bd5fc-cwnjm" (UID: "77b3cf15-3ff5-4e13-b14a-f22d102a26a0") : secret "model-serving-api-tls" not found
Jul 29 20:30:39.415620 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.415571    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvpgl\" (UniqueName: \"kubernetes.io/projected/77b3cf15-3ff5-4e13-b14a-f22d102a26a0-kube-api-access-kvpgl\") pod \"model-serving-api-54d89bd5fc-cwnjm\" (UID: \"77b3cf15-3ff5-4e13-b14a-f22d102a26a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:30:39.494792 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.494764    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"]
Jul 29 20:30:39.497374 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.497342    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.500586 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.500375    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 20:30:39.500703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.500636    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 20:30:39.500703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.500661    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 20:30:39.500813 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.500705    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wjt8d\""
Jul 29 20:30:39.500813 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.500636    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 20:30:39.514989 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.514969    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"]
Jul 29 20:30:39.607341 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.607262    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/78066d11-0a7f-4de3-86da-db21b4584937-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.607341 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.607311    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft5v2\" (UniqueName: \"kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-kube-api-access-ft5v2\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.607536 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.607350    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.607536 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.607380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.607536 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.607445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.607536 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.607498    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.607536 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.607527    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.708908 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.708878    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.709067 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.708929    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.709067 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.708969    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/78066d11-0a7f-4de3-86da-db21b4584937-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.709067 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.708999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5v2\" (UniqueName: \"kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-kube-api-access-ft5v2\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.709067 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.709042    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.709276 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.709070    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.709276 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.709139    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.710160 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.710130    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.712106 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.712083    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.712343 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.712295    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/78066d11-0a7f-4de3-86da-db21b4584937-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.712460 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.712444    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.712721 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.712688    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.719177 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.719119    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.720299 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.720258    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft5v2\" (UniqueName: \"kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-kube-api-access-ft5v2\") pod \"istiod-openshift-gateway-7b7995d5cd-vlm9v\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.810983 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.810950    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:39.911102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.911065    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b3cf15-3ff5-4e13-b14a-f22d102a26a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-cwnjm\" (UID: \"77b3cf15-3ff5-4e13-b14a-f22d102a26a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:30:39.914955 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.914930    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b3cf15-3ff5-4e13-b14a-f22d102a26a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-cwnjm\" (UID: \"77b3cf15-3ff5-4e13-b14a-f22d102a26a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:30:39.988158 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:39.988099    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"]
Jul 29 20:30:39.991165 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:30:39.991136    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78066d11_0a7f_4de3_86da_db21b4584937.slice/crio-fc6145a25e94ddf1374fee618ef80f7258eceacf02bb56a5930f86e83ce324d5 WatchSource:0}: Error finding container fc6145a25e94ddf1374fee618ef80f7258eceacf02bb56a5930f86e83ce324d5: Status 404 returned error can't find the container with id fc6145a25e94ddf1374fee618ef80f7258eceacf02bb56a5930f86e83ce324d5
Jul 29 20:30:40.185981 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:40.185902    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:30:40.337552 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:40.337464    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cwnjm"]
Jul 29 20:30:40.340692 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:30:40.340665    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b3cf15_3ff5_4e13_b14a_f22d102a26a0.slice/crio-9cc82bc7141be66b9c09a215688d28b2fc7c34bafddd0fb2ce209d895e3f3258 WatchSource:0}: Error finding container 9cc82bc7141be66b9c09a215688d28b2fc7c34bafddd0fb2ce209d895e3f3258: Status 404 returned error can't find the container with id 9cc82bc7141be66b9c09a215688d28b2fc7c34bafddd0fb2ce209d895e3f3258
Jul 29 20:30:40.978582 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:40.978543    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v" event={"ID":"78066d11-0a7f-4de3-86da-db21b4584937","Type":"ContainerStarted","Data":"fc6145a25e94ddf1374fee618ef80f7258eceacf02bb56a5930f86e83ce324d5"}
Jul 29 20:30:40.979810 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:40.979780    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm" event={"ID":"77b3cf15-3ff5-4e13-b14a-f22d102a26a0","Type":"ContainerStarted","Data":"9cc82bc7141be66b9c09a215688d28b2fc7c34bafddd0fb2ce209d895e3f3258"}
Jul 29 20:30:42.999259 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:42.999157    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6" event={"ID":"33408537-b79a-459f-a7e2-ec571f5feeb5","Type":"ContainerStarted","Data":"d7995a9f824ea12978de06c6386bbedc8a521940bedcf1ebdd44afd74f38bcc0"}
Jul 29 20:30:42.999735 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:42.999288    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6"
Jul 29 20:30:43.000817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:43.000787    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn" event={"ID":"76e1e37e-c08a-4518-ad99-7ed75310d0dd","Type":"ContainerStarted","Data":"1e77176e44beca422e1580b1c8b874883abdaf8f15d0766944bd0bcd961158a2"}
Jul 29 20:30:43.017725 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:43.017667    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6" podStartSLOduration=1.236607382 podStartE2EDuration="5.017649638s" totalImagesPullingTime="3.781042256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:30:43.016192822 +0000 UTC m=+352.867693497" watchObservedRunningTime="2026-07-29 20:30:43.017649638 +0000 UTC m=+352.869150312"
Jul 29 20:30:43.034270 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:43.034219    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b588c995f-mhxpn" podStartSLOduration=1.0169214069999999 podStartE2EDuration="5.034209045s" totalImagesPullingTime="4.017287638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:30:43.032546532 +0000 UTC m=+352.884047209" watchObservedRunningTime="2026-07-29 20:30:43.034209045 +0000 UTC m=+352.885709717"
Jul 29 20:30:44.125096 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:44.125050    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:30:44.125360 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:44.125133    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:30:45.011992 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:45.011959    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm" event={"ID":"77b3cf15-3ff5-4e13-b14a-f22d102a26a0","Type":"ContainerStarted","Data":"7cec636fc8186f196fb85ad6371f6a0af40149449e5072f6ae09f52e81e73d71"}
Jul 29 20:30:45.012161 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:45.012142    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:30:45.013638 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:45.013610    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v" event={"ID":"78066d11-0a7f-4de3-86da-db21b4584937","Type":"ContainerStarted","Data":"639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48"}
Jul 29 20:30:45.013742 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:45.013724    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:45.015323 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:45.015293    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-vlm9v container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 20:30:45.015422 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:45.015341    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v" podUID="78066d11-0a7f-4de3-86da-db21b4584937" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 20:30:45.031568 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:45.031528    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm" podStartSLOduration=2.285627906 podStartE2EDuration="6.031516887s" totalImagesPullingTime="3.745888981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:30:45.029866642 +0000 UTC m=+354.881367316" watchObservedRunningTime="2026-07-29 20:30:45.031516887 +0000 UTC m=+354.883017629"
Jul 29 20:30:45.083207 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:45.083167    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v" podStartSLOduration=1.952188752 podStartE2EDuration="6.083155025s" totalImagesPullingTime="4.130966273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:30:45.080609471 +0000 UTC m=+354.932110143" watchObservedRunningTime="2026-07-29 20:30:45.083155025 +0000 UTC m=+354.934655699"
Jul 29 20:30:46.018936 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.018906    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:46.083650 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.083621    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"]
Jul 29 20:30:46.086096 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.086074    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.089123 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.089096    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kr742\""
Jul 29 20:30:46.107237 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.107214    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"]
Jul 29 20:30:46.164099 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.164075    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89769e32-80be-49ba-aa95-af3ddcadc513-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.164176 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.164104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.164176 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.164128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.164176 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.164148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89769e32-80be-49ba-aa95-af3ddcadc513-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.164288 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.164190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.164288 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.164250    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.164288 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.164275    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89769e32-80be-49ba-aa95-af3ddcadc513-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.164375 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.164292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.164375 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.164308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7jn5\" (UniqueName: \"kubernetes.io/projected/89769e32-80be-49ba-aa95-af3ddcadc513-kube-api-access-h7jn5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.264761 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.264734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.264869 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.264766    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89769e32-80be-49ba-aa95-af3ddcadc513-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.264869 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.264790    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.264869 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.264809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.264993 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.264877    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89769e32-80be-49ba-aa95-af3ddcadc513-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.264993 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.264905    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.264993 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.264932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jn5\" (UniqueName: \"kubernetes.io/projected/89769e32-80be-49ba-aa95-af3ddcadc513-kube-api-access-h7jn5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.264993 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.264988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89769e32-80be-49ba-aa95-af3ddcadc513-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.265189 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.265012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.265242 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.265188    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.265375 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.265345    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.265464 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.265371    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.265529 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.265459    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.265658 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.265637    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89769e32-80be-49ba-aa95-af3ddcadc513-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.267175 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.267151    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89769e32-80be-49ba-aa95-af3ddcadc513-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.267325 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.267308    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89769e32-80be-49ba-aa95-af3ddcadc513-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.282380 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.282315    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89769e32-80be-49ba-aa95-af3ddcadc513-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.282489 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.282474    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7jn5\" (UniqueName: \"kubernetes.io/projected/89769e32-80be-49ba-aa95-af3ddcadc513-kube-api-access-h7jn5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps\" (UID: \"89769e32-80be-49ba-aa95-af3ddcadc513\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.396299 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.396279    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:46.557454 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:46.557380    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"]
Jul 29 20:30:46.560789 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:30:46.560766    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89769e32_80be_49ba_aa95_af3ddcadc513.slice/crio-a6d891871bd851b9c42685da120f21b23742d6da8640db0e672d714ab3109304 WatchSource:0}: Error finding container a6d891871bd851b9c42685da120f21b23742d6da8640db0e672d714ab3109304: Status 404 returned error can't find the container with id a6d891871bd851b9c42685da120f21b23742d6da8640db0e672d714ab3109304
Jul 29 20:30:47.023215 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:47.023181    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps" event={"ID":"89769e32-80be-49ba-aa95-af3ddcadc513","Type":"ContainerStarted","Data":"a6d891871bd851b9c42685da120f21b23742d6da8640db0e672d714ab3109304"}
Jul 29 20:30:48.909396 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.909367    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h548v"]
Jul 29 20:30:48.912464 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.912443    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v"
Jul 29 20:30:48.917253 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.917103    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 29 20:30:48.917253 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.917119    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rlhjm\""
Jul 29 20:30:48.918679 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.918658    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"]
Jul 29 20:30:48.921889 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.921870    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"
Jul 29 20:30:48.924853 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.924809    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-q27hm\""
Jul 29 20:30:48.924945 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.924828    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 29 20:30:48.928160 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.928143    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h548v"]
Jul 29 20:30:48.933018 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.932999    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"]
Jul 29 20:30:48.989737 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.989711    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae68cfb6-0301-48e5-87bc-72c07d320bf9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xmlwr\" (UID: \"ae68cfb6-0301-48e5-87bc-72c07d320bf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"
Jul 29 20:30:48.989871 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.989743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d0bf53-c14a-4ac6-9627-5dba01121ce1-cert\") pod \"kserve-controller-manager-d6f4b65b8-h548v\" (UID: \"91d0bf53-c14a-4ac6-9627-5dba01121ce1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v"
Jul 29 20:30:48.989871 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.989818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cld2m\" (UniqueName: \"kubernetes.io/projected/91d0bf53-c14a-4ac6-9627-5dba01121ce1-kube-api-access-cld2m\") pod \"kserve-controller-manager-d6f4b65b8-h548v\" (UID: \"91d0bf53-c14a-4ac6-9627-5dba01121ce1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v"
Jul 29 20:30:48.989871 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:48.989861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh7cm\" (UniqueName: \"kubernetes.io/projected/ae68cfb6-0301-48e5-87bc-72c07d320bf9-kube-api-access-xh7cm\") pod \"llmisvc-controller-manager-777c6bd7d5-xmlwr\" (UID: \"ae68cfb6-0301-48e5-87bc-72c07d320bf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"
Jul 29 20:30:49.091149 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.091113    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cld2m\" (UniqueName: \"kubernetes.io/projected/91d0bf53-c14a-4ac6-9627-5dba01121ce1-kube-api-access-cld2m\") pod \"kserve-controller-manager-d6f4b65b8-h548v\" (UID: \"91d0bf53-c14a-4ac6-9627-5dba01121ce1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v"
Jul 29 20:30:49.091301 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.091160    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh7cm\" (UniqueName: \"kubernetes.io/projected/ae68cfb6-0301-48e5-87bc-72c07d320bf9-kube-api-access-xh7cm\") pod \"llmisvc-controller-manager-777c6bd7d5-xmlwr\" (UID: \"ae68cfb6-0301-48e5-87bc-72c07d320bf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"
Jul 29 20:30:49.091301 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.091195    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae68cfb6-0301-48e5-87bc-72c07d320bf9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xmlwr\" (UID: \"ae68cfb6-0301-48e5-87bc-72c07d320bf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"
Jul 29 20:30:49.091301 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.091217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d0bf53-c14a-4ac6-9627-5dba01121ce1-cert\") pod \"kserve-controller-manager-d6f4b65b8-h548v\" (UID: \"91d0bf53-c14a-4ac6-9627-5dba01121ce1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v"
Jul 29 20:30:49.094009 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.093987    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d0bf53-c14a-4ac6-9627-5dba01121ce1-cert\") pod \"kserve-controller-manager-d6f4b65b8-h548v\" (UID: \"91d0bf53-c14a-4ac6-9627-5dba01121ce1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v"
Jul 29 20:30:49.094191 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.094162    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae68cfb6-0301-48e5-87bc-72c07d320bf9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xmlwr\" (UID: \"ae68cfb6-0301-48e5-87bc-72c07d320bf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"
Jul 29 20:30:49.111675 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.111649    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cld2m\" (UniqueName: \"kubernetes.io/projected/91d0bf53-c14a-4ac6-9627-5dba01121ce1-kube-api-access-cld2m\") pod \"kserve-controller-manager-d6f4b65b8-h548v\" (UID: \"91d0bf53-c14a-4ac6-9627-5dba01121ce1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v"
Jul 29 20:30:49.133117 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.133089    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh7cm\" (UniqueName: \"kubernetes.io/projected/ae68cfb6-0301-48e5-87bc-72c07d320bf9-kube-api-access-xh7cm\") pod \"llmisvc-controller-manager-777c6bd7d5-xmlwr\" (UID: \"ae68cfb6-0301-48e5-87bc-72c07d320bf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"
Jul 29 20:30:49.226446 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.226357    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v"
Jul 29 20:30:49.236511 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.236483    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"
Jul 29 20:30:49.675174 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.675141    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"]
Jul 29 20:30:49.675424 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:49.675334    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v" podUID="78066d11-0a7f-4de3-86da-db21b4584937" containerName="discovery" containerID="cri-o://639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48" gracePeriod=30
Jul 29 20:30:50.276334 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.275239    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:30:50.276334 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.275335    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:30:50.276334 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.275378    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:30:50.349734 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.349711    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:50.404703 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.404675    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/78066d11-0a7f-4de3-86da-db21b4584937-local-certs\") pod \"78066d11-0a7f-4de3-86da-db21b4584937\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") "
Jul 29 20:30:50.404885 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.404735    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft5v2\" (UniqueName: \"kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-kube-api-access-ft5v2\") pod \"78066d11-0a7f-4de3-86da-db21b4584937\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") "
Jul 29 20:30:50.404885 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.404778    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-ca-configmap\") pod \"78066d11-0a7f-4de3-86da-db21b4584937\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") "
Jul 29 20:30:50.404885 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.404809    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-cacerts\") pod \"78066d11-0a7f-4de3-86da-db21b4584937\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") "
Jul 29 20:30:50.404885 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.404875    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-istio-token\") pod \"78066d11-0a7f-4de3-86da-db21b4584937\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") "
Jul 29 20:30:50.405105 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.404923    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-kubeconfig\") pod \"78066d11-0a7f-4de3-86da-db21b4584937\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") "
Jul 29 20:30:50.405105 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.404953    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-dns-cert\") pod \"78066d11-0a7f-4de3-86da-db21b4584937\" (UID: \"78066d11-0a7f-4de3-86da-db21b4584937\") "
Jul 29 20:30:50.405348 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.405319    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "78066d11-0a7f-4de3-86da-db21b4584937" (UID: "78066d11-0a7f-4de3-86da-db21b4584937"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:30:50.407674 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.407636    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78066d11-0a7f-4de3-86da-db21b4584937-local-certs" (OuterVolumeSpecName: "local-certs") pod "78066d11-0a7f-4de3-86da-db21b4584937" (UID: "78066d11-0a7f-4de3-86da-db21b4584937"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:30:50.407806 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.407713    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-kube-api-access-ft5v2" (OuterVolumeSpecName: "kube-api-access-ft5v2") pod "78066d11-0a7f-4de3-86da-db21b4584937" (UID: "78066d11-0a7f-4de3-86da-db21b4584937"). InnerVolumeSpecName "kube-api-access-ft5v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:30:50.407806 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.407750    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-istio-token" (OuterVolumeSpecName: "istio-token") pod "78066d11-0a7f-4de3-86da-db21b4584937" (UID: "78066d11-0a7f-4de3-86da-db21b4584937"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:30:50.407806 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.407765    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-cacerts" (OuterVolumeSpecName: "cacerts") pod "78066d11-0a7f-4de3-86da-db21b4584937" (UID: "78066d11-0a7f-4de3-86da-db21b4584937"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:30:50.408952 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.408929    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "78066d11-0a7f-4de3-86da-db21b4584937" (UID: "78066d11-0a7f-4de3-86da-db21b4584937"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:30:50.409432 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.409419    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "78066d11-0a7f-4de3-86da-db21b4584937" (UID: "78066d11-0a7f-4de3-86da-db21b4584937"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:30:50.506233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.506159    2557 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/78066d11-0a7f-4de3-86da-db21b4584937-local-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:30:50.506233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.506189    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft5v2\" (UniqueName: \"kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-kube-api-access-ft5v2\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:30:50.506233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.506202    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-ca-configmap\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:30:50.506233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.506215    2557 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-cacerts\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:30:50.506233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.506228    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78066d11-0a7f-4de3-86da-db21b4584937-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:30:50.506474 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.506240    2557 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-kubeconfig\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:30:50.506474 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.506252    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/78066d11-0a7f-4de3-86da-db21b4584937-istio-csr-dns-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:30:50.540355 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.540324    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"]
Jul 29 20:30:50.541959 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:30:50.541924    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podae68cfb6_0301_48e5_87bc_72c07d320bf9.slice/crio-1964dfdf0f336618cc8c0944656a5b322490ed3d86fa86bc664452eb4d88a0e1 WatchSource:0}: Error finding container 1964dfdf0f336618cc8c0944656a5b322490ed3d86fa86bc664452eb4d88a0e1: Status 404 returned error can't find the container with id 1964dfdf0f336618cc8c0944656a5b322490ed3d86fa86bc664452eb4d88a0e1
Jul 29 20:30:50.542739 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:50.542679    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h548v"]
Jul 29 20:30:50.544621 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:30:50.544599    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d0bf53_c14a_4ac6_9627_5dba01121ce1.slice/crio-c017f60f7060cd22ff6b4ade1a87bd80bf150bf8694a8119cd354b19a87ed69f WatchSource:0}: Error finding container c017f60f7060cd22ff6b4ade1a87bd80bf150bf8694a8119cd354b19a87ed69f: Status 404 returned error can't find the container with id c017f60f7060cd22ff6b4ade1a87bd80bf150bf8694a8119cd354b19a87ed69f
Jul 29 20:30:51.040690 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.040656    2557 generic.go:356] "Generic (PLEG): container finished" podID="78066d11-0a7f-4de3-86da-db21b4584937" containerID="639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48" exitCode=0
Jul 29 20:30:51.040879 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.040725    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"
Jul 29 20:30:51.040879 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.040730    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v" event={"ID":"78066d11-0a7f-4de3-86da-db21b4584937","Type":"ContainerDied","Data":"639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48"}
Jul 29 20:30:51.040879 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.040794    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v" event={"ID":"78066d11-0a7f-4de3-86da-db21b4584937","Type":"ContainerDied","Data":"fc6145a25e94ddf1374fee618ef80f7258eceacf02bb56a5930f86e83ce324d5"}
Jul 29 20:30:51.040879 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.040825    2557 scope.go:117] "RemoveContainer" containerID="639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48"
Jul 29 20:30:51.042002 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.041977    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr" event={"ID":"ae68cfb6-0301-48e5-87bc-72c07d320bf9","Type":"ContainerStarted","Data":"1964dfdf0f336618cc8c0944656a5b322490ed3d86fa86bc664452eb4d88a0e1"}
Jul 29 20:30:51.043332 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.043303    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v" event={"ID":"91d0bf53-c14a-4ac6-9627-5dba01121ce1","Type":"ContainerStarted","Data":"c017f60f7060cd22ff6b4ade1a87bd80bf150bf8694a8119cd354b19a87ed69f"}
Jul 29 20:30:51.044782 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.044758    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps" event={"ID":"89769e32-80be-49ba-aa95-af3ddcadc513","Type":"ContainerStarted","Data":"f93686aa9b0dba2feced50f93cd67557c693e3ac0a21f265ae639dd3e67afa1f"}
Jul 29 20:30:51.065959 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.065935    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"]
Jul 29 20:30:51.073442 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.073420    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vlm9v"]
Jul 29 20:30:51.095331 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.095310    2557 scope.go:117] "RemoveContainer" containerID="639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48"
Jul 29 20:30:51.095665 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:30:51.095637    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48\": container with ID starting with 639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48 not found: ID does not exist" containerID="639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48"
Jul 29 20:30:51.095747 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.095667    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48"} err="failed to get container status \"639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48\": rpc error: code = NotFound desc = could not find container \"639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48\": container with ID starting with 639746aa9cade37fe86c6309af7e617e1a1e0e9ccaa4551252b2405e678a6b48 not found: ID does not exist"
Jul 29 20:30:51.098871 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.098800    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps" podStartSLOduration=1.3866821630000001 podStartE2EDuration="5.098783246s" totalImagesPullingTime="3.712101083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:30:51.098006695 +0000 UTC m=+360.949507393" watchObservedRunningTime="2026-07-29 20:30:51.098783246 +0000 UTC m=+360.950283920"
Jul 29 20:30:51.396967 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.396881    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:51.402948 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:51.402921    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:52.050996 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:52.050965    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:52.052048 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:52.052025    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps"
Jul 29 20:30:52.623311 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:52.623277    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78066d11-0a7f-4de3-86da-db21b4584937" path="/var/lib/kubelet/pods/78066d11-0a7f-4de3-86da-db21b4584937/volumes"
Jul 29 20:30:53.062510 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:53.062458    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v" event={"ID":"91d0bf53-c14a-4ac6-9627-5dba01121ce1","Type":"ContainerStarted","Data":"6f8095a1c6b6b0aac0abfe3a76e7dca060b097034858a0fb6248901223427e53"}
Jul 29 20:30:53.062719 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:53.062696    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v"
Jul 29 20:30:53.083977 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:53.083933    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v" podStartSLOduration=2.716623391 podStartE2EDuration="5.083918348s" totalImagesPullingTime="2.367294957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:30:53.082347501 +0000 UTC m=+362.933848175" watchObservedRunningTime="2026-07-29 20:30:53.083918348 +0000 UTC m=+362.935419021"
Jul 29 20:30:54.007811 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:54.007740    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xpzr6"
Jul 29 20:30:54.069145 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:54.069067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr" event={"ID":"ae68cfb6-0301-48e5-87bc-72c07d320bf9","Type":"ContainerStarted","Data":"48f473d3f24623cecf6723d53127d3bd8b676e207b1c7ce153317f0698310139"}
Jul 29 20:30:54.069301 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:54.069150    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"
Jul 29 20:30:54.087628 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:54.087580    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr" podStartSLOduration=3.018580779 podStartE2EDuration="6.087565924s" totalImagesPullingTime="3.068985145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:30:54.086049327 +0000 UTC m=+363.937550025" watchObservedRunningTime="2026-07-29 20:30:54.087565924 +0000 UTC m=+363.939066596"
Jul 29 20:30:56.022303 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:30:56.022273    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cwnjm"
Jul 29 20:31:24.074363 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:24.074332    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h548v"
Jul 29 20:31:25.074648 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:25.074615    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xmlwr"
Jul 29 20:31:39.007065 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.007027    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vtlmh"]
Jul 29 20:31:39.007504 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.007481    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78066d11-0a7f-4de3-86da-db21b4584937" containerName="discovery"
Jul 29 20:31:39.007504 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.007500    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="78066d11-0a7f-4de3-86da-db21b4584937" containerName="discovery"
Jul 29 20:31:39.007614 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.007578    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="78066d11-0a7f-4de3-86da-db21b4584937" containerName="discovery"
Jul 29 20:31:39.019295 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.019268    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vtlmh"
Jul 29 20:31:39.020223 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.020200    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vtlmh"]
Jul 29 20:31:39.022249 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.022231    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 20:31:39.024085 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.024060    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cllsd\""
Jul 29 20:31:39.024195 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.024066    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 20:31:39.059233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.059207    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg2dl\" (UniqueName: \"kubernetes.io/projected/acfe50e1-8c82-4e6f-8668-f9717ee51916-kube-api-access-jg2dl\") pod \"kuadrant-operator-catalog-vtlmh\" (UID: \"acfe50e1-8c82-4e6f-8668-f9717ee51916\") " pod="kuadrant-system/kuadrant-operator-catalog-vtlmh"
Jul 29 20:31:39.159919 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.159884    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg2dl\" (UniqueName: \"kubernetes.io/projected/acfe50e1-8c82-4e6f-8668-f9717ee51916-kube-api-access-jg2dl\") pod \"kuadrant-operator-catalog-vtlmh\" (UID: \"acfe50e1-8c82-4e6f-8668-f9717ee51916\") " pod="kuadrant-system/kuadrant-operator-catalog-vtlmh"
Jul 29 20:31:39.177971 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.177949    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg2dl\" (UniqueName: \"kubernetes.io/projected/acfe50e1-8c82-4e6f-8668-f9717ee51916-kube-api-access-jg2dl\") pod \"kuadrant-operator-catalog-vtlmh\" (UID: \"acfe50e1-8c82-4e6f-8668-f9717ee51916\") " pod="kuadrant-system/kuadrant-operator-catalog-vtlmh"
Jul 29 20:31:39.331684 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.331660    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vtlmh"
Jul 29 20:31:39.376204 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.376173    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vtlmh"]
Jul 29 20:31:39.457442 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.457421    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vtlmh"]
Jul 29 20:31:39.460227 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:31:39.460193    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfe50e1_8c82_4e6f_8668_f9717ee51916.slice/crio-0ed52952abbd6801e360ac65caae928a1cede4258e2190985cf2dd5559216627 WatchSource:0}: Error finding container 0ed52952abbd6801e360ac65caae928a1cede4258e2190985cf2dd5559216627: Status 404 returned error can't find the container with id 0ed52952abbd6801e360ac65caae928a1cede4258e2190985cf2dd5559216627
Jul 29 20:31:39.584155 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.584080    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vrvgb"]
Jul 29 20:31:39.586983 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.586962    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vrvgb"
Jul 29 20:31:39.594064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.593967    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vrvgb"]
Jul 29 20:31:39.664098 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.664072    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48h8k\" (UniqueName: \"kubernetes.io/projected/c038a2b2-e008-406e-a64c-2651b6c5a75f-kube-api-access-48h8k\") pod \"kuadrant-operator-catalog-vrvgb\" (UID: \"c038a2b2-e008-406e-a64c-2651b6c5a75f\") " pod="kuadrant-system/kuadrant-operator-catalog-vrvgb"
Jul 29 20:31:39.765123 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.765101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h8k\" (UniqueName: \"kubernetes.io/projected/c038a2b2-e008-406e-a64c-2651b6c5a75f-kube-api-access-48h8k\") pod \"kuadrant-operator-catalog-vrvgb\" (UID: \"c038a2b2-e008-406e-a64c-2651b6c5a75f\") " pod="kuadrant-system/kuadrant-operator-catalog-vrvgb"
Jul 29 20:31:39.772434 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.772411    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48h8k\" (UniqueName: \"kubernetes.io/projected/c038a2b2-e008-406e-a64c-2651b6c5a75f-kube-api-access-48h8k\") pod \"kuadrant-operator-catalog-vrvgb\" (UID: \"c038a2b2-e008-406e-a64c-2651b6c5a75f\") " pod="kuadrant-system/kuadrant-operator-catalog-vrvgb"
Jul 29 20:31:39.897623 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:39.897574    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vrvgb"
Jul 29 20:31:40.018672 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:40.018650    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vrvgb"]
Jul 29 20:31:40.020615 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:31:40.020593    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc038a2b2_e008_406e_a64c_2651b6c5a75f.slice/crio-85057df4fea9d61084e39c59740ef4763ddc1604992574eb562d2fac07811043 WatchSource:0}: Error finding container 85057df4fea9d61084e39c59740ef4763ddc1604992574eb562d2fac07811043: Status 404 returned error can't find the container with id 85057df4fea9d61084e39c59740ef4763ddc1604992574eb562d2fac07811043
Jul 29 20:31:40.253939 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:40.253864    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vrvgb" event={"ID":"c038a2b2-e008-406e-a64c-2651b6c5a75f","Type":"ContainerStarted","Data":"85057df4fea9d61084e39c59740ef4763ddc1604992574eb562d2fac07811043"}
Jul 29 20:31:40.255066 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:40.255039    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vtlmh" event={"ID":"acfe50e1-8c82-4e6f-8668-f9717ee51916","Type":"ContainerStarted","Data":"0ed52952abbd6801e360ac65caae928a1cede4258e2190985cf2dd5559216627"}
Jul 29 20:31:42.267355 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:42.267311    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vrvgb" event={"ID":"c038a2b2-e008-406e-a64c-2651b6c5a75f","Type":"ContainerStarted","Data":"d975f605e15413e9ab0dc6b1e1ca680a55ed3043b2bf8fc0b00e425903910c66"}
Jul 29 20:31:42.269307 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:42.269285    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vtlmh" event={"ID":"acfe50e1-8c82-4e6f-8668-f9717ee51916","Type":"ContainerStarted","Data":"4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4"}
Jul 29 20:31:42.269419 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:42.269324    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-vtlmh" podUID="acfe50e1-8c82-4e6f-8668-f9717ee51916" containerName="registry-server" containerID="cri-o://4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4" gracePeriod=2
Jul 29 20:31:42.289101 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:42.286076    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vrvgb" podStartSLOduration=1.760223563 podStartE2EDuration="3.286057871s" totalImagesPullingTime="1.525834308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:31:42.282687065 +0000 UTC m=+412.134187737" watchObservedRunningTime="2026-07-29 20:31:42.286057871 +0000 UTC m=+412.137558545"
Jul 29 20:31:42.300841 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:42.300789    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vtlmh" podStartSLOduration=2.21720322 podStartE2EDuration="4.300775707s" totalImagesPullingTime="2.083572487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:31:42.300107198 +0000 UTC m=+412.151607882" watchObservedRunningTime="2026-07-29 20:31:42.300775707 +0000 UTC m=+412.152276754"
Jul 29 20:31:42.504607 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:42.504586    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vtlmh"
Jul 29 20:31:42.589181 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:42.589113    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg2dl\" (UniqueName: \"kubernetes.io/projected/acfe50e1-8c82-4e6f-8668-f9717ee51916-kube-api-access-jg2dl\") pod \"acfe50e1-8c82-4e6f-8668-f9717ee51916\" (UID: \"acfe50e1-8c82-4e6f-8668-f9717ee51916\") "
Jul 29 20:31:42.591166 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:42.591142    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfe50e1-8c82-4e6f-8668-f9717ee51916-kube-api-access-jg2dl" (OuterVolumeSpecName: "kube-api-access-jg2dl") pod "acfe50e1-8c82-4e6f-8668-f9717ee51916" (UID: "acfe50e1-8c82-4e6f-8668-f9717ee51916"). InnerVolumeSpecName "kube-api-access-jg2dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:31:42.690145 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:42.690118    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg2dl\" (UniqueName: \"kubernetes.io/projected/acfe50e1-8c82-4e6f-8668-f9717ee51916-kube-api-access-jg2dl\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:31:43.274409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:43.274374    2557 generic.go:356] "Generic (PLEG): container finished" podID="acfe50e1-8c82-4e6f-8668-f9717ee51916" containerID="4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4" exitCode=0
Jul 29 20:31:43.274797 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:43.274422    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vtlmh"
Jul 29 20:31:43.274797 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:43.274453    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vtlmh" event={"ID":"acfe50e1-8c82-4e6f-8668-f9717ee51916","Type":"ContainerDied","Data":"4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4"}
Jul 29 20:31:43.274797 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:43.274504    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vtlmh" event={"ID":"acfe50e1-8c82-4e6f-8668-f9717ee51916","Type":"ContainerDied","Data":"0ed52952abbd6801e360ac65caae928a1cede4258e2190985cf2dd5559216627"}
Jul 29 20:31:43.274797 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:43.274525    2557 scope.go:117] "RemoveContainer" containerID="4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4"
Jul 29 20:31:43.283598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:43.283582    2557 scope.go:117] "RemoveContainer" containerID="4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4"
Jul 29 20:31:43.283865 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:31:43.283826    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4\": container with ID starting with 4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4 not found: ID does not exist" containerID="4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4"
Jul 29 20:31:43.283915 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:43.283873    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4"} err="failed to get container status \"4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4\": rpc error: code = NotFound desc = could not find container \"4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4\": container with ID starting with 4866c618b29d72cbdcd5fc5dc8c95053b95fc2741849d9837363c75fbb8589e4 not found: ID does not exist"
Jul 29 20:31:43.289791 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:43.289768    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vtlmh"]
Jul 29 20:31:43.293409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:43.293389    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vtlmh"]
Jul 29 20:31:44.620750 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:44.620720    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acfe50e1-8c82-4e6f-8668-f9717ee51916" path="/var/lib/kubelet/pods/acfe50e1-8c82-4e6f-8668-f9717ee51916/volumes"
Jul 29 20:31:49.898359 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:49.898328    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vrvgb"
Jul 29 20:31:49.898722 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:49.898376    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vrvgb"
Jul 29 20:31:49.917917 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:49.917894    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vrvgb"
Jul 29 20:31:50.326211 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:50.326186    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vrvgb"
Jul 29 20:31:54.173584 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.173551    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"]
Jul 29 20:31:54.173984 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.173879    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfe50e1-8c82-4e6f-8668-f9717ee51916" containerName="registry-server"
Jul 29 20:31:54.173984 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.173890    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfe50e1-8c82-4e6f-8668-f9717ee51916" containerName="registry-server"
Jul 29 20:31:54.173984 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.173945    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfe50e1-8c82-4e6f-8668-f9717ee51916" containerName="registry-server"
Jul 29 20:31:54.177040 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.177023    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.179599 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.179575    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m9rcf\""
Jul 29 20:31:54.184720 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.184696    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"]
Jul 29 20:31:54.270953 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.270920    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.271101 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.270961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.271101 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.270989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-255xc\" (UniqueName: \"kubernetes.io/projected/68b6d40b-0b68-4433-83e7-315a667027f2-kube-api-access-255xc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.371864 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.371814    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.372007 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.371877    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.372007 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.371916    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-255xc\" (UniqueName: \"kubernetes.io/projected/68b6d40b-0b68-4433-83e7-315a667027f2-kube-api-access-255xc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.372174 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.372152    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.372238 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.372177    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.379594 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.379570    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-255xc\" (UniqueName: \"kubernetes.io/projected/68b6d40b-0b68-4433-83e7-315a667027f2-kube-api-access-255xc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.486918 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.486864    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:54.607211 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.607189    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"]
Jul 29 20:31:54.609142 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:31:54.609114    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b6d40b_0b68_4433_83e7_315a667027f2.slice/crio-849c6aff2c4bb6d21e42c0bfb974671c4f43a738ecb6579af5990841278620b7 WatchSource:0}: Error finding container 849c6aff2c4bb6d21e42c0bfb974671c4f43a738ecb6579af5990841278620b7: Status 404 returned error can't find the container with id 849c6aff2c4bb6d21e42c0bfb974671c4f43a738ecb6579af5990841278620b7
Jul 29 20:31:54.973955 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.973925    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"]
Jul 29 20:31:54.976227 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.976212    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:54.984171 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:54.984149    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"]
Jul 29 20:31:55.076748 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.076726    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:55.076853 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.076782    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbxvf\" (UniqueName: \"kubernetes.io/projected/95a8d424-e295-43a4-8b2e-7afcfb4e2637-kube-api-access-fbxvf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:55.076853 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.076823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:55.178050 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.178028    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbxvf\" (UniqueName: \"kubernetes.io/projected/95a8d424-e295-43a4-8b2e-7afcfb4e2637-kube-api-access-fbxvf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:55.178334 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.178063    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:55.178334 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.178100    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:55.178403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.178368    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:55.178440 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.178425    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:55.185552 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.185529    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbxvf\" (UniqueName: \"kubernetes.io/projected/95a8d424-e295-43a4-8b2e-7afcfb4e2637-kube-api-access-fbxvf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:55.285337 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.285310    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:31:55.328180 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.328144    2557 generic.go:356] "Generic (PLEG): container finished" podID="68b6d40b-0b68-4433-83e7-315a667027f2" containerID="5fa87f60819e688e1497ba24d21c42a7c29c0fab27c39c7f91eb6076d7fee3dc" exitCode=0
Jul 29 20:31:55.328341 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.328194    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph" event={"ID":"68b6d40b-0b68-4433-83e7-315a667027f2","Type":"ContainerDied","Data":"5fa87f60819e688e1497ba24d21c42a7c29c0fab27c39c7f91eb6076d7fee3dc"}
Jul 29 20:31:55.328341 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.328255    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph" event={"ID":"68b6d40b-0b68-4433-83e7-315a667027f2","Type":"ContainerStarted","Data":"849c6aff2c4bb6d21e42c0bfb974671c4f43a738ecb6579af5990841278620b7"}
Jul 29 20:31:55.420353 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.420331    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"]
Jul 29 20:31:55.422232 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:31:55.422206    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a8d424_e295_43a4_8b2e_7afcfb4e2637.slice/crio-0f30b8d223693f13af7a47797099d48384a119d2d7834bbe66c5085eca2de560 WatchSource:0}: Error finding container 0f30b8d223693f13af7a47797099d48384a119d2d7834bbe66c5085eca2de560: Status 404 returned error can't find the container with id 0f30b8d223693f13af7a47797099d48384a119d2d7834bbe66c5085eca2de560
Jul 29 20:31:55.436113 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.436091    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"]
Jul 29 20:31:55.439054 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.439035    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.446611 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.446593    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"]
Jul 29 20:31:55.481408 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.481385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.481481 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.481423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.481481 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.481443    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9v84\" (UniqueName: \"kubernetes.io/projected/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-kube-api-access-c9v84\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.582690 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.582640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.582690 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.582679    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.582825 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.582699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9v84\" (UniqueName: \"kubernetes.io/projected/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-kube-api-access-c9v84\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.583037 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.583019    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.583037 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.583029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.591250 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.591232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9v84\" (UniqueName: \"kubernetes.io/projected/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-kube-api-access-c9v84\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.770318 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.770295    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:55.775670 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.775636    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"]
Jul 29 20:31:55.778108 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.778092    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:55.787570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.787548    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"]
Jul 29 20:31:55.884229 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.884202    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:55.884354 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.884294    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:55.884354 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.884329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c94xt\" (UniqueName: \"kubernetes.io/projected/fb61c181-9076-4746-b5cf-eca70827c766-kube-api-access-c94xt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:55.895027 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.894986    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"]
Jul 29 20:31:55.897517 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:31:55.897493    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440b00df_bc2b_4ed3_8a42_4ebd47720b1b.slice/crio-280cd25794c006cbb8bb1973a830b119dadadca7aab911d7940258155d12eeab WatchSource:0}: Error finding container 280cd25794c006cbb8bb1973a830b119dadadca7aab911d7940258155d12eeab: Status 404 returned error can't find the container with id 280cd25794c006cbb8bb1973a830b119dadadca7aab911d7940258155d12eeab
Jul 29 20:31:55.984732 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.984707    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c94xt\" (UniqueName: \"kubernetes.io/projected/fb61c181-9076-4746-b5cf-eca70827c766-kube-api-access-c94xt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:55.984821 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.984743    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:55.984821 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.984802    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:55.985147 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.985119    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:55.985256 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.985235    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:55.994473 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:55.994451    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c94xt\" (UniqueName: \"kubernetes.io/projected/fb61c181-9076-4746-b5cf-eca70827c766-kube-api-access-c94xt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:56.088439 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.088419    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:31:56.211938 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.211912    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"]
Jul 29 20:31:56.213728 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:31:56.213706    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb61c181_9076_4746_b5cf_eca70827c766.slice/crio-e62c11e0341124ef6b9c9ec7ec2478ce2d932d82df8a4867c909d8066df9f720 WatchSource:0}: Error finding container e62c11e0341124ef6b9c9ec7ec2478ce2d932d82df8a4867c909d8066df9f720: Status 404 returned error can't find the container with id e62c11e0341124ef6b9c9ec7ec2478ce2d932d82df8a4867c909d8066df9f720
Jul 29 20:31:56.334454 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.334431    2557 generic.go:356] "Generic (PLEG): container finished" podID="fb61c181-9076-4746-b5cf-eca70827c766" containerID="e8ec2f9b64d3682371ad0598bca35e2d92307a2cff5750e4e81b1c272a4636c2" exitCode=0
Jul 29 20:31:56.334568 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.334515    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2" event={"ID":"fb61c181-9076-4746-b5cf-eca70827c766","Type":"ContainerDied","Data":"e8ec2f9b64d3682371ad0598bca35e2d92307a2cff5750e4e81b1c272a4636c2"}
Jul 29 20:31:56.334682 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.334574    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2" event={"ID":"fb61c181-9076-4746-b5cf-eca70827c766","Type":"ContainerStarted","Data":"e62c11e0341124ef6b9c9ec7ec2478ce2d932d82df8a4867c909d8066df9f720"}
Jul 29 20:31:56.336094 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.336074    2557 generic.go:356] "Generic (PLEG): container finished" podID="440b00df-bc2b-4ed3-8a42-4ebd47720b1b" containerID="d6667d9a3a9deb89058bc87431d3d8ff42713a6efad4a5dd391a7bdd99fa592f" exitCode=0
Jul 29 20:31:56.336188 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.336148    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j" event={"ID":"440b00df-bc2b-4ed3-8a42-4ebd47720b1b","Type":"ContainerDied","Data":"d6667d9a3a9deb89058bc87431d3d8ff42713a6efad4a5dd391a7bdd99fa592f"}
Jul 29 20:31:56.336244 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.336198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j" event={"ID":"440b00df-bc2b-4ed3-8a42-4ebd47720b1b","Type":"ContainerStarted","Data":"280cd25794c006cbb8bb1973a830b119dadadca7aab911d7940258155d12eeab"}
Jul 29 20:31:56.337791 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.337768    2557 generic.go:356] "Generic (PLEG): container finished" podID="95a8d424-e295-43a4-8b2e-7afcfb4e2637" containerID="ccc94b1c46ef2579e26f803920404e5cabca2d879ddb06ae2526ca3f5359b9a9" exitCode=0
Jul 29 20:31:56.338024 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.337854    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb" event={"ID":"95a8d424-e295-43a4-8b2e-7afcfb4e2637","Type":"ContainerDied","Data":"ccc94b1c46ef2579e26f803920404e5cabca2d879ddb06ae2526ca3f5359b9a9"}
Jul 29 20:31:56.338024 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.337897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb" event={"ID":"95a8d424-e295-43a4-8b2e-7afcfb4e2637","Type":"ContainerStarted","Data":"0f30b8d223693f13af7a47797099d48384a119d2d7834bbe66c5085eca2de560"}
Jul 29 20:31:56.339791 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.339773    2557 generic.go:356] "Generic (PLEG): container finished" podID="68b6d40b-0b68-4433-83e7-315a667027f2" containerID="b543ff5f59115d54fd41971fa955e4d8b9b391ddaf60a6f8813a92e65664fad1" exitCode=0
Jul 29 20:31:56.339917 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:56.339804    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph" event={"ID":"68b6d40b-0b68-4433-83e7-315a667027f2","Type":"ContainerDied","Data":"b543ff5f59115d54fd41971fa955e4d8b9b391ddaf60a6f8813a92e65664fad1"}
Jul 29 20:31:57.347947 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:57.347872    2557 generic.go:356] "Generic (PLEG): container finished" podID="68b6d40b-0b68-4433-83e7-315a667027f2" containerID="617ed4544f61a90d1003035eaa1cd2a126bda854df2b809607ab9b903429ec22" exitCode=0
Jul 29 20:31:57.348344 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:57.347944    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph" event={"ID":"68b6d40b-0b68-4433-83e7-315a667027f2","Type":"ContainerDied","Data":"617ed4544f61a90d1003035eaa1cd2a126bda854df2b809607ab9b903429ec22"}
Jul 29 20:31:57.349865 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:57.349825    2557 generic.go:356] "Generic (PLEG): container finished" podID="440b00df-bc2b-4ed3-8a42-4ebd47720b1b" containerID="fa790a6f88a65a53374fe2bab2ac813639aae4b14dec4465868e601dedfb15a5" exitCode=0
Jul 29 20:31:57.349966 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:57.349865    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j" event={"ID":"440b00df-bc2b-4ed3-8a42-4ebd47720b1b","Type":"ContainerDied","Data":"fa790a6f88a65a53374fe2bab2ac813639aae4b14dec4465868e601dedfb15a5"}
Jul 29 20:31:58.356465 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.356431    2557 generic.go:356] "Generic (PLEG): container finished" podID="440b00df-bc2b-4ed3-8a42-4ebd47720b1b" containerID="95173ea8eaeff02aa60ab56b5875eda499a13b5726776f296544d013ea466b34" exitCode=0
Jul 29 20:31:58.356877 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.356523    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j" event={"ID":"440b00df-bc2b-4ed3-8a42-4ebd47720b1b","Type":"ContainerDied","Data":"95173ea8eaeff02aa60ab56b5875eda499a13b5726776f296544d013ea466b34"}
Jul 29 20:31:58.358178 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.358157    2557 generic.go:356] "Generic (PLEG): container finished" podID="95a8d424-e295-43a4-8b2e-7afcfb4e2637" containerID="7f19f6ef7b1a1eb9add965e39442a38af5cca18a5d8b1304bc71bbac42932193" exitCode=0
Jul 29 20:31:58.358281 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.358241    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb" event={"ID":"95a8d424-e295-43a4-8b2e-7afcfb4e2637","Type":"ContainerDied","Data":"7f19f6ef7b1a1eb9add965e39442a38af5cca18a5d8b1304bc71bbac42932193"}
Jul 29 20:31:58.360133 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.360106    2557 generic.go:356] "Generic (PLEG): container finished" podID="fb61c181-9076-4746-b5cf-eca70827c766" containerID="b15f746a73913e5c9dc965a753d90342d312de640ac2ea8061325f1a064835a1" exitCode=0
Jul 29 20:31:58.360198 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.360132    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2" event={"ID":"fb61c181-9076-4746-b5cf-eca70827c766","Type":"ContainerDied","Data":"b15f746a73913e5c9dc965a753d90342d312de640ac2ea8061325f1a064835a1"}
Jul 29 20:31:58.600764 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.600740    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:58.704127 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.704071    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-255xc\" (UniqueName: \"kubernetes.io/projected/68b6d40b-0b68-4433-83e7-315a667027f2-kube-api-access-255xc\") pod \"68b6d40b-0b68-4433-83e7-315a667027f2\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") "
Jul 29 20:31:58.704127 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.704106    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-util\") pod \"68b6d40b-0b68-4433-83e7-315a667027f2\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") "
Jul 29 20:31:58.704270 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.704143    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-bundle\") pod \"68b6d40b-0b68-4433-83e7-315a667027f2\" (UID: \"68b6d40b-0b68-4433-83e7-315a667027f2\") "
Jul 29 20:31:58.704751 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.704726    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-bundle" (OuterVolumeSpecName: "bundle") pod "68b6d40b-0b68-4433-83e7-315a667027f2" (UID: "68b6d40b-0b68-4433-83e7-315a667027f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:31:58.706018 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.705999    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68b6d40b-0b68-4433-83e7-315a667027f2-kube-api-access-255xc" (OuterVolumeSpecName: "kube-api-access-255xc") pod "68b6d40b-0b68-4433-83e7-315a667027f2" (UID: "68b6d40b-0b68-4433-83e7-315a667027f2"). InnerVolumeSpecName "kube-api-access-255xc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:31:58.710058 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.710035    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-util" (OuterVolumeSpecName: "util") pod "68b6d40b-0b68-4433-83e7-315a667027f2" (UID: "68b6d40b-0b68-4433-83e7-315a667027f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:31:58.804927 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.804909    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:31:58.804927 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.804927    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-255xc\" (UniqueName: \"kubernetes.io/projected/68b6d40b-0b68-4433-83e7-315a667027f2-kube-api-access-255xc\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:31:58.805047 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:58.804936    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68b6d40b-0b68-4433-83e7-315a667027f2-util\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:31:59.366225 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.366191    2557 generic.go:356] "Generic (PLEG): container finished" podID="fb61c181-9076-4746-b5cf-eca70827c766" containerID="f44c117ba5802b479f4fd4cf4bc05b51cedc93fa76f1d66c7a1ebeb09cc0b29c" exitCode=0
Jul 29 20:31:59.366565 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.366274    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2" event={"ID":"fb61c181-9076-4746-b5cf-eca70827c766","Type":"ContainerDied","Data":"f44c117ba5802b479f4fd4cf4bc05b51cedc93fa76f1d66c7a1ebeb09cc0b29c"}
Jul 29 20:31:59.368348 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.368325    2557 generic.go:356] "Generic (PLEG): container finished" podID="95a8d424-e295-43a4-8b2e-7afcfb4e2637" containerID="7400c68b8afa4a013697408f8225581acf522c82a56927e6a399c9e9c6a30fa2" exitCode=0
Jul 29 20:31:59.368473 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.368393    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb" event={"ID":"95a8d424-e295-43a4-8b2e-7afcfb4e2637","Type":"ContainerDied","Data":"7400c68b8afa4a013697408f8225581acf522c82a56927e6a399c9e9c6a30fa2"}
Jul 29 20:31:59.370255 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.370238    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph"
Jul 29 20:31:59.370351 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.370273    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph" event={"ID":"68b6d40b-0b68-4433-83e7-315a667027f2","Type":"ContainerDied","Data":"849c6aff2c4bb6d21e42c0bfb974671c4f43a738ecb6579af5990841278620b7"}
Jul 29 20:31:59.370351 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.370304    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="849c6aff2c4bb6d21e42c0bfb974671c4f43a738ecb6579af5990841278620b7"
Jul 29 20:31:59.500617 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.500595    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:31:59.610660 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.610632    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-bundle\") pod \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") "
Jul 29 20:31:59.610771 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.610688    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9v84\" (UniqueName: \"kubernetes.io/projected/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-kube-api-access-c9v84\") pod \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") "
Jul 29 20:31:59.610771 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.610725    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-util\") pod \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\" (UID: \"440b00df-bc2b-4ed3-8a42-4ebd47720b1b\") "
Jul 29 20:31:59.611187 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.611162    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-bundle" (OuterVolumeSpecName: "bundle") pod "440b00df-bc2b-4ed3-8a42-4ebd47720b1b" (UID: "440b00df-bc2b-4ed3-8a42-4ebd47720b1b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:31:59.612689 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.612664    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-kube-api-access-c9v84" (OuterVolumeSpecName: "kube-api-access-c9v84") pod "440b00df-bc2b-4ed3-8a42-4ebd47720b1b" (UID: "440b00df-bc2b-4ed3-8a42-4ebd47720b1b"). InnerVolumeSpecName "kube-api-access-c9v84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:31:59.615979 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.615957    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-util" (OuterVolumeSpecName: "util") pod "440b00df-bc2b-4ed3-8a42-4ebd47720b1b" (UID: "440b00df-bc2b-4ed3-8a42-4ebd47720b1b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:31:59.711672 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.711651    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9v84\" (UniqueName: \"kubernetes.io/projected/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-kube-api-access-c9v84\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:31:59.711672 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.711670    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-util\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:31:59.711792 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:31:59.711680    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/440b00df-bc2b-4ed3-8a42-4ebd47720b1b-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:00.376325 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.376299    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j"
Jul 29 20:32:00.376325 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.376312    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j" event={"ID":"440b00df-bc2b-4ed3-8a42-4ebd47720b1b","Type":"ContainerDied","Data":"280cd25794c006cbb8bb1973a830b119dadadca7aab911d7940258155d12eeab"}
Jul 29 20:32:00.376707 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.376360    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="280cd25794c006cbb8bb1973a830b119dadadca7aab911d7940258155d12eeab"
Jul 29 20:32:00.516859 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.516816    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:32:00.543177 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.543156    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:32:00.617708 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.617684    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-bundle\") pod \"fb61c181-9076-4746-b5cf-eca70827c766\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") "
Jul 29 20:32:00.617845 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.617751    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbxvf\" (UniqueName: \"kubernetes.io/projected/95a8d424-e295-43a4-8b2e-7afcfb4e2637-kube-api-access-fbxvf\") pod \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") "
Jul 29 20:32:00.617845 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.617771    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-util\") pod \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") "
Jul 29 20:32:00.617845 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.617797    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-util\") pod \"fb61c181-9076-4746-b5cf-eca70827c766\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") "
Jul 29 20:32:00.618018 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.617855    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c94xt\" (UniqueName: \"kubernetes.io/projected/fb61c181-9076-4746-b5cf-eca70827c766-kube-api-access-c94xt\") pod \"fb61c181-9076-4746-b5cf-eca70827c766\" (UID: \"fb61c181-9076-4746-b5cf-eca70827c766\") "
Jul 29 20:32:00.618018 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.617884    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-bundle\") pod \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\" (UID: \"95a8d424-e295-43a4-8b2e-7afcfb4e2637\") "
Jul 29 20:32:00.618383 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.618353    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-bundle" (OuterVolumeSpecName: "bundle") pod "fb61c181-9076-4746-b5cf-eca70827c766" (UID: "fb61c181-9076-4746-b5cf-eca70827c766"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:32:00.618597 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.618543    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-bundle" (OuterVolumeSpecName: "bundle") pod "95a8d424-e295-43a4-8b2e-7afcfb4e2637" (UID: "95a8d424-e295-43a4-8b2e-7afcfb4e2637"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:32:00.620315 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.620286    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95a8d424-e295-43a4-8b2e-7afcfb4e2637-kube-api-access-fbxvf" (OuterVolumeSpecName: "kube-api-access-fbxvf") pod "95a8d424-e295-43a4-8b2e-7afcfb4e2637" (UID: "95a8d424-e295-43a4-8b2e-7afcfb4e2637"). InnerVolumeSpecName "kube-api-access-fbxvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:32:00.620572 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.620536    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb61c181-9076-4746-b5cf-eca70827c766-kube-api-access-c94xt" (OuterVolumeSpecName: "kube-api-access-c94xt") pod "fb61c181-9076-4746-b5cf-eca70827c766" (UID: "fb61c181-9076-4746-b5cf-eca70827c766"). InnerVolumeSpecName "kube-api-access-c94xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:32:00.624700 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.624672    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-util" (OuterVolumeSpecName: "util") pod "95a8d424-e295-43a4-8b2e-7afcfb4e2637" (UID: "95a8d424-e295-43a4-8b2e-7afcfb4e2637"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:32:00.626437 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.626389    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-util" (OuterVolumeSpecName: "util") pod "fb61c181-9076-4746-b5cf-eca70827c766" (UID: "fb61c181-9076-4746-b5cf-eca70827c766"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:32:00.719268 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.719242    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c94xt\" (UniqueName: \"kubernetes.io/projected/fb61c181-9076-4746-b5cf-eca70827c766-kube-api-access-c94xt\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:00.719268 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.719268    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:00.719393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.719281    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:00.719393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.719295    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbxvf\" (UniqueName: \"kubernetes.io/projected/95a8d424-e295-43a4-8b2e-7afcfb4e2637-kube-api-access-fbxvf\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:00.719393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.719307    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95a8d424-e295-43a4-8b2e-7afcfb4e2637-util\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:00.719393 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:00.719318    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb61c181-9076-4746-b5cf-eca70827c766-util\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:01.382741 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:01.382714    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb"
Jul 29 20:32:01.382741 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:01.382718    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb" event={"ID":"95a8d424-e295-43a4-8b2e-7afcfb4e2637","Type":"ContainerDied","Data":"0f30b8d223693f13af7a47797099d48384a119d2d7834bbe66c5085eca2de560"}
Jul 29 20:32:01.383217 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:01.382765    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f30b8d223693f13af7a47797099d48384a119d2d7834bbe66c5085eca2de560"
Jul 29 20:32:01.384604 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:01.384581    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2" event={"ID":"fb61c181-9076-4746-b5cf-eca70827c766","Type":"ContainerDied","Data":"e62c11e0341124ef6b9c9ec7ec2478ce2d932d82df8a4867c909d8066df9f720"}
Jul 29 20:32:01.384707 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:01.384619    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e62c11e0341124ef6b9c9ec7ec2478ce2d932d82df8a4867c909d8066df9f720"
Jul 29 20:32:01.384707 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:01.384586    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2"
Jul 29 20:32:10.355705 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.355673    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq"]
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.355968    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="440b00df-bc2b-4ed3-8a42-4ebd47720b1b" containerName="util"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.355979    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="440b00df-bc2b-4ed3-8a42-4ebd47720b1b" containerName="util"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.355988    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb61c181-9076-4746-b5cf-eca70827c766" containerName="util"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.355993    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb61c181-9076-4746-b5cf-eca70827c766" containerName="util"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356002    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="440b00df-bc2b-4ed3-8a42-4ebd47720b1b" containerName="pull"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356007    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="440b00df-bc2b-4ed3-8a42-4ebd47720b1b" containerName="pull"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356015    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a8d424-e295-43a4-8b2e-7afcfb4e2637" containerName="extract"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356021    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a8d424-e295-43a4-8b2e-7afcfb4e2637" containerName="extract"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356029    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a8d424-e295-43a4-8b2e-7afcfb4e2637" containerName="util"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356035    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a8d424-e295-43a4-8b2e-7afcfb4e2637" containerName="util"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356045    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68b6d40b-0b68-4433-83e7-315a667027f2" containerName="pull"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356050    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="68b6d40b-0b68-4433-83e7-315a667027f2" containerName="pull"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356055    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb61c181-9076-4746-b5cf-eca70827c766" containerName="pull"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356060    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb61c181-9076-4746-b5cf-eca70827c766" containerName="pull"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356066    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68b6d40b-0b68-4433-83e7-315a667027f2" containerName="util"
Jul 29 20:32:10.356064 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356071    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="68b6d40b-0b68-4433-83e7-315a667027f2" containerName="util"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356076    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68b6d40b-0b68-4433-83e7-315a667027f2" containerName="extract"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356081    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="68b6d40b-0b68-4433-83e7-315a667027f2" containerName="extract"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356088    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="440b00df-bc2b-4ed3-8a42-4ebd47720b1b" containerName="extract"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356093    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="440b00df-bc2b-4ed3-8a42-4ebd47720b1b" containerName="extract"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356114    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb61c181-9076-4746-b5cf-eca70827c766" containerName="extract"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356121    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb61c181-9076-4746-b5cf-eca70827c766" containerName="extract"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356132    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a8d424-e295-43a4-8b2e-7afcfb4e2637" containerName="pull"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356137    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a8d424-e295-43a4-8b2e-7afcfb4e2637" containerName="pull"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356183    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="95a8d424-e295-43a4-8b2e-7afcfb4e2637" containerName="extract"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356190    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="68b6d40b-0b68-4433-83e7-315a667027f2" containerName="extract"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356195    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="440b00df-bc2b-4ed3-8a42-4ebd47720b1b" containerName="extract"
Jul 29 20:32:10.356562 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.356201    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb61c181-9076-4746-b5cf-eca70827c766" containerName="extract"
Jul 29 20:32:10.358889 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.358873    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq"
Jul 29 20:32:10.361335 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.361307    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 29 20:32:10.361445 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.361359    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tf827\""
Jul 29 20:32:10.367651 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.367629    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq"]
Jul 29 20:32:10.389407 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.389379    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkghm\" (UniqueName: \"kubernetes.io/projected/455a7330-7baf-4a37-8916-16ba962756a0-kube-api-access-xkghm\") pod \"dns-operator-controller-manager-864dd78c4c-ntgfq\" (UID: \"455a7330-7baf-4a37-8916-16ba962756a0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq"
Jul 29 20:32:10.489678 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.489655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkghm\" (UniqueName: \"kubernetes.io/projected/455a7330-7baf-4a37-8916-16ba962756a0-kube-api-access-xkghm\") pod \"dns-operator-controller-manager-864dd78c4c-ntgfq\" (UID: \"455a7330-7baf-4a37-8916-16ba962756a0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq"
Jul 29 20:32:10.513624 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.513596    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkghm\" (UniqueName: \"kubernetes.io/projected/455a7330-7baf-4a37-8916-16ba962756a0-kube-api-access-xkghm\") pod \"dns-operator-controller-manager-864dd78c4c-ntgfq\" (UID: \"455a7330-7baf-4a37-8916-16ba962756a0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq"
Jul 29 20:32:10.668937 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.668888    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq"
Jul 29 20:32:10.799340 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:10.799284    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq"]
Jul 29 20:32:10.801713 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:32:10.801685    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455a7330_7baf_4a37_8916_16ba962756a0.slice/crio-a405d2dcf0b7f8b1318099996a5847614f68e28a1b951941983bc9913278154b WatchSource:0}: Error finding container a405d2dcf0b7f8b1318099996a5847614f68e28a1b951941983bc9913278154b: Status 404 returned error can't find the container with id a405d2dcf0b7f8b1318099996a5847614f68e28a1b951941983bc9913278154b
Jul 29 20:32:11.430531 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:11.430500    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq" event={"ID":"455a7330-7baf-4a37-8916-16ba962756a0","Type":"ContainerStarted","Data":"a405d2dcf0b7f8b1318099996a5847614f68e28a1b951941983bc9913278154b"}
Jul 29 20:32:12.611340 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.611263    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77dccd7df-lv4lz"]
Jul 29 20:32:12.613902 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.613880    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.616861 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.616820    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 20:32:12.618104 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.617958    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 20:32:12.618104 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.617971    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g2zcr\""
Jul 29 20:32:12.618290 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.618276    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 20:32:12.618367 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.618345    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 20:32:12.618669 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.618596    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 20:32:12.618669 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.618658    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 20:32:12.618669 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.618666    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 20:32:12.624171 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.624150    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 20:32:12.638275 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.638247    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77dccd7df-lv4lz"]
Jul 29 20:32:12.709335 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.709312    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-console-serving-cert\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.709480 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.709380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-trusted-ca-bundle\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.709480 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.709429    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-console-oauth-config\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.709480 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.709461    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxg6r\" (UniqueName: \"kubernetes.io/projected/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-kube-api-access-qxg6r\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.709614 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.709512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-oauth-serving-cert\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.709614 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.709538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-console-config\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.709702 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.709610    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-service-ca\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.810335 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.810304    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-trusted-ca-bundle\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.810335 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.810341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-console-oauth-config\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.810517 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.810359    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxg6r\" (UniqueName: \"kubernetes.io/projected/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-kube-api-access-qxg6r\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.810517 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.810391    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-oauth-serving-cert\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.810517 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.810419    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-console-config\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.810517 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.810445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-service-ca\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.810517 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.810470    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-console-serving-cert\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.811433 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.811401    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-oauth-serving-cert\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.811572 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.811405    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-console-config\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.811572 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.811411    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-trusted-ca-bundle\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.811572 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.811481    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-service-ca\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.813144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.813116    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-console-oauth-config\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.815343 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.815319    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-console-serving-cert\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.817793 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.817770    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxg6r\" (UniqueName: \"kubernetes.io/projected/6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1-kube-api-access-qxg6r\") pod \"console-77dccd7df-lv4lz\" (UID: \"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1\") " pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:12.926224 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:12.926204    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:13.051312 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:13.051285    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77dccd7df-lv4lz"]
Jul 29 20:32:13.053501 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:32:13.053473    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7d65a5_a7e9_4d9a_b7d7_b614561ec6c1.slice/crio-54e60574997a6d47815333318f317d41592da3aa685096f1b9b89a9a798c1bff WatchSource:0}: Error finding container 54e60574997a6d47815333318f317d41592da3aa685096f1b9b89a9a798c1bff: Status 404 returned error can't find the container with id 54e60574997a6d47815333318f317d41592da3aa685096f1b9b89a9a798c1bff
Jul 29 20:32:13.442550 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:13.442516    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq" event={"ID":"455a7330-7baf-4a37-8916-16ba962756a0","Type":"ContainerStarted","Data":"a72fc5ec5a6807f55411190742796f0ee0bef8cb566b97618f0f3be10eba6ce3"}
Jul 29 20:32:13.442705 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:13.442623    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq"
Jul 29 20:32:13.444096 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:13.444071    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77dccd7df-lv4lz" event={"ID":"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1","Type":"ContainerStarted","Data":"83fad2d937c4138257431fb603061d6bc44c733b12520dc214629d8bcb826957"}
Jul 29 20:32:13.444188 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:13.444109    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77dccd7df-lv4lz" event={"ID":"6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1","Type":"ContainerStarted","Data":"54e60574997a6d47815333318f317d41592da3aa685096f1b9b89a9a798c1bff"}
Jul 29 20:32:13.459203 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:13.459164    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq" podStartSLOduration=1.413526188 podStartE2EDuration="3.459149373s" totalImagesPullingTime="2.045623185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:32:13.457239391 +0000 UTC m=+443.308740063" watchObservedRunningTime="2026-07-29 20:32:13.459149373 +0000 UTC m=+443.310650046"
Jul 29 20:32:13.472482 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:13.472437    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77dccd7df-lv4lz" podStartSLOduration=1.472421944 podStartE2EDuration="1.472421944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:32:13.472242018 +0000 UTC m=+443.323742692" watchObservedRunningTime="2026-07-29 20:32:13.472421944 +0000 UTC m=+443.323922616"
Jul 29 20:32:15.754296 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:15.754265    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"]
Jul 29 20:32:15.758484 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:15.758469    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:15.764955 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:15.764928    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6x5cb\""
Jul 29 20:32:15.773651 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:15.773626    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"]
Jul 29 20:32:15.834465 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:15.834440    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6xp7\" (UniqueName: \"kubernetes.io/projected/b042a846-c09b-46a1-bc97-e5e9d65a317d-kube-api-access-l6xp7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" (UID: \"b042a846-c09b-46a1-bc97-e5e9d65a317d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:15.834612 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:15.834480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b042a846-c09b-46a1-bc97-e5e9d65a317d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" (UID: \"b042a846-c09b-46a1-bc97-e5e9d65a317d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:15.935635 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:15.935609    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6xp7\" (UniqueName: \"kubernetes.io/projected/b042a846-c09b-46a1-bc97-e5e9d65a317d-kube-api-access-l6xp7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" (UID: \"b042a846-c09b-46a1-bc97-e5e9d65a317d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:15.935816 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:15.935647    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b042a846-c09b-46a1-bc97-e5e9d65a317d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" (UID: \"b042a846-c09b-46a1-bc97-e5e9d65a317d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:15.936067 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:15.936047    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b042a846-c09b-46a1-bc97-e5e9d65a317d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" (UID: \"b042a846-c09b-46a1-bc97-e5e9d65a317d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:15.951571 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:15.951545    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6xp7\" (UniqueName: \"kubernetes.io/projected/b042a846-c09b-46a1-bc97-e5e9d65a317d-kube-api-access-l6xp7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" (UID: \"b042a846-c09b-46a1-bc97-e5e9d65a317d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:16.068420 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:16.068396    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:16.205595 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:16.205564    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"]
Jul 29 20:32:16.208856 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:32:16.208816    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb042a846_c09b_46a1_bc97_e5e9d65a317d.slice/crio-01056f3c96bf637dc1936ae84fdc79221ed9b581bddf5cefb652102ce9508d73 WatchSource:0}: Error finding container 01056f3c96bf637dc1936ae84fdc79221ed9b581bddf5cefb652102ce9508d73: Status 404 returned error can't find the container with id 01056f3c96bf637dc1936ae84fdc79221ed9b581bddf5cefb652102ce9508d73
Jul 29 20:32:16.459531 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:16.459470    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz" event={"ID":"b042a846-c09b-46a1-bc97-e5e9d65a317d","Type":"ContainerStarted","Data":"01056f3c96bf637dc1936ae84fdc79221ed9b581bddf5cefb652102ce9508d73"}
Jul 29 20:32:19.169039 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:19.169004    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm"]
Jul 29 20:32:19.171857 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:19.171821    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm"
Jul 29 20:32:19.174350 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:19.174325    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5t6ds\""
Jul 29 20:32:19.183342 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:19.183317    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm"]
Jul 29 20:32:19.266436 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:19.266312    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg9f2\" (UniqueName: \"kubernetes.io/projected/5c0894a4-bcb4-4da9-9fe1-5fc422e78a5f-kube-api-access-sg9f2\") pod \"authorino-operator-75cc8d5cb7-5s5qm\" (UID: \"5c0894a4-bcb4-4da9-9fe1-5fc422e78a5f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm"
Jul 29 20:32:19.367460 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:19.367429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg9f2\" (UniqueName: \"kubernetes.io/projected/5c0894a4-bcb4-4da9-9fe1-5fc422e78a5f-kube-api-access-sg9f2\") pod \"authorino-operator-75cc8d5cb7-5s5qm\" (UID: \"5c0894a4-bcb4-4da9-9fe1-5fc422e78a5f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm"
Jul 29 20:32:19.378329 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:19.378305    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg9f2\" (UniqueName: \"kubernetes.io/projected/5c0894a4-bcb4-4da9-9fe1-5fc422e78a5f-kube-api-access-sg9f2\") pod \"authorino-operator-75cc8d5cb7-5s5qm\" (UID: \"5c0894a4-bcb4-4da9-9fe1-5fc422e78a5f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm"
Jul 29 20:32:19.484372 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:19.484311    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm"
Jul 29 20:32:19.633888 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:19.633859    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm"]
Jul 29 20:32:20.781600 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:32:20.781565    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0894a4_bcb4_4da9_9fe1_5fc422e78a5f.slice/crio-a6a54b0386c2e64fb6ca1d93d19b3cc06ea3b18f0ac53b2d44b59bfae02c3953 WatchSource:0}: Error finding container a6a54b0386c2e64fb6ca1d93d19b3cc06ea3b18f0ac53b2d44b59bfae02c3953: Status 404 returned error can't find the container with id a6a54b0386c2e64fb6ca1d93d19b3cc06ea3b18f0ac53b2d44b59bfae02c3953
Jul 29 20:32:21.488279 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:21.488233    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz" event={"ID":"b042a846-c09b-46a1-bc97-e5e9d65a317d","Type":"ContainerStarted","Data":"2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2"}
Jul 29 20:32:21.488544 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:21.488522    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:21.490070 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:21.490023    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm" event={"ID":"5c0894a4-bcb4-4da9-9fe1-5fc422e78a5f","Type":"ContainerStarted","Data":"a6a54b0386c2e64fb6ca1d93d19b3cc06ea3b18f0ac53b2d44b59bfae02c3953"}
Jul 29 20:32:21.508579 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:21.508536    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz" podStartSLOduration=1.900047873 podStartE2EDuration="6.508522725s" totalImagesPullingTime="4.608474852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:32:21.505687319 +0000 UTC m=+451.357188021" watchObservedRunningTime="2026-07-29 20:32:21.508522725 +0000 UTC m=+451.360023441"
Jul 29 20:32:22.926688 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:22.926650    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:22.927153 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:22.926748    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:22.932263 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:22.932240    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:23.504466 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.504425    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm" event={"ID":"5c0894a4-bcb4-4da9-9fe1-5fc422e78a5f","Type":"ContainerStarted","Data":"f5c80b55fc51c1db278ab12af46f0e4956b51c3a039563519943743807bc7841"}
Jul 29 20:32:23.504813 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.504789    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm"
Jul 29 20:32:23.508478 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.508459    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77dccd7df-lv4lz"
Jul 29 20:32:23.521741 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.521698    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm" podStartSLOduration=2.3209962969999998 podStartE2EDuration="4.521683321s" totalImagesPullingTime="2.200687024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:32:23.521337135 +0000 UTC m=+453.372837833" watchObservedRunningTime="2026-07-29 20:32:23.521683321 +0000 UTC m=+453.373183994"
Jul 29 20:32:23.734569 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.734531    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"]
Jul 29 20:32:23.736968 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.736949    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:23.739582 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.739557    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 20:32:23.739713 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.739587    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m9rcf\""
Jul 29 20:32:23.739713 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.739600    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 20:32:23.745994 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.745962    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"]
Jul 29 20:32:23.805279 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.805244    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3039e992-6d30-435d-9feb-fe0814783693-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wfr4c\" (UID: \"3039e992-6d30-435d-9feb-fe0814783693\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:23.805495 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.805285    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mw69\" (UniqueName: \"kubernetes.io/projected/3039e992-6d30-435d-9feb-fe0814783693-kube-api-access-5mw69\") pod \"kuadrant-console-plugin-66b5774985-wfr4c\" (UID: \"3039e992-6d30-435d-9feb-fe0814783693\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:23.805495 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.805376    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3039e992-6d30-435d-9feb-fe0814783693-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wfr4c\" (UID: \"3039e992-6d30-435d-9feb-fe0814783693\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:23.906705 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.906667    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3039e992-6d30-435d-9feb-fe0814783693-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wfr4c\" (UID: \"3039e992-6d30-435d-9feb-fe0814783693\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:23.906705 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.906706    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mw69\" (UniqueName: \"kubernetes.io/projected/3039e992-6d30-435d-9feb-fe0814783693-kube-api-access-5mw69\") pod \"kuadrant-console-plugin-66b5774985-wfr4c\" (UID: \"3039e992-6d30-435d-9feb-fe0814783693\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:23.906989 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.906774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3039e992-6d30-435d-9feb-fe0814783693-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wfr4c\" (UID: \"3039e992-6d30-435d-9feb-fe0814783693\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:23.907436 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.907411    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3039e992-6d30-435d-9feb-fe0814783693-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wfr4c\" (UID: \"3039e992-6d30-435d-9feb-fe0814783693\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:23.909123 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.909096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3039e992-6d30-435d-9feb-fe0814783693-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wfr4c\" (UID: \"3039e992-6d30-435d-9feb-fe0814783693\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:23.918220 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:23.918195    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mw69\" (UniqueName: \"kubernetes.io/projected/3039e992-6d30-435d-9feb-fe0814783693-kube-api-access-5mw69\") pod \"kuadrant-console-plugin-66b5774985-wfr4c\" (UID: \"3039e992-6d30-435d-9feb-fe0814783693\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:24.046101 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:24.046064    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"
Jul 29 20:32:24.185142 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:24.185114    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c"]
Jul 29 20:32:24.186315 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:32:24.186284    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3039e992_6d30_435d_9feb_fe0814783693.slice/crio-e55842dcd17ff952a9d8ce2e52f7b438e13ca027d5e21ef7e557ebe91bfdcbdc WatchSource:0}: Error finding container e55842dcd17ff952a9d8ce2e52f7b438e13ca027d5e21ef7e557ebe91bfdcbdc: Status 404 returned error can't find the container with id e55842dcd17ff952a9d8ce2e52f7b438e13ca027d5e21ef7e557ebe91bfdcbdc
Jul 29 20:32:24.452033 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:24.451953    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ntgfq"
Jul 29 20:32:24.510655 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:24.510619    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c" event={"ID":"3039e992-6d30-435d-9feb-fe0814783693","Type":"ContainerStarted","Data":"e55842dcd17ff952a9d8ce2e52f7b438e13ca027d5e21ef7e557ebe91bfdcbdc"}
Jul 29 20:32:32.499297 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:32.499264    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:33.842957 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:33.842919    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"]
Jul 29 20:32:33.864011 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:33.863978    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"]
Jul 29 20:32:33.864187 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:33.864096    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:34.000738 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.000527    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4240d41c-d3a1-419e-a45c-4c983f8878b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" (UID: \"4240d41c-d3a1-419e-a45c-4c983f8878b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:34.000738 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.000646    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzm5\" (UniqueName: \"kubernetes.io/projected/4240d41c-d3a1-419e-a45c-4c983f8878b1-kube-api-access-4gzm5\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" (UID: \"4240d41c-d3a1-419e-a45c-4c983f8878b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:34.101355 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.101265    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzm5\" (UniqueName: \"kubernetes.io/projected/4240d41c-d3a1-419e-a45c-4c983f8878b1-kube-api-access-4gzm5\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" (UID: \"4240d41c-d3a1-419e-a45c-4c983f8878b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:34.101355 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.101333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4240d41c-d3a1-419e-a45c-4c983f8878b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" (UID: \"4240d41c-d3a1-419e-a45c-4c983f8878b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:34.101788 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.101760    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4240d41c-d3a1-419e-a45c-4c983f8878b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" (UID: \"4240d41c-d3a1-419e-a45c-4c983f8878b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:34.118103 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.118066    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzm5\" (UniqueName: \"kubernetes.io/projected/4240d41c-d3a1-419e-a45c-4c983f8878b1-kube-api-access-4gzm5\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" (UID: \"4240d41c-d3a1-419e-a45c-4c983f8878b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:34.177745 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.177705    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:34.231058 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.231020    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"]
Jul 29 20:32:34.234843 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.234769    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"]
Jul 29 20:32:34.247523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.247323    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"]
Jul 29 20:32:34.247692 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.247562    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz" podUID="b042a846-c09b-46a1-bc97-e5e9d65a317d" containerName="manager" containerID="cri-o://2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2" gracePeriod=2
Jul 29 20:32:34.251520 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.251494    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"]
Jul 29 20:32:34.258217 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.258185    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:32:34.258340 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.258269    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"]
Jul 29 20:32:34.264959 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:34.264883    2557 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b042a846-c09b-46a1-bc97-e5e9d65a317d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\": pods \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:34.267050 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:34.267015    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" podUID="b042a846-c09b-46a1-bc97-e5e9d65a317d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:34.268659 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.268624    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"]
Jul 29 20:32:34.271902 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.271875    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"]
Jul 29 20:32:34.272431 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.272407    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b042a846-c09b-46a1-bc97-e5e9d65a317d" containerName="manager"
Jul 29 20:32:34.272431 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.272432    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b042a846-c09b-46a1-bc97-e5e9d65a317d" containerName="manager"
Jul 29 20:32:34.272596 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.272543    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b042a846-c09b-46a1-bc97-e5e9d65a317d" containerName="manager"
Jul 29 20:32:34.276043 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.276019    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:34.290978 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.290775    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"]
Jul 29 20:32:34.302062 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:34.302000    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" podUID="b042a846-c09b-46a1-bc97-e5e9d65a317d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:34.404325 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.404225    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw26g\" (UniqueName: \"kubernetes.io/projected/e8013fbf-770d-473f-a578-900192222899-kube-api-access-mw26g\") pod \"kuadrant-operator-controller-manager-55467d9f7-gcp7z\" (UID: \"e8013fbf-770d-473f-a578-900192222899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:32:34.404325 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.404298    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpfmr\" (UniqueName: \"kubernetes.io/projected/396e44d9-db84-4d3d-bbec-87952a532e61-kube-api-access-wpfmr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wzbqg\" (UID: \"396e44d9-db84-4d3d-bbec-87952a532e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:34.404546 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.404345    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/396e44d9-db84-4d3d-bbec-87952a532e61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wzbqg\" (UID: \"396e44d9-db84-4d3d-bbec-87952a532e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:34.404546 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.404380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8013fbf-770d-473f-a578-900192222899-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gcp7z\" (UID: \"e8013fbf-770d-473f-a578-900192222899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:32:34.505918 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.505872    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/396e44d9-db84-4d3d-bbec-87952a532e61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wzbqg\" (UID: \"396e44d9-db84-4d3d-bbec-87952a532e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:34.506105 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.505926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8013fbf-770d-473f-a578-900192222899-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gcp7z\" (UID: \"e8013fbf-770d-473f-a578-900192222899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:32:34.506105 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.506001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw26g\" (UniqueName: \"kubernetes.io/projected/e8013fbf-770d-473f-a578-900192222899-kube-api-access-mw26g\") pod \"kuadrant-operator-controller-manager-55467d9f7-gcp7z\" (UID: \"e8013fbf-770d-473f-a578-900192222899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:32:34.506105 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.506051    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpfmr\" (UniqueName: \"kubernetes.io/projected/396e44d9-db84-4d3d-bbec-87952a532e61-kube-api-access-wpfmr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wzbqg\" (UID: \"396e44d9-db84-4d3d-bbec-87952a532e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:34.506301 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.506278    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/396e44d9-db84-4d3d-bbec-87952a532e61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wzbqg\" (UID: \"396e44d9-db84-4d3d-bbec-87952a532e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:34.506361 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.506301    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8013fbf-770d-473f-a578-900192222899-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gcp7z\" (UID: \"e8013fbf-770d-473f-a578-900192222899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:32:34.515532 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.515500    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpfmr\" (UniqueName: \"kubernetes.io/projected/396e44d9-db84-4d3d-bbec-87952a532e61-kube-api-access-wpfmr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wzbqg\" (UID: \"396e44d9-db84-4d3d-bbec-87952a532e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:34.515749 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.515728    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw26g\" (UniqueName: \"kubernetes.io/projected/e8013fbf-770d-473f-a578-900192222899-kube-api-access-mw26g\") pod \"kuadrant-operator-controller-manager-55467d9f7-gcp7z\" (UID: \"e8013fbf-770d-473f-a578-900192222899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:32:34.616243 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.616205    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:32:34.624437 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:34.624397    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:35.520797 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:35.520758    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5s5qm"
Jul 29 20:32:46.331135 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.331085    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"]
Jul 29 20:32:46.334891 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.334451    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:46.336887 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:46.336847    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" podUID="b042a846-c09b-46a1-bc97-e5e9d65a317d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:46.354626 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.354603    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"]
Jul 29 20:32:46.357111 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:32:46.357083    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396e44d9_db84_4d3d_bbec_87952a532e61.slice/crio-7fadd15d4605a7a4403d6b02ef31b2159d2ccd167ec3a5afecd28eac8ec14738 WatchSource:0}: Error finding container 7fadd15d4605a7a4403d6b02ef31b2159d2ccd167ec3a5afecd28eac8ec14738: Status 404 returned error can't find the container with id 7fadd15d4605a7a4403d6b02ef31b2159d2ccd167ec3a5afecd28eac8ec14738
Jul 29 20:32:46.522024 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.521992    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6xp7\" (UniqueName: \"kubernetes.io/projected/b042a846-c09b-46a1-bc97-e5e9d65a317d-kube-api-access-l6xp7\") pod \"b042a846-c09b-46a1-bc97-e5e9d65a317d\" (UID: \"b042a846-c09b-46a1-bc97-e5e9d65a317d\") "
Jul 29 20:32:46.522204 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.522052    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b042a846-c09b-46a1-bc97-e5e9d65a317d-extensions-socket-volume\") pod \"b042a846-c09b-46a1-bc97-e5e9d65a317d\" (UID: \"b042a846-c09b-46a1-bc97-e5e9d65a317d\") "
Jul 29 20:32:46.522593 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.522556    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b042a846-c09b-46a1-bc97-e5e9d65a317d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b042a846-c09b-46a1-bc97-e5e9d65a317d" (UID: "b042a846-c09b-46a1-bc97-e5e9d65a317d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:32:46.524212 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.524190    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b042a846-c09b-46a1-bc97-e5e9d65a317d-kube-api-access-l6xp7" (OuterVolumeSpecName: "kube-api-access-l6xp7") pod "b042a846-c09b-46a1-bc97-e5e9d65a317d" (UID: "b042a846-c09b-46a1-bc97-e5e9d65a317d"). InnerVolumeSpecName "kube-api-access-l6xp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:32:46.621398 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.621364    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b042a846-c09b-46a1-bc97-e5e9d65a317d" path="/var/lib/kubelet/pods/b042a846-c09b-46a1-bc97-e5e9d65a317d/volumes"
Jul 29 20:32:46.622904 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.622883    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6xp7\" (UniqueName: \"kubernetes.io/projected/b042a846-c09b-46a1-bc97-e5e9d65a317d-kube-api-access-l6xp7\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:46.623017 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.622907    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b042a846-c09b-46a1-bc97-e5e9d65a317d-extensions-socket-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:46.649812 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.649768    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c" event={"ID":"3039e992-6d30-435d-9feb-fe0814783693","Type":"ContainerStarted","Data":"affd1b5ddea8e56b7c93c8cfdfaf41b4f4cf0c6784019aac6b9e5a3412064aaf"}
Jul 29 20:32:46.651159 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.651134    2557 generic.go:356] "Generic (PLEG): container finished" podID="b042a846-c09b-46a1-bc97-e5e9d65a317d" containerID="2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2" exitCode=0
Jul 29 20:32:46.651277 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.651173    2557 scope.go:117] "RemoveContainer" containerID="2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2"
Jul 29 20:32:46.651277 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.651177    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:46.653254 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.653215    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg" event={"ID":"396e44d9-db84-4d3d-bbec-87952a532e61","Type":"ContainerStarted","Data":"e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54"}
Jul 29 20:32:46.653681 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.653459    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg" event={"ID":"396e44d9-db84-4d3d-bbec-87952a532e61","Type":"ContainerStarted","Data":"7fadd15d4605a7a4403d6b02ef31b2159d2ccd167ec3a5afecd28eac8ec14738"}
Jul 29 20:32:46.653681 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.653506    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:46.655105 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.655075    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z" event={"ID":"e8013fbf-770d-473f-a578-900192222899","Type":"ContainerStarted","Data":"7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416"}
Jul 29 20:32:46.655187 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.655121    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z" event={"ID":"e8013fbf-770d-473f-a578-900192222899","Type":"ContainerStarted","Data":"25da67c0c7954dd1a9cbf858ea740fa97e953c7adfcb2a62d872c28deb3f9a9a"}
Jul 29 20:32:46.655234 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.655190    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:32:46.660689 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.660673    2557 scope.go:117] "RemoveContainer" containerID="2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2"
Jul 29 20:32:46.660964 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:46.660945    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2\": container with ID starting with 2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2 not found: ID does not exist" containerID="2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2"
Jul 29 20:32:46.661022 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.660975    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2"} err="failed to get container status \"2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2\": rpc error: code = NotFound desc = could not find container \"2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2\": container with ID starting with 2a2fd580f08be4bf45bae14707413320d7185f5fbdf8b4eef760c7ad44fb95f2 not found: ID does not exist"
Jul 29 20:32:46.667459 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:46.667427    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp4pz\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" podUID="b042a846-c09b-46a1-bc97-e5e9d65a317d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp4pz"
Jul 29 20:32:46.667919 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.667879    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfr4c" podStartSLOduration=1.587604338 podStartE2EDuration="23.667867197s" totalImagesPullingTime="22.080262859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:32:46.665351733 +0000 UTC m=+476.516852429" watchObservedRunningTime="2026-07-29 20:32:46.667867197 +0000 UTC m=+476.519367870"
Jul 29 20:32:46.690658 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.690602    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z" podStartSLOduration=12.690584955 podStartE2EDuration="12.690584955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:32:46.688780506 +0000 UTC m=+476.540281180" watchObservedRunningTime="2026-07-29 20:32:46.690584955 +0000 UTC m=+476.542085629"
Jul 29 20:32:46.711639 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:46.711584    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg" podStartSLOduration=12.711564463 podStartE2EDuration="12.711564463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:32:46.7093914 +0000 UTC m=+476.560892084" watchObservedRunningTime="2026-07-29 20:32:46.711564463 +0000 UTC m=+476.563065136"
Jul 29 20:32:48.714688 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:48.714650    2557 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-v6ls4_kuadrant-system_4240d41c-d3a1-419e-a45c-4c983f8878b1_0(613a2fa53347bc1ac818dc994ddfa70f5e73f64ad654f20dee4d521c509f236f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-v6ls4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 29 20:32:48.714962 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:48.714719    2557 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-v6ls4_kuadrant-system_4240d41c-d3a1-419e-a45c-4c983f8878b1_0(613a2fa53347bc1ac818dc994ddfa70f5e73f64ad654f20dee4d521c509f236f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-v6ls4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:49.672532 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:49.672502    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:49.674951 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:49.674919    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" podUID="4240d41c-d3a1-419e-a45c-4c983f8878b1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:49.683376 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:49.683356    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:49.685618 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:49.685590    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" podUID="4240d41c-d3a1-419e-a45c-4c983f8878b1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:49.749038 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:49.749002    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4240d41c-d3a1-419e-a45c-4c983f8878b1-extensions-socket-volume\") pod \"4240d41c-d3a1-419e-a45c-4c983f8878b1\" (UID: \"4240d41c-d3a1-419e-a45c-4c983f8878b1\") "
Jul 29 20:32:49.749396 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:49.749052    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gzm5\" (UniqueName: \"kubernetes.io/projected/4240d41c-d3a1-419e-a45c-4c983f8878b1-kube-api-access-4gzm5\") pod \"4240d41c-d3a1-419e-a45c-4c983f8878b1\" (UID: \"4240d41c-d3a1-419e-a45c-4c983f8878b1\") "
Jul 29 20:32:49.749396 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:49.749280    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4240d41c-d3a1-419e-a45c-4c983f8878b1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4240d41c-d3a1-419e-a45c-4c983f8878b1" (UID: "4240d41c-d3a1-419e-a45c-4c983f8878b1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:32:49.751201 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:49.751180    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4240d41c-d3a1-419e-a45c-4c983f8878b1-kube-api-access-4gzm5" (OuterVolumeSpecName: "kube-api-access-4gzm5") pod "4240d41c-d3a1-419e-a45c-4c983f8878b1" (UID: "4240d41c-d3a1-419e-a45c-4c983f8878b1"). InnerVolumeSpecName "kube-api-access-4gzm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:32:49.850598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:49.850563    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4240d41c-d3a1-419e-a45c-4c983f8878b1-extensions-socket-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:49.850598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:49.850597    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gzm5\" (UniqueName: \"kubernetes.io/projected/4240d41c-d3a1-419e-a45c-4c983f8878b1-kube-api-access-4gzm5\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:50.624914 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:50.624870    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" podUID="4240d41c-d3a1-419e-a45c-4c983f8878b1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:50.625994 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:50.625972    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4240d41c-d3a1-419e-a45c-4c983f8878b1" path="/var/lib/kubelet/pods/4240d41c-d3a1-419e-a45c-4c983f8878b1/volumes"
Jul 29 20:32:50.677387 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:50.677360    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:50.679711 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:50.679681    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" podUID="4240d41c-d3a1-419e-a45c-4c983f8878b1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:50.681789 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:50.681768    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v6ls4\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" podUID="4240d41c-d3a1-419e-a45c-4c983f8878b1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6ls4"
Jul 29 20:32:57.663774 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:57.663743    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:32:57.664381 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:57.663877    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:57.735391 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:57.735360    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"]
Jul 29 20:32:57.735567 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:57.735546    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg" podUID="396e44d9-db84-4d3d-bbec-87952a532e61" containerName="manager" containerID="cri-o://e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54" gracePeriod=10
Jul 29 20:32:57.956729 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:57.956611    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"]
Jul 29 20:32:57.959068 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:57.959050    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:32:57.974115 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:57.974091    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"]
Jul 29 20:32:57.976314 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:57.976292    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:58.018904 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.018880    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/396e44d9-db84-4d3d-bbec-87952a532e61-extensions-socket-volume\") pod \"396e44d9-db84-4d3d-bbec-87952a532e61\" (UID: \"396e44d9-db84-4d3d-bbec-87952a532e61\") "
Jul 29 20:32:58.019036 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.018968    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpfmr\" (UniqueName: \"kubernetes.io/projected/396e44d9-db84-4d3d-bbec-87952a532e61-kube-api-access-wpfmr\") pod \"396e44d9-db84-4d3d-bbec-87952a532e61\" (UID: \"396e44d9-db84-4d3d-bbec-87952a532e61\") "
Jul 29 20:32:58.019089 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.019058    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz7wb\" (UniqueName: \"kubernetes.io/projected/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-kube-api-access-dz7wb\") pod \"kuadrant-operator-controller-manager-86878c769f-vxnhp\" (UID: \"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:32:58.019136 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.019086    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vxnhp\" (UID: \"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:32:58.019304 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.019279    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396e44d9-db84-4d3d-bbec-87952a532e61-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "396e44d9-db84-4d3d-bbec-87952a532e61" (UID: "396e44d9-db84-4d3d-bbec-87952a532e61"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:32:58.020918 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.020898    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396e44d9-db84-4d3d-bbec-87952a532e61-kube-api-access-wpfmr" (OuterVolumeSpecName: "kube-api-access-wpfmr") pod "396e44d9-db84-4d3d-bbec-87952a532e61" (UID: "396e44d9-db84-4d3d-bbec-87952a532e61"). InnerVolumeSpecName "kube-api-access-wpfmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:32:58.119671 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.119639    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz7wb\" (UniqueName: \"kubernetes.io/projected/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-kube-api-access-dz7wb\") pod \"kuadrant-operator-controller-manager-86878c769f-vxnhp\" (UID: \"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:32:58.119822 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.119680    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vxnhp\" (UID: \"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:32:58.119822 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.119750    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/396e44d9-db84-4d3d-bbec-87952a532e61-extensions-socket-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:58.119822 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.119760    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpfmr\" (UniqueName: \"kubernetes.io/projected/396e44d9-db84-4d3d-bbec-87952a532e61-kube-api-access-wpfmr\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:32:58.120144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.120122    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vxnhp\" (UID: \"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:32:58.128059 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.128030    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz7wb\" (UniqueName: \"kubernetes.io/projected/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-kube-api-access-dz7wb\") pod \"kuadrant-operator-controller-manager-86878c769f-vxnhp\" (UID: \"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:32:58.282452 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.282418    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:32:58.420174 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.420145    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"]
Jul 29 20:32:58.423691 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:32:58.423664    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f8d96f_b8eb_4b4f_8093_b50cbaa443df.slice/crio-722bf6eb72095f6f863fcaed3010d58c7f1e29f0e2b990d7d8019d51d9e1abca WatchSource:0}: Error finding container 722bf6eb72095f6f863fcaed3010d58c7f1e29f0e2b990d7d8019d51d9e1abca: Status 404 returned error can't find the container with id 722bf6eb72095f6f863fcaed3010d58c7f1e29f0e2b990d7d8019d51d9e1abca
Jul 29 20:32:58.717659 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.717621    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp" event={"ID":"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df","Type":"ContainerStarted","Data":"77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa"}
Jul 29 20:32:58.718098 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.717687    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp" event={"ID":"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df","Type":"ContainerStarted","Data":"722bf6eb72095f6f863fcaed3010d58c7f1e29f0e2b990d7d8019d51d9e1abca"}
Jul 29 20:32:58.718098 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.717716    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:32:58.718931 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.718900    2557 generic.go:356] "Generic (PLEG): container finished" podID="396e44d9-db84-4d3d-bbec-87952a532e61" containerID="e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54" exitCode=0
Jul 29 20:32:58.719050 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.718939    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"
Jul 29 20:32:58.719050 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.718987    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg" event={"ID":"396e44d9-db84-4d3d-bbec-87952a532e61","Type":"ContainerDied","Data":"e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54"}
Jul 29 20:32:58.719050 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.719040    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg" event={"ID":"396e44d9-db84-4d3d-bbec-87952a532e61","Type":"ContainerDied","Data":"7fadd15d4605a7a4403d6b02ef31b2159d2ccd167ec3a5afecd28eac8ec14738"}
Jul 29 20:32:58.719205 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.719104    2557 scope.go:117] "RemoveContainer" containerID="e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54"
Jul 29 20:32:58.728083 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.728068    2557 scope.go:117] "RemoveContainer" containerID="e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54"
Jul 29 20:32:58.728571 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:32:58.728543    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54\": container with ID starting with e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54 not found: ID does not exist" containerID="e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54"
Jul 29 20:32:58.728685 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.728579    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54"} err="failed to get container status \"e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54\": rpc error: code = NotFound desc = could not find container \"e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54\": container with ID starting with e4137bc119d5d2dac2b74afc2ac0f6d14df4f74655eb6cd977f8fb37d4e4cf54 not found: ID does not exist"
Jul 29 20:32:58.736685 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.736642    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp" podStartSLOduration=1.736629737 podStartE2EDuration="1.736629737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:32:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:32:58.733701086 +0000 UTC m=+488.585201770" watchObservedRunningTime="2026-07-29 20:32:58.736629737 +0000 UTC m=+488.588130409"
Jul 29 20:32:58.746636 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.746614    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"]
Jul 29 20:32:58.755016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:32:58.754996    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wzbqg"]
Jul 29 20:33:00.622159 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:00.622127    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="396e44d9-db84-4d3d-bbec-87952a532e61" path="/var/lib/kubelet/pods/396e44d9-db84-4d3d-bbec-87952a532e61/volumes"
Jul 29 20:33:09.727451 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:09.727418    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:33:09.774409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:09.774376    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"]
Jul 29 20:33:09.774666 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:09.774612    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z" podUID="e8013fbf-770d-473f-a578-900192222899" containerName="manager" containerID="cri-o://7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416" gracePeriod=10
Jul 29 20:33:10.542575 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.542550    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:33:10.625852 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.625810    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8013fbf-770d-473f-a578-900192222899-extensions-socket-volume\") pod \"e8013fbf-770d-473f-a578-900192222899\" (UID: \"e8013fbf-770d-473f-a578-900192222899\") "
Jul 29 20:33:10.625981 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.625911    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw26g\" (UniqueName: \"kubernetes.io/projected/e8013fbf-770d-473f-a578-900192222899-kube-api-access-mw26g\") pod \"e8013fbf-770d-473f-a578-900192222899\" (UID: \"e8013fbf-770d-473f-a578-900192222899\") "
Jul 29 20:33:10.626181 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.626152    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8013fbf-770d-473f-a578-900192222899-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e8013fbf-770d-473f-a578-900192222899" (UID: "e8013fbf-770d-473f-a578-900192222899"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:33:10.627887 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.627859    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8013fbf-770d-473f-a578-900192222899-kube-api-access-mw26g" (OuterVolumeSpecName: "kube-api-access-mw26g") pod "e8013fbf-770d-473f-a578-900192222899" (UID: "e8013fbf-770d-473f-a578-900192222899"). InnerVolumeSpecName "kube-api-access-mw26g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:33:10.727194 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.727137    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8013fbf-770d-473f-a578-900192222899-extensions-socket-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:33:10.727194 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.727159    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw26g\" (UniqueName: \"kubernetes.io/projected/e8013fbf-770d-473f-a578-900192222899-kube-api-access-mw26g\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:33:10.778942 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.778901    2557 generic.go:356] "Generic (PLEG): container finished" podID="e8013fbf-770d-473f-a578-900192222899" containerID="7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416" exitCode=0
Jul 29 20:33:10.779272 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.778956    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"
Jul 29 20:33:10.779272 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.778969    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z" event={"ID":"e8013fbf-770d-473f-a578-900192222899","Type":"ContainerDied","Data":"7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416"}
Jul 29 20:33:10.779272 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.779011    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z" event={"ID":"e8013fbf-770d-473f-a578-900192222899","Type":"ContainerDied","Data":"25da67c0c7954dd1a9cbf858ea740fa97e953c7adfcb2a62d872c28deb3f9a9a"}
Jul 29 20:33:10.779272 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.779032    2557 scope.go:117] "RemoveContainer" containerID="7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416"
Jul 29 20:33:10.788117 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.788096    2557 scope.go:117] "RemoveContainer" containerID="7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416"
Jul 29 20:33:10.788350 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:33:10.788332    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416\": container with ID starting with 7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416 not found: ID does not exist" containerID="7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416"
Jul 29 20:33:10.788401 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.788358    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416"} err="failed to get container status \"7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416\": rpc error: code = NotFound desc = could not find container \"7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416\": container with ID starting with 7714d220fdd75f9157754ae6236fc6e22d9ebdd96eda24baca9946100dcbb416 not found: ID does not exist"
Jul 29 20:33:10.803147 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.803121    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"]
Jul 29 20:33:10.807016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:10.806993    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gcp7z"]
Jul 29 20:33:12.621792 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:12.621759    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8013fbf-770d-473f-a578-900192222899" path="/var/lib/kubelet/pods/e8013fbf-770d-473f-a578-900192222899/volumes"
Jul 29 20:33:15.038468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.038439    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"]
Jul 29 20:33:15.038932 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.038779    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396e44d9-db84-4d3d-bbec-87952a532e61" containerName="manager"
Jul 29 20:33:15.038932 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.038794    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="396e44d9-db84-4d3d-bbec-87952a532e61" containerName="manager"
Jul 29 20:33:15.038932 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.038815    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8013fbf-770d-473f-a578-900192222899" containerName="manager"
Jul 29 20:33:15.038932 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.038823    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8013fbf-770d-473f-a578-900192222899" containerName="manager"
Jul 29 20:33:15.039076 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.038938    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="396e44d9-db84-4d3d-bbec-87952a532e61" containerName="manager"
Jul 29 20:33:15.039076 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.038950    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8013fbf-770d-473f-a578-900192222899" containerName="manager"
Jul 29 20:33:15.164450 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.164420    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"]
Jul 29 20:33:15.164616 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.164516    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.166948 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.166925    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fs8lt\""
Jul 29 20:33:15.264377 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.264349    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.264513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.264387    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjfvx\" (UniqueName: \"kubernetes.io/projected/1a1c02e7-2946-4031-b6f6-84e282df5ff2-kube-api-access-sjfvx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.264513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.264449    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.264513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.264488    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.264631 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.264516    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.264631 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.264534    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.264631 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.264556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.264631 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.264590    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.264631 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.264608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.365454 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.365369    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.365454 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.365413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.365454 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.365431    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.365699 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.365600    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.365699 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.365690    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjfvx\" (UniqueName: \"kubernetes.io/projected/1a1c02e7-2946-4031-b6f6-84e282df5ff2-kube-api-access-sjfvx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.365784 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.365765    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.365857 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.365809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.365857 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.365850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.365969 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.365864    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.365969 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.365902    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.366144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.366123    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.366201 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.366172    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.366245 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.366176    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.366284 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.366260    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.367939 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.367918    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.368045 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.368031    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.373747 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.373728    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjfvx\" (UniqueName: \"kubernetes.io/projected/1a1c02e7-2946-4031-b6f6-84e282df5ff2-kube-api-access-sjfvx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.373912 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.373893    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a1c02e7-2946-4031-b6f6-84e282df5ff2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2xv2q\" (UID: \"1a1c02e7-2946-4031-b6f6-84e282df5ff2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.474515 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.474489    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:15.622183 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.622154    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"]
Jul 29 20:33:15.623779 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:33:15.623753    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1c02e7_2946_4031_b6f6_84e282df5ff2.slice/crio-0ef5727b89c7a99b290d989b55659bc37f1587eef1ac55d9fff427cc68379c6c WatchSource:0}: Error finding container 0ef5727b89c7a99b290d989b55659bc37f1587eef1ac55d9fff427cc68379c6c: Status 404 returned error can't find the container with id 0ef5727b89c7a99b290d989b55659bc37f1587eef1ac55d9fff427cc68379c6c
Jul 29 20:33:15.625959 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.625923    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:33:15.626038 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.625987    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:33:15.626038 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.626018    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:33:15.811996 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.811954    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q" event={"ID":"1a1c02e7-2946-4031-b6f6-84e282df5ff2","Type":"ContainerStarted","Data":"59128bc707e101d7deeb107a5ea1e6dd7235331611dd155d41c412d3995c9cb2"}
Jul 29 20:33:15.812185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.812020    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q" event={"ID":"1a1c02e7-2946-4031-b6f6-84e282df5ff2","Type":"ContainerStarted","Data":"0ef5727b89c7a99b290d989b55659bc37f1587eef1ac55d9fff427cc68379c6c"}
Jul 29 20:33:15.831100 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:15.831053    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q" podStartSLOduration=0.831037382 podStartE2EDuration="831.037382ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:33:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:33:15.828482732 +0000 UTC m=+505.679983487" watchObservedRunningTime="2026-07-29 20:33:15.831037382 +0000 UTC m=+505.682538055"
Jul 29 20:33:16.475047 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:16.475016    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:16.479679 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:16.479655    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:16.816894 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:16.816859    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:16.817665 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:16.817647    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:33:28.006850 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.006803    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-txgwq"]
Jul 29 20:33:28.029904 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.029878    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-txgwq"]
Jul 29 20:33:28.030056 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.029975    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:28.032970 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.032951    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 20:33:28.105116 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.105084    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-txgwq"]
Jul 29 20:33:28.163149 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.163118    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66f616d8-8850-4b5d-a553-3b2c562754ff-config-file\") pod \"limitador-limitador-64c94fd64f-txgwq\" (UID: \"66f616d8-8850-4b5d-a553-3b2c562754ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:28.163282 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.163154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czxqx\" (UniqueName: \"kubernetes.io/projected/66f616d8-8850-4b5d-a553-3b2c562754ff-kube-api-access-czxqx\") pod \"limitador-limitador-64c94fd64f-txgwq\" (UID: \"66f616d8-8850-4b5d-a553-3b2c562754ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:28.263986 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.263959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66f616d8-8850-4b5d-a553-3b2c562754ff-config-file\") pod \"limitador-limitador-64c94fd64f-txgwq\" (UID: \"66f616d8-8850-4b5d-a553-3b2c562754ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:28.264143 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.263991    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czxqx\" (UniqueName: \"kubernetes.io/projected/66f616d8-8850-4b5d-a553-3b2c562754ff-kube-api-access-czxqx\") pod \"limitador-limitador-64c94fd64f-txgwq\" (UID: \"66f616d8-8850-4b5d-a553-3b2c562754ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:28.264564 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.264545    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66f616d8-8850-4b5d-a553-3b2c562754ff-config-file\") pod \"limitador-limitador-64c94fd64f-txgwq\" (UID: \"66f616d8-8850-4b5d-a553-3b2c562754ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:28.274759 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.274735    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czxqx\" (UniqueName: \"kubernetes.io/projected/66f616d8-8850-4b5d-a553-3b2c562754ff-kube-api-access-czxqx\") pod \"limitador-limitador-64c94fd64f-txgwq\" (UID: \"66f616d8-8850-4b5d-a553-3b2c562754ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:28.340353 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.340323    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:28.470201 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.470179    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-txgwq"]
Jul 29 20:33:28.472186 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:33:28.472157    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f616d8_8850_4b5d_a553_3b2c562754ff.slice/crio-a7a065b54925ee95c9d1e61a96077ab885796bb3ce8b503945cc81cc2ea12e6c WatchSource:0}: Error finding container a7a065b54925ee95c9d1e61a96077ab885796bb3ce8b503945cc81cc2ea12e6c: Status 404 returned error can't find the container with id a7a065b54925ee95c9d1e61a96077ab885796bb3ce8b503945cc81cc2ea12e6c
Jul 29 20:33:28.875419 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:28.875381    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq" event={"ID":"66f616d8-8850-4b5d-a553-3b2c562754ff","Type":"ContainerStarted","Data":"a7a065b54925ee95c9d1e61a96077ab885796bb3ce8b503945cc81cc2ea12e6c"}
Jul 29 20:33:31.893992 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:31.893950    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq" event={"ID":"66f616d8-8850-4b5d-a553-3b2c562754ff","Type":"ContainerStarted","Data":"1b816e20b473795fa2786c627cb78aab3fc40618646a814748a6b9c9d6cb77b5"}
Jul 29 20:33:31.894353 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:31.894130    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:31.912670 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:31.912626    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq" podStartSLOduration=2.331734128 podStartE2EDuration="4.912612338s" totalImagesPullingTime="2.58087821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:33:31.910907222 +0000 UTC m=+521.762407896" watchObservedRunningTime="2026-07-29 20:33:31.912612338 +0000 UTC m=+521.764113031"
Jul 29 20:33:42.402301 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:42.402215    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-txgwq"]
Jul 29 20:33:42.402981 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:42.402527    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq" podUID="66f616d8-8850-4b5d-a553-3b2c562754ff" containerName="limitador" containerID="cri-o://1b816e20b473795fa2786c627cb78aab3fc40618646a814748a6b9c9d6cb77b5" gracePeriod=30
Jul 29 20:33:42.403433 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:42.403414    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:42.949344 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:42.949316    2557 generic.go:356] "Generic (PLEG): container finished" podID="66f616d8-8850-4b5d-a553-3b2c562754ff" containerID="1b816e20b473795fa2786c627cb78aab3fc40618646a814748a6b9c9d6cb77b5" exitCode=0
Jul 29 20:33:42.949466 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:42.949354    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq" event={"ID":"66f616d8-8850-4b5d-a553-3b2c562754ff","Type":"ContainerDied","Data":"1b816e20b473795fa2786c627cb78aab3fc40618646a814748a6b9c9d6cb77b5"}
Jul 29 20:33:42.949466 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:42.949394    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq" event={"ID":"66f616d8-8850-4b5d-a553-3b2c562754ff","Type":"ContainerDied","Data":"a7a065b54925ee95c9d1e61a96077ab885796bb3ce8b503945cc81cc2ea12e6c"}
Jul 29 20:33:42.949466 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:42.949409    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7a065b54925ee95c9d1e61a96077ab885796bb3ce8b503945cc81cc2ea12e6c"
Jul 29 20:33:42.955659 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:42.955639    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:43.082715 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:43.082684    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66f616d8-8850-4b5d-a553-3b2c562754ff-config-file\") pod \"66f616d8-8850-4b5d-a553-3b2c562754ff\" (UID: \"66f616d8-8850-4b5d-a553-3b2c562754ff\") "
Jul 29 20:33:43.082894 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:43.082729    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czxqx\" (UniqueName: \"kubernetes.io/projected/66f616d8-8850-4b5d-a553-3b2c562754ff-kube-api-access-czxqx\") pod \"66f616d8-8850-4b5d-a553-3b2c562754ff\" (UID: \"66f616d8-8850-4b5d-a553-3b2c562754ff\") "
Jul 29 20:33:43.083120 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:43.083097    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f616d8-8850-4b5d-a553-3b2c562754ff-config-file" (OuterVolumeSpecName: "config-file") pod "66f616d8-8850-4b5d-a553-3b2c562754ff" (UID: "66f616d8-8850-4b5d-a553-3b2c562754ff"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:33:43.084775 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:43.084749    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f616d8-8850-4b5d-a553-3b2c562754ff-kube-api-access-czxqx" (OuterVolumeSpecName: "kube-api-access-czxqx") pod "66f616d8-8850-4b5d-a553-3b2c562754ff" (UID: "66f616d8-8850-4b5d-a553-3b2c562754ff"). InnerVolumeSpecName "kube-api-access-czxqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:33:43.183541 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:43.183503    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czxqx\" (UniqueName: \"kubernetes.io/projected/66f616d8-8850-4b5d-a553-3b2c562754ff-kube-api-access-czxqx\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:33:43.183541 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:43.183535    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66f616d8-8850-4b5d-a553-3b2c562754ff-config-file\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:33:43.954334 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:43.954303    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-txgwq"
Jul 29 20:33:43.974798 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:43.974764    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-txgwq"]
Jul 29 20:33:43.976664 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:43.976646    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-txgwq"]
Jul 29 20:33:44.621682 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:44.621650    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66f616d8-8850-4b5d-a553-3b2c562754ff" path="/var/lib/kubelet/pods/66f616d8-8850-4b5d-a553-3b2c562754ff/volumes"
Jul 29 20:33:48.659544 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.659508    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"]
Jul 29 20:33:48.660042 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.660025    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f616d8-8850-4b5d-a553-3b2c562754ff" containerName="limitador"
Jul 29 20:33:48.660087 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.660044    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f616d8-8850-4b5d-a553-3b2c562754ff" containerName="limitador"
Jul 29 20:33:48.660160 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.660149    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="66f616d8-8850-4b5d-a553-3b2c562754ff" containerName="limitador"
Jul 29 20:33:48.664017 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.664000    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"
Jul 29 20:33:48.666572 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.666530    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 20:33:48.667282 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.667256    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 29 20:33:48.667402 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.667283    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:33:48.667402 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.667392    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-j2hj9\""
Jul 29 20:33:48.669052 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.669026    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"]
Jul 29 20:33:48.834339 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.834298    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b61315b5-e5a2-4246-a40a-d7509d7a81a2-data\") pod \"postgres-69fb4594cf-cwv7l\" (UID: \"b61315b5-e5a2-4246-a40a-d7509d7a81a2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"
Jul 29 20:33:48.834596 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.834363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs7kf\" (UniqueName: \"kubernetes.io/projected/b61315b5-e5a2-4246-a40a-d7509d7a81a2-kube-api-access-fs7kf\") pod \"postgres-69fb4594cf-cwv7l\" (UID: \"b61315b5-e5a2-4246-a40a-d7509d7a81a2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"
Jul 29 20:33:48.935117 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.935028    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b61315b5-e5a2-4246-a40a-d7509d7a81a2-data\") pod \"postgres-69fb4594cf-cwv7l\" (UID: \"b61315b5-e5a2-4246-a40a-d7509d7a81a2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"
Jul 29 20:33:48.935117 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.935081    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs7kf\" (UniqueName: \"kubernetes.io/projected/b61315b5-e5a2-4246-a40a-d7509d7a81a2-kube-api-access-fs7kf\") pod \"postgres-69fb4594cf-cwv7l\" (UID: \"b61315b5-e5a2-4246-a40a-d7509d7a81a2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"
Jul 29 20:33:48.935459 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.935438    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b61315b5-e5a2-4246-a40a-d7509d7a81a2-data\") pod \"postgres-69fb4594cf-cwv7l\" (UID: \"b61315b5-e5a2-4246-a40a-d7509d7a81a2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"
Jul 29 20:33:48.944137 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.944106    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs7kf\" (UniqueName: \"kubernetes.io/projected/b61315b5-e5a2-4246-a40a-d7509d7a81a2-kube-api-access-fs7kf\") pod \"postgres-69fb4594cf-cwv7l\" (UID: \"b61315b5-e5a2-4246-a40a-d7509d7a81a2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"
Jul 29 20:33:48.977142 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:48.977108    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"
Jul 29 20:33:49.114691 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:49.114664    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"]
Jul 29 20:33:49.116746 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:33:49.116716    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb61315b5_e5a2_4246_a40a_d7509d7a81a2.slice/crio-460b642d0744bf05684a99fe0670d046f451920ba7f20112020a7b91bfebeed5 WatchSource:0}: Error finding container 460b642d0744bf05684a99fe0670d046f451920ba7f20112020a7b91bfebeed5: Status 404 returned error can't find the container with id 460b642d0744bf05684a99fe0670d046f451920ba7f20112020a7b91bfebeed5
Jul 29 20:33:49.992069 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:49.991991    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l" event={"ID":"b61315b5-e5a2-4246-a40a-d7509d7a81a2","Type":"ContainerStarted","Data":"460b642d0744bf05684a99fe0670d046f451920ba7f20112020a7b91bfebeed5"}
Jul 29 20:33:53.972009 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:53.971984    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 29 20:33:55.026820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:55.026783    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l" event={"ID":"b61315b5-e5a2-4246-a40a-d7509d7a81a2","Type":"ContainerStarted","Data":"24fde6abc174dbc1d2e6c96a98f160a2b5f43ba9748b9dae905c4b27d795d9f9"}
Jul 29 20:33:55.027191 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:55.026980    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"
Jul 29 20:33:55.042136 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:33:55.042094    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l" podStartSLOduration=2.1908864120000002 podStartE2EDuration="7.042079793s" totalImagesPullingTime="4.851193381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:33:55.040518825 +0000 UTC m=+544.892019502" watchObservedRunningTime="2026-07-29 20:33:55.042079793 +0000 UTC m=+544.893580465"
Jul 29 20:34:01.060396 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:01.060364    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cwv7l"
Jul 29 20:34:45.034009 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.033972    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-q9t74"]
Jul 29 20:34:45.037652 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.037631    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74"
Jul 29 20:34:45.040105 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.040080    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9r294\""
Jul 29 20:34:45.040252 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.040169    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 29 20:34:45.047645 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.047618    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-q9t74"]
Jul 29 20:34:45.065912 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.065879    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"]
Jul 29 20:34:45.070027 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.069999    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"
Jul 29 20:34:45.082918 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.082894    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"]
Jul 29 20:34:45.129063 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.129033    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxd7l\" (UniqueName: \"kubernetes.io/projected/b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6-kube-api-access-dxd7l\") pod \"payload-pre-processing-687dbb6cf6-7pnxq\" (UID: \"b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"
Jul 29 20:34:45.129233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.129066    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsvz2\" (UniqueName: \"kubernetes.io/projected/2a2a6527-da5b-4e56-8919-c7c94769d089-kube-api-access-bsvz2\") pod \"payload-processing-5cc6cd444b-q9t74\" (UID: \"2a2a6527-da5b-4e56-8919-c7c94769d089\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74"
Jul 29 20:34:45.129233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.129135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-7pnxq\" (UID: \"b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"
Jul 29 20:34:45.129233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.129163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a2a6527-da5b-4e56-8919-c7c94769d089-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-q9t74\" (UID: \"2a2a6527-da5b-4e56-8919-c7c94769d089\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74"
Jul 29 20:34:45.230168 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.230130    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxd7l\" (UniqueName: \"kubernetes.io/projected/b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6-kube-api-access-dxd7l\") pod \"payload-pre-processing-687dbb6cf6-7pnxq\" (UID: \"b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"
Jul 29 20:34:45.230168 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.230169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsvz2\" (UniqueName: \"kubernetes.io/projected/2a2a6527-da5b-4e56-8919-c7c94769d089-kube-api-access-bsvz2\") pod \"payload-processing-5cc6cd444b-q9t74\" (UID: \"2a2a6527-da5b-4e56-8919-c7c94769d089\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74"
Jul 29 20:34:45.230409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.230219    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-7pnxq\" (UID: \"b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"
Jul 29 20:34:45.230409 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.230249    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a2a6527-da5b-4e56-8919-c7c94769d089-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-q9t74\" (UID: \"2a2a6527-da5b-4e56-8919-c7c94769d089\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74"
Jul 29 20:34:45.231121 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.231095    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-7pnxq\" (UID: \"b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"
Jul 29 20:34:45.231213 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.231096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a2a6527-da5b-4e56-8919-c7c94769d089-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-q9t74\" (UID: \"2a2a6527-da5b-4e56-8919-c7c94769d089\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74"
Jul 29 20:34:45.238741 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.238714    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsvz2\" (UniqueName: \"kubernetes.io/projected/2a2a6527-da5b-4e56-8919-c7c94769d089-kube-api-access-bsvz2\") pod \"payload-processing-5cc6cd444b-q9t74\" (UID: \"2a2a6527-da5b-4e56-8919-c7c94769d089\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74"
Jul 29 20:34:45.238899 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.238766    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxd7l\" (UniqueName: \"kubernetes.io/projected/b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6-kube-api-access-dxd7l\") pod \"payload-pre-processing-687dbb6cf6-7pnxq\" (UID: \"b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"
Jul 29 20:34:45.350614 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.350524    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74"
Jul 29 20:34:45.380845 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.380799    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"
Jul 29 20:34:45.505071 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.505041    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-q9t74"]
Jul 29 20:34:45.507516 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:34:45.507482    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2a6527_da5b_4e56_8919_c7c94769d089.slice/crio-ba103ed859e3f583331ca70e5e31ed13cedc9932f68cb78f31ce7b9ae0681df5 WatchSource:0}: Error finding container ba103ed859e3f583331ca70e5e31ed13cedc9932f68cb78f31ce7b9ae0681df5: Status 404 returned error can't find the container with id ba103ed859e3f583331ca70e5e31ed13cedc9932f68cb78f31ce7b9ae0681df5
Jul 29 20:34:45.530798 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:45.530650    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"]
Jul 29 20:34:45.533021 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:34:45.532990    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d70d9f_e5ef_4bd6_8fed_f9ff8c5e0bb6.slice/crio-3635aa29e4233c307fe96eff4ed3433ce62017882a1462af6b1edf88ba331231 WatchSource:0}: Error finding container 3635aa29e4233c307fe96eff4ed3433ce62017882a1462af6b1edf88ba331231: Status 404 returned error can't find the container with id 3635aa29e4233c307fe96eff4ed3433ce62017882a1462af6b1edf88ba331231
Jul 29 20:34:46.307477 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:46.307437    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq" event={"ID":"b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6","Type":"ContainerStarted","Data":"3635aa29e4233c307fe96eff4ed3433ce62017882a1462af6b1edf88ba331231"}
Jul 29 20:34:46.312085 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:46.312012    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74" event={"ID":"2a2a6527-da5b-4e56-8919-c7c94769d089","Type":"ContainerStarted","Data":"ba103ed859e3f583331ca70e5e31ed13cedc9932f68cb78f31ce7b9ae0681df5"}
Jul 29 20:34:48.327114 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:48.327078    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq" event={"ID":"b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6","Type":"ContainerStarted","Data":"a872f69493551b81a53b9c36db0fbe51de842f2b1fdec7c2549bfd3b93aa4d6d"}
Jul 29 20:34:48.327549 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:48.327196    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"
Jul 29 20:34:48.328733 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:48.328704    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74" event={"ID":"2a2a6527-da5b-4e56-8919-c7c94769d089","Type":"ContainerStarted","Data":"40280d75f73fe4964744a52c3e9acc0224fff549a6c6e7cfd6a1b5c97a171619"}
Jul 29 20:34:48.328857 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:48.328786    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74"
Jul 29 20:34:48.341887 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:48.341814    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq" podStartSLOduration=1.234707001 podStartE2EDuration="3.341798335s" totalImagesPullingTime="2.107091334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:34:48.341304725 +0000 UTC m=+598.192805397" watchObservedRunningTime="2026-07-29 20:34:48.341798335 +0000 UTC m=+598.193299009"
Jul 29 20:34:48.356985 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:48.356935    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74" podStartSLOduration=1.231327225 podStartE2EDuration="3.356920646s" totalImagesPullingTime="2.125593421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:34:48.354577666 +0000 UTC m=+598.206078338" watchObservedRunningTime="2026-07-29 20:34:48.356920646 +0000 UTC m=+598.208421318"
Jul 29 20:34:50.538049 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:50.538018    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:34:50.538588 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:50.538570    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:34:53.358329 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:53.358293    2557 generic.go:356] "Generic (PLEG): container finished" podID="1a1c02e7-2946-4031-b6f6-84e282df5ff2" containerID="59128bc707e101d7deeb107a5ea1e6dd7235331611dd155d41c412d3995c9cb2" exitCode=0
Jul 29 20:34:53.358747 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:53.358366    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q" event={"ID":"1a1c02e7-2946-4031-b6f6-84e282df5ff2","Type":"ContainerDied","Data":"59128bc707e101d7deeb107a5ea1e6dd7235331611dd155d41c412d3995c9cb2"}
Jul 29 20:34:53.358794 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:53.358758    2557 scope.go:117] "RemoveContainer" containerID="59128bc707e101d7deeb107a5ea1e6dd7235331611dd155d41c412d3995c9cb2"
Jul 29 20:34:53.359775 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:53.359748    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:34:53.359855 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:53.359816    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:34:53.359897 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:53.359871    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:34:54.366049 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:54.366017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q" event={"ID":"1a1c02e7-2946-4031-b6f6-84e282df5ff2","Type":"ContainerStarted","Data":"4f17ffac306814aca62c4c15811456717543e3103778f0803611627f21ea3322"}
Jul 29 20:34:54.476020 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:54.475990    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:34:54.476367 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:54.476345    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2xv2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 29 20:34:54.476513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:54.476489    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q" podUID="1a1c02e7-2946-4031-b6f6-84e282df5ff2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 29 20:34:55.475317 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:55.475279    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2xv2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 29 20:34:55.475903 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:55.475866    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q" podUID="1a1c02e7-2946-4031-b6f6-84e282df5ff2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 29 20:34:56.475576 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:56.475536    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2xv2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 29 20:34:56.476197 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:56.476163    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q" podUID="1a1c02e7-2946-4031-b6f6-84e282df5ff2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 29 20:34:57.475418 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:57.475382    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2xv2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 29 20:34:57.475734 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:57.475702    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q" podUID="1a1c02e7-2946-4031-b6f6-84e282df5ff2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 29 20:34:58.480337 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:58.480307    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:34:58.480807 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:58.480600    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:34:58.481200 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:58.481184    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2xv2q"
Jul 29 20:34:59.335895 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:59.335825    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq" podUID="b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.46:9004: connect: connection refused"
Jul 29 20:34:59.336335 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:34:59.336311    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-q9t74"
Jul 29 20:35:09.335261 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:09.335228    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7pnxq"
Jul 29 20:35:17.923800 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:17.923696    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"]
Jul 29 20:35:17.927318 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:17.927298    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:17.930880 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:17.930850    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 20:35:17.931042 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:17.930855    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 20:35:17.931133 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:17.930865    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 20:35:17.931197 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:17.930964    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bcvdz\""
Jul 29 20:35:17.938523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:17.938503    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"]
Jul 29 20:35:18.026697 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.026654    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0c43f87-7e5f-49d0-af06-4943ed3095f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.026915 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.026725    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.026915 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.026753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.026915 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.026808    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqttn\" (UniqueName: \"kubernetes.io/projected/a0c43f87-7e5f-49d0-af06-4943ed3095f1-kube-api-access-lqttn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.026915 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.026905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.027154 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.027020    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.127577 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.127546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqttn\" (UniqueName: \"kubernetes.io/projected/a0c43f87-7e5f-49d0-af06-4943ed3095f1-kube-api-access-lqttn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.127740 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.127592    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.127740 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.127676    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.127740 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.127708    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0c43f87-7e5f-49d0-af06-4943ed3095f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.127934 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.127775    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.127934 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.127801    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.128123 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.128096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.128196 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.128154    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.128236 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.128221    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.130010 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.129985    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0c43f87-7e5f-49d0-af06-4943ed3095f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.130429 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.130405    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0c43f87-7e5f-49d0-af06-4943ed3095f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.135516 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.135495    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqttn\" (UniqueName: \"kubernetes.io/projected/a0c43f87-7e5f-49d0-af06-4943ed3095f1-kube-api-access-lqttn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-76rxh\" (UID: \"a0c43f87-7e5f-49d0-af06-4943ed3095f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.239435 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.239342    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:18.373784 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.373665    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"]
Jul 29 20:35:18.376164 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:35:18.376131    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c43f87_7e5f_49d0_af06_4943ed3095f1.slice/crio-07758aed3a749d2de7be10ade55fc00e459c2c3b5adbaa22a1e4a3aabbd50a5c WatchSource:0}: Error finding container 07758aed3a749d2de7be10ade55fc00e459c2c3b5adbaa22a1e4a3aabbd50a5c: Status 404 returned error can't find the container with id 07758aed3a749d2de7be10ade55fc00e459c2c3b5adbaa22a1e4a3aabbd50a5c
Jul 29 20:35:18.377563 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.377533    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 20:35:18.499788 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:18.499708    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh" event={"ID":"a0c43f87-7e5f-49d0-af06-4943ed3095f1","Type":"ContainerStarted","Data":"07758aed3a749d2de7be10ade55fc00e459c2c3b5adbaa22a1e4a3aabbd50a5c"}
Jul 29 20:35:19.508455 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:19.508419    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh" event={"ID":"a0c43f87-7e5f-49d0-af06-4943ed3095f1","Type":"ContainerStarted","Data":"98dc259bd248b6fe95b4e10b3ece51c73d7c9a9da67d6d888e5d3504a32b0b6a"}
Jul 29 20:35:19.528097 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:19.528034    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh" podStartSLOduration=1.5269565539999999 podStartE2EDuration="2.52801997s" totalImagesPullingTime="1.001063416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:35:19.526959384 +0000 UTC m=+629.378460057" watchObservedRunningTime="2026-07-29 20:35:19.52801997 +0000 UTC m=+629.379520642"
Jul 29 20:35:28.239820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:28.239728    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:28.239820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:28.239808    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:28.252557 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:28.252528    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:28.568699 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:28.568672    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-76rxh"
Jul 29 20:35:29.132696 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.132656    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"]
Jul 29 20:35:29.136403 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.136378    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.138921 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.138901    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 29 20:35:29.144318 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.144298    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"]
Jul 29 20:35:29.231209 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.231175    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.231368 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.231223    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/069104d0-1f06-4cd7-8a7d-de7c0d179923-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.231368 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.231265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.231368 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.231317    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.231368 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.231361    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l64ph\" (UniqueName: \"kubernetes.io/projected/069104d0-1f06-4cd7-8a7d-de7c0d179923-kube-api-access-l64ph\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.231505 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.231388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.332652 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.332617    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.333144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.332665    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/069104d0-1f06-4cd7-8a7d-de7c0d179923-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.333144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.332805    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.333144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.332895    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.333144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.332943    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l64ph\" (UniqueName: \"kubernetes.io/projected/069104d0-1f06-4cd7-8a7d-de7c0d179923-kube-api-access-l64ph\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.333144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.332995    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.333144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.333023    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.333441 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.333208    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.333441 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.333355    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.335108 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.335087    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/069104d0-1f06-4cd7-8a7d-de7c0d179923-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.335371 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.335355    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/069104d0-1f06-4cd7-8a7d-de7c0d179923-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.340042 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.340018    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l64ph\" (UniqueName: \"kubernetes.io/projected/069104d0-1f06-4cd7-8a7d-de7c0d179923-kube-api-access-l64ph\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t6llj\" (UID: \"069104d0-1f06-4cd7-8a7d-de7c0d179923\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.447861 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.447744    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:29.589416 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:29.589367    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"]
Jul 29 20:35:29.591776 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:35:29.591741    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069104d0_1f06_4cd7_8a7d_de7c0d179923.slice/crio-9ed1c355c4f695d31260e20590b4e4c320d8e023e1d63f8f6717cf1913327b5e WatchSource:0}: Error finding container 9ed1c355c4f695d31260e20590b4e4c320d8e023e1d63f8f6717cf1913327b5e: Status 404 returned error can't find the container with id 9ed1c355c4f695d31260e20590b4e4c320d8e023e1d63f8f6717cf1913327b5e
Jul 29 20:35:30.571760 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:30.571711    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj" event={"ID":"069104d0-1f06-4cd7-8a7d-de7c0d179923","Type":"ContainerStarted","Data":"cc43ca97eb6f2c6e3d9148508baf03cc1a055e1f77892468b394c2a34e04efd0"}
Jul 29 20:35:30.572300 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:30.571787    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj" event={"ID":"069104d0-1f06-4cd7-8a7d-de7c0d179923","Type":"ContainerStarted","Data":"9ed1c355c4f695d31260e20590b4e4c320d8e023e1d63f8f6717cf1913327b5e"}
Jul 29 20:35:30.597605 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:30.597555    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj" podStartSLOduration=1.360082574 podStartE2EDuration="1.597532071s" totalImagesPullingTime="237.449497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:35:30.596906667 +0000 UTC m=+640.448407341" watchObservedRunningTime="2026-07-29 20:35:30.597532071 +0000 UTC m=+640.449032744"
Jul 29 20:35:39.448555 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:39.448517    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:39.448975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:39.448584    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:39.461470 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:39.461444    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:35:39.630646 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:35:39.630615    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t6llj"
Jul 29 20:39:50.578745 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:39:50.578658    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:39:50.580426 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:39:50.580403    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:39:50.603757 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:39:50.603729    2557 scope.go:117] "RemoveContainer" containerID="1b816e20b473795fa2786c627cb78aab3fc40618646a814748a6b9c9d6cb77b5"
Jul 29 20:44:50.609786 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:44:50.609758    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:44:50.612685 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:44:50.612666    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:45:00.146035 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:00.146001    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9"]
Jul 29 20:45:00.149599 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:00.149582    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9"
Jul 29 20:45:00.151956 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:00.151941    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 20:45:00.158484 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:00.158468    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9"
Jul 29 20:45:00.167552 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:00.167532    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9"]
Jul 29 20:45:00.497211 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:00.497190    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9"]
Jul 29 20:45:00.499447 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:45:00.499414    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0ce931_c52f_4851_aa07_29511873cc1e.slice/crio-38d057a536048da017001e9e03b5fa78dc10134ab06315362e51a17c8b797e5a WatchSource:0}: Error finding container 38d057a536048da017001e9e03b5fa78dc10134ab06315362e51a17c8b797e5a: Status 404 returned error can't find the container with id 38d057a536048da017001e9e03b5fa78dc10134ab06315362e51a17c8b797e5a
Jul 29 20:45:00.501697 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:00.501677    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 20:45:00.604814 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:00.604788    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9" event={"ID":"7e0ce931-c52f-4851-aa07-29511873cc1e","Type":"ContainerStarted","Data":"38d057a536048da017001e9e03b5fa78dc10134ab06315362e51a17c8b797e5a"}
Jul 29 20:45:03.622508 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:03.622482    2557 generic.go:356] "Generic (PLEG): container finished" podID="7e0ce931-c52f-4851-aa07-29511873cc1e" containerID="3f924d23055f4f7d09da32f8a3775eef61d14b8c7fe508ce2743db22916c36ee" exitCode=0
Jul 29 20:45:03.622809 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:03.622515    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9" event={"ID":"7e0ce931-c52f-4851-aa07-29511873cc1e","Type":"ContainerDied","Data":"3f924d23055f4f7d09da32f8a3775eef61d14b8c7fe508ce2743db22916c36ee"}
Jul 29 20:45:04.762029 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:04.761999    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9"
Jul 29 20:45:05.633806 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:05.633771    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9" event={"ID":"7e0ce931-c52f-4851-aa07-29511873cc1e","Type":"ContainerDied","Data":"38d057a536048da017001e9e03b5fa78dc10134ab06315362e51a17c8b797e5a"}
Jul 29 20:45:05.633978 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:05.633818    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38d057a536048da017001e9e03b5fa78dc10134ab06315362e51a17c8b797e5a"
Jul 29 20:45:05.633978 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:45:05.633787    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9"
Jul 29 20:46:12.541685 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.541605    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"]
Jul 29 20:46:12.544168 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.541791    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp" podUID="b2f8d96f-b8eb-4b4f-8093-b50cbaa443df" containerName="manager" containerID="cri-o://77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa" gracePeriod=10
Jul 29 20:46:12.795846 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.795781    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:46:12.947317 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.947292    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-extensions-socket-volume\") pod \"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df\" (UID: \"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df\") "
Jul 29 20:46:12.947570 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.947368    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz7wb\" (UniqueName: \"kubernetes.io/projected/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-kube-api-access-dz7wb\") pod \"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df\" (UID: \"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df\") "
Jul 29 20:46:12.947641 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.947616    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b2f8d96f-b8eb-4b4f-8093-b50cbaa443df" (UID: "b2f8d96f-b8eb-4b4f-8093-b50cbaa443df"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:46:12.949227 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.949195    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-kube-api-access-dz7wb" (OuterVolumeSpecName: "kube-api-access-dz7wb") pod "b2f8d96f-b8eb-4b4f-8093-b50cbaa443df" (UID: "b2f8d96f-b8eb-4b4f-8093-b50cbaa443df"). InnerVolumeSpecName "kube-api-access-dz7wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:46:12.979863 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.979821    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2f8d96f-b8eb-4b4f-8093-b50cbaa443df" containerID="77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa" exitCode=0
Jul 29 20:46:12.979973 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.979857    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp" event={"ID":"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df","Type":"ContainerDied","Data":"77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa"}
Jul 29 20:46:12.979973 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.979894    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"
Jul 29 20:46:12.979973 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.979921    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp" event={"ID":"b2f8d96f-b8eb-4b4f-8093-b50cbaa443df","Type":"ContainerDied","Data":"722bf6eb72095f6f863fcaed3010d58c7f1e29f0e2b990d7d8019d51d9e1abca"}
Jul 29 20:46:12.979973 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.979956    2557 scope.go:117] "RemoveContainer" containerID="77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa"
Jul 29 20:46:12.989419 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.989403    2557 scope.go:117] "RemoveContainer" containerID="77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa"
Jul 29 20:46:12.989671 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:46:12.989653    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa\": container with ID starting with 77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa not found: ID does not exist" containerID="77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa"
Jul 29 20:46:12.989711 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:12.989681    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa"} err="failed to get container status \"77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa\": rpc error: code = NotFound desc = could not find container \"77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa\": container with ID starting with 77c647a1c77066f274584dae75a3ad4863a8214f8261380915b6ddfc300402fa not found: ID does not exist"
Jul 29 20:46:13.001594 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:13.001573    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"]
Jul 29 20:46:13.004913 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:13.004892    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxnhp"]
Jul 29 20:46:13.048183 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:13.048121    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz7wb\" (UniqueName: \"kubernetes.io/projected/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-kube-api-access-dz7wb\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:46:13.048183 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:13.048143    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df-extensions-socket-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:46:14.621484 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:46:14.621453    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2f8d96f-b8eb-4b4f-8093-b50cbaa443df" path="/var/lib/kubelet/pods/b2f8d96f-b8eb-4b4f-8093-b50cbaa443df/volumes"
Jul 29 20:47:13.217767 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.217695    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"]
Jul 29 20:47:13.218145 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.218093    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f8d96f-b8eb-4b4f-8093-b50cbaa443df" containerName="manager"
Jul 29 20:47:13.218145 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.218107    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f8d96f-b8eb-4b4f-8093-b50cbaa443df" containerName="manager"
Jul 29 20:47:13.218145 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.218125    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0ce931-c52f-4851-aa07-29511873cc1e" containerName="cleanup"
Jul 29 20:47:13.218145 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.218130    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0ce931-c52f-4851-aa07-29511873cc1e" containerName="cleanup"
Jul 29 20:47:13.218270 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.218191    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f8d96f-b8eb-4b4f-8093-b50cbaa443df" containerName="manager"
Jul 29 20:47:13.218270 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.218199    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e0ce931-c52f-4851-aa07-29511873cc1e" containerName="cleanup"
Jul 29 20:47:13.222097 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.222081    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 20:47:13.224739 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.224723    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6x5cb\""
Jul 29 20:47:13.234022 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.234002    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"]
Jul 29 20:47:13.302498 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.302473    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsq8z\" (UniqueName: \"kubernetes.io/projected/8a86de28-2098-46fe-91ff-35bf70a868b3-kube-api-access-dsq8z\") pod \"kuadrant-operator-controller-manager-86878c769f-ql6tp\" (UID: \"8a86de28-2098-46fe-91ff-35bf70a868b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 20:47:13.302606 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.302519    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a86de28-2098-46fe-91ff-35bf70a868b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ql6tp\" (UID: \"8a86de28-2098-46fe-91ff-35bf70a868b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 20:47:13.403419 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.403397    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a86de28-2098-46fe-91ff-35bf70a868b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ql6tp\" (UID: \"8a86de28-2098-46fe-91ff-35bf70a868b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 20:47:13.403523 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.403469    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsq8z\" (UniqueName: \"kubernetes.io/projected/8a86de28-2098-46fe-91ff-35bf70a868b3-kube-api-access-dsq8z\") pod \"kuadrant-operator-controller-manager-86878c769f-ql6tp\" (UID: \"8a86de28-2098-46fe-91ff-35bf70a868b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 20:47:13.403806 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.403788    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a86de28-2098-46fe-91ff-35bf70a868b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ql6tp\" (UID: \"8a86de28-2098-46fe-91ff-35bf70a868b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 20:47:13.415809 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.415787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsq8z\" (UniqueName: \"kubernetes.io/projected/8a86de28-2098-46fe-91ff-35bf70a868b3-kube-api-access-dsq8z\") pod \"kuadrant-operator-controller-manager-86878c769f-ql6tp\" (UID: \"8a86de28-2098-46fe-91ff-35bf70a868b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 20:47:13.531859 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.531813    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 20:47:13.667959 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:13.667937    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"]
Jul 29 20:47:13.669932 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:47:13.669904    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a86de28_2098_46fe_91ff_35bf70a868b3.slice/crio-0c5eb8f59c70f2614269404487a55b845c4a84c306389249515da80a869da9e0 WatchSource:0}: Error finding container 0c5eb8f59c70f2614269404487a55b845c4a84c306389249515da80a869da9e0: Status 404 returned error can't find the container with id 0c5eb8f59c70f2614269404487a55b845c4a84c306389249515da80a869da9e0
Jul 29 20:47:14.288468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:14.288435    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp" event={"ID":"8a86de28-2098-46fe-91ff-35bf70a868b3","Type":"ContainerStarted","Data":"8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271"}
Jul 29 20:47:14.288875 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:14.288490    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp" event={"ID":"8a86de28-2098-46fe-91ff-35bf70a868b3","Type":"ContainerStarted","Data":"0c5eb8f59c70f2614269404487a55b845c4a84c306389249515da80a869da9e0"}
Jul 29 20:47:14.288875 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:14.288521    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 20:47:14.311102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:14.311032    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp" podStartSLOduration=1.311018637 podStartE2EDuration="1.311018637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:47:14.3096501 +0000 UTC m=+1344.161150772" watchObservedRunningTime="2026-07-29 20:47:14.311018637 +0000 UTC m=+1344.162519309"
Jul 29 20:47:25.295872 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:47:25.295823    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 20:49:50.645206 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:49:50.645174    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:49:50.648994 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:49:50.648966    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:54:50.679736 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:54:50.679711    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:54:50.684306 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:54:50.684286    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:55:48.213982 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.213946    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"]
Jul 29 20:55:48.217489 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.217471    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.219918 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.219898    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a64c614d-openshift-default-dockercfg-w8ldk\""
Jul 29 20:55:48.235553 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.235528    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"]
Jul 29 20:55:48.360282 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.360243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-data\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.360468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.360298    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbdsz\" (UniqueName: \"kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-kube-api-access-sbdsz\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.360468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.360338    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfee553d-47ef-4655-9de0-f18495f5450a-istio-podinfo\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.360468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.360362    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-istio-token\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.360468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.360390    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-socket\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.360468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.360410    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-certs\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.360468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.360425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfee553d-47ef-4655-9de0-f18495f5450a-istiod-ca-cert\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.360468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.360445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-envoy\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.360468 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.360465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-credential-socket\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.461236 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.461190    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-data\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.461444 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.461250    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdsz\" (UniqueName: \"kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-kube-api-access-sbdsz\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.461444 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.461272    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfee553d-47ef-4655-9de0-f18495f5450a-istio-podinfo\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.461444 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.461305    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-istio-token\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.461444 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.461337    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-socket\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.461444 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.461354    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-certs\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.461444 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.461436    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfee553d-47ef-4655-9de0-f18495f5450a-istiod-ca-cert\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.461749 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.461492    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-envoy\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.461749 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.461528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-credential-socket\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.461749 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.461666    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-data\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.462041 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.462019    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-socket\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.462104 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.462067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-credential-socket\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.462151 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.462135    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-certs\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.462213 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.462191    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfee553d-47ef-4655-9de0-f18495f5450a-istiod-ca-cert\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.463802 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.463776    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-envoy\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.463802 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.463793    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfee553d-47ef-4655-9de0-f18495f5450a-istio-podinfo\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.469127 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.469074    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-istio-token\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.469262 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.469240    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbdsz\" (UniqueName: \"kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-kube-api-access-sbdsz\") pod \"e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") " pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.527682 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.527642    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:48.671696 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.671669    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"]
Jul 29 20:55:48.674621 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:55:48.674597    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfee553d_47ef_4655_9de0_f18495f5450a.slice/crio-a7562a8c4ab93f762aef69c5ea04ffb4a45953d4bcf15b35c60dc0533c0cf126 WatchSource:0}: Error finding container a7562a8c4ab93f762aef69c5ea04ffb4a45953d4bcf15b35c60dc0533c0cf126: Status 404 returned error can't find the container with id a7562a8c4ab93f762aef69c5ea04ffb4a45953d4bcf15b35c60dc0533c0cf126
Jul 29 20:55:48.676714 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.676682    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:55:48.676791 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.676745    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:55:48.676791 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.676773    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:55:48.957900 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.957861    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" event={"ID":"dfee553d-47ef-4655-9de0-f18495f5450a","Type":"ContainerStarted","Data":"df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c"}
Jul 29 20:55:48.958068 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.957926    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" event={"ID":"dfee553d-47ef-4655-9de0-f18495f5450a","Type":"ContainerStarted","Data":"a7562a8c4ab93f762aef69c5ea04ffb4a45953d4bcf15b35c60dc0533c0cf126"}
Jul 29 20:55:48.977488 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:48.977445    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" podStartSLOduration=0.977428113 podStartE2EDuration="977.428113ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:55:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:55:48.975889261 +0000 UTC m=+1858.827389933" watchObservedRunningTime="2026-07-29 20:55:48.977428113 +0000 UTC m=+1858.828928785"
Jul 29 20:55:49.528274 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:49.528240    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:49.533130 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:49.533108    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:49.964052 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:49.963962    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:49.964865 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:49.964824    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:55:51.230445 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.230410    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"]
Jul 29 20:55:51.234026 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.234011    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:55:51.236387 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.236364    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a64c614d-dockercfg-fw7kk\""
Jul 29 20:55:51.236538 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.236464    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a64c614d\""
Jul 29 20:55:51.237375 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.237350    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"]
Jul 29 20:55:51.240701 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.240678    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:55:51.245475 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.245444    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"]
Jul 29 20:55:51.251692 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.251667    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"]
Jul 29 20:55:51.390221 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.390189    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w878\" (UniqueName: \"kubernetes.io/projected/c5245f20-753a-48be-94ab-c96aec067498-kube-api-access-9w878\") pod \"payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh\" (UID: \"c5245f20-753a-48be-94ab-c96aec067498\") " pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:55:51.390389 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.390229    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r\" (UID: \"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:55:51.390389 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.390257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l925n\" (UniqueName: \"kubernetes.io/projected/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-kube-api-access-l925n\") pod \"payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r\" (UID: \"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:55:51.390389 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.390344    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5245f20-753a-48be-94ab-c96aec067498-plugins-config-volume\") pod \"payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh\" (UID: \"c5245f20-753a-48be-94ab-c96aec067498\") " pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:55:51.491082 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.490999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w878\" (UniqueName: \"kubernetes.io/projected/c5245f20-753a-48be-94ab-c96aec067498-kube-api-access-9w878\") pod \"payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh\" (UID: \"c5245f20-753a-48be-94ab-c96aec067498\") " pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:55:51.491082 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.491032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r\" (UID: \"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:55:51.491082 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.491053    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l925n\" (UniqueName: \"kubernetes.io/projected/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-kube-api-access-l925n\") pod \"payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r\" (UID: \"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:55:51.491340 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.491114    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5245f20-753a-48be-94ab-c96aec067498-plugins-config-volume\") pod \"payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh\" (UID: \"c5245f20-753a-48be-94ab-c96aec067498\") " pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:55:51.491744 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.491725    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5245f20-753a-48be-94ab-c96aec067498-plugins-config-volume\") pod \"payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh\" (UID: \"c5245f20-753a-48be-94ab-c96aec067498\") " pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:55:51.491744 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.491738    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r\" (UID: \"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:55:51.498682 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.498661    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w878\" (UniqueName: \"kubernetes.io/projected/c5245f20-753a-48be-94ab-c96aec067498-kube-api-access-9w878\") pod \"payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh\" (UID: \"c5245f20-753a-48be-94ab-c96aec067498\") " pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:55:51.498868 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.498759    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l925n\" (UniqueName: \"kubernetes.io/projected/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-kube-api-access-l925n\") pod \"payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r\" (UID: \"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:55:51.546484 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.546466    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:55:51.557529 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.557452    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:55:51.699193 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.699164    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"]
Jul 29 20:55:51.701262 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:55:51.701236    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8646c5b1_d9c4_47f7_ad65_b8a8693ffd36.slice/crio-d4a741f0bc27097e29f1dc07d35bf3695b42332c6e58d088f30147653cd8e701 WatchSource:0}: Error finding container d4a741f0bc27097e29f1dc07d35bf3695b42332c6e58d088f30147653cd8e701: Status 404 returned error can't find the container with id d4a741f0bc27097e29f1dc07d35bf3695b42332c6e58d088f30147653cd8e701
Jul 29 20:55:51.932365 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.932337    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"]
Jul 29 20:55:51.935029 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:55:51.935000    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5245f20_753a_48be_94ab_c96aec067498.slice/crio-9bc8c476d19903216a59511749c07e45dd3953de2331571e58515a9636a256bb WatchSource:0}: Error finding container 9bc8c476d19903216a59511749c07e45dd3953de2331571e58515a9636a256bb: Status 404 returned error can't find the container with id 9bc8c476d19903216a59511749c07e45dd3953de2331571e58515a9636a256bb
Jul 29 20:55:51.979544 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.979517    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r" event={"ID":"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36","Type":"ContainerStarted","Data":"9051c440caa4db6424c58a07264d7f396044dc97a130a17e32a41a91439da0f9"}
Jul 29 20:55:51.979623 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.979575    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r" event={"ID":"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36","Type":"ContainerStarted","Data":"d4a741f0bc27097e29f1dc07d35bf3695b42332c6e58d088f30147653cd8e701"}
Jul 29 20:55:51.979821 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.979800    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:55:51.981203 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.981174    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh" event={"ID":"c5245f20-753a-48be-94ab-c96aec067498","Type":"ContainerStarted","Data":"9bc8c476d19903216a59511749c07e45dd3953de2331571e58515a9636a256bb"}
Jul 29 20:55:51.995659 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:51.995590    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r" podStartSLOduration=0.995577022 podStartE2EDuration="995.577022ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:55:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:55:51.994707159 +0000 UTC m=+1861.846207832" watchObservedRunningTime="2026-07-29 20:55:51.995577022 +0000 UTC m=+1861.847077695"
Jul 29 20:55:52.988538 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:52.988500    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh" event={"ID":"c5245f20-753a-48be-94ab-c96aec067498","Type":"ContainerStarted","Data":"1a462f22fc5eb883ec4605c2bd14b601d8e66430270f8ac3931c08433fcaa85f"}
Jul 29 20:55:53.007800 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:53.007754    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh" podStartSLOduration=2.00774019 podStartE2EDuration="2.00774019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:55:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:55:53.006491749 +0000 UTC m=+1862.857992421" watchObservedRunningTime="2026-07-29 20:55:53.00774019 +0000 UTC m=+1862.859240863"
Jul 29 20:55:53.995907 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:55:53.995874    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:56:02.991374 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:02.991338    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:56:04.965976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:04.965942    2557 patch_prober.go:28] interesting pod/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 29 20:56:04.966380 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:04.966004    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 29 20:56:05.003320 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:05.003294    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:56:05.063494 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:05.063464    2557 generic.go:356] "Generic (PLEG): container finished" podID="dfee553d-47ef-4655-9de0-f18495f5450a" containerID="df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c" exitCode=0
Jul 29 20:56:05.063645 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:05.063537    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" event={"ID":"dfee553d-47ef-4655-9de0-f18495f5450a","Type":"ContainerDied","Data":"df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c"}
Jul 29 20:56:05.063948 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:05.063922    2557 scope.go:117] "RemoveContainer" containerID="df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c"
Jul 29 20:56:05.064916 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:05.064888    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:56:05.064986 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:05.064952    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:56:05.065024 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:05.064985    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:56:06.074905 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:06.074872    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" event={"ID":"dfee553d-47ef-4655-9de0-f18495f5450a","Type":"ContainerStarted","Data":"a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad"}
Jul 29 20:56:06.528357 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:06.528315    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:56:06.528630 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:06.528605    2557 patch_prober.go:28] interesting pod/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 29 20:56:06.528738 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:06.528672    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 29 20:56:07.528819 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:07.528784    2557 patch_prober.go:28] interesting pod/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 29 20:56:07.529261 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:07.528858    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 29 20:56:08.528554 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:08.528518    2557 patch_prober.go:28] interesting pod/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 29 20:56:08.528743 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:08.528572    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 29 20:56:09.528870 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:09.528810    2557 patch_prober.go:28] interesting pod/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 29 20:56:09.529261 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:09.528894    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 29 20:56:10.531842 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:10.531802    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:56:10.532203 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:10.532158    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:56:10.532879 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:10.532860    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:56:31.082736 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.082657    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"]
Jul 29 20:56:31.083301 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.082931    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh" podUID="c5245f20-753a-48be-94ab-c96aec067498" containerName="payload-processing" containerID="cri-o://1a462f22fc5eb883ec4605c2bd14b601d8e66430270f8ac3931c08433fcaa85f" gracePeriod=30
Jul 29 20:56:31.090817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.090788    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"]
Jul 29 20:56:31.091040 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.091014    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r" podUID="8646c5b1-d9c4-47f7-ad65-b8a8693ffd36" containerName="payload-pre-processing" containerID="cri-o://9051c440caa4db6424c58a07264d7f396044dc97a130a17e32a41a91439da0f9" gracePeriod=30
Jul 29 20:56:31.215747 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.215714    2557 generic.go:356] "Generic (PLEG): container finished" podID="8646c5b1-d9c4-47f7-ad65-b8a8693ffd36" containerID="9051c440caa4db6424c58a07264d7f396044dc97a130a17e32a41a91439da0f9" exitCode=0
Jul 29 20:56:31.215938 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.215752    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r" event={"ID":"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36","Type":"ContainerDied","Data":"9051c440caa4db6424c58a07264d7f396044dc97a130a17e32a41a91439da0f9"}
Jul 29 20:56:31.217889 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.217863    2557 generic.go:356] "Generic (PLEG): container finished" podID="c5245f20-753a-48be-94ab-c96aec067498" containerID="1a462f22fc5eb883ec4605c2bd14b601d8e66430270f8ac3931c08433fcaa85f" exitCode=0
Jul 29 20:56:31.218014 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.217927    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh" event={"ID":"c5245f20-753a-48be-94ab-c96aec067498","Type":"ContainerDied","Data":"1a462f22fc5eb883ec4605c2bd14b601d8e66430270f8ac3931c08433fcaa85f"}
Jul 29 20:56:31.383123 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.383092    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:56:31.387518 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.387493    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:56:31.413270 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.413245    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"]
Jul 29 20:56:31.413453 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.413430    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy" containerID="cri-o://a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad" gracePeriod=30
Jul 29 20:56:31.447594 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.447561    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l925n\" (UniqueName: \"kubernetes.io/projected/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-kube-api-access-l925n\") pod \"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36\" (UID: \"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36\") "
Jul 29 20:56:31.447751 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.447628    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w878\" (UniqueName: \"kubernetes.io/projected/c5245f20-753a-48be-94ab-c96aec067498-kube-api-access-9w878\") pod \"c5245f20-753a-48be-94ab-c96aec067498\" (UID: \"c5245f20-753a-48be-94ab-c96aec067498\") "
Jul 29 20:56:31.447751 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.447644    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-plugins-config-volume\") pod \"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36\" (UID: \"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36\") "
Jul 29 20:56:31.447751 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.447705    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5245f20-753a-48be-94ab-c96aec067498-plugins-config-volume\") pod \"c5245f20-753a-48be-94ab-c96aec067498\" (UID: \"c5245f20-753a-48be-94ab-c96aec067498\") "
Jul 29 20:56:31.448037 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.448008    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8646c5b1-d9c4-47f7-ad65-b8a8693ffd36" (UID: "8646c5b1-d9c4-47f7-ad65-b8a8693ffd36"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:56:31.448138 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.448091    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5245f20-753a-48be-94ab-c96aec067498-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c5245f20-753a-48be-94ab-c96aec067498" (UID: "c5245f20-753a-48be-94ab-c96aec067498"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:56:31.449745 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.449723    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-kube-api-access-l925n" (OuterVolumeSpecName: "kube-api-access-l925n") pod "8646c5b1-d9c4-47f7-ad65-b8a8693ffd36" (UID: "8646c5b1-d9c4-47f7-ad65-b8a8693ffd36"). InnerVolumeSpecName "kube-api-access-l925n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:56:31.449848 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.449796    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5245f20-753a-48be-94ab-c96aec067498-kube-api-access-9w878" (OuterVolumeSpecName: "kube-api-access-9w878") pod "c5245f20-753a-48be-94ab-c96aec067498" (UID: "c5245f20-753a-48be-94ab-c96aec067498"). InnerVolumeSpecName "kube-api-access-9w878". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:56:31.548706 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.548671    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w878\" (UniqueName: \"kubernetes.io/projected/c5245f20-753a-48be-94ab-c96aec067498-kube-api-access-9w878\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:31.548706 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.548700    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-plugins-config-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:31.548706 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.548710    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5245f20-753a-48be-94ab-c96aec067498-plugins-config-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:31.548982 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:31.548718    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l925n\" (UniqueName: \"kubernetes.io/projected/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36-kube-api-access-l925n\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:32.224601 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.224572    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"
Jul 29 20:56:32.225039 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.224601    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r" event={"ID":"8646c5b1-d9c4-47f7-ad65-b8a8693ffd36","Type":"ContainerDied","Data":"d4a741f0bc27097e29f1dc07d35bf3695b42332c6e58d088f30147653cd8e701"}
Jul 29 20:56:32.225039 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.224673    2557 scope.go:117] "RemoveContainer" containerID="9051c440caa4db6424c58a07264d7f396044dc97a130a17e32a41a91439da0f9"
Jul 29 20:56:32.226037 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.226017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh" event={"ID":"c5245f20-753a-48be-94ab-c96aec067498","Type":"ContainerDied","Data":"9bc8c476d19903216a59511749c07e45dd3953de2331571e58515a9636a256bb"}
Jul 29 20:56:32.226111 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.226058    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"
Jul 29 20:56:32.235380 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.235359    2557 scope.go:117] "RemoveContainer" containerID="1a462f22fc5eb883ec4605c2bd14b601d8e66430270f8ac3931c08433fcaa85f"
Jul 29 20:56:32.247534 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.247514    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"]
Jul 29 20:56:32.251434 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.251413    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a64c614d-5f7b76657b-wkk5r"]
Jul 29 20:56:32.261851 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.261815    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"]
Jul 29 20:56:32.265691 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.265671    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a64c614d-58cd5ccfd-tkmgh"]
Jul 29 20:56:32.622549 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.622519    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8646c5b1-d9c4-47f7-ad65-b8a8693ffd36" path="/var/lib/kubelet/pods/8646c5b1-d9c4-47f7-ad65-b8a8693ffd36/volumes"
Jul 29 20:56:32.622915 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.622901    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5245f20-753a-48be-94ab-c96aec067498" path="/var/lib/kubelet/pods/c5245f20-753a-48be-94ab-c96aec067498/volumes"
Jul 29 20:56:32.623153 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.623142    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"]
Jul 29 20:56:32.623481 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.623471    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5245f20-753a-48be-94ab-c96aec067498" containerName="payload-processing"
Jul 29 20:56:32.623516 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.623483    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5245f20-753a-48be-94ab-c96aec067498" containerName="payload-processing"
Jul 29 20:56:32.623516 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.623496    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8646c5b1-d9c4-47f7-ad65-b8a8693ffd36" containerName="payload-pre-processing"
Jul 29 20:56:32.623516 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.623501    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8646c5b1-d9c4-47f7-ad65-b8a8693ffd36" containerName="payload-pre-processing"
Jul 29 20:56:32.623615 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.623563    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5245f20-753a-48be-94ab-c96aec067498" containerName="payload-processing"
Jul 29 20:56:32.623615 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.623571    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8646c5b1-d9c4-47f7-ad65-b8a8693ffd36" containerName="payload-pre-processing"
Jul 29 20:56:32.626379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.626358    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.629185 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.629162    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-eba524b8-gw-openshift-default-dockercfg-ssjlz\""
Jul 29 20:56:32.633437 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.633416    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"]
Jul 29 20:56:32.759047 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.759015    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-envoy\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.759218 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.759074    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-credential-socket\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.759218 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.759178    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-token\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.759218 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.759210    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppqql\" (UniqueName: \"kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-kube-api-access-ppqql\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.759328 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.759232    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-certs\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.759328 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.759247    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-podinfo\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.759328 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.759277    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-socket\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.759328 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.759294    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-data\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.759328 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.759319    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istiod-ca-cert\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.860504 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.860475    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-token\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.860504 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.860507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppqql\" (UniqueName: \"kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-kube-api-access-ppqql\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.860711 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.860527    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-certs\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.860711 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.860553    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-podinfo\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.860711 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.860571    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-socket\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.860711 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.860585    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-data\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.860711 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.860609    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istiod-ca-cert\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.860711 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.860633    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-envoy\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.861055 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.860913    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-credential-socket\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.861055 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.860975    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-socket\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.861055 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.861039    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-certs\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.861164 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.861076    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-data\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.861231 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.861214    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-credential-socket\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.861576 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.861559    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istiod-ca-cert\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.863065 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.863046    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-envoy\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.863206 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.863187    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-podinfo\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.868348 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.868325    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppqql\" (UniqueName: \"kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-kube-api-access-ppqql\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.868460 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.868373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-token\") pod \"e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") " pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:32.938977 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:32.938918    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:33.087648 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:33.087604    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"]
Jul 29 20:56:33.093328 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:56:33.093300    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07beb8f3_b050_403f_87c5_9eda4b21bf9b.slice/crio-a0c64c21090888c18e6581690e5dec0c5894bf9e9521c5380c964b89a01c10c5 WatchSource:0}: Error finding container a0c64c21090888c18e6581690e5dec0c5894bf9e9521c5380c964b89a01c10c5: Status 404 returned error can't find the container with id a0c64c21090888c18e6581690e5dec0c5894bf9e9521c5380c964b89a01c10c5
Jul 29 20:56:33.095446 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:33.095417    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:56:33.095508 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:33.095495    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:56:33.095548 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:33.095521    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:56:33.235545 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:33.235441    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" event={"ID":"07beb8f3-b050-403f-87c5-9eda4b21bf9b","Type":"ContainerStarted","Data":"c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b"}
Jul 29 20:56:33.235545 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:33.235514    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" event={"ID":"07beb8f3-b050-403f-87c5-9eda4b21bf9b","Type":"ContainerStarted","Data":"a0c64c21090888c18e6581690e5dec0c5894bf9e9521c5380c964b89a01c10c5"}
Jul 29 20:56:33.258215 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:33.258154    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" podStartSLOduration=1.258132827 podStartE2EDuration="1.258132827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:56:33.255651434 +0000 UTC m=+1903.107152107" watchObservedRunningTime="2026-07-29 20:56:33.258132827 +0000 UTC m=+1903.109633500"
Jul 29 20:56:33.939732 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:33.939700    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:34.948144 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:34.948105    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:35.246533 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.246451    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:35.247476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.247455    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:35.625206 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.625172    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"]
Jul 29 20:56:35.627941 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.627922    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:56:35.631663 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.631642    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-eba524b8-dockercfg-bvn5d\""
Jul 29 20:56:35.632262 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.632245    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-eba524b8\""
Jul 29 20:56:35.643956 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.643935    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"]
Jul 29 20:56:35.656973 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.656950    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"]
Jul 29 20:56:35.664687 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.664663    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:56:35.673395 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.673375    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"]
Jul 29 20:56:35.685341 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.685314    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c7e234-0292-404e-bcc8-bc1301eb6344-plugins-config-volume\") pod \"payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62\" (UID: \"05c7e234-0292-404e-bcc8-bc1301eb6344\") " pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:56:35.686100 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.685449    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr8dl\" (UniqueName: \"kubernetes.io/projected/05c7e234-0292-404e-bcc8-bc1301eb6344-kube-api-access-jr8dl\") pod \"payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62\" (UID: \"05c7e234-0292-404e-bcc8-bc1301eb6344\") " pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:56:35.786770 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.786731    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c7e234-0292-404e-bcc8-bc1301eb6344-plugins-config-volume\") pod \"payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62\" (UID: \"05c7e234-0292-404e-bcc8-bc1301eb6344\") " pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:56:35.786949 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.786787    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx56n\" (UniqueName: \"kubernetes.io/projected/43713823-f6ef-4ed0-81f1-7ae6c1576999-kube-api-access-sx56n\") pod \"payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8\" (UID: \"43713823-f6ef-4ed0-81f1-7ae6c1576999\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:56:35.786949 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.786821    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8dl\" (UniqueName: \"kubernetes.io/projected/05c7e234-0292-404e-bcc8-bc1301eb6344-kube-api-access-jr8dl\") pod \"payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62\" (UID: \"05c7e234-0292-404e-bcc8-bc1301eb6344\") " pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:56:35.786949 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.786924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43713823-f6ef-4ed0-81f1-7ae6c1576999-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8\" (UID: \"43713823-f6ef-4ed0-81f1-7ae6c1576999\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:56:35.787524 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.787504    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c7e234-0292-404e-bcc8-bc1301eb6344-plugins-config-volume\") pod \"payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62\" (UID: \"05c7e234-0292-404e-bcc8-bc1301eb6344\") " pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:56:35.794976 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.794948    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr8dl\" (UniqueName: \"kubernetes.io/projected/05c7e234-0292-404e-bcc8-bc1301eb6344-kube-api-access-jr8dl\") pod \"payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62\" (UID: \"05c7e234-0292-404e-bcc8-bc1301eb6344\") " pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:56:35.888205 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.888124    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx56n\" (UniqueName: \"kubernetes.io/projected/43713823-f6ef-4ed0-81f1-7ae6c1576999-kube-api-access-sx56n\") pod \"payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8\" (UID: \"43713823-f6ef-4ed0-81f1-7ae6c1576999\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:56:35.888343 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.888243    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43713823-f6ef-4ed0-81f1-7ae6c1576999-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8\" (UID: \"43713823-f6ef-4ed0-81f1-7ae6c1576999\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:56:35.888992 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.888974    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43713823-f6ef-4ed0-81f1-7ae6c1576999-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8\" (UID: \"43713823-f6ef-4ed0-81f1-7ae6c1576999\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:56:35.897364 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.897344    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx56n\" (UniqueName: \"kubernetes.io/projected/43713823-f6ef-4ed0-81f1-7ae6c1576999-kube-api-access-sx56n\") pod \"payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8\" (UID: \"43713823-f6ef-4ed0-81f1-7ae6c1576999\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:56:35.938624 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.938599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:56:35.978549 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:35.978450    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:56:36.084055 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.084005    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"]
Jul 29 20:56:36.084825 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:56:36.084795    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c7e234_0292_404e_bcc8_bc1301eb6344.slice/crio-bcc568a210d54aebf80a4be34ea224852d5b7c5ae8b8d179cd26c7e45ab093e8 WatchSource:0}: Error finding container bcc568a210d54aebf80a4be34ea224852d5b7c5ae8b8d179cd26c7e45ab093e8: Status 404 returned error can't find the container with id bcc568a210d54aebf80a4be34ea224852d5b7c5ae8b8d179cd26c7e45ab093e8
Jul 29 20:56:36.138309 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.138259    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"]
Jul 29 20:56:36.140031 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:56:36.140004    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43713823_f6ef_4ed0_81f1_7ae6c1576999.slice/crio-7e80180a4bdc8a3ba6c367b0972c975cfac01f26fd886e2976e6eaa7dac28209 WatchSource:0}: Error finding container 7e80180a4bdc8a3ba6c367b0972c975cfac01f26fd886e2976e6eaa7dac28209: Status 404 returned error can't find the container with id 7e80180a4bdc8a3ba6c367b0972c975cfac01f26fd886e2976e6eaa7dac28209
Jul 29 20:56:36.253630 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.253592    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8" event={"ID":"43713823-f6ef-4ed0-81f1-7ae6c1576999","Type":"ContainerStarted","Data":"a25ddcd9b4dd3c6b28e82962e5b042b120a6f20b7ff88b6ed6f4c492bebba88c"}
Jul 29 20:56:36.253770 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.253656    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:56:36.253770 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.253682    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8" event={"ID":"43713823-f6ef-4ed0-81f1-7ae6c1576999","Type":"ContainerStarted","Data":"7e80180a4bdc8a3ba6c367b0972c975cfac01f26fd886e2976e6eaa7dac28209"}
Jul 29 20:56:36.255146 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.255118    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62" event={"ID":"05c7e234-0292-404e-bcc8-bc1301eb6344","Type":"ContainerStarted","Data":"c3e9da52252c349c14494e6c49b41bcc082152cf0e150034d75ebd68c6e52c3d"}
Jul 29 20:56:36.255244 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.255164    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62" event={"ID":"05c7e234-0292-404e-bcc8-bc1301eb6344","Type":"ContainerStarted","Data":"bcc568a210d54aebf80a4be34ea224852d5b7c5ae8b8d179cd26c7e45ab093e8"}
Jul 29 20:56:36.255244 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.255213    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:56:36.274197 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.274131    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8" podStartSLOduration=1.274113933 podStartE2EDuration="1.274113933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:56:36.273981989 +0000 UTC m=+1906.125482663" watchObservedRunningTime="2026-07-29 20:56:36.274113933 +0000 UTC m=+1906.125614607"
Jul 29 20:56:36.293788 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.293735    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62" podStartSLOduration=1.2937204580000001 podStartE2EDuration="1.293720458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:56:36.291011708 +0000 UTC m=+1906.142512395" watchObservedRunningTime="2026-07-29 20:56:36.293720458 +0000 UTC m=+1906.145221132"
Jul 29 20:56:36.653491 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.653466    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:56:36.802142 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802110    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-socket\") pod \"dfee553d-47ef-4655-9de0-f18495f5450a\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") "
Jul 29 20:56:36.802324 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802167    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-envoy\") pod \"dfee553d-47ef-4655-9de0-f18495f5450a\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") "
Jul 29 20:56:36.802324 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802210    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-data\") pod \"dfee553d-47ef-4655-9de0-f18495f5450a\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") "
Jul 29 20:56:36.802324 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802247    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfee553d-47ef-4655-9de0-f18495f5450a-istio-podinfo\") pod \"dfee553d-47ef-4655-9de0-f18495f5450a\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") "
Jul 29 20:56:36.802324 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802277    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfee553d-47ef-4655-9de0-f18495f5450a-istiod-ca-cert\") pod \"dfee553d-47ef-4655-9de0-f18495f5450a\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") "
Jul 29 20:56:36.802324 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802304    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-credential-socket\") pod \"dfee553d-47ef-4655-9de0-f18495f5450a\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") "
Jul 29 20:56:36.802568 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802355    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbdsz\" (UniqueName: \"kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-kube-api-access-sbdsz\") pod \"dfee553d-47ef-4655-9de0-f18495f5450a\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") "
Jul 29 20:56:36.802568 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802378    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-istio-token\") pod \"dfee553d-47ef-4655-9de0-f18495f5450a\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") "
Jul 29 20:56:36.802568 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802404    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-certs\") pod \"dfee553d-47ef-4655-9de0-f18495f5450a\" (UID: \"dfee553d-47ef-4655-9de0-f18495f5450a\") "
Jul 29 20:56:36.802568 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802401    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfee553d-47ef-4655-9de0-f18495f5450a" (UID: "dfee553d-47ef-4655-9de0-f18495f5450a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:56:36.802755 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802589    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfee553d-47ef-4655-9de0-f18495f5450a" (UID: "dfee553d-47ef-4655-9de0-f18495f5450a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:56:36.802808 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802746    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfee553d-47ef-4655-9de0-f18495f5450a" (UID: "dfee553d-47ef-4655-9de0-f18495f5450a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:56:36.802902 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802802    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:36.802902 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.802822    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:36.803096 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.803069    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfee553d-47ef-4655-9de0-f18495f5450a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfee553d-47ef-4655-9de0-f18495f5450a" (UID: "dfee553d-47ef-4655-9de0-f18495f5450a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:56:36.803196 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.803142    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfee553d-47ef-4655-9de0-f18495f5450a" (UID: "dfee553d-47ef-4655-9de0-f18495f5450a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:56:36.804513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.804489    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfee553d-47ef-4655-9de0-f18495f5450a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfee553d-47ef-4655-9de0-f18495f5450a" (UID: "dfee553d-47ef-4655-9de0-f18495f5450a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:56:36.804661 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.804642    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfee553d-47ef-4655-9de0-f18495f5450a" (UID: "dfee553d-47ef-4655-9de0-f18495f5450a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:56:36.805029 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.804890    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfee553d-47ef-4655-9de0-f18495f5450a" (UID: "dfee553d-47ef-4655-9de0-f18495f5450a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:56:36.805029 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.804968    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-kube-api-access-sbdsz" (OuterVolumeSpecName: "kube-api-access-sbdsz") pod "dfee553d-47ef-4655-9de0-f18495f5450a" (UID: "dfee553d-47ef-4655-9de0-f18495f5450a"). InnerVolumeSpecName "kube-api-access-sbdsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:56:36.904131 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.904100    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:36.904131 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.904132    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfee553d-47ef-4655-9de0-f18495f5450a-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:36.904131 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.904144    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfee553d-47ef-4655-9de0-f18495f5450a-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:36.904358 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.904152    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:36.904358 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.904161    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbdsz\" (UniqueName: \"kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-kube-api-access-sbdsz\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:36.904358 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.904171    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfee553d-47ef-4655-9de0-f18495f5450a-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:36.904358 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:36.904179    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfee553d-47ef-4655-9de0-f18495f5450a-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:56:37.262163 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.262128    2557 generic.go:356] "Generic (PLEG): container finished" podID="dfee553d-47ef-4655-9de0-f18495f5450a" containerID="a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad" exitCode=0
Jul 29 20:56:37.262621 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.262197    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"
Jul 29 20:56:37.262621 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.262217    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" event={"ID":"dfee553d-47ef-4655-9de0-f18495f5450a","Type":"ContainerDied","Data":"a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad"}
Jul 29 20:56:37.262621 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.262274    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm" event={"ID":"dfee553d-47ef-4655-9de0-f18495f5450a","Type":"ContainerDied","Data":"a7562a8c4ab93f762aef69c5ea04ffb4a45953d4bcf15b35c60dc0533c0cf126"}
Jul 29 20:56:37.263305 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.262307    2557 scope.go:117] "RemoveContainer" containerID="a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad"
Jul 29 20:56:37.273364 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.273340    2557 scope.go:117] "RemoveContainer" containerID="df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c"
Jul 29 20:56:37.282050 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.282034    2557 scope.go:117] "RemoveContainer" containerID="a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad"
Jul 29 20:56:37.282294 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:56:37.282273    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad\": container with ID starting with a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad not found: ID does not exist" containerID="a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad"
Jul 29 20:56:37.282370 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.282303    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad"} err="failed to get container status \"a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad\": rpc error: code = NotFound desc = could not find container \"a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad\": container with ID starting with a8ae10abc788ec26d194be8a580d200188d1450824bc71b26f396de4b1d4f2ad not found: ID does not exist"
Jul 29 20:56:37.282370 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.282325    2557 scope.go:117] "RemoveContainer" containerID="df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c"
Jul 29 20:56:37.282619 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:56:37.282592    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c\": container with ID starting with df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c not found: ID does not exist" containerID="df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c"
Jul 29 20:56:37.282722 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.282627    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c"} err="failed to get container status \"df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c\": rpc error: code = NotFound desc = could not find container \"df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c\": container with ID starting with df7655b8569ad5cdaa90bf85cc93837a2bcd9ae44cff9fe14527d7c907f8034c not found: ID does not exist"
Jul 29 20:56:37.286444 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.286421    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"]
Jul 29 20:56:37.289761 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:37.289737    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a64c614d-openshift-default-57d489468b-x8tnm"]
Jul 29 20:56:38.622617 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:38.622587    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" path="/var/lib/kubelet/pods/dfee553d-47ef-4655-9de0-f18495f5450a/volumes"
Jul 29 20:56:47.264900 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:47.264865    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:56:47.265330 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:47.264955    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:56:49.336415 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:49.336386    2557 generic.go:356] "Generic (PLEG): container finished" podID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerID="c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b" exitCode=0
Jul 29 20:56:49.336787 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:49.336461    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" event={"ID":"07beb8f3-b050-403f-87c5-9eda4b21bf9b","Type":"ContainerDied","Data":"c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b"}
Jul 29 20:56:49.336875 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:49.336860    2557 scope.go:117] "RemoveContainer" containerID="c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b"
Jul 29 20:56:49.337969 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:49.337938    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:56:49.338041 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:49.338023    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:56:49.338088 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:49.338074    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:56:50.247441 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:50.247409    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:50.343232 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:50.343201    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" event={"ID":"07beb8f3-b050-403f-87c5-9eda4b21bf9b","Type":"ContainerStarted","Data":"97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d"}
Jul 29 20:56:50.939644 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:50.939598    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:50.940733 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:50.940710    2557 patch_prober.go:28] interesting pod/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 29 20:56:50.940797 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:50.940762    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 29 20:56:51.939491 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:51.939457    2557 patch_prober.go:28] interesting pod/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 29 20:56:51.939902 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:51.939528    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 29 20:56:52.939479 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:52.939445    2557 patch_prober.go:28] interesting pod/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 29 20:56:52.939660 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:52.939499    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 29 20:56:53.939921 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:53.939886    2557 patch_prober.go:28] interesting pod/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 29 20:56:53.940303 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:53.939954    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 29 20:56:54.943622 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:54.943589    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:54.944034 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:54.943948    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:56:54.944576 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:56:54.944557    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:57:06.282443 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.281081    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"]
Jul 29 20:57:06.282443 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.281360    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62" podUID="05c7e234-0292-404e-bcc8-bc1301eb6344" containerName="payload-processing" containerID="cri-o://c3e9da52252c349c14494e6c49b41bcc082152cf0e150034d75ebd68c6e52c3d" gracePeriod=30
Jul 29 20:57:06.285820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.284975    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"]
Jul 29 20:57:06.285820 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.285219    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8" podUID="43713823-f6ef-4ed0-81f1-7ae6c1576999" containerName="payload-pre-processing" containerID="cri-o://a25ddcd9b4dd3c6b28e82962e5b042b120a6f20b7ff88b6ed6f4c492bebba88c" gracePeriod=30
Jul 29 20:57:06.434265 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.434168    2557 generic.go:356] "Generic (PLEG): container finished" podID="43713823-f6ef-4ed0-81f1-7ae6c1576999" containerID="a25ddcd9b4dd3c6b28e82962e5b042b120a6f20b7ff88b6ed6f4c492bebba88c" exitCode=0
Jul 29 20:57:06.434265 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.434262    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8" event={"ID":"43713823-f6ef-4ed0-81f1-7ae6c1576999","Type":"ContainerDied","Data":"a25ddcd9b4dd3c6b28e82962e5b042b120a6f20b7ff88b6ed6f4c492bebba88c"}
Jul 29 20:57:06.436103 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.436075    2557 generic.go:356] "Generic (PLEG): container finished" podID="05c7e234-0292-404e-bcc8-bc1301eb6344" containerID="c3e9da52252c349c14494e6c49b41bcc082152cf0e150034d75ebd68c6e52c3d" exitCode=0
Jul 29 20:57:06.436225 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.436111    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62" event={"ID":"05c7e234-0292-404e-bcc8-bc1301eb6344","Type":"ContainerDied","Data":"c3e9da52252c349c14494e6c49b41bcc082152cf0e150034d75ebd68c6e52c3d"}
Jul 29 20:57:06.544506 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.544452    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:57:06.576553 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.576526    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c7e234-0292-404e-bcc8-bc1301eb6344-plugins-config-volume\") pod \"05c7e234-0292-404e-bcc8-bc1301eb6344\" (UID: \"05c7e234-0292-404e-bcc8-bc1301eb6344\") "
Jul 29 20:57:06.576676 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.576661    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr8dl\" (UniqueName: \"kubernetes.io/projected/05c7e234-0292-404e-bcc8-bc1301eb6344-kube-api-access-jr8dl\") pod \"05c7e234-0292-404e-bcc8-bc1301eb6344\" (UID: \"05c7e234-0292-404e-bcc8-bc1301eb6344\") "
Jul 29 20:57:06.576961 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.576936    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c7e234-0292-404e-bcc8-bc1301eb6344-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05c7e234-0292-404e-bcc8-bc1301eb6344" (UID: "05c7e234-0292-404e-bcc8-bc1301eb6344"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:57:06.577844 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.577816    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:57:06.578688 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.578666    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c7e234-0292-404e-bcc8-bc1301eb6344-kube-api-access-jr8dl" (OuterVolumeSpecName: "kube-api-access-jr8dl") pod "05c7e234-0292-404e-bcc8-bc1301eb6344" (UID: "05c7e234-0292-404e-bcc8-bc1301eb6344"). InnerVolumeSpecName "kube-api-access-jr8dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:57:06.607319 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.607295    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"]
Jul 29 20:57:06.607525 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.607502    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy" containerID="cri-o://97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d" gracePeriod=30
Jul 29 20:57:06.677853 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.677797    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx56n\" (UniqueName: \"kubernetes.io/projected/43713823-f6ef-4ed0-81f1-7ae6c1576999-kube-api-access-sx56n\") pod \"43713823-f6ef-4ed0-81f1-7ae6c1576999\" (UID: \"43713823-f6ef-4ed0-81f1-7ae6c1576999\") "
Jul 29 20:57:06.677995 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.677906    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43713823-f6ef-4ed0-81f1-7ae6c1576999-plugins-config-volume\") pod \"43713823-f6ef-4ed0-81f1-7ae6c1576999\" (UID: \"43713823-f6ef-4ed0-81f1-7ae6c1576999\") "
Jul 29 20:57:06.678195 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.678179    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr8dl\" (UniqueName: \"kubernetes.io/projected/05c7e234-0292-404e-bcc8-bc1301eb6344-kube-api-access-jr8dl\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:06.678265 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.678188    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43713823-f6ef-4ed0-81f1-7ae6c1576999-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "43713823-f6ef-4ed0-81f1-7ae6c1576999" (UID: "43713823-f6ef-4ed0-81f1-7ae6c1576999"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:57:06.678265 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.678201    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c7e234-0292-404e-bcc8-bc1301eb6344-plugins-config-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:06.679678 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.679658    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43713823-f6ef-4ed0-81f1-7ae6c1576999-kube-api-access-sx56n" (OuterVolumeSpecName: "kube-api-access-sx56n") pod "43713823-f6ef-4ed0-81f1-7ae6c1576999" (UID: "43713823-f6ef-4ed0-81f1-7ae6c1576999"). InnerVolumeSpecName "kube-api-access-sx56n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:57:06.779388 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.779352    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx56n\" (UniqueName: \"kubernetes.io/projected/43713823-f6ef-4ed0-81f1-7ae6c1576999-kube-api-access-sx56n\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:06.779388 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:06.779381    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43713823-f6ef-4ed0-81f1-7ae6c1576999-plugins-config-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:07.443437 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.443411    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"
Jul 29 20:57:07.443859 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.443442    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62" event={"ID":"05c7e234-0292-404e-bcc8-bc1301eb6344","Type":"ContainerDied","Data":"bcc568a210d54aebf80a4be34ea224852d5b7c5ae8b8d179cd26c7e45ab093e8"}
Jul 29 20:57:07.443859 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.443501    2557 scope.go:117] "RemoveContainer" containerID="c3e9da52252c349c14494e6c49b41bcc082152cf0e150034d75ebd68c6e52c3d"
Jul 29 20:57:07.444891 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.444863    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8" event={"ID":"43713823-f6ef-4ed0-81f1-7ae6c1576999","Type":"ContainerDied","Data":"7e80180a4bdc8a3ba6c367b0972c975cfac01f26fd886e2976e6eaa7dac28209"}
Jul 29 20:57:07.444996 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.444876    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"
Jul 29 20:57:07.453696 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.453677    2557 scope.go:117] "RemoveContainer" containerID="a25ddcd9b4dd3c6b28e82962e5b042b120a6f20b7ff88b6ed6f4c492bebba88c"
Jul 29 20:57:07.463508 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.463486    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"]
Jul 29 20:57:07.470739 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.470716    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-eba524b8-d5dd6b6fc-sgn62"]
Jul 29 20:57:07.490081 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.490059    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"]
Jul 29 20:57:07.494415 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.494394    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-eba524b8-84cfbd69d4-l25d8"]
Jul 29 20:57:07.551945 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.551889    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"]
Jul 29 20:57:07.552293 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552278    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy"
Jul 29 20:57:07.552379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552294    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy"
Jul 29 20:57:07.552379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552305    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c7e234-0292-404e-bcc8-bc1301eb6344" containerName="payload-processing"
Jul 29 20:57:07.552379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552313    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c7e234-0292-404e-bcc8-bc1301eb6344" containerName="payload-processing"
Jul 29 20:57:07.552379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552325    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy"
Jul 29 20:57:07.552379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552330    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy"
Jul 29 20:57:07.552379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552350    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43713823-f6ef-4ed0-81f1-7ae6c1576999" containerName="payload-pre-processing"
Jul 29 20:57:07.552379 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552369    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="43713823-f6ef-4ed0-81f1-7ae6c1576999" containerName="payload-pre-processing"
Jul 29 20:57:07.552598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552448    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="05c7e234-0292-404e-bcc8-bc1301eb6344" containerName="payload-processing"
Jul 29 20:57:07.552598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552456    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy"
Jul 29 20:57:07.552598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552463    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfee553d-47ef-4655-9de0-f18495f5450a" containerName="istio-proxy"
Jul 29 20:57:07.552598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.552473    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="43713823-f6ef-4ed0-81f1-7ae6c1576999" containerName="payload-pre-processing"
Jul 29 20:57:07.555466 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.555451    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.562900 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.559069    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7cdd0d7d-openshift-default-dockercfg-wbt5c\""
Jul 29 20:57:07.570181 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.570157    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"]
Jul 29 20:57:07.585346 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.585311    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istiod-ca-cert\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.585460 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.585365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-credential-socket\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.585460 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.585414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-certs\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.585460 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.585444    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg4sp\" (UniqueName: \"kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-kube-api-access-qg4sp\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.585636 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.585504    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-data\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.585636 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.585530    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-envoy\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.585636 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.585556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-token\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.585636 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.585604    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-socket\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.585636 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.585630    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-podinfo\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686259 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-credential-socket\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686259 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686259    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-certs\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686451 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686278    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg4sp\" (UniqueName: \"kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-kube-api-access-qg4sp\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686451 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-data\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686539 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686462    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-envoy\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686539 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686497    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-token\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686613 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-socket\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686613 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686599    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-podinfo\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686702 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686659    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-credential-socket\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686758 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istiod-ca-cert\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686758 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686741    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-data\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.686890 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.686790    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-certs\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.687043 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.687014    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-socket\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.687356 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.687335    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istiod-ca-cert\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.688944 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.688917    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-envoy\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.689055 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.689006    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-podinfo\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.694873 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.694807    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg4sp\" (UniqueName: \"kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-kube-api-access-qg4sp\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.694873 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.694822    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-token\") pod \"e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") " pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:07.871668 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:07.871601    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:08.006718 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:08.006694    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"]
Jul 29 20:57:08.008197 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:57:08.008176    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bfaa611_b4f2_4d8e_8800_5735767c1bcc.slice/crio-5c2a105d10ad7d87f1275d1c037ff6a08dd77c91ab3bd4a91d7b27c606c8e6ef WatchSource:0}: Error finding container 5c2a105d10ad7d87f1275d1c037ff6a08dd77c91ab3bd4a91d7b27c606c8e6ef: Status 404 returned error can't find the container with id 5c2a105d10ad7d87f1275d1c037ff6a08dd77c91ab3bd4a91d7b27c606c8e6ef
Jul 29 20:57:08.010327 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:08.010294    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:08.010424 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:08.010374    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:08.010491 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:08.010423    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:08.453299 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:08.453257    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" event={"ID":"0bfaa611-b4f2-4d8e-8800-5735767c1bcc","Type":"ContainerStarted","Data":"3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b"}
Jul 29 20:57:08.453773 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:08.453326    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" event={"ID":"0bfaa611-b4f2-4d8e-8800-5735767c1bcc","Type":"ContainerStarted","Data":"5c2a105d10ad7d87f1275d1c037ff6a08dd77c91ab3bd4a91d7b27c606c8e6ef"}
Jul 29 20:57:08.477464 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:08.477413    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" podStartSLOduration=1.477398202 podStartE2EDuration="1.477398202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:57:08.475427261 +0000 UTC m=+1938.326927934" watchObservedRunningTime="2026-07-29 20:57:08.477398202 +0000 UTC m=+1938.328898874"
Jul 29 20:57:08.623017 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:08.622986    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05c7e234-0292-404e-bcc8-bc1301eb6344" path="/var/lib/kubelet/pods/05c7e234-0292-404e-bcc8-bc1301eb6344/volumes"
Jul 29 20:57:08.623364 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:08.623350    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43713823-f6ef-4ed0-81f1-7ae6c1576999" path="/var/lib/kubelet/pods/43713823-f6ef-4ed0-81f1-7ae6c1576999/volumes"
Jul 29 20:57:08.872578 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:08.872547    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:09.878673 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:09.878640    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:09.946349 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:09.946319    2557 patch_prober.go:28] interesting pod/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 29 20:57:09.946473 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:09.946371    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 20:57:10.465236 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.465208    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:10.466067 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.466049    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:10.731539 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.731465    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"]
Jul 29 20:57:10.734740 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.734720    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:10.737625 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.737604    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-7cdd0d7d-dockercfg-2n9kw\""
Jul 29 20:57:10.737759 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.737671    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-7cdd0d7d\""
Jul 29 20:57:10.745462 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.745438    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"]
Jul 29 20:57:10.756815 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.756794    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"]
Jul 29 20:57:10.759344 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.759322    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:10.777189 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.777088    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"]
Jul 29 20:57:10.813851 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.813802    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvtwc\" (UniqueName: \"kubernetes.io/projected/6c81a749-eb95-4095-bfb0-a96357086cb8-kube-api-access-vvtwc\") pod \"payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg\" (UID: \"6c81a749-eb95-4095-bfb0-a96357086cb8\") " pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:10.813947 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.813860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b576cef-5eb5-493a-aca4-cd6673dbcca5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b\" (UID: \"5b576cef-5eb5-493a-aca4-cd6673dbcca5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:10.813998 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.813949    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr889\" (UniqueName: \"kubernetes.io/projected/5b576cef-5eb5-493a-aca4-cd6673dbcca5-kube-api-access-kr889\") pod \"payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b\" (UID: \"5b576cef-5eb5-493a-aca4-cd6673dbcca5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:10.814036 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.814029    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c81a749-eb95-4095-bfb0-a96357086cb8-plugins-config-volume\") pod \"payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg\" (UID: \"6c81a749-eb95-4095-bfb0-a96357086cb8\") " pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:10.915319 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.915281    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvtwc\" (UniqueName: \"kubernetes.io/projected/6c81a749-eb95-4095-bfb0-a96357086cb8-kube-api-access-vvtwc\") pod \"payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg\" (UID: \"6c81a749-eb95-4095-bfb0-a96357086cb8\") " pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:10.915319 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.915318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b576cef-5eb5-493a-aca4-cd6673dbcca5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b\" (UID: \"5b576cef-5eb5-493a-aca4-cd6673dbcca5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:10.916167 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.915467    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr889\" (UniqueName: \"kubernetes.io/projected/5b576cef-5eb5-493a-aca4-cd6673dbcca5-kube-api-access-kr889\") pod \"payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b\" (UID: \"5b576cef-5eb5-493a-aca4-cd6673dbcca5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:10.916167 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.915580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c81a749-eb95-4095-bfb0-a96357086cb8-plugins-config-volume\") pod \"payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg\" (UID: \"6c81a749-eb95-4095-bfb0-a96357086cb8\") " pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:10.916319 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.916283    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b576cef-5eb5-493a-aca4-cd6673dbcca5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b\" (UID: \"5b576cef-5eb5-493a-aca4-cd6673dbcca5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:10.916493 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.916473    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c81a749-eb95-4095-bfb0-a96357086cb8-plugins-config-volume\") pod \"payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg\" (UID: \"6c81a749-eb95-4095-bfb0-a96357086cb8\") " pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:10.923476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.923453    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvtwc\" (UniqueName: \"kubernetes.io/projected/6c81a749-eb95-4095-bfb0-a96357086cb8-kube-api-access-vvtwc\") pod \"payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg\" (UID: \"6c81a749-eb95-4095-bfb0-a96357086cb8\") " pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:10.923567 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:10.923549    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr889\" (UniqueName: \"kubernetes.io/projected/5b576cef-5eb5-493a-aca4-cd6673dbcca5-kube-api-access-kr889\") pod \"payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b\" (UID: \"5b576cef-5eb5-493a-aca4-cd6673dbcca5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:11.046493 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.046467    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:11.073780 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.073747    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:11.207335 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.207310    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"]
Jul 29 20:57:11.209985 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:57:11.209960    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b576cef_5eb5_493a_aca4_cd6673dbcca5.slice/crio-48cdb7a25d5537692bbfe320a7ce782e5f1d005ac63bf83ee51ae173bd902127 WatchSource:0}: Error finding container 48cdb7a25d5537692bbfe320a7ce782e5f1d005ac63bf83ee51ae173bd902127: Status 404 returned error can't find the container with id 48cdb7a25d5537692bbfe320a7ce782e5f1d005ac63bf83ee51ae173bd902127
Jul 29 20:57:11.433439 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.433417    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"]
Jul 29 20:57:11.434797 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:57:11.434761    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c81a749_eb95_4095_bfb0_a96357086cb8.slice/crio-35e4df9355ff0e0eb112ec9dff965e7d98f4fe123c4818e352cb90593aa5fb9a WatchSource:0}: Error finding container 35e4df9355ff0e0eb112ec9dff965e7d98f4fe123c4818e352cb90593aa5fb9a: Status 404 returned error can't find the container with id 35e4df9355ff0e0eb112ec9dff965e7d98f4fe123c4818e352cb90593aa5fb9a
Jul 29 20:57:11.473707 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.473680    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg" event={"ID":"6c81a749-eb95-4095-bfb0-a96357086cb8","Type":"ContainerStarted","Data":"35e4df9355ff0e0eb112ec9dff965e7d98f4fe123c4818e352cb90593aa5fb9a"}
Jul 29 20:57:11.475511 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.475479    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b" event={"ID":"5b576cef-5eb5-493a-aca4-cd6673dbcca5","Type":"ContainerStarted","Data":"d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758"}
Jul 29 20:57:11.475608 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.475533    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b" event={"ID":"5b576cef-5eb5-493a-aca4-cd6673dbcca5","Type":"ContainerStarted","Data":"48cdb7a25d5537692bbfe320a7ce782e5f1d005ac63bf83ee51ae173bd902127"}
Jul 29 20:57:11.494736 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.494698    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b" podStartSLOduration=1.494684461 podStartE2EDuration="1.494684461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:57:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:57:11.492639932 +0000 UTC m=+1941.344140606" watchObservedRunningTime="2026-07-29 20:57:11.494684461 +0000 UTC m=+1941.346185134"
Jul 29 20:57:11.853507 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.853482    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:57:11.925583 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.925560    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-envoy\") pod \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") "
Jul 29 20:57:11.926016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.925587    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-certs\") pod \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") "
Jul 29 20:57:11.926016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.925616    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppqql\" (UniqueName: \"kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-kube-api-access-ppqql\") pod \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") "
Jul 29 20:57:11.926016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.925642    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istiod-ca-cert\") pod \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") "
Jul 29 20:57:11.926016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.925684    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-podinfo\") pod \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") "
Jul 29 20:57:11.926016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.925721    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-credential-socket\") pod \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") "
Jul 29 20:57:11.926016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.925751    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-token\") pod \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") "
Jul 29 20:57:11.926016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.925807    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-data\") pod \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") "
Jul 29 20:57:11.926016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.925854    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07beb8f3-b050-403f-87c5-9eda4b21bf9b" (UID: "07beb8f3-b050-403f-87c5-9eda4b21bf9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:57:11.926016 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.925862    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-socket\") pod \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\" (UID: \"07beb8f3-b050-403f-87c5-9eda4b21bf9b\") "
Jul 29 20:57:11.926465 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.926055    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07beb8f3-b050-403f-87c5-9eda4b21bf9b" (UID: "07beb8f3-b050-403f-87c5-9eda4b21bf9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:57:11.926465 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.926290    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:11.926465 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.926309    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:11.926465 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.926380    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07beb8f3-b050-403f-87c5-9eda4b21bf9b" (UID: "07beb8f3-b050-403f-87c5-9eda4b21bf9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:57:11.926680 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.926472    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07beb8f3-b050-403f-87c5-9eda4b21bf9b" (UID: "07beb8f3-b050-403f-87c5-9eda4b21bf9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:57:11.926734 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.926703    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "07beb8f3-b050-403f-87c5-9eda4b21bf9b" (UID: "07beb8f3-b050-403f-87c5-9eda4b21bf9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:57:11.927856 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.927821    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07beb8f3-b050-403f-87c5-9eda4b21bf9b" (UID: "07beb8f3-b050-403f-87c5-9eda4b21bf9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:57:11.928125 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.928095    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-kube-api-access-ppqql" (OuterVolumeSpecName: "kube-api-access-ppqql") pod "07beb8f3-b050-403f-87c5-9eda4b21bf9b" (UID: "07beb8f3-b050-403f-87c5-9eda4b21bf9b"). InnerVolumeSpecName "kube-api-access-ppqql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:57:11.928466 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.928439    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07beb8f3-b050-403f-87c5-9eda4b21bf9b" (UID: "07beb8f3-b050-403f-87c5-9eda4b21bf9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:57:11.928557 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:11.928447    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "07beb8f3-b050-403f-87c5-9eda4b21bf9b" (UID: "07beb8f3-b050-403f-87c5-9eda4b21bf9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:57:12.026899 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.026877    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppqql\" (UniqueName: \"kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-kube-api-access-ppqql\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:12.026899 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.026899    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:12.027043 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.026908    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:12.027043 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.026916    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:12.027043 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.026924    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:12.027043 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.026934    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:12.027043 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.026942    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07beb8f3-b050-403f-87c5-9eda4b21bf9b-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:12.483864 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.483770    2557 generic.go:356] "Generic (PLEG): container finished" podID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerID="97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d" exitCode=0
Jul 29 20:57:12.483864 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.483818    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"
Jul 29 20:57:12.484078 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.483861    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" event={"ID":"07beb8f3-b050-403f-87c5-9eda4b21bf9b","Type":"ContainerDied","Data":"97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d"}
Jul 29 20:57:12.484078 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.483921    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc" event={"ID":"07beb8f3-b050-403f-87c5-9eda4b21bf9b","Type":"ContainerDied","Data":"a0c64c21090888c18e6581690e5dec0c5894bf9e9521c5380c964b89a01c10c5"}
Jul 29 20:57:12.484078 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.483951    2557 scope.go:117] "RemoveContainer" containerID="97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d"
Jul 29 20:57:12.485787 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.485760    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg" event={"ID":"6c81a749-eb95-4095-bfb0-a96357086cb8","Type":"ContainerStarted","Data":"221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d"}
Jul 29 20:57:12.485970 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.485824    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:12.486285 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.486228    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:12.493715 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.493701    2557 scope.go:117] "RemoveContainer" containerID="c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b"
Jul 29 20:57:12.501407 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.501390    2557 scope.go:117] "RemoveContainer" containerID="97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d"
Jul 29 20:57:12.501647 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:57:12.501625    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d\": container with ID starting with 97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d not found: ID does not exist" containerID="97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d"
Jul 29 20:57:12.501724 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.501658    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d"} err="failed to get container status \"97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d\": rpc error: code = NotFound desc = could not find container \"97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d\": container with ID starting with 97b4e824e4536108e79db632e3bfa5f3b409b83f2ecf5d1dcf48014211d45a5d not found: ID does not exist"
Jul 29 20:57:12.501724 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.501682    2557 scope.go:117] "RemoveContainer" containerID="c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b"
Jul 29 20:57:12.501965 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:57:12.501946    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b\": container with ID starting with c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b not found: ID does not exist" containerID="c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b"
Jul 29 20:57:12.502010 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.501971    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b"} err="failed to get container status \"c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b\": rpc error: code = NotFound desc = could not find container \"c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b\": container with ID starting with c3d21799ecac8d7e1f7d2e42a203ed7d0a841733cb7c264bf8417b0073942f2b not found: ID does not exist"
Jul 29 20:57:12.506760 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.506723    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg" podStartSLOduration=2.506710865 podStartE2EDuration="2.506710865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:57:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:57:12.505767628 +0000 UTC m=+1942.357268300" watchObservedRunningTime="2026-07-29 20:57:12.506710865 +0000 UTC m=+1942.358211537"
Jul 29 20:57:12.521282 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.521260    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"]
Jul 29 20:57:12.524524 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.524504    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-eba524b8-gw-openshift-default-67bf98f9fb-2bntc"]
Jul 29 20:57:12.624728 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:12.624701    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" path="/var/lib/kubelet/pods/07beb8f3-b050-403f-87c5-9eda4b21bf9b/volumes"
Jul 29 20:57:23.494405 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:23.494368    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:23.494926 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:23.494459    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:25.466942 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:25.466910    2557 patch_prober.go:28] interesting pod/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 29 20:57:25.467336 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:25.466993    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 29 20:57:25.563622 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:25.563590    2557 generic.go:356] "Generic (PLEG): container finished" podID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerID="3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b" exitCode=0
Jul 29 20:57:25.563795 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:25.563662    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" event={"ID":"0bfaa611-b4f2-4d8e-8800-5735767c1bcc","Type":"ContainerDied","Data":"3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b"}
Jul 29 20:57:25.564060 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:25.564047    2557 scope.go:117] "RemoveContainer" containerID="3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b"
Jul 29 20:57:25.564986 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:25.564960    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:25.565088 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:25.565020    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:25.565088 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:25.565053    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:26.572300 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:26.572264    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" event={"ID":"0bfaa611-b4f2-4d8e-8800-5735767c1bcc","Type":"ContainerStarted","Data":"723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2"}
Jul 29 20:57:26.872512 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:26.872417    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:26.872689 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:26.872546    2557 patch_prober.go:28] interesting pod/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 29 20:57:26.872689 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:26.872589    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 29 20:57:27.873073 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:27.873039    2557 patch_prober.go:28] interesting pod/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 29 20:57:27.873652 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:27.873615    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 29 20:57:28.872436 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:28.872394    2557 patch_prober.go:28] interesting pod/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 29 20:57:28.872757 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:28.872709    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 29 20:57:29.872069 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:29.872023    2557 patch_prober.go:28] interesting pod/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 29 20:57:29.872563 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:29.872104    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 29 20:57:30.876170 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:30.876139    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:30.876609 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:30.876537    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:30.877148 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:30.877132    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:40.591757 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:40.591716    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"]
Jul 29 20:57:40.592332 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:40.592013    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg" podUID="6c81a749-eb95-4095-bfb0-a96357086cb8" containerName="payload-processing" containerID="cri-o://221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d" gracePeriod=30
Jul 29 20:57:40.600687 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:40.600659    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"]
Jul 29 20:57:40.601049 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:40.600994    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b" podUID="5b576cef-5eb5-493a-aca4-cd6673dbcca5" containerName="payload-pre-processing" containerID="cri-o://d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758" gracePeriod=30
Jul 29 20:57:40.867174 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:40.867145    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:40.903121 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:40.903094    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:40.985779 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:40.985744    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c81a749-eb95-4095-bfb0-a96357086cb8-plugins-config-volume\") pod \"6c81a749-eb95-4095-bfb0-a96357086cb8\" (UID: \"6c81a749-eb95-4095-bfb0-a96357086cb8\") "
Jul 29 20:57:40.985779 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:40.985790    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvtwc\" (UniqueName: \"kubernetes.io/projected/6c81a749-eb95-4095-bfb0-a96357086cb8-kube-api-access-vvtwc\") pod \"6c81a749-eb95-4095-bfb0-a96357086cb8\" (UID: \"6c81a749-eb95-4095-bfb0-a96357086cb8\") "
Jul 29 20:57:40.986279 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:40.986250    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c81a749-eb95-4095-bfb0-a96357086cb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6c81a749-eb95-4095-bfb0-a96357086cb8" (UID: "6c81a749-eb95-4095-bfb0-a96357086cb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:57:40.987992 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:40.987965    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c81a749-eb95-4095-bfb0-a96357086cb8-kube-api-access-vvtwc" (OuterVolumeSpecName: "kube-api-access-vvtwc") pod "6c81a749-eb95-4095-bfb0-a96357086cb8" (UID: "6c81a749-eb95-4095-bfb0-a96357086cb8"). InnerVolumeSpecName "kube-api-access-vvtwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:57:41.086787 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.086752    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b576cef-5eb5-493a-aca4-cd6673dbcca5-plugins-config-volume\") pod \"5b576cef-5eb5-493a-aca4-cd6673dbcca5\" (UID: \"5b576cef-5eb5-493a-aca4-cd6673dbcca5\") "
Jul 29 20:57:41.087012 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.086866    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr889\" (UniqueName: \"kubernetes.io/projected/5b576cef-5eb5-493a-aca4-cd6673dbcca5-kube-api-access-kr889\") pod \"5b576cef-5eb5-493a-aca4-cd6673dbcca5\" (UID: \"5b576cef-5eb5-493a-aca4-cd6673dbcca5\") "
Jul 29 20:57:41.087115 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.087101    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c81a749-eb95-4095-bfb0-a96357086cb8-plugins-config-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:41.087177 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.087115    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvtwc\" (UniqueName: \"kubernetes.io/projected/6c81a749-eb95-4095-bfb0-a96357086cb8-kube-api-access-vvtwc\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:41.087177 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.087143    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b576cef-5eb5-493a-aca4-cd6673dbcca5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b576cef-5eb5-493a-aca4-cd6673dbcca5" (UID: "5b576cef-5eb5-493a-aca4-cd6673dbcca5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:57:41.088959 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.088932    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b576cef-5eb5-493a-aca4-cd6673dbcca5-kube-api-access-kr889" (OuterVolumeSpecName: "kube-api-access-kr889") pod "5b576cef-5eb5-493a-aca4-cd6673dbcca5" (UID: "5b576cef-5eb5-493a-aca4-cd6673dbcca5"). InnerVolumeSpecName "kube-api-access-kr889". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:57:41.188050 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.187965    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b576cef-5eb5-493a-aca4-cd6673dbcca5-plugins-config-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:41.188050 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.188002    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr889\" (UniqueName: \"kubernetes.io/projected/5b576cef-5eb5-493a-aca4-cd6673dbcca5-kube-api-access-kr889\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:41.662651 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.662617    2557 generic.go:356] "Generic (PLEG): container finished" podID="6c81a749-eb95-4095-bfb0-a96357086cb8" containerID="221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d" exitCode=0
Jul 29 20:57:41.663110 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.662660    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"
Jul 29 20:57:41.663110 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.662708    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg" event={"ID":"6c81a749-eb95-4095-bfb0-a96357086cb8","Type":"ContainerDied","Data":"221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d"}
Jul 29 20:57:41.663110 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.662760    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg" event={"ID":"6c81a749-eb95-4095-bfb0-a96357086cb8","Type":"ContainerDied","Data":"35e4df9355ff0e0eb112ec9dff965e7d98f4fe123c4818e352cb90593aa5fb9a"}
Jul 29 20:57:41.663110 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.662783    2557 scope.go:117] "RemoveContainer" containerID="221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d"
Jul 29 20:57:41.664156 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.664005    2557 generic.go:356] "Generic (PLEG): container finished" podID="5b576cef-5eb5-493a-aca4-cd6673dbcca5" containerID="d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758" exitCode=0
Jul 29 20:57:41.664156 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.664050    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"
Jul 29 20:57:41.664156 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.664088    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b" event={"ID":"5b576cef-5eb5-493a-aca4-cd6673dbcca5","Type":"ContainerDied","Data":"d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758"}
Jul 29 20:57:41.664156 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.664148    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b" event={"ID":"5b576cef-5eb5-493a-aca4-cd6673dbcca5","Type":"ContainerDied","Data":"48cdb7a25d5537692bbfe320a7ce782e5f1d005ac63bf83ee51ae173bd902127"}
Jul 29 20:57:41.672896 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.672871    2557 scope.go:117] "RemoveContainer" containerID="221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d"
Jul 29 20:57:41.673185 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:57:41.673162    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d\": container with ID starting with 221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d not found: ID does not exist" containerID="221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d"
Jul 29 20:57:41.673282 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.673196    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d"} err="failed to get container status \"221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d\": rpc error: code = NotFound desc = could not find container \"221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d\": container with ID starting with 221ae1a3d25872a03e21fd5910204e61e3279f374c54495be7324638bf4e166d not found: ID does not exist"
Jul 29 20:57:41.673282 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.673220    2557 scope.go:117] "RemoveContainer" containerID="d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758"
Jul 29 20:57:41.681654 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.681639    2557 scope.go:117] "RemoveContainer" containerID="d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758"
Jul 29 20:57:41.681946 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:57:41.681924    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758\": container with ID starting with d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758 not found: ID does not exist" containerID="d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758"
Jul 29 20:57:41.682019 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.681955    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758"} err="failed to get container status \"d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758\": rpc error: code = NotFound desc = could not find container \"d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758\": container with ID starting with d63add4e995c005156170c1699fa43614d5ac39f5f0f34ce2a7f73177b32a758 not found: ID does not exist"
Jul 29 20:57:41.691641 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.691616    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"]
Jul 29 20:57:41.696494 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.696477    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7cdd0d7d-6c66f49fd4-jgx7b"]
Jul 29 20:57:41.707521 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.707499    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"]
Jul 29 20:57:41.711817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.711798    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7cdd0d7d-545cfcb99d-w7zwg"]
Jul 29 20:57:41.976419 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.976338    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"]
Jul 29 20:57:41.976598 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:41.976574    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy" containerID="cri-o://723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2" gracePeriod=30
Jul 29 20:57:42.621264 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.621225    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b576cef-5eb5-493a-aca4-cd6673dbcca5" path="/var/lib/kubelet/pods/5b576cef-5eb5-493a-aca4-cd6673dbcca5/volumes"
Jul 29 20:57:42.621694 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.621673    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c81a749-eb95-4095-bfb0-a96357086cb8" path="/var/lib/kubelet/pods/6c81a749-eb95-4095-bfb0-a96357086cb8/volumes"
Jul 29 20:57:42.753011 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.752976    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"]
Jul 29 20:57:42.753505 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753489    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c81a749-eb95-4095-bfb0-a96357086cb8" containerName="payload-processing"
Jul 29 20:57:42.753505 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753506    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c81a749-eb95-4095-bfb0-a96357086cb8" containerName="payload-processing"
Jul 29 20:57:42.753622 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753526    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy"
Jul 29 20:57:42.753622 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753532    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy"
Jul 29 20:57:42.753622 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753540    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy"
Jul 29 20:57:42.753622 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753545    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy"
Jul 29 20:57:42.753622 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753555    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b576cef-5eb5-493a-aca4-cd6673dbcca5" containerName="payload-pre-processing"
Jul 29 20:57:42.753622 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753562    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b576cef-5eb5-493a-aca4-cd6673dbcca5" containerName="payload-pre-processing"
Jul 29 20:57:42.753622 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753621    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy"
Jul 29 20:57:42.753950 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753633    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b576cef-5eb5-493a-aca4-cd6673dbcca5" containerName="payload-pre-processing"
Jul 29 20:57:42.753950 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.753640    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c81a749-eb95-4095-bfb0-a96357086cb8" containerName="payload-processing"
Jul 29 20:57:42.757159 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.757143    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.759663 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.759647    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8e2d92b2-openshift-default-dockercfg-4j2km\""
Jul 29 20:57:42.767344 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.767320    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"]
Jul 29 20:57:42.804238 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.804207    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-socket\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.804238 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.804237    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-credential-socket\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.804413 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.804259    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-certs\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.804413 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.804337    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-podinfo\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.804413 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.804392    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-data\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.804513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.804433    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-token\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.804513 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.804502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnldh\" (UniqueName: \"kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-kube-api-access-tnldh\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.804578 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.804525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istiod-ca-cert\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.804578 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.804546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-envoy\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905056 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.904977    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-socket\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905056 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905010    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-credential-socket\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905056 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-certs\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905285 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905139    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-podinfo\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905285 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905216    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-data\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905285 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905250    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-token\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905441 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905355    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-credential-socket\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905441 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnldh\" (UniqueName: \"kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-kube-api-access-tnldh\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905441 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905407    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istiod-ca-cert\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905441 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905409    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-socket\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905695 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-envoy\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905695 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905464    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-certs\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905695 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-data\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.905980 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.905963    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istiod-ca-cert\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.907537 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.907519    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-envoy\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.907755 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.907740    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-podinfo\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.913743 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.913720    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-token\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:42.914449 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:42.914431    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnldh\" (UniqueName: \"kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-kube-api-access-tnldh\") pod \"e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") " pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:43.067783 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:43.067744    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:43.208247 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:43.208218    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"]
Jul 29 20:57:43.209729 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:57:43.209704    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34bd311f_ceb5_43cf_8ddd_20d8c93d2d1f.slice/crio-e0fb1c356cc43ab24afaa0f98af3c6a3b968c20bb6a2dbfbb4cdf97ca335d8ca WatchSource:0}: Error finding container e0fb1c356cc43ab24afaa0f98af3c6a3b968c20bb6a2dbfbb4cdf97ca335d8ca: Status 404 returned error can't find the container with id e0fb1c356cc43ab24afaa0f98af3c6a3b968c20bb6a2dbfbb4cdf97ca335d8ca
Jul 29 20:57:43.211870 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:43.211818    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:43.211947 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:43.211912    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:43.211984 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:43.211948    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:43.685182 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:43.685143    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" event={"ID":"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f","Type":"ContainerStarted","Data":"e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce"}
Jul 29 20:57:43.685371 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:43.685209    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" event={"ID":"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f","Type":"ContainerStarted","Data":"e0fb1c356cc43ab24afaa0f98af3c6a3b968c20bb6a2dbfbb4cdf97ca335d8ca"}
Jul 29 20:57:43.716414 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:43.716364    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" podStartSLOduration=1.7163484850000001 podStartE2EDuration="1.716348485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:57:43.705733617 +0000 UTC m=+1973.557234290" watchObservedRunningTime="2026-07-29 20:57:43.716348485 +0000 UTC m=+1973.567849158"
Jul 29 20:57:44.067899 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:44.067866    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:44.073827 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:44.073800    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:44.690285 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:44.690256    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:44.691296 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:44.691272    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:57:45.878824 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:45.878785    2557 patch_prober.go:28] interesting pod/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 29 20:57:45.879230 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:45.878873    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 20:57:45.892628 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:45.892601    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"]
Jul 29 20:57:45.893055 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:45.893042    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="07beb8f3-b050-403f-87c5-9eda4b21bf9b" containerName="istio-proxy"
Jul 29 20:57:45.895305 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:45.895290    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:57:45.897931 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:45.897912    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-8e2d92b2\""
Jul 29 20:57:45.907071 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:45.907050    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"]
Jul 29 20:57:45.933265 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:45.933239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/970f9955-102e-40e3-b112-d2a630518703-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2\" (UID: \"970f9955-102e-40e3-b112-d2a630518703\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:57:45.933354 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:45.933327    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45xt\" (UniqueName: \"kubernetes.io/projected/970f9955-102e-40e3-b112-d2a630518703-kube-api-access-c45xt\") pod \"payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2\" (UID: \"970f9955-102e-40e3-b112-d2a630518703\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:57:46.034437 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:46.034406    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45xt\" (UniqueName: \"kubernetes.io/projected/970f9955-102e-40e3-b112-d2a630518703-kube-api-access-c45xt\") pod \"payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2\" (UID: \"970f9955-102e-40e3-b112-d2a630518703\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:57:46.034619 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:46.034490    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/970f9955-102e-40e3-b112-d2a630518703-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2\" (UID: \"970f9955-102e-40e3-b112-d2a630518703\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:57:46.035174 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:46.035147    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/970f9955-102e-40e3-b112-d2a630518703-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2\" (UID: \"970f9955-102e-40e3-b112-d2a630518703\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:57:46.042646 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:46.042623    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45xt\" (UniqueName: \"kubernetes.io/projected/970f9955-102e-40e3-b112-d2a630518703-kube-api-access-c45xt\") pod \"payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2\" (UID: \"970f9955-102e-40e3-b112-d2a630518703\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:57:46.207544 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:46.207470    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:57:46.345993 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:46.345968    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"]
Jul 29 20:57:46.347665 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:57:46.347638    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970f9955_102e_40e3_b112_d2a630518703.slice/crio-711d3366cb2864bc7943129e84a42146d375425d6e1aa3f17c36c5162368a8b8 WatchSource:0}: Error finding container 711d3366cb2864bc7943129e84a42146d375425d6e1aa3f17c36c5162368a8b8: Status 404 returned error can't find the container with id 711d3366cb2864bc7943129e84a42146d375425d6e1aa3f17c36c5162368a8b8
Jul 29 20:57:46.702050 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:46.702017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2" event={"ID":"970f9955-102e-40e3-b112-d2a630518703","Type":"ContainerStarted","Data":"c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39"}
Jul 29 20:57:46.702210 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:46.702070    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2" event={"ID":"970f9955-102e-40e3-b112-d2a630518703","Type":"ContainerStarted","Data":"711d3366cb2864bc7943129e84a42146d375425d6e1aa3f17c36c5162368a8b8"}
Jul 29 20:57:46.702210 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:46.702099    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:57:46.719678 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:46.719636    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2" podStartSLOduration=1.7196196750000001 podStartE2EDuration="1.719619675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:57:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:57:46.717477749 +0000 UTC m=+1976.568978422" watchObservedRunningTime="2026-07-29 20:57:46.719619675 +0000 UTC m=+1976.571120349"
Jul 29 20:57:47.233840 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.233797    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:47.244846 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.244779    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-envoy\") pod \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") "
Jul 29 20:57:47.244947 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.244848    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-certs\") pod \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") "
Jul 29 20:57:47.244947 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.244878    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg4sp\" (UniqueName: \"kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-kube-api-access-qg4sp\") pod \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") "
Jul 29 20:57:47.244947 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.244894    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-data\") pod \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") "
Jul 29 20:57:47.244947 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.244908    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-token\") pod \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") "
Jul 29 20:57:47.244947 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.244923    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-socket\") pod \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") "
Jul 29 20:57:47.245197 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.244946    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-podinfo\") pod \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") "
Jul 29 20:57:47.245197 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.244973    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istiod-ca-cert\") pod \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") "
Jul 29 20:57:47.245197 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.245061    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-credential-socket\") pod \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\" (UID: \"0bfaa611-b4f2-4d8e-8800-5735767c1bcc\") "
Jul 29 20:57:47.245197 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.245179    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0bfaa611-b4f2-4d8e-8800-5735767c1bcc" (UID: "0bfaa611-b4f2-4d8e-8800-5735767c1bcc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:57:47.245394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.245223    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0bfaa611-b4f2-4d8e-8800-5735767c1bcc" (UID: "0bfaa611-b4f2-4d8e-8800-5735767c1bcc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:57:47.245394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.245359    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0bfaa611-b4f2-4d8e-8800-5735767c1bcc" (UID: "0bfaa611-b4f2-4d8e-8800-5735767c1bcc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:57:47.245394 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.245380    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:47.245555 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.245401    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:47.245609 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.245561    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0bfaa611-b4f2-4d8e-8800-5735767c1bcc" (UID: "0bfaa611-b4f2-4d8e-8800-5735767c1bcc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:57:47.245873 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.245849    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-data" (OuterVolumeSpecName: "istio-data") pod "0bfaa611-b4f2-4d8e-8800-5735767c1bcc" (UID: "0bfaa611-b4f2-4d8e-8800-5735767c1bcc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:57:47.246983 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.246961    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0bfaa611-b4f2-4d8e-8800-5735767c1bcc" (UID: "0bfaa611-b4f2-4d8e-8800-5735767c1bcc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:57:47.247142 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.247127    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-token" (OuterVolumeSpecName: "istio-token") pod "0bfaa611-b4f2-4d8e-8800-5735767c1bcc" (UID: "0bfaa611-b4f2-4d8e-8800-5735767c1bcc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:57:47.247331 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.247310    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-kube-api-access-qg4sp" (OuterVolumeSpecName: "kube-api-access-qg4sp") pod "0bfaa611-b4f2-4d8e-8800-5735767c1bcc" (UID: "0bfaa611-b4f2-4d8e-8800-5735767c1bcc"). InnerVolumeSpecName "kube-api-access-qg4sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:57:47.247432 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.247348    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0bfaa611-b4f2-4d8e-8800-5735767c1bcc" (UID: "0bfaa611-b4f2-4d8e-8800-5735767c1bcc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:57:47.345900 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.345873    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:47.345900 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.345895    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg4sp\" (UniqueName: \"kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-kube-api-access-qg4sp\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:47.346068 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.345906    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:47.346068 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.345917    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:47.346068 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.345925    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:47.346068 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.345933    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:47.346068 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.345942    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfaa611-b4f2-4d8e-8800-5735767c1bcc-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:57:47.709073 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.709043    2557 generic.go:356] "Generic (PLEG): container finished" podID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerID="723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2" exitCode=0
Jul 29 20:57:47.709231 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.709089    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"
Jul 29 20:57:47.709231 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.709124    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" event={"ID":"0bfaa611-b4f2-4d8e-8800-5735767c1bcc","Type":"ContainerDied","Data":"723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2"}
Jul 29 20:57:47.709231 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.709186    2557 scope.go:117] "RemoveContainer" containerID="723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2"
Jul 29 20:57:47.709443 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.709174    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g" event={"ID":"0bfaa611-b4f2-4d8e-8800-5735767c1bcc","Type":"ContainerDied","Data":"5c2a105d10ad7d87f1275d1c037ff6a08dd77c91ab3bd4a91d7b27c606c8e6ef"}
Jul 29 20:57:47.727079 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.727058    2557 scope.go:117] "RemoveContainer" containerID="3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b"
Jul 29 20:57:47.735155 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.735138    2557 scope.go:117] "RemoveContainer" containerID="723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2"
Jul 29 20:57:47.735439 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:57:47.735419    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2\": container with ID starting with 723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2 not found: ID does not exist" containerID="723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2"
Jul 29 20:57:47.735492 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.735447    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2"} err="failed to get container status \"723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2\": rpc error: code = NotFound desc = could not find container \"723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2\": container with ID starting with 723e88d08e2e11a6035da793a5679e1402fdd799cc71d7888a5fed6e3e8819f2 not found: ID does not exist"
Jul 29 20:57:47.735492 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.735463    2557 scope.go:117] "RemoveContainer" containerID="3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b"
Jul 29 20:57:47.735704 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:57:47.735686    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b\": container with ID starting with 3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b not found: ID does not exist" containerID="3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b"
Jul 29 20:57:47.735745 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.735710    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b"} err="failed to get container status \"3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b\": rpc error: code = NotFound desc = could not find container \"3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b\": container with ID starting with 3f3c88ab1abf4de3887ef9708e74ca0b7b4fb86ae9cd12b1f695112e4367127b not found: ID does not exist"
Jul 29 20:57:47.736750 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.736731    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"]
Jul 29 20:57:47.741713 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:47.741693    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7cdd0d7d-openshift-default-58ff64d946-zx77g"]
Jul 29 20:57:48.622324 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:48.622296    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" path="/var/lib/kubelet/pods/0bfaa611-b4f2-4d8e-8800-5735767c1bcc/volumes"
Jul 29 20:57:57.713136 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:57.713093    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:57:59.691821 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:59.691735    2557 patch_prober.go:28] interesting pod/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 29 20:57:59.691821 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:59.691803    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 29 20:57:59.777233 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:59.777203    2557 generic.go:356] "Generic (PLEG): container finished" podID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerID="e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce" exitCode=0
Jul 29 20:57:59.777408 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:59.777269    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" event={"ID":"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f","Type":"ContainerDied","Data":"e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce"}
Jul 29 20:57:59.777680 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:59.777658    2557 scope.go:117] "RemoveContainer" containerID="e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce"
Jul 29 20:57:59.778792 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:59.778757    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:59.778883 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:59.778865    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:57:59.778930 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:57:59.778915    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 20:58:00.791578 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:00.791535    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" event={"ID":"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f","Type":"ContainerStarted","Data":"bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc"}
Jul 29 20:58:01.067971 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:01.067882    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:58:01.068115 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:01.068100    2557 patch_prober.go:28] interesting pod/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 29 20:58:01.068172 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:01.068150    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 29 20:58:02.069130 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:02.069094    2557 patch_prober.go:28] interesting pod/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 29 20:58:02.069719 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:02.069686    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 29 20:58:03.068780 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:03.068741    2557 patch_prober.go:28] interesting pod/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 29 20:58:03.069018 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:03.068806    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 29 20:58:04.068352 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:04.068317    2557 patch_prober.go:28] interesting pod/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 29 20:58:04.068753 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:04.068382    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 29 20:58:05.072593 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:05.072562    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:58:05.073062 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:05.072946    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:58:05.073881 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:05.073860    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:58:09.970707 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:09.970672    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"]
Jul 29 20:58:09.971133 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:09.971118    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy"
Jul 29 20:58:09.971181 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:09.971135    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy"
Jul 29 20:58:09.971223 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:09.971214    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy"
Jul 29 20:58:09.973694 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:09.973680    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"
Jul 29 20:58:09.976327 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:09.976312    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 20:58:09.982121 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:09.982096    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"]
Jul 29 20:58:10.050178 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:10.050143    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9\" (UID: \"fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"
Jul 29 20:58:10.151200 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:10.151166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9\" (UID: \"fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"
Jul 29 20:58:10.151812 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:10.151787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9\" (UID: \"fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"
Jul 29 20:58:10.284761 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:10.284726    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"
Jul 29 20:58:10.416893 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:10.416866    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"]
Jul 29 20:58:10.418552 ip-10-0-137-228 kubenswrapper[2557]: W0729 20:58:10.418531    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8a7b4e_d4a6_4cdf_86d2_ad7f92254193.slice/crio-e62ada5c4ac2ff7397146789570e72f5ed533eca1ae67523b400f5320bd4204e WatchSource:0}: Error finding container e62ada5c4ac2ff7397146789570e72f5ed533eca1ae67523b400f5320bd4204e: Status 404 returned error can't find the container with id e62ada5c4ac2ff7397146789570e72f5ed533eca1ae67523b400f5320bd4204e
Jul 29 20:58:10.846924 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:10.846813    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9" event={"ID":"fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193","Type":"ContainerStarted","Data":"73443074ac46464cdbb85478d9d8c5d421d89785d5bf50e7e4bd451c145e1074"}
Jul 29 20:58:10.846924 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:10.846903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9" event={"ID":"fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193","Type":"ContainerStarted","Data":"e62ada5c4ac2ff7397146789570e72f5ed533eca1ae67523b400f5320bd4204e"}
Jul 29 20:58:10.864932 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:10.864889    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9" podStartSLOduration=1.864873844 podStartE2EDuration="1.864873844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:58:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:58:10.862850546 +0000 UTC m=+2000.714351216" watchObservedRunningTime="2026-07-29 20:58:10.864873844 +0000 UTC m=+2000.716374544"
Jul 29 20:58:11.853340 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:11.853309    2557 generic.go:356] "Generic (PLEG): container finished" podID="fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193" containerID="73443074ac46464cdbb85478d9d8c5d421d89785d5bf50e7e4bd451c145e1074" exitCode=0
Jul 29 20:58:11.853700 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:11.853400    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9" event={"ID":"fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193","Type":"ContainerDied","Data":"73443074ac46464cdbb85478d9d8c5d421d89785d5bf50e7e4bd451c145e1074"}
Jul 29 20:58:12.996425 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:12.996400    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"
Jul 29 20:58:13.076890 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:13.076858    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193-maas-api-service-ca\") pod \"fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193\" (UID: \"fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193\") "
Jul 29 20:58:13.077263 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:13.077242    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193" (UID: "fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:58:13.178404 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:13.178321    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193-maas-api-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:13.865414 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:13.865382    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"
Jul 29 20:58:13.865591 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:13.865381    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9" event={"ID":"fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193","Type":"ContainerDied","Data":"e62ada5c4ac2ff7397146789570e72f5ed533eca1ae67523b400f5320bd4204e"}
Jul 29 20:58:13.865591 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:13.865505    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e62ada5c4ac2ff7397146789570e72f5ed533eca1ae67523b400f5320bd4204e"
Jul 29 20:58:15.921827 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:15.921797    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"]
Jul 29 20:58:15.922319 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:15.922010    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2" podUID="970f9955-102e-40e3-b112-d2a630518703" containerName="payload-pre-processing" containerID="cri-o://c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39" gracePeriod=30
Jul 29 20:58:16.075102 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.075066    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"]
Jul 29 20:58:16.080466 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.080422    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e2d92b2-r6cg9"]
Jul 29 20:58:16.198942 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.198917    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:58:16.207667 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.207635    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"]
Jul 29 20:58:16.207940 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.207893    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy" containerID="cri-o://bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc" gracePeriod=30
Jul 29 20:58:16.313422 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.313389    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/970f9955-102e-40e3-b112-d2a630518703-plugins-config-volume\") pod \"970f9955-102e-40e3-b112-d2a630518703\" (UID: \"970f9955-102e-40e3-b112-d2a630518703\") "
Jul 29 20:58:16.313605 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.313591    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c45xt\" (UniqueName: \"kubernetes.io/projected/970f9955-102e-40e3-b112-d2a630518703-kube-api-access-c45xt\") pod \"970f9955-102e-40e3-b112-d2a630518703\" (UID: \"970f9955-102e-40e3-b112-d2a630518703\") "
Jul 29 20:58:16.313864 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.313822    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/970f9955-102e-40e3-b112-d2a630518703-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "970f9955-102e-40e3-b112-d2a630518703" (UID: "970f9955-102e-40e3-b112-d2a630518703"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:58:16.316817 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.316788    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/970f9955-102e-40e3-b112-d2a630518703-kube-api-access-c45xt" (OuterVolumeSpecName: "kube-api-access-c45xt") pod "970f9955-102e-40e3-b112-d2a630518703" (UID: "970f9955-102e-40e3-b112-d2a630518703"). InnerVolumeSpecName "kube-api-access-c45xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:58:16.414551 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.414514    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/970f9955-102e-40e3-b112-d2a630518703-plugins-config-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:16.414551 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.414546    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c45xt\" (UniqueName: \"kubernetes.io/projected/970f9955-102e-40e3-b112-d2a630518703-kube-api-access-c45xt\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:16.622271 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.622237    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193" path="/var/lib/kubelet/pods/fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193/volumes"
Jul 29 20:58:16.884998 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.884913    2557 generic.go:356] "Generic (PLEG): container finished" podID="970f9955-102e-40e3-b112-d2a630518703" containerID="c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39" exitCode=0
Jul 29 20:58:16.884998 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.884963    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"
Jul 29 20:58:16.884998 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.884970    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2" event={"ID":"970f9955-102e-40e3-b112-d2a630518703","Type":"ContainerDied","Data":"c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39"}
Jul 29 20:58:16.885208 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.885023    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2" event={"ID":"970f9955-102e-40e3-b112-d2a630518703","Type":"ContainerDied","Data":"711d3366cb2864bc7943129e84a42146d375425d6e1aa3f17c36c5162368a8b8"}
Jul 29 20:58:16.885208 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.885053    2557 scope.go:117] "RemoveContainer" containerID="c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39"
Jul 29 20:58:16.894305 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.894287    2557 scope.go:117] "RemoveContainer" containerID="c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39"
Jul 29 20:58:16.894587 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:58:16.894564    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39\": container with ID starting with c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39 not found: ID does not exist" containerID="c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39"
Jul 29 20:58:16.894663 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.894594    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39"} err="failed to get container status \"c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39\": rpc error: code = NotFound desc = could not find container \"c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39\": container with ID starting with c5629f35b6111805794fed94941d9282f60e16f9f155af376a4a3daba87ffc39 not found: ID does not exist"
Jul 29 20:58:16.917813 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.917781    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"]
Jul 29 20:58:16.933450 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:16.933416    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e2d92b2-56955d8fb8-p4sq2"]
Jul 29 20:58:18.623412 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:18.623378    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="970f9955-102e-40e3-b112-d2a630518703" path="/var/lib/kubelet/pods/970f9955-102e-40e3-b112-d2a630518703/volumes"
Jul 29 20:58:20.075502 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:20.075457    2557 patch_prober.go:28] interesting pod/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 20:58:20.075966 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:20.075530    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 20:58:21.473022 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.472950    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:58:21.564234 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564197    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-envoy\") pod \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") "
Jul 29 20:58:21.564234 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564242    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-certs\") pod \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") "
Jul 29 20:58:21.564476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564259    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-data\") pod \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") "
Jul 29 20:58:21.564476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564284    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istiod-ca-cert\") pod \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") "
Jul 29 20:58:21.564476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564318    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-token\") pod \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") "
Jul 29 20:58:21.564476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564353    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnldh\" (UniqueName: \"kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-kube-api-access-tnldh\") pod \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") "
Jul 29 20:58:21.564476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564375    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-credential-socket\") pod \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") "
Jul 29 20:58:21.564476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564400    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-podinfo\") pod \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") "
Jul 29 20:58:21.564476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564437    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-socket\") pod \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\" (UID: \"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f\") "
Jul 29 20:58:21.564863 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564645    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" (UID: "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:58:21.564863 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564714    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" (UID: "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:58:21.564975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564889    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" (UID: "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:58:21.564975 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.564916    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" (UID: "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:58:21.565246 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.565216    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-data" (OuterVolumeSpecName: "istio-data") pod "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" (UID: "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:58:21.566544 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.566522    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" (UID: "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:58:21.566726 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.566706    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-kube-api-access-tnldh" (OuterVolumeSpecName: "kube-api-access-tnldh") pod "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" (UID: "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f"). InnerVolumeSpecName "kube-api-access-tnldh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:58:21.567105 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.567081    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" (UID: "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:58:21.567105 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.567090    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" (UID: "34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:58:21.665475 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.665419    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:21.665475 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.665466    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:21.665475 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.665475    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:21.665475 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.665482    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:21.665475 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.665491    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:21.665475 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.665498    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:21.665809 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.665506    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnldh\" (UniqueName: \"kubernetes.io/projected/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-kube-api-access-tnldh\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:21.665809 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.665516    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:21.665809 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.665526    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 20:58:21.914476 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.914440    2557 generic.go:356] "Generic (PLEG): container finished" podID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerID="bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc" exitCode=0
Jul 29 20:58:21.914673 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.914493    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"
Jul 29 20:58:21.914673 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.914524    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" event={"ID":"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f","Type":"ContainerDied","Data":"bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc"}
Jul 29 20:58:21.914673 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.914590    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk" event={"ID":"34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f","Type":"ContainerDied","Data":"e0fb1c356cc43ab24afaa0f98af3c6a3b968c20bb6a2dbfbb4cdf97ca335d8ca"}
Jul 29 20:58:21.914673 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.914623    2557 scope.go:117] "RemoveContainer" containerID="bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc"
Jul 29 20:58:21.923855 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.923824    2557 scope.go:117] "RemoveContainer" containerID="e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce"
Jul 29 20:58:21.932103 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.932080    2557 scope.go:117] "RemoveContainer" containerID="bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc"
Jul 29 20:58:21.932331 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:58:21.932313    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc\": container with ID starting with bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc not found: ID does not exist" containerID="bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc"
Jul 29 20:58:21.932392 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.932339    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc"} err="failed to get container status \"bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc\": rpc error: code = NotFound desc = could not find container \"bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc\": container with ID starting with bbddcc8519ee9eb951a3c831eef8e0260f8f3d4040a1ad3f56cff08d94e3aafc not found: ID does not exist"
Jul 29 20:58:21.932392 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.932354    2557 scope.go:117] "RemoveContainer" containerID="e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce"
Jul 29 20:58:21.932574 ip-10-0-137-228 kubenswrapper[2557]: E0729 20:58:21.932554    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce\": container with ID starting with e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce not found: ID does not exist" containerID="e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce"
Jul 29 20:58:21.932616 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.932581    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce"} err="failed to get container status \"e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce\": rpc error: code = NotFound desc = could not find container \"e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce\": container with ID starting with e23ce505affba043bd3d7b8b080e4235760c7ff54f458f95fff5621b15917cce not found: ID does not exist"
Jul 29 20:58:21.936439 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.936417    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"]
Jul 29 20:58:21.946930 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:21.946547    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8e2d92b2-openshift-default-65595f5b84-l8hzk"]
Jul 29 20:58:22.621352 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:58:22.621317    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" path="/var/lib/kubelet/pods/34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f/volumes"
Jul 29 20:59:50.716005 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:59:50.715979    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 20:59:50.720140 ip-10-0-137-228 kubenswrapper[2557]: I0729 20:59:50.720120    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:00:00.136569 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.136538    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755980-v75j8"]
Jul 29 21:00:00.136968 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.136929    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy"
Jul 29 21:00:00.136968 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.136941    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy"
Jul 29 21:00:00.136968 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.136949    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy"
Jul 29 21:00:00.136968 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.136955    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy"
Jul 29 21:00:00.136968 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.136964    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="970f9955-102e-40e3-b112-d2a630518703" containerName="payload-pre-processing"
Jul 29 21:00:00.136968 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.136970    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="970f9955-102e-40e3-b112-d2a630518703" containerName="payload-pre-processing"
Jul 29 21:00:00.137159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.136979    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193" containerName="revoke-keys"
Jul 29 21:00:00.137159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.136985    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193" containerName="revoke-keys"
Jul 29 21:00:00.137159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.136999    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy"
Jul 29 21:00:00.137159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.137004    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy"
Jul 29 21:00:00.137159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.137058    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd8a7b4e-d4a6-4cdf-86d2-ad7f92254193" containerName="revoke-keys"
Jul 29 21:00:00.137159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.137067    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy"
Jul 29 21:00:00.137159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.137073    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="34bd311f-ceb5-43cf-8ddd-20d8c93d2d1f" containerName="istio-proxy"
Jul 29 21:00:00.137159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.137079    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="970f9955-102e-40e3-b112-d2a630518703" containerName="payload-pre-processing"
Jul 29 21:00:00.137159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.137084    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bfaa611-b4f2-4d8e-8800-5735767c1bcc" containerName="istio-proxy"
Jul 29 21:00:00.140044 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.140025    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755980-v75j8"
Jul 29 21:00:00.142750 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.142730    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 21:00:00.149362 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.149347    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755980-v75j8"
Jul 29 21:00:00.156038 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.156016    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755980-v75j8"]
Jul 29 21:00:00.487663 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:00.487640    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755980-v75j8"]
Jul 29 21:00:00.489573 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:00:00.489548    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84904cd5_2367_497e_974d_15d2d9f5e8ed.slice/crio-0f42499fb7990d73d1c6fb8dcb5b8a8248296c866d283277d15c4f71513a42fe WatchSource:0}: Error finding container 0f42499fb7990d73d1c6fb8dcb5b8a8248296c866d283277d15c4f71513a42fe: Status 404 returned error can't find the container with id 0f42499fb7990d73d1c6fb8dcb5b8a8248296c866d283277d15c4f71513a42fe
Jul 29 21:00:01.432336 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:01.432302    2557 generic.go:356] "Generic (PLEG): container finished" podID="84904cd5-2367-497e-974d-15d2d9f5e8ed" containerID="e2d4e39ac3d1a247e857d948376d0b4859d2eb8cc2071a74a60dc12aced8dd62" exitCode=0
Jul 29 21:00:01.432684 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:01.432389    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755980-v75j8" event={"ID":"84904cd5-2367-497e-974d-15d2d9f5e8ed","Type":"ContainerDied","Data":"e2d4e39ac3d1a247e857d948376d0b4859d2eb8cc2071a74a60dc12aced8dd62"}
Jul 29 21:00:01.432684 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:01.432444    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755980-v75j8" event={"ID":"84904cd5-2367-497e-974d-15d2d9f5e8ed","Type":"ContainerStarted","Data":"0f42499fb7990d73d1c6fb8dcb5b8a8248296c866d283277d15c4f71513a42fe"}
Jul 29 21:00:02.580098 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:02.580074    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755980-v75j8"
Jul 29 21:00:03.444751 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:03.444727    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755980-v75j8"
Jul 29 21:00:03.444934 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:03.444725    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755980-v75j8" event={"ID":"84904cd5-2367-497e-974d-15d2d9f5e8ed","Type":"ContainerDied","Data":"0f42499fb7990d73d1c6fb8dcb5b8a8248296c866d283277d15c4f71513a42fe"}
Jul 29 21:00:03.444934 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:03.444862    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f42499fb7990d73d1c6fb8dcb5b8a8248296c866d283277d15c4f71513a42fe"
Jul 29 21:00:08.044533 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.044503    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"]
Jul 29 21:00:08.044892 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.044884    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84904cd5-2367-497e-974d-15d2d9f5e8ed" containerName="cleanup"
Jul 29 21:00:08.044949 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.044896    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="84904cd5-2367-497e-974d-15d2d9f5e8ed" containerName="cleanup"
Jul 29 21:00:08.044986 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.044960    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="84904cd5-2367-497e-974d-15d2d9f5e8ed" containerName="cleanup"
Jul 29 21:00:08.047870 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.047854    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.050613 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.050592    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4dbbbb61-openshift-default-dockercfg-t74rk\""
Jul 29 21:00:08.060390 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.060358    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"]
Jul 29 21:00:08.203160 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.203130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-socket\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.203160 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.203165    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-certs\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.203412 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.203200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-token\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.203412 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.203284    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-credential-socket\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.203412 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.203324    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxvg2\" (UniqueName: \"kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-kube-api-access-gxvg2\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.203412 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.203396    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-data\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.203634 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.203415    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-envoy\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.203634 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.203431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/297f700f-ec01-444c-91bd-6fbd3968af8d-istiod-ca-cert\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.203634 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.203470    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-podinfo\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.303934 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.303863    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-podinfo\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.303934 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.303903    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-socket\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.303934 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.303925    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-certs\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304195 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.303960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-token\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304195 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.304096    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-credential-socket\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304195 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.304141    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxvg2\" (UniqueName: \"kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-kube-api-access-gxvg2\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304367 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.304215    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-data\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304367 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.304242    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-envoy\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304367 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.304268    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/297f700f-ec01-444c-91bd-6fbd3968af8d-istiod-ca-cert\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304367 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.304336    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-certs\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304542 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.304389    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-socket\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304542 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.304453    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-credential-socket\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304617 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.304575    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-data\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.304942 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.304921    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/297f700f-ec01-444c-91bd-6fbd3968af8d-istiod-ca-cert\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.306620 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.306600    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-envoy\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.306805 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.306786    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-podinfo\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.313159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.313136    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-token\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.314406 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.314378    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxvg2\" (UniqueName: \"kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-kube-api-access-gxvg2\") pod \"e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") " pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.358324 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.358287    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:08.506381 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.506356    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"]
Jul 29 21:00:08.507868 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:00:08.507823    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297f700f_ec01_444c_91bd_6fbd3968af8d.slice/crio-69576bb2dcf2ba479f31a638b02c54c130313bfb9179bbecff5a386f3e5b16eb WatchSource:0}: Error finding container 69576bb2dcf2ba479f31a638b02c54c130313bfb9179bbecff5a386f3e5b16eb: Status 404 returned error can't find the container with id 69576bb2dcf2ba479f31a638b02c54c130313bfb9179bbecff5a386f3e5b16eb
Jul 29 21:00:08.510056 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.510014    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:00:08.510147 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.510097    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:00:08.510197 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:08.510148    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:00:09.485948 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:09.485908    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" event={"ID":"297f700f-ec01-444c-91bd-6fbd3968af8d","Type":"ContainerStarted","Data":"d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172"}
Jul 29 21:00:09.486668 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:09.486294    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" event={"ID":"297f700f-ec01-444c-91bd-6fbd3968af8d","Type":"ContainerStarted","Data":"69576bb2dcf2ba479f31a638b02c54c130313bfb9179bbecff5a386f3e5b16eb"}
Jul 29 21:00:09.508292 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:09.508249    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" podStartSLOduration=1.5082368640000001 podStartE2EDuration="1.508236864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:00:09.506913419 +0000 UTC m=+2119.358414093" watchObservedRunningTime="2026-07-29 21:00:09.508236864 +0000 UTC m=+2119.359737537"
Jul 29 21:00:10.358601 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:10.358572    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:10.363076 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:10.363052    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:10.492458 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:10.492386    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:10.493255 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:10.493237    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:23.564425 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:23.564392    2557 generic.go:356] "Generic (PLEG): container finished" podID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerID="d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172" exitCode=0
Jul 29 21:00:23.564815 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:23.564462    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" event={"ID":"297f700f-ec01-444c-91bd-6fbd3968af8d","Type":"ContainerDied","Data":"d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172"}
Jul 29 21:00:23.564815 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:23.564797    2557 scope.go:117] "RemoveContainer" containerID="d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172"
Jul 29 21:00:23.565785 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:23.565760    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:00:23.565857 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:23.565824    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:00:23.565903 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:23.565890    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:00:24.573434 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:24.573395    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" event={"ID":"297f700f-ec01-444c-91bd-6fbd3968af8d","Type":"ContainerStarted","Data":"5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7"}
Jul 29 21:00:25.359148 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:25.359119    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:25.359976 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:25.359946    2557 patch_prober.go:28] interesting pod/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 29 21:00:25.360099 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:25.359996    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 29 21:00:25.492681 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:25.492643    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:26.359398 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:26.359363    2557 patch_prober.go:28] interesting pod/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 29 21:00:26.359782 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:26.359429    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 29 21:00:27.359584 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:27.359547    2557 patch_prober.go:28] interesting pod/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 29 21:00:27.360074 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:27.359604    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 29 21:00:28.359431 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:28.359399    2557 patch_prober.go:28] interesting pod/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 29 21:00:28.359645 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:28.359457    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 29 21:00:29.362901 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:29.362873    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:29.363916 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:29.363893    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:00:48.350006 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.349932    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"]
Jul 29 21:00:48.352910 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.352895    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.355530 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.355513    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-72dabfe4-openshift-default-dockercfg-t8lz4\""
Jul 29 21:00:48.376459 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.376434    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"]
Jul 29 21:00:48.440009 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.439974    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvsg8\" (UniqueName: \"kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-kube-api-access-rvsg8\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.440207 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.440026    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-envoy\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.440207 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.440060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-certs\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.440207 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.440119    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-token\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.440207 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.440148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istiod-ca-cert\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.440207 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.440176    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-credential-socket\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.440496 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.440226    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-socket\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.440496 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.440252    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-podinfo\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.440496 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.440290    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-data\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.541664 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.541633    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-token\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.541664 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.541667    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istiod-ca-cert\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.541898 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.541689    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-credential-socket\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.541898 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.541737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-socket\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.541898 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.541762    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-podinfo\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.541898 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.541794    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-data\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.541898 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.541875    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvsg8\" (UniqueName: \"kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-kube-api-access-rvsg8\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.542158 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.541906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-envoy\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.542158 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.541937    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-certs\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.542271 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.542191    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-socket\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.542271 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.542229    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-credential-socket\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.542392 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.542278    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-data\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.542392 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.542344    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-certs\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.542480 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.542464    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istiod-ca-cert\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.544151 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.544134    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-envoy\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.544386 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.544366    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-podinfo\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.554011 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.553983    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvsg8\" (UniqueName: \"kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-kube-api-access-rvsg8\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.554157 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.554139    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-token\") pod \"e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") " pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.663326 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.663268    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:48.800870 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.800844    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"]
Jul 29 21:00:48.802323 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:00:48.802299    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1409f27b_eb7f_403a_9e81_8f4cd3d47dd8.slice/crio-dda34be6bda37c0286dfd16b04c2b3368e1450be2cac3b2c80a3511a53ad604d WatchSource:0}: Error finding container dda34be6bda37c0286dfd16b04c2b3368e1450be2cac3b2c80a3511a53ad604d: Status 404 returned error can't find the container with id dda34be6bda37c0286dfd16b04c2b3368e1450be2cac3b2c80a3511a53ad604d
Jul 29 21:00:48.804406 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.804378    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:00:48.804471 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.804440    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:00:48.804508 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:48.804468    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:00:49.718589 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:49.718556    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" event={"ID":"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8","Type":"ContainerStarted","Data":"8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50"}
Jul 29 21:00:49.718989 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:49.718607    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" event={"ID":"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8","Type":"ContainerStarted","Data":"dda34be6bda37c0286dfd16b04c2b3368e1450be2cac3b2c80a3511a53ad604d"}
Jul 29 21:00:50.663960 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:50.663934    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:50.668608 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:50.668582    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:50.689627 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:50.689582    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" podStartSLOduration=2.689568611 podStartE2EDuration="2.689568611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:00:49.76691259 +0000 UTC m=+2159.618413262" watchObservedRunningTime="2026-07-29 21:00:50.689568611 +0000 UTC m=+2160.541069283"
Jul 29 21:00:50.723650 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:50.723631    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:00:50.724441 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:00:50.724424    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:01:06.766006 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:06.765970    2557 patch_prober.go:28] interesting pod/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 21:01:06.766420 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:06.766029    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 21:01:07.823538 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:07.823506    2557 generic.go:356] "Generic (PLEG): container finished" podID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerID="8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50" exitCode=0
Jul 29 21:01:07.824069 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:07.823583    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" event={"ID":"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8","Type":"ContainerDied","Data":"8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50"}
Jul 29 21:01:07.824069 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:07.823991    2557 scope.go:117] "RemoveContainer" containerID="8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50"
Jul 29 21:01:07.824979 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:07.824943    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:01:07.825094 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:07.825024    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:01:07.825094 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:07.825076    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:01:08.830890 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:08.830858    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" event={"ID":"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8","Type":"ContainerStarted","Data":"e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3"}
Jul 29 21:01:09.664230 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:09.664197    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:01:09.664451 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:09.664428    2557 patch_prober.go:28] interesting pod/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 29 21:01:09.664510 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:09.664490    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 29 21:01:10.664527 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:10.664493    2557 patch_prober.go:28] interesting pod/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 29 21:01:10.664919 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:10.664543    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 29 21:01:11.664549 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:11.664514    2557 patch_prober.go:28] interesting pod/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 29 21:01:11.665003 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:11.664569    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 29 21:01:12.666865 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:12.666827    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:01:12.667257 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:12.667122    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:01:12.667695 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:01:12.667679    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:04:37.820991 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:37.820955    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"]
Jul 29 21:04:37.823642 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:37.823620    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"
Jul 29 21:04:37.826357 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:37.826336    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 21:04:37.840807 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:37.840787    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"]
Jul 29 21:04:37.885985 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:37.885959    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a71f932-417b-4c4e-928b-b9431c95f54a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl\" (UID: \"5a71f932-417b-4c4e-928b-b9431c95f54a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"
Jul 29 21:04:37.987147 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:37.987111    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a71f932-417b-4c4e-928b-b9431c95f54a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl\" (UID: \"5a71f932-417b-4c4e-928b-b9431c95f54a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"
Jul 29 21:04:37.987683 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:37.987661    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a71f932-417b-4c4e-928b-b9431c95f54a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl\" (UID: \"5a71f932-417b-4c4e-928b-b9431c95f54a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"
Jul 29 21:04:38.133229 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:38.133170    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"
Jul 29 21:04:38.260207 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:38.260178    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"]
Jul 29 21:04:38.261725 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:04:38.261701    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a71f932_417b_4c4e_928b_b9431c95f54a.slice/crio-0aa3b18eef5aabfd7841d478d987e707133262a3449ea04214dc8260c4703291 WatchSource:0}: Error finding container 0aa3b18eef5aabfd7841d478d987e707133262a3449ea04214dc8260c4703291: Status 404 returned error can't find the container with id 0aa3b18eef5aabfd7841d478d987e707133262a3449ea04214dc8260c4703291
Jul 29 21:04:38.946913 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:38.946815    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl" event={"ID":"5a71f932-417b-4c4e-928b-b9431c95f54a","Type":"ContainerStarted","Data":"922bb13714ce7aad8f7a0c5bafb289432d1f952c5a48f29ef73eac31bcb03c5e"}
Jul 29 21:04:38.946913 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:38.946886    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl" event={"ID":"5a71f932-417b-4c4e-928b-b9431c95f54a","Type":"ContainerStarted","Data":"0aa3b18eef5aabfd7841d478d987e707133262a3449ea04214dc8260c4703291"}
Jul 29 21:04:38.961876 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:38.961807    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl" podStartSLOduration=1.961795477 podStartE2EDuration="1.961795477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:04:38.961615871 +0000 UTC m=+2388.813116544" watchObservedRunningTime="2026-07-29 21:04:38.961795477 +0000 UTC m=+2388.813296172"
Jul 29 21:04:39.953873 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:39.953828    2557 generic.go:356] "Generic (PLEG): container finished" podID="5a71f932-417b-4c4e-928b-b9431c95f54a" containerID="922bb13714ce7aad8f7a0c5bafb289432d1f952c5a48f29ef73eac31bcb03c5e" exitCode=0
Jul 29 21:04:39.954256 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:39.953935    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl" event={"ID":"5a71f932-417b-4c4e-928b-b9431c95f54a","Type":"ContainerDied","Data":"922bb13714ce7aad8f7a0c5bafb289432d1f952c5a48f29ef73eac31bcb03c5e"}
Jul 29 21:04:41.094180 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:41.094156    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"
Jul 29 21:04:41.216305 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:41.216226    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a71f932-417b-4c4e-928b-b9431c95f54a-maas-api-service-ca\") pod \"5a71f932-417b-4c4e-928b-b9431c95f54a\" (UID: \"5a71f932-417b-4c4e-928b-b9431c95f54a\") "
Jul 29 21:04:41.216543 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:41.216522    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a71f932-417b-4c4e-928b-b9431c95f54a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5a71f932-417b-4c4e-928b-b9431c95f54a" (UID: "5a71f932-417b-4c4e-928b-b9431c95f54a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:04:41.317587 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:41.317566    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a71f932-417b-4c4e-928b-b9431c95f54a-maas-api-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:04:41.967317 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:41.967288    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"
Jul 29 21:04:41.967317 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:41.967301    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl" event={"ID":"5a71f932-417b-4c4e-928b-b9431c95f54a","Type":"ContainerDied","Data":"0aa3b18eef5aabfd7841d478d987e707133262a3449ea04214dc8260c4703291"}
Jul 29 21:04:41.967558 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:41.967343    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aa3b18eef5aabfd7841d478d987e707133262a3449ea04214dc8260c4703291"
Jul 29 21:04:50.759903 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:50.759864    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:04:50.765321 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:50.765303    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:04:50.899530 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:04:50.899505    2557 scope.go:117] "RemoveContainer" containerID="73443074ac46464cdbb85478d9d8c5d421d89785d5bf50e7e4bd451c145e1074"
Jul 29 21:09:38.490901 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:38.490866    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"]
Jul 29 21:09:38.491433 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:38.491090    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy" containerID="cri-o://5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7" gracePeriod=30
Jul 29 21:09:38.863544 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:38.863511    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"]
Jul 29 21:09:38.864024 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:38.864006    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a71f932-417b-4c4e-928b-b9431c95f54a" containerName="revoke-keys"
Jul 29 21:09:38.864024 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:38.864025    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a71f932-417b-4c4e-928b-b9431c95f54a" containerName="revoke-keys"
Jul 29 21:09:38.864180 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:38.864112    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a71f932-417b-4c4e-928b-b9431c95f54a" containerName="revoke-keys"
Jul 29 21:09:38.866299 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:38.866280    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"
Jul 29 21:09:38.868754 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:38.868730    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 21:09:38.875096 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:38.875072    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"]
Jul 29 21:09:38.912258 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:38.912234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b7cd42-b28f-40f0-9e62-0171ff5919a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f\" (UID: \"82b7cd42-b28f-40f0-9e62-0171ff5919a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"
Jul 29 21:09:39.012868 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:39.012827    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b7cd42-b28f-40f0-9e62-0171ff5919a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f\" (UID: \"82b7cd42-b28f-40f0-9e62-0171ff5919a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"
Jul 29 21:09:39.013430 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:39.013411    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b7cd42-b28f-40f0-9e62-0171ff5919a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f\" (UID: \"82b7cd42-b28f-40f0-9e62-0171ff5919a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"
Jul 29 21:09:39.179590 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:39.179525    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"
Jul 29 21:09:39.516242 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:39.516221    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"]
Jul 29 21:09:39.517952 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:09:39.517927    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b7cd42_b28f_40f0_9e62_0171ff5919a3.slice/crio-d0525d87919113085f3a4c94e8d6e9f3dd2b60f7d16fc1b65c5e8b1e3d0a21dd WatchSource:0}: Error finding container d0525d87919113085f3a4c94e8d6e9f3dd2b60f7d16fc1b65c5e8b1e3d0a21dd: Status 404 returned error can't find the container with id d0525d87919113085f3a4c94e8d6e9f3dd2b60f7d16fc1b65c5e8b1e3d0a21dd
Jul 29 21:09:39.557309 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:39.557277    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f" event={"ID":"82b7cd42-b28f-40f0-9e62-0171ff5919a3","Type":"ContainerStarted","Data":"d0525d87919113085f3a4c94e8d6e9f3dd2b60f7d16fc1b65c5e8b1e3d0a21dd"}
Jul 29 21:09:40.564917 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:40.564818    2557 generic.go:356] "Generic (PLEG): container finished" podID="82b7cd42-b28f-40f0-9e62-0171ff5919a3" containerID="794996c65997abf7036a0344a8f554db4fcad4422172e6f159015c6289a4ffb4" exitCode=0
Jul 29 21:09:40.565277 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:40.564899    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f" event={"ID":"82b7cd42-b28f-40f0-9e62-0171ff5919a3","Type":"ContainerDied","Data":"794996c65997abf7036a0344a8f554db4fcad4422172e6f159015c6289a4ffb4"}
Jul 29 21:09:41.026503 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:41.026471    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"]
Jul 29 21:09:41.028709 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:41.028689    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4dbbbb61-xc2dl"]
Jul 29 21:09:41.697726 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:41.697703    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"
Jul 29 21:09:41.736791 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:41.736761    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b7cd42-b28f-40f0-9e62-0171ff5919a3-maas-api-service-ca\") pod \"82b7cd42-b28f-40f0-9e62-0171ff5919a3\" (UID: \"82b7cd42-b28f-40f0-9e62-0171ff5919a3\") "
Jul 29 21:09:41.737092 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:41.737072    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b7cd42-b28f-40f0-9e62-0171ff5919a3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "82b7cd42-b28f-40f0-9e62-0171ff5919a3" (UID: "82b7cd42-b28f-40f0-9e62-0171ff5919a3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:41.838149 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:41.838093    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b7cd42-b28f-40f0-9e62-0171ff5919a3-maas-api-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:09:42.578195 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:42.578164    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"
Jul 29 21:09:42.578373 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:42.578198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f" event={"ID":"82b7cd42-b28f-40f0-9e62-0171ff5919a3","Type":"ContainerDied","Data":"d0525d87919113085f3a4c94e8d6e9f3dd2b60f7d16fc1b65c5e8b1e3d0a21dd"}
Jul 29 21:09:42.578373 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:42.578257    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0525d87919113085f3a4c94e8d6e9f3dd2b60f7d16fc1b65c5e8b1e3d0a21dd"
Jul 29 21:09:42.621617 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:42.621590    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a71f932-417b-4c4e-928b-b9431c95f54a" path="/var/lib/kubelet/pods/5a71f932-417b-4c4e-928b-b9431c95f54a/volumes"
Jul 29 21:09:43.749651 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.749595    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:09:43.854603 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.854570    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-credential-socket\") pod \"297f700f-ec01-444c-91bd-6fbd3968af8d\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") "
Jul 29 21:09:43.854751 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.854628    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-podinfo\") pod \"297f700f-ec01-444c-91bd-6fbd3968af8d\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") "
Jul 29 21:09:43.854751 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.854668    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-envoy\") pod \"297f700f-ec01-444c-91bd-6fbd3968af8d\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") "
Jul 29 21:09:43.854751 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.854696    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-token\") pod \"297f700f-ec01-444c-91bd-6fbd3968af8d\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") "
Jul 29 21:09:43.854885 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.854750    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-certs\") pod \"297f700f-ec01-444c-91bd-6fbd3968af8d\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") "
Jul 29 21:09:43.854885 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.854779    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-socket\") pod \"297f700f-ec01-444c-91bd-6fbd3968af8d\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") "
Jul 29 21:09:43.854885 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.854868    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "297f700f-ec01-444c-91bd-6fbd3968af8d" (UID: "297f700f-ec01-444c-91bd-6fbd3968af8d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:09:43.855010 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.854920    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxvg2\" (UniqueName: \"kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-kube-api-access-gxvg2\") pod \"297f700f-ec01-444c-91bd-6fbd3968af8d\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") "
Jul 29 21:09:43.855010 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.854951    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/297f700f-ec01-444c-91bd-6fbd3968af8d-istiod-ca-cert\") pod \"297f700f-ec01-444c-91bd-6fbd3968af8d\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") "
Jul 29 21:09:43.855114 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.854984    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-data\") pod \"297f700f-ec01-444c-91bd-6fbd3968af8d\" (UID: \"297f700f-ec01-444c-91bd-6fbd3968af8d\") "
Jul 29 21:09:43.855114 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.855068    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "297f700f-ec01-444c-91bd-6fbd3968af8d" (UID: "297f700f-ec01-444c-91bd-6fbd3968af8d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:09:43.855114 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.855082    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "297f700f-ec01-444c-91bd-6fbd3968af8d" (UID: "297f700f-ec01-444c-91bd-6fbd3968af8d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:09:43.855429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.855366    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:09:43.855429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.855389    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:09:43.855429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.855403    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:09:43.855674 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.855439    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/297f700f-ec01-444c-91bd-6fbd3968af8d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "297f700f-ec01-444c-91bd-6fbd3968af8d" (UID: "297f700f-ec01-444c-91bd-6fbd3968af8d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:43.856185 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.856158    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-data" (OuterVolumeSpecName: "istio-data") pod "297f700f-ec01-444c-91bd-6fbd3968af8d" (UID: "297f700f-ec01-444c-91bd-6fbd3968af8d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:09:43.856954 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.856931    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-token" (OuterVolumeSpecName: "istio-token") pod "297f700f-ec01-444c-91bd-6fbd3968af8d" (UID: "297f700f-ec01-444c-91bd-6fbd3968af8d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:09:43.857069 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.856960    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "297f700f-ec01-444c-91bd-6fbd3968af8d" (UID: "297f700f-ec01-444c-91bd-6fbd3968af8d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:09:43.857069 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.856967    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-kube-api-access-gxvg2" (OuterVolumeSpecName: "kube-api-access-gxvg2") pod "297f700f-ec01-444c-91bd-6fbd3968af8d" (UID: "297f700f-ec01-444c-91bd-6fbd3968af8d"). InnerVolumeSpecName "kube-api-access-gxvg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:09:43.857069 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.857026    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "297f700f-ec01-444c-91bd-6fbd3968af8d" (UID: "297f700f-ec01-444c-91bd-6fbd3968af8d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:09:43.956797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.956767    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:09:43.956797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.956796    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:09:43.956797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.956805    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:09:43.956979 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.956814    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxvg2\" (UniqueName: \"kubernetes.io/projected/297f700f-ec01-444c-91bd-6fbd3968af8d-kube-api-access-gxvg2\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:09:43.956979 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.956823    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/297f700f-ec01-444c-91bd-6fbd3968af8d-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:09:43.956979 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:43.956851    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/297f700f-ec01-444c-91bd-6fbd3968af8d-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:09:44.597451 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.597421    2557 generic.go:356] "Generic (PLEG): container finished" podID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerID="5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7" exitCode=0
Jul 29 21:09:44.597610 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.597464    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" event={"ID":"297f700f-ec01-444c-91bd-6fbd3968af8d","Type":"ContainerDied","Data":"5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7"}
Jul 29 21:09:44.597610 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.597474    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"
Jul 29 21:09:44.597610 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.597526    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5" event={"ID":"297f700f-ec01-444c-91bd-6fbd3968af8d","Type":"ContainerDied","Data":"69576bb2dcf2ba479f31a638b02c54c130313bfb9179bbecff5a386f3e5b16eb"}
Jul 29 21:09:44.597610 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.597548    2557 scope.go:117] "RemoveContainer" containerID="5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7"
Jul 29 21:09:44.606885 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.606866    2557 scope.go:117] "RemoveContainer" containerID="d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172"
Jul 29 21:09:44.614551 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.614536    2557 scope.go:117] "RemoveContainer" containerID="5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7"
Jul 29 21:09:44.614776 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:09:44.614760    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7\": container with ID starting with 5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7 not found: ID does not exist" containerID="5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7"
Jul 29 21:09:44.614815 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.614784    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7"} err="failed to get container status \"5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7\": rpc error: code = NotFound desc = could not find container \"5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7\": container with ID starting with 5e9ba225edd8d89b05ef402ad6310dd6b4ca70dec3f5eb25b71d74424b75b7d7 not found: ID does not exist"
Jul 29 21:09:44.614815 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.614799    2557 scope.go:117] "RemoveContainer" containerID="d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172"
Jul 29 21:09:44.615010 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:09:44.614992    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172\": container with ID starting with d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172 not found: ID does not exist" containerID="d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172"
Jul 29 21:09:44.615043 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.615016    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172"} err="failed to get container status \"d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172\": rpc error: code = NotFound desc = could not find container \"d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172\": container with ID starting with d28a7709499a145f24cefcddd8cc0ee238791d0c8da4d95e99b6ac89658be172 not found: ID does not exist"
Jul 29 21:09:44.622484 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.622460    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"]
Jul 29 21:09:44.625215 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:44.625194    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4dbbbb61-openshift-default-86df876648-4j9l5"]
Jul 29 21:09:46.621854 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:46.621810    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" path="/var/lib/kubelet/pods/297f700f-ec01-444c-91bd-6fbd3968af8d/volumes"
Jul 29 21:09:50.795117 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:50.795090    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:09:50.802923 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:50.802902    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:09:54.611606 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:54.611568    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"]
Jul 29 21:09:54.613967 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:54.613944    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-72dabfe4-qvk2f"]
Jul 29 21:09:54.623840 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:09:54.623796    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b7cd42-b28f-40f0-9e62-0171ff5919a3" path="/var/lib/kubelet/pods/82b7cd42-b28f-40f0-9e62-0171ff5919a3/volumes"
Jul 29 21:10:01.011305 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.011277    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"]
Jul 29 21:10:01.011744 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.011532    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy" containerID="cri-o://e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3" gracePeriod=30
Jul 29 21:10:01.850597 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.850555    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"]
Jul 29 21:10:01.850987 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.850974    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy"
Jul 29 21:10:01.851044 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.850988    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy"
Jul 29 21:10:01.851044 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.850998    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b7cd42-b28f-40f0-9e62-0171ff5919a3" containerName="revoke-keys"
Jul 29 21:10:01.851044 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.851004    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b7cd42-b28f-40f0-9e62-0171ff5919a3" containerName="revoke-keys"
Jul 29 21:10:01.851044 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.851017    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy"
Jul 29 21:10:01.851044 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.851022    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy"
Jul 29 21:10:01.851225 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.851084    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b7cd42-b28f-40f0-9e62-0171ff5919a3" containerName="revoke-keys"
Jul 29 21:10:01.851225 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.851093    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy"
Jul 29 21:10:01.854232 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.854212    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:01.857575 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.857556    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0ab55cec-openshift-default-dockercfg-hk76l\""
Jul 29 21:10:01.883717 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:01.883682    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"]
Jul 29 21:10:02.009826 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.009780    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-credential-socket\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.009826 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.009842    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-data\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.010083 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.009906    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-envoy\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.010083 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.009961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-certs\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.010083 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.009985    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7481b7fe-5d2d-45dd-bf77-827e87351edb-istiod-ca-cert\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.010083 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.010014    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-podinfo\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.010083 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.010034    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9hq4\" (UniqueName: \"kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-kube-api-access-l9hq4\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.010283 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.010110    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-socket\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.010283 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.010170    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-token\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.111349 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-data\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.111349 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111296    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-envoy\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.111349 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111321    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-certs\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.111349 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7481b7fe-5d2d-45dd-bf77-827e87351edb-istiod-ca-cert\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.112020 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111390    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-podinfo\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.112020 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111422    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9hq4\" (UniqueName: \"kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-kube-api-access-l9hq4\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.112020 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111447    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-socket\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.112020 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111495    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-token\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.112020 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111541    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-credential-socket\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.112020 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111717    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-data\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.112020 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111828    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-certs\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.112020 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.111897    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-credential-socket\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.112448 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.112060    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-socket\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.112448 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.112160    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7481b7fe-5d2d-45dd-bf77-827e87351edb-istiod-ca-cert\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.113790 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.113765    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-envoy\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.114086 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.114067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-podinfo\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.119515 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.119490    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-token\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.119631 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.119613    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9hq4\" (UniqueName: \"kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-kube-api-access-l9hq4\") pod \"e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") " pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.164769 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.164703    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:02.316015 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.315984    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"]
Jul 29 21:10:02.316693 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:10:02.316662    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7481b7fe_5d2d_45dd_bf77_827e87351edb.slice/crio-341d198403244ead9d3d23c9acaa922ae01b6e4dfd6466be027e25c5bd1144ea WatchSource:0}: Error finding container 341d198403244ead9d3d23c9acaa922ae01b6e4dfd6466be027e25c5bd1144ea: Status 404 returned error can't find the container with id 341d198403244ead9d3d23c9acaa922ae01b6e4dfd6466be027e25c5bd1144ea
Jul 29 21:10:02.319227 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.319194    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:10:02.319334 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.319277    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:10:02.319334 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.319322    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:10:02.703945 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.703859    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" event={"ID":"7481b7fe-5d2d-45dd-bf77-827e87351edb","Type":"ContainerStarted","Data":"29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73"}
Jul 29 21:10:02.703945 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.703911    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" event={"ID":"7481b7fe-5d2d-45dd-bf77-827e87351edb","Type":"ContainerStarted","Data":"341d198403244ead9d3d23c9acaa922ae01b6e4dfd6466be027e25c5bd1144ea"}
Jul 29 21:10:02.726055 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:02.726013    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" podStartSLOduration=1.7259986889999999 podStartE2EDuration="1.725998689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:10:02.723554272 +0000 UTC m=+2712.575054950" watchObservedRunningTime="2026-07-29 21:10:02.725998689 +0000 UTC m=+2712.577499361"
Jul 29 21:10:03.165585 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:03.165556    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:03.170005 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:03.169976    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:03.710165 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:03.710133    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:03.711159 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:03.711139    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:06.276809 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.276747    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:10:06.322769 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.322741    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"]
Jul 29 21:10:06.323211 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.323195    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy"
Jul 29 21:10:06.323285 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.323214    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy"
Jul 29 21:10:06.323285 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.323230    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy"
Jul 29 21:10:06.323285 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.323236    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy"
Jul 29 21:10:06.323431 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.323297    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="297f700f-ec01-444c-91bd-6fbd3968af8d" containerName="istio-proxy"
Jul 29 21:10:06.323431 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.323305    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy"
Jul 29 21:10:06.323431 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.323313    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerName="istio-proxy"
Jul 29 21:10:06.326284 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.326267    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:06.337740 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.337702    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0ab55cec-dockercfg-2c6t7\""
Jul 29 21:10:06.338689 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.338672    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0ab55cec\""
Jul 29 21:10:06.358976 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.358951    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"]
Jul 29 21:10:06.450389 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450357    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-certs\") pod \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") "
Jul 29 21:10:06.450551 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450404    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvsg8\" (UniqueName: \"kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-kube-api-access-rvsg8\") pod \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") "
Jul 29 21:10:06.450551 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450468    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-token\") pod \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") "
Jul 29 21:10:06.450551 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450484    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istiod-ca-cert\") pod \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") "
Jul 29 21:10:06.450551 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450513    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-podinfo\") pod \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") "
Jul 29 21:10:06.450551 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450546    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-envoy\") pod \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") "
Jul 29 21:10:06.450844 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450597    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-data\") pod \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") "
Jul 29 21:10:06.450844 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450627    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-credential-socket\") pod \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") "
Jul 29 21:10:06.450844 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450668    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-socket\") pod \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\" (UID: \"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8\") "
Jul 29 21:10:06.450844 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450693    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" (UID: "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:10:06.451074 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450867    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bebfb65-2640-417a-83f9-94a9b56aacec-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh\" (UID: \"9bebfb65-2640-417a-83f9-94a9b56aacec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:06.451074 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450875    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" (UID: "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:10:06.451074 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.450940    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66d8n\" (UniqueName: \"kubernetes.io/projected/9bebfb65-2640-417a-83f9-94a9b56aacec-kube-api-access-66d8n\") pod \"payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh\" (UID: \"9bebfb65-2640-417a-83f9-94a9b56aacec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:06.451074 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.451017    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" (UID: "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:10:06.451300 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.451085    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:06.451300 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.451101    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:06.451300 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.451118    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:06.451300 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.451276    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" (UID: "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:10:06.451947 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.451875    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-data" (OuterVolumeSpecName: "istio-data") pod "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" (UID: "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:10:06.453369 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.453340    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" (UID: "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:10:06.453588 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.453564    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" (UID: "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:10:06.453679 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.453582    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-kube-api-access-rvsg8" (OuterVolumeSpecName: "kube-api-access-rvsg8") pod "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" (UID: "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8"). InnerVolumeSpecName "kube-api-access-rvsg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:10:06.453679 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.453653    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-token" (OuterVolumeSpecName: "istio-token") pod "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" (UID: "1409f27b-eb7f-403a-9e81-8f4cd3d47dd8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:10:06.552089 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.552017    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66d8n\" (UniqueName: \"kubernetes.io/projected/9bebfb65-2640-417a-83f9-94a9b56aacec-kube-api-access-66d8n\") pod \"payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh\" (UID: \"9bebfb65-2640-417a-83f9-94a9b56aacec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:06.552221 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.552110    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bebfb65-2640-417a-83f9-94a9b56aacec-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh\" (UID: \"9bebfb65-2640-417a-83f9-94a9b56aacec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:06.552221 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.552143    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:06.552221 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.552153    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:06.552221 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.552161    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:06.552221 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.552170    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:06.552221 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.552178    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:06.552221 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.552186    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvsg8\" (UniqueName: \"kubernetes.io/projected/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8-kube-api-access-rvsg8\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:06.552781 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.552762    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bebfb65-2640-417a-83f9-94a9b56aacec-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh\" (UID: \"9bebfb65-2640-417a-83f9-94a9b56aacec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:06.560562 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.560543    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66d8n\" (UniqueName: \"kubernetes.io/projected/9bebfb65-2640-417a-83f9-94a9b56aacec-kube-api-access-66d8n\") pod \"payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh\" (UID: \"9bebfb65-2640-417a-83f9-94a9b56aacec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:06.635709 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.635687    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:06.727753 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.727720    2557 generic.go:356] "Generic (PLEG): container finished" podID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" containerID="e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3" exitCode=0
Jul 29 21:10:06.727952 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.727922    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" event={"ID":"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8","Type":"ContainerDied","Data":"e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3"}
Jul 29 21:10:06.728023 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.727953    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"
Jul 29 21:10:06.728023 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.727994    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p" event={"ID":"1409f27b-eb7f-403a-9e81-8f4cd3d47dd8","Type":"ContainerDied","Data":"dda34be6bda37c0286dfd16b04c2b3368e1450be2cac3b2c80a3511a53ad604d"}
Jul 29 21:10:06.728187 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.728027    2557 scope.go:117] "RemoveContainer" containerID="e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3"
Jul 29 21:10:06.738902 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.738882    2557 scope.go:117] "RemoveContainer" containerID="8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50"
Jul 29 21:10:06.748408 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.748387    2557 scope.go:117] "RemoveContainer" containerID="e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3"
Jul 29 21:10:06.748690 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:10:06.748661    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3\": container with ID starting with e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3 not found: ID does not exist" containerID="e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3"
Jul 29 21:10:06.748797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.748700    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3"} err="failed to get container status \"e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3\": rpc error: code = NotFound desc = could not find container \"e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3\": container with ID starting with e4cdf88ec78e9db3d360318a2a78a980c2e36740fff1e498f132d659985c89c3 not found: ID does not exist"
Jul 29 21:10:06.748797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.748724    2557 scope.go:117] "RemoveContainer" containerID="8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50"
Jul 29 21:10:06.749059 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:10:06.749031    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50\": container with ID starting with 8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50 not found: ID does not exist" containerID="8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50"
Jul 29 21:10:06.749133 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.749068    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50"} err="failed to get container status \"8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50\": rpc error: code = NotFound desc = could not find container \"8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50\": container with ID starting with 8672565fe08c7c320b51ee06daa01af31cf75a7546ce7ad0fa1ed258f3510c50 not found: ID does not exist"
Jul 29 21:10:06.749195 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.749139    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"]
Jul 29 21:10:06.755688 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.755626    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-72dabfe4-openshift-default-6d4c567976-jpv4p"]
Jul 29 21:10:06.790149 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:06.790127    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"]
Jul 29 21:10:06.791402 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:10:06.791379    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bebfb65_2640_417a_83f9_94a9b56aacec.slice/crio-be72ea0a4ec6e2b4a85a975b20a695c4437589a3d8e7fb0bf5b2c9521a6cef69 WatchSource:0}: Error finding container be72ea0a4ec6e2b4a85a975b20a695c4437589a3d8e7fb0bf5b2c9521a6cef69: Status 404 returned error can't find the container with id be72ea0a4ec6e2b4a85a975b20a695c4437589a3d8e7fb0bf5b2c9521a6cef69
Jul 29 21:10:07.739057 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:07.739027    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh" event={"ID":"9bebfb65-2640-417a-83f9-94a9b56aacec","Type":"ContainerStarted","Data":"a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba"}
Jul 29 21:10:07.739452 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:07.739075    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh" event={"ID":"9bebfb65-2640-417a-83f9-94a9b56aacec","Type":"ContainerStarted","Data":"be72ea0a4ec6e2b4a85a975b20a695c4437589a3d8e7fb0bf5b2c9521a6cef69"}
Jul 29 21:10:07.739452 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:07.739125    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:07.758908 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:07.758861    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh" podStartSLOduration=1.758848572 podStartE2EDuration="1.758848572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:10:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:10:07.757145803 +0000 UTC m=+2717.608646477" watchObservedRunningTime="2026-07-29 21:10:07.758848572 +0000 UTC m=+2717.610349236"
Jul 29 21:10:08.622052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:08.622018    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1409f27b-eb7f-403a-9e81-8f4cd3d47dd8" path="/var/lib/kubelet/pods/1409f27b-eb7f-403a-9e81-8f4cd3d47dd8/volumes"
Jul 29 21:10:18.712313 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:18.712235    2557 patch_prober.go:28] interesting pod/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 29 21:10:18.712313 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:18.712299    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 29 21:10:18.746351 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:18.746326    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:18.803594 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:18.803559    2557 generic.go:356] "Generic (PLEG): container finished" podID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerID="29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73" exitCode=0
Jul 29 21:10:18.803742 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:18.803624    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" event={"ID":"7481b7fe-5d2d-45dd-bf77-827e87351edb","Type":"ContainerDied","Data":"29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73"}
Jul 29 21:10:18.804062 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:18.804048    2557 scope.go:117] "RemoveContainer" containerID="29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73"
Jul 29 21:10:18.805074 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:18.805046    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:10:18.805141 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:18.805119    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:10:18.805183 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:18.805153    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:10:19.811333 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:19.811295    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" event={"ID":"7481b7fe-5d2d-45dd-bf77-827e87351edb","Type":"ContainerStarted","Data":"a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885"}
Jul 29 21:10:20.165646 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:20.165564    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:20.165799 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:20.165728    2557 patch_prober.go:28] interesting pod/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 29 21:10:20.165799 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:20.165783    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 29 21:10:21.165374 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:21.165345    2557 patch_prober.go:28] interesting pod/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 29 21:10:21.165759 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:21.165393    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 29 21:10:21.686825 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:21.686783    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"]
Jul 29 21:10:21.690779 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:21.690748    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"
Jul 29 21:10:21.693665 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:21.693644    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 21:10:21.705586 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:21.705559    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"]
Jul 29 21:10:21.798247 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:21.798210    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f420d46e-8230-40ed-85da-275c072f16ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2\" (UID: \"f420d46e-8230-40ed-85da-275c072f16ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"
Jul 29 21:10:21.899201 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:21.899170    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f420d46e-8230-40ed-85da-275c072f16ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2\" (UID: \"f420d46e-8230-40ed-85da-275c072f16ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"
Jul 29 21:10:21.899792 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:21.899774    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f420d46e-8230-40ed-85da-275c072f16ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2\" (UID: \"f420d46e-8230-40ed-85da-275c072f16ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"
Jul 29 21:10:22.006516 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:22.006444    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"
Jul 29 21:10:22.165763 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:22.165732    2557 patch_prober.go:28] interesting pod/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 29 21:10:22.166100 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:22.165790    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 29 21:10:22.166771 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:22.166746    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"]
Jul 29 21:10:22.168481 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:10:22.168455    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf420d46e_8230_40ed_85da_275c072f16ae.slice/crio-c22de639b711b003a9a5d9b38cff038200bbd0017777eb5472ed82a3f197e170 WatchSource:0}: Error finding container c22de639b711b003a9a5d9b38cff038200bbd0017777eb5472ed82a3f197e170: Status 404 returned error can't find the container with id c22de639b711b003a9a5d9b38cff038200bbd0017777eb5472ed82a3f197e170
Jul 29 21:10:22.828078 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:22.828042    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2" event={"ID":"f420d46e-8230-40ed-85da-275c072f16ae","Type":"ContainerStarted","Data":"d80f3034ef2804904d9c658daad62c9d3d09dcb27202e9ac719aa7473f150210"}
Jul 29 21:10:22.828275 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:22.828092    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2" event={"ID":"f420d46e-8230-40ed-85da-275c072f16ae","Type":"ContainerStarted","Data":"c22de639b711b003a9a5d9b38cff038200bbd0017777eb5472ed82a3f197e170"}
Jul 29 21:10:22.846121 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:22.846074    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2" podStartSLOduration=1.846058981 podStartE2EDuration="1.846058981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:10:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:10:22.844123002 +0000 UTC m=+2732.695623675" watchObservedRunningTime="2026-07-29 21:10:22.846058981 +0000 UTC m=+2732.697559678"
Jul 29 21:10:23.165545 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:23.165519    2557 patch_prober.go:28] interesting pod/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 29 21:10:23.165658 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:23.165569    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 29 21:10:23.835305 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:23.835272    2557 generic.go:356] "Generic (PLEG): container finished" podID="f420d46e-8230-40ed-85da-275c072f16ae" containerID="d80f3034ef2804904d9c658daad62c9d3d09dcb27202e9ac719aa7473f150210" exitCode=0
Jul 29 21:10:23.835717 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:23.835358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2" event={"ID":"f420d46e-8230-40ed-85da-275c072f16ae","Type":"ContainerDied","Data":"d80f3034ef2804904d9c658daad62c9d3d09dcb27202e9ac719aa7473f150210"}
Jul 29 21:10:24.169145 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:24.169073    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:24.169472 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:24.169453    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:24.170215 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:24.170200    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:24.974805 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:24.974783    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"
Jul 29 21:10:25.027911 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:25.027883    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f420d46e-8230-40ed-85da-275c072f16ae-maas-api-service-ca\") pod \"f420d46e-8230-40ed-85da-275c072f16ae\" (UID: \"f420d46e-8230-40ed-85da-275c072f16ae\") "
Jul 29 21:10:25.028224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:25.028201    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f420d46e-8230-40ed-85da-275c072f16ae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f420d46e-8230-40ed-85da-275c072f16ae" (UID: "f420d46e-8230-40ed-85da-275c072f16ae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:10:25.128848 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:25.128776    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f420d46e-8230-40ed-85da-275c072f16ae-maas-api-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:25.847192 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:25.847167    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"
Jul 29 21:10:25.847479 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:25.847211    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2" event={"ID":"f420d46e-8230-40ed-85da-275c072f16ae","Type":"ContainerDied","Data":"c22de639b711b003a9a5d9b38cff038200bbd0017777eb5472ed82a3f197e170"}
Jul 29 21:10:25.847479 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:25.847255    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c22de639b711b003a9a5d9b38cff038200bbd0017777eb5472ed82a3f197e170"
Jul 29 21:10:27.403789 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.403759    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"]
Jul 29 21:10:27.404244 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.404008    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh" podUID="9bebfb65-2640-417a-83f9-94a9b56aacec" containerName="payload-pre-processing" containerID="cri-o://a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba" gracePeriod=30
Jul 29 21:10:27.568358 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.568286    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"]
Jul 29 21:10:27.572253 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.572231    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ab55cec-tnvw2"]
Jul 29 21:10:27.655527 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.655471    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:27.748856 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.748794    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bebfb65-2640-417a-83f9-94a9b56aacec-plugins-config-volume\") pod \"9bebfb65-2640-417a-83f9-94a9b56aacec\" (UID: \"9bebfb65-2640-417a-83f9-94a9b56aacec\") "
Jul 29 21:10:27.748856 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.748862    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66d8n\" (UniqueName: \"kubernetes.io/projected/9bebfb65-2640-417a-83f9-94a9b56aacec-kube-api-access-66d8n\") pod \"9bebfb65-2640-417a-83f9-94a9b56aacec\" (UID: \"9bebfb65-2640-417a-83f9-94a9b56aacec\") "
Jul 29 21:10:27.749130 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.749109    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bebfb65-2640-417a-83f9-94a9b56aacec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9bebfb65-2640-417a-83f9-94a9b56aacec" (UID: "9bebfb65-2640-417a-83f9-94a9b56aacec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:10:27.749221 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.749202    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bebfb65-2640-417a-83f9-94a9b56aacec-plugins-config-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:27.750915 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.750883    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bebfb65-2640-417a-83f9-94a9b56aacec-kube-api-access-66d8n" (OuterVolumeSpecName: "kube-api-access-66d8n") pod "9bebfb65-2640-417a-83f9-94a9b56aacec" (UID: "9bebfb65-2640-417a-83f9-94a9b56aacec"). InnerVolumeSpecName "kube-api-access-66d8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:10:27.850100 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.850077    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66d8n\" (UniqueName: \"kubernetes.io/projected/9bebfb65-2640-417a-83f9-94a9b56aacec-kube-api-access-66d8n\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:27.864594 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.864568    2557 generic.go:356] "Generic (PLEG): container finished" podID="9bebfb65-2640-417a-83f9-94a9b56aacec" containerID="a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba" exitCode=0
Jul 29 21:10:27.864700 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.864605    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"
Jul 29 21:10:27.864700 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.864609    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh" event={"ID":"9bebfb65-2640-417a-83f9-94a9b56aacec","Type":"ContainerDied","Data":"a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba"}
Jul 29 21:10:27.864700 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.864650    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh" event={"ID":"9bebfb65-2640-417a-83f9-94a9b56aacec","Type":"ContainerDied","Data":"be72ea0a4ec6e2b4a85a975b20a695c4437589a3d8e7fb0bf5b2c9521a6cef69"}
Jul 29 21:10:27.864700 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.864672    2557 scope.go:117] "RemoveContainer" containerID="a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba"
Jul 29 21:10:27.874080 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.874058    2557 scope.go:117] "RemoveContainer" containerID="a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba"
Jul 29 21:10:27.874348 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:10:27.874326    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba\": container with ID starting with a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba not found: ID does not exist" containerID="a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba"
Jul 29 21:10:27.874398 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.874360    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba"} err="failed to get container status \"a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba\": rpc error: code = NotFound desc = could not find container \"a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba\": container with ID starting with a36e00130df41300511f8566d1776591e53d8f1056ce79b907b0990c75df95ba not found: ID does not exist"
Jul 29 21:10:27.887633 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.887612    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"]
Jul 29 21:10:27.891457 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:27.891437    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ab55cec-7957c48668-8j5sh"]
Jul 29 21:10:28.621590 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:28.621559    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bebfb65-2640-417a-83f9-94a9b56aacec" path="/var/lib/kubelet/pods/9bebfb65-2640-417a-83f9-94a9b56aacec/volumes"
Jul 29 21:10:28.621975 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:28.621881    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f420d46e-8230-40ed-85da-275c072f16ae" path="/var/lib/kubelet/pods/f420d46e-8230-40ed-85da-275c072f16ae/volumes"
Jul 29 21:10:33.880136 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:33.880099    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"]
Jul 29 21:10:33.880586 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:33.880292    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy" containerID="cri-o://a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885" gracePeriod=30
Jul 29 21:10:39.141171 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.141144    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:39.237655 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.237593    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-data\") pod \"7481b7fe-5d2d-45dd-bf77-827e87351edb\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") "
Jul 29 21:10:39.237655 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.237622    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7481b7fe-5d2d-45dd-bf77-827e87351edb-istiod-ca-cert\") pod \"7481b7fe-5d2d-45dd-bf77-827e87351edb\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") "
Jul 29 21:10:39.237655 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.237640    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-token\") pod \"7481b7fe-5d2d-45dd-bf77-827e87351edb\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") "
Jul 29 21:10:39.237916 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.237693    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-credential-socket\") pod \"7481b7fe-5d2d-45dd-bf77-827e87351edb\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") "
Jul 29 21:10:39.237916 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.237718    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-socket\") pod \"7481b7fe-5d2d-45dd-bf77-827e87351edb\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") "
Jul 29 21:10:39.237916 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.237745    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-podinfo\") pod \"7481b7fe-5d2d-45dd-bf77-827e87351edb\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") "
Jul 29 21:10:39.237916 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.237793    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9hq4\" (UniqueName: \"kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-kube-api-access-l9hq4\") pod \"7481b7fe-5d2d-45dd-bf77-827e87351edb\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") "
Jul 29 21:10:39.237916 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.237824    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-certs\") pod \"7481b7fe-5d2d-45dd-bf77-827e87351edb\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") "
Jul 29 21:10:39.237916 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.237882    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-envoy\") pod \"7481b7fe-5d2d-45dd-bf77-827e87351edb\" (UID: \"7481b7fe-5d2d-45dd-bf77-827e87351edb\") "
Jul 29 21:10:39.238202 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.238009    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7481b7fe-5d2d-45dd-bf77-827e87351edb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7481b7fe-5d2d-45dd-bf77-827e87351edb" (UID: "7481b7fe-5d2d-45dd-bf77-827e87351edb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:10:39.238202 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.238184    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7481b7fe-5d2d-45dd-bf77-827e87351edb" (UID: "7481b7fe-5d2d-45dd-bf77-827e87351edb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:10:39.238304 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.238227    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7481b7fe-5d2d-45dd-bf77-827e87351edb-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:39.238372 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.238337    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7481b7fe-5d2d-45dd-bf77-827e87351edb" (UID: "7481b7fe-5d2d-45dd-bf77-827e87351edb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:10:39.238372 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.238350    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7481b7fe-5d2d-45dd-bf77-827e87351edb" (UID: "7481b7fe-5d2d-45dd-bf77-827e87351edb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:10:39.238488 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.238405    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-data" (OuterVolumeSpecName: "istio-data") pod "7481b7fe-5d2d-45dd-bf77-827e87351edb" (UID: "7481b7fe-5d2d-45dd-bf77-827e87351edb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:10:39.240124 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.240094    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-kube-api-access-l9hq4" (OuterVolumeSpecName: "kube-api-access-l9hq4") pod "7481b7fe-5d2d-45dd-bf77-827e87351edb" (UID: "7481b7fe-5d2d-45dd-bf77-827e87351edb"). InnerVolumeSpecName "kube-api-access-l9hq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:10:39.240226 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.240139    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-token" (OuterVolumeSpecName: "istio-token") pod "7481b7fe-5d2d-45dd-bf77-827e87351edb" (UID: "7481b7fe-5d2d-45dd-bf77-827e87351edb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:10:39.240226 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.240190    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7481b7fe-5d2d-45dd-bf77-827e87351edb" (UID: "7481b7fe-5d2d-45dd-bf77-827e87351edb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:10:39.240226 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.240207    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7481b7fe-5d2d-45dd-bf77-827e87351edb" (UID: "7481b7fe-5d2d-45dd-bf77-827e87351edb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:10:39.339360 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.339338    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:39.339360 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.339358    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:39.339495 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.339367    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:39.339495 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.339377    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:39.339495 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.339385    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:39.339495 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.339392    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9hq4\" (UniqueName: \"kubernetes.io/projected/7481b7fe-5d2d-45dd-bf77-827e87351edb-kube-api-access-l9hq4\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:39.339495 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.339401    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:39.339495 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.339409    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7481b7fe-5d2d-45dd-bf77-827e87351edb-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:10:39.934225 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.934194    2557 generic.go:356] "Generic (PLEG): container finished" podID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerID="a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885" exitCode=0
Jul 29 21:10:39.934396 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.934244    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"
Jul 29 21:10:39.934396 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.934242    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" event={"ID":"7481b7fe-5d2d-45dd-bf77-827e87351edb","Type":"ContainerDied","Data":"a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885"}
Jul 29 21:10:39.934396 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.934369    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875" event={"ID":"7481b7fe-5d2d-45dd-bf77-827e87351edb","Type":"ContainerDied","Data":"341d198403244ead9d3d23c9acaa922ae01b6e4dfd6466be027e25c5bd1144ea"}
Jul 29 21:10:39.934577 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.934401    2557 scope.go:117] "RemoveContainer" containerID="a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885"
Jul 29 21:10:39.944051 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.944034    2557 scope.go:117] "RemoveContainer" containerID="29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73"
Jul 29 21:10:39.952103 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.952086    2557 scope.go:117] "RemoveContainer" containerID="a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885"
Jul 29 21:10:39.952326 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:10:39.952308    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885\": container with ID starting with a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885 not found: ID does not exist" containerID="a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885"
Jul 29 21:10:39.952375 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.952334    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885"} err="failed to get container status \"a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885\": rpc error: code = NotFound desc = could not find container \"a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885\": container with ID starting with a856654876d151a107f4bab0b9722476cf229b96bf1eb680d4908e1ce14a4885 not found: ID does not exist"
Jul 29 21:10:39.952375 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.952351    2557 scope.go:117] "RemoveContainer" containerID="29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73"
Jul 29 21:10:39.952574 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:10:39.952550    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73\": container with ID starting with 29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73 not found: ID does not exist" containerID="29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73"
Jul 29 21:10:39.952616 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.952583    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73"} err="failed to get container status \"29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73\": rpc error: code = NotFound desc = could not find container \"29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73\": container with ID starting with 29848e0d45c6e77cee323cd34aca30e38c72df1844c9f7c70d627b9b57b29b73 not found: ID does not exist"
Jul 29 21:10:39.956232 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.956213    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"]
Jul 29 21:10:39.960386 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:39.960365    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0ab55cec-openshift-default-7d9c9984f6-6m875"]
Jul 29 21:10:40.621828 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:40.621789    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" path="/var/lib/kubelet/pods/7481b7fe-5d2d-45dd-bf77-827e87351edb/volumes"
Jul 29 21:10:50.964266 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:10:50.964238    2557 scope.go:117] "RemoveContainer" containerID="922bb13714ce7aad8f7a0c5bafb289432d1f952c5a48f29ef73eac31bcb03c5e"
Jul 29 21:11:25.264691 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:25.264658    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"]
Jul 29 21:11:25.265178 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:25.264892    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp" podUID="8a86de28-2098-46fe-91ff-35bf70a868b3" containerName="manager" containerID="cri-o://8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271" gracePeriod=10
Jul 29 21:11:25.821543 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:25.821490    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 21:11:25.901609 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:25.901583    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a86de28-2098-46fe-91ff-35bf70a868b3-extensions-socket-volume\") pod \"8a86de28-2098-46fe-91ff-35bf70a868b3\" (UID: \"8a86de28-2098-46fe-91ff-35bf70a868b3\") "
Jul 29 21:11:25.901737 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:25.901655    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsq8z\" (UniqueName: \"kubernetes.io/projected/8a86de28-2098-46fe-91ff-35bf70a868b3-kube-api-access-dsq8z\") pod \"8a86de28-2098-46fe-91ff-35bf70a868b3\" (UID: \"8a86de28-2098-46fe-91ff-35bf70a868b3\") "
Jul 29 21:11:25.901994 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:25.901970    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a86de28-2098-46fe-91ff-35bf70a868b3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8a86de28-2098-46fe-91ff-35bf70a868b3" (UID: "8a86de28-2098-46fe-91ff-35bf70a868b3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:11:25.903595 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:25.903571    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a86de28-2098-46fe-91ff-35bf70a868b3-kube-api-access-dsq8z" (OuterVolumeSpecName: "kube-api-access-dsq8z") pod "8a86de28-2098-46fe-91ff-35bf70a868b3" (UID: "8a86de28-2098-46fe-91ff-35bf70a868b3"). InnerVolumeSpecName "kube-api-access-dsq8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:11:26.002334 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.002311    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a86de28-2098-46fe-91ff-35bf70a868b3-extensions-socket-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:11:26.002334 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.002333    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsq8z\" (UniqueName: \"kubernetes.io/projected/8a86de28-2098-46fe-91ff-35bf70a868b3-kube-api-access-dsq8z\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:11:26.194621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.194556    2557 generic.go:356] "Generic (PLEG): container finished" podID="8a86de28-2098-46fe-91ff-35bf70a868b3" containerID="8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271" exitCode=0
Jul 29 21:11:26.194621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.194600    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"
Jul 29 21:11:26.194758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.194639    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp" event={"ID":"8a86de28-2098-46fe-91ff-35bf70a868b3","Type":"ContainerDied","Data":"8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271"}
Jul 29 21:11:26.194758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.194697    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp" event={"ID":"8a86de28-2098-46fe-91ff-35bf70a868b3","Type":"ContainerDied","Data":"0c5eb8f59c70f2614269404487a55b845c4a84c306389249515da80a869da9e0"}
Jul 29 21:11:26.194758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.194721    2557 scope.go:117] "RemoveContainer" containerID="8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271"
Jul 29 21:11:26.204453 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.204433    2557 scope.go:117] "RemoveContainer" containerID="8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271"
Jul 29 21:11:26.204694 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:11:26.204674    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271\": container with ID starting with 8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271 not found: ID does not exist" containerID="8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271"
Jul 29 21:11:26.204732 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.204703    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271"} err="failed to get container status \"8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271\": rpc error: code = NotFound desc = could not find container \"8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271\": container with ID starting with 8bd92c9faa1296ca3957664c4d850c7315d2e3f82b12de798cf27c451003a271 not found: ID does not exist"
Jul 29 21:11:26.217894 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.217867    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"]
Jul 29 21:11:26.223401 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.223376    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql6tp"]
Jul 29 21:11:26.621287 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:11:26.621262    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a86de28-2098-46fe-91ff-35bf70a868b3" path="/var/lib/kubelet/pods/8a86de28-2098-46fe-91ff-35bf70a868b3/volumes"
Jul 29 21:12:40.904508 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904471    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"]
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904853    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f420d46e-8230-40ed-85da-275c072f16ae" containerName="revoke-keys"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904867    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f420d46e-8230-40ed-85da-275c072f16ae" containerName="revoke-keys"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904888    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904894    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904903    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904910    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904917    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a86de28-2098-46fe-91ff-35bf70a868b3" containerName="manager"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904922    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a86de28-2098-46fe-91ff-35bf70a868b3" containerName="manager"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904928    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bebfb65-2640-417a-83f9-94a9b56aacec" containerName="payload-pre-processing"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904933    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bebfb65-2640-417a-83f9-94a9b56aacec" containerName="payload-pre-processing"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904987    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.904995    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a86de28-2098-46fe-91ff-35bf70a868b3" containerName="manager"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.905001    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bebfb65-2640-417a-83f9-94a9b56aacec" containerName="payload-pre-processing"
Jul 29 21:12:40.905120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.905006    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f420d46e-8230-40ed-85da-275c072f16ae" containerName="revoke-keys"
Jul 29 21:12:40.908047 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.908026    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"
Jul 29 21:12:40.910631 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.910610    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6x5cb\""
Jul 29 21:12:40.919032 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.919010    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"]
Jul 29 21:12:40.989457 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.989424    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a561b3-9f37-4a0f-bc73-c7d942ad3186-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pwf4n\" (UID: \"02a561b3-9f37-4a0f-bc73-c7d942ad3186\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"
Jul 29 21:12:40.989457 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:40.989460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5db8\" (UniqueName: \"kubernetes.io/projected/02a561b3-9f37-4a0f-bc73-c7d942ad3186-kube-api-access-k5db8\") pod \"kuadrant-operator-controller-manager-86878c769f-pwf4n\" (UID: \"02a561b3-9f37-4a0f-bc73-c7d942ad3186\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"
Jul 29 21:12:41.089904 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:41.089876    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a561b3-9f37-4a0f-bc73-c7d942ad3186-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pwf4n\" (UID: \"02a561b3-9f37-4a0f-bc73-c7d942ad3186\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"
Jul 29 21:12:41.090059 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:41.089909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5db8\" (UniqueName: \"kubernetes.io/projected/02a561b3-9f37-4a0f-bc73-c7d942ad3186-kube-api-access-k5db8\") pod \"kuadrant-operator-controller-manager-86878c769f-pwf4n\" (UID: \"02a561b3-9f37-4a0f-bc73-c7d942ad3186\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"
Jul 29 21:12:41.090229 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:41.090211    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a561b3-9f37-4a0f-bc73-c7d942ad3186-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pwf4n\" (UID: \"02a561b3-9f37-4a0f-bc73-c7d942ad3186\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"
Jul 29 21:12:41.100578 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:41.100557    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5db8\" (UniqueName: \"kubernetes.io/projected/02a561b3-9f37-4a0f-bc73-c7d942ad3186-kube-api-access-k5db8\") pod \"kuadrant-operator-controller-manager-86878c769f-pwf4n\" (UID: \"02a561b3-9f37-4a0f-bc73-c7d942ad3186\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"
Jul 29 21:12:41.219894 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:41.219811    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"
Jul 29 21:12:41.363851 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:41.363802    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"]
Jul 29 21:12:41.367249 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:12:41.367224    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a561b3_9f37_4a0f_bc73_c7d942ad3186.slice/crio-4f9092eec1b00c39441f09db9e9b53d88154abbe7a3af47475e465fbbe119549 WatchSource:0}: Error finding container 4f9092eec1b00c39441f09db9e9b53d88154abbe7a3af47475e465fbbe119549: Status 404 returned error can't find the container with id 4f9092eec1b00c39441f09db9e9b53d88154abbe7a3af47475e465fbbe119549
Jul 29 21:12:41.598313 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:41.598279    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n" event={"ID":"02a561b3-9f37-4a0f-bc73-c7d942ad3186","Type":"ContainerStarted","Data":"832a27f6d40c2600a0739b513e513db8a036ee89db5fa798e610edc84a725bc8"}
Jul 29 21:12:41.598481 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:41.598338    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n" event={"ID":"02a561b3-9f37-4a0f-bc73-c7d942ad3186","Type":"ContainerStarted","Data":"4f9092eec1b00c39441f09db9e9b53d88154abbe7a3af47475e465fbbe119549"}
Jul 29 21:12:41.598481 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:41.598364    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"
Jul 29 21:12:41.621777 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:41.621728    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n" podStartSLOduration=1.621712557 podStartE2EDuration="1.621712557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:12:41.619758673 +0000 UTC m=+2871.471259346" watchObservedRunningTime="2026-07-29 21:12:41.621712557 +0000 UTC m=+2871.473213230"
Jul 29 21:12:52.606621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:52.606548    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pwf4n"
Jul 29 21:12:59.435949 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.435915    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"]
Jul 29 21:12:59.436406 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.436381    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7481b7fe-5d2d-45dd-bf77-827e87351edb" containerName="istio-proxy"
Jul 29 21:12:59.439677 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.439655    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.442518 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.442493    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6951c5fd-openshift-default-dockercfg-54z5t\""
Jul 29 21:12:59.451209 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.451187    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"]
Jul 29 21:12:59.539240 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.539202    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpg8b\" (UniqueName: \"kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-kube-api-access-jpg8b\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.539404 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.539268    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-credential-socket\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.539404 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.539292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-certs\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.539404 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.539355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-podinfo\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.539404 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.539396    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-socket\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.539571 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.539437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-envoy\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.539571 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.539531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-data\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.539571 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.539568    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-token\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.539733 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.539595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istiod-ca-cert\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.640377 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640334    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-credential-socket\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.640377 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640372    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-certs\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.640621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640390    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-podinfo\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.640621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640415    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-socket\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.640621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640467    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-envoy\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.640621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640494    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-data\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.640621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-token\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.640621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640564    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istiod-ca-cert\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.640621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640608    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpg8b\" (UniqueName: \"kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-kube-api-access-jpg8b\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.641106 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640887    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-socket\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.641106 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.640914    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-certs\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.641106 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.641020    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-data\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.641106 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.641028    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-credential-socket\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.641486 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.641465    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istiod-ca-cert\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.642893 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.642866    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-envoy\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.643089 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.643071    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-podinfo\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.648236 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.648213    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-token\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.648349 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.648285    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpg8b\" (UniqueName: \"kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-kube-api-access-jpg8b\") pod \"e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") " pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.750231 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.750136    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:12:59.887376 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.887351    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"]
Jul 29 21:12:59.889676 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:12:59.889653    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e534a33_5f0d_4988_b5c4_0a1b8b6bdd17.slice/crio-f799d43254a9b3401d62dfbf50904c68a544810c3289c19a37108de43d7f9c2b WatchSource:0}: Error finding container f799d43254a9b3401d62dfbf50904c68a544810c3289c19a37108de43d7f9c2b: Status 404 returned error can't find the container with id f799d43254a9b3401d62dfbf50904c68a544810c3289c19a37108de43d7f9c2b
Jul 29 21:12:59.891735 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.891701    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:12:59.891844 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.891787    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:12:59.891937 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:12:59.891848    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:13:00.704812 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:00.704770    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" event={"ID":"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17","Type":"ContainerStarted","Data":"8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153"}
Jul 29 21:13:00.705207 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:00.704850    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" event={"ID":"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17","Type":"ContainerStarted","Data":"f799d43254a9b3401d62dfbf50904c68a544810c3289c19a37108de43d7f9c2b"}
Jul 29 21:13:00.726300 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:00.726252    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" podStartSLOduration=1.7262357609999999 podStartE2EDuration="1.726235761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:12:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:13:00.724002698 +0000 UTC m=+2890.575503372" watchObservedRunningTime="2026-07-29 21:13:00.726235761 +0000 UTC m=+2890.577736433"
Jul 29 21:13:00.750634 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:00.750596    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:13:00.755742 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:00.755718    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:13:01.710725 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:01.710688    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:13:01.711611 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:01.711591    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:13:03.453510 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.453475    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"]
Jul 29 21:13:03.457366 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.457348    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:13:03.460343 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.460322    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6951c5fd-dockercfg-bqfp2\""
Jul 29 21:13:03.460624 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.460604    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6951c5fd\""
Jul 29 21:13:03.466771 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.466745    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"]
Jul 29 21:13:03.578109 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.578070    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zskl5\" (UniqueName: \"kubernetes.io/projected/266a157a-37a7-49c0-b016-c1687bdebdd9-kube-api-access-zskl5\") pod \"payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx\" (UID: \"266a157a-37a7-49c0-b016-c1687bdebdd9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:13:03.578304 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.578240    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/266a157a-37a7-49c0-b016-c1687bdebdd9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx\" (UID: \"266a157a-37a7-49c0-b016-c1687bdebdd9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:13:03.678899 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.678861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/266a157a-37a7-49c0-b016-c1687bdebdd9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx\" (UID: \"266a157a-37a7-49c0-b016-c1687bdebdd9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:13:03.679078 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.678924    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zskl5\" (UniqueName: \"kubernetes.io/projected/266a157a-37a7-49c0-b016-c1687bdebdd9-kube-api-access-zskl5\") pod \"payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx\" (UID: \"266a157a-37a7-49c0-b016-c1687bdebdd9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:13:03.679583 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.679555    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/266a157a-37a7-49c0-b016-c1687bdebdd9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx\" (UID: \"266a157a-37a7-49c0-b016-c1687bdebdd9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:13:03.687937 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.687909    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zskl5\" (UniqueName: \"kubernetes.io/projected/266a157a-37a7-49c0-b016-c1687bdebdd9-kube-api-access-zskl5\") pod \"payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx\" (UID: \"266a157a-37a7-49c0-b016-c1687bdebdd9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:13:03.769260 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.769225    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:13:03.920041 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:03.920015    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"]
Jul 29 21:13:03.921805 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:13:03.921770    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266a157a_37a7_49c0_b016_c1687bdebdd9.slice/crio-5e8232315dd731af91b504cd6a1f66118c4d73bbcd80e3452f7c50b2e9d2337b WatchSource:0}: Error finding container 5e8232315dd731af91b504cd6a1f66118c4d73bbcd80e3452f7c50b2e9d2337b: Status 404 returned error can't find the container with id 5e8232315dd731af91b504cd6a1f66118c4d73bbcd80e3452f7c50b2e9d2337b
Jul 29 21:13:04.728326 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:04.728291    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx" event={"ID":"266a157a-37a7-49c0-b016-c1687bdebdd9","Type":"ContainerStarted","Data":"1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b"}
Jul 29 21:13:04.728742 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:04.728352    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx" event={"ID":"266a157a-37a7-49c0-b016-c1687bdebdd9","Type":"ContainerStarted","Data":"5e8232315dd731af91b504cd6a1f66118c4d73bbcd80e3452f7c50b2e9d2337b"}
Jul 29 21:13:04.728742 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:04.728393    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:13:04.746128 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:04.746076    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx" podStartSLOduration=1.746058937 podStartE2EDuration="1.746058937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:13:04.743504434 +0000 UTC m=+2894.595005107" watchObservedRunningTime="2026-07-29 21:13:04.746058937 +0000 UTC m=+2894.597559611"
Jul 29 21:13:14.792912 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:14.792880    2557 generic.go:356] "Generic (PLEG): container finished" podID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerID="8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153" exitCode=0
Jul 29 21:13:14.793370 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:14.792957    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" event={"ID":"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17","Type":"ContainerDied","Data":"8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153"}
Jul 29 21:13:14.793370 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:14.793354    2557 scope.go:117] "RemoveContainer" containerID="8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153"
Jul 29 21:13:14.794387 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:14.794349    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:13:14.794451 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:14.794420    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:13:14.794491 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:14.794455    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:13:15.736031 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:15.735996    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:13:15.808606 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:15.808575    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" event={"ID":"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17","Type":"ContainerStarted","Data":"545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e"}
Jul 29 21:13:16.710826 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:16.710790    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:13:16.751114 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:16.751083    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:13:16.752399 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:16.752370    2557 patch_prober.go:28] interesting pod/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 29 21:13:16.752526 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:16.752420    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 29 21:13:17.751507 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:17.751461    2557 patch_prober.go:28] interesting pod/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 29 21:13:17.751976 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:17.751525    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 29 21:13:18.751137 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:18.751094    2557 patch_prober.go:28] interesting pod/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 29 21:13:18.751322 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:18.751155    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 29 21:13:19.755594 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:19.755562    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:13:19.756630 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:19.756605    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:13:31.726629 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.726585    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"]
Jul 29 21:13:31.730310 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.730288    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.734070 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.734043    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6951c5fd\"/\"kube-root-ca.crt\""
Jul 29 21:13:31.734070 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.734061    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6951c5fd\"/\"default-dockercfg-hkfdz\""
Jul 29 21:13:31.734285 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.734056    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6951c5fd\"/\"e2e-lifecycle-model-6951c5fd-kserve-self-signed-certs\""
Jul 29 21:13:31.734285 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.734056    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6951c5fd\"/\"openshift-service-ca.crt\""
Jul 29 21:13:31.741478 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.741452    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"]
Jul 29 21:13:31.834453 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.834412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-dshm\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.834630 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.834464    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-home\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.834630 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.834491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-tmp-dir\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.834630 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.834513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12d448a8-a358-496c-b1d2-c8835bbaf414-tls-certs\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.834630 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.834529    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtkwg\" (UniqueName: \"kubernetes.io/projected/12d448a8-a358-496c-b1d2-c8835bbaf414-kube-api-access-jtkwg\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.834630 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.834600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-model-cache\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.935085 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.935042    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-dshm\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.935271 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.935115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-home\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.935271 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.935140    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-tmp-dir\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.935271 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.935165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12d448a8-a358-496c-b1d2-c8835bbaf414-tls-certs\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.935271 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.935189    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtkwg\" (UniqueName: \"kubernetes.io/projected/12d448a8-a358-496c-b1d2-c8835bbaf414-kube-api-access-jtkwg\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.935271 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.935253    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-model-cache\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.935628 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.935595    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-home\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.935698 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.935624    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-tmp-dir\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.935698 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.935662    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-model-cache\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.937542 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.937519    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-dshm\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.937820 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.937800    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12d448a8-a358-496c-b1d2-c8835bbaf414-tls-certs\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:31.943670 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:31.943649    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtkwg\" (UniqueName: \"kubernetes.io/projected/12d448a8-a358-496c-b1d2-c8835bbaf414-kube-api-access-jtkwg\") pod \"e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") " pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:32.040988 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:32.040942    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:32.199495 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:32.199464    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"]
Jul 29 21:13:32.906991 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:32.906946    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw" event={"ID":"12d448a8-a358-496c-b1d2-c8835bbaf414","Type":"ContainerStarted","Data":"4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272"}
Jul 29 21:13:32.907398 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:32.907004    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw" event={"ID":"12d448a8-a358-496c-b1d2-c8835bbaf414","Type":"ContainerStarted","Data":"4a84038a439ef1603b21223b97a59dfe44610290cef3e0b1ffd026c558e2eb53"}
Jul 29 21:13:32.926357 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:32.926300    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw" podStartSLOduration=1.9262848099999998 podStartE2EDuration="1.92628481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:13:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:13:32.923528578 +0000 UTC m=+2922.775029263" watchObservedRunningTime="2026-07-29 21:13:32.92628481 +0000 UTC m=+2922.777785501"
Jul 29 21:13:42.041392 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:42.041347    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:42.041392 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:42.041397    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:42.054404 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:42.054375    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:13:42.976377 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:13:42.976345    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:14:07.388339 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:07.388288    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"]
Jul 29 21:14:07.392098 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:07.392077    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"
Jul 29 21:14:07.394763 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:07.394738    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 21:14:07.398890 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:07.398860    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"]
Jul 29 21:14:07.472296 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:07.472248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs\" (UID: \"8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"
Jul 29 21:14:07.572670 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:07.572624    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs\" (UID: \"8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"
Jul 29 21:14:07.573387 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:07.573366    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs\" (UID: \"8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"
Jul 29 21:14:07.705944 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:07.705821    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"
Jul 29 21:14:08.052421 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:08.052391    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"]
Jul 29 21:14:08.055446 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:14:08.055409    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ccf881d_c4a8_45e1_bd1f_0cbaf0ef8753.slice/crio-f2db355507329f87a51c511f3c5c8d266928e0eb8ee348088b9d50140508e6a4 WatchSource:0}: Error finding container f2db355507329f87a51c511f3c5c8d266928e0eb8ee348088b9d50140508e6a4: Status 404 returned error can't find the container with id f2db355507329f87a51c511f3c5c8d266928e0eb8ee348088b9d50140508e6a4
Jul 29 21:14:08.106610 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:08.106575    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs" event={"ID":"8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753","Type":"ContainerStarted","Data":"f2db355507329f87a51c511f3c5c8d266928e0eb8ee348088b9d50140508e6a4"}
Jul 29 21:14:09.113772 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:09.113677    2557 generic.go:356] "Generic (PLEG): container finished" podID="8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753" containerID="c57ac4c1a5593df89011988c787b018d87cbe6dd018b0764ccd05730f3fca962" exitCode=0
Jul 29 21:14:09.113772 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:09.113720    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs" event={"ID":"8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753","Type":"ContainerDied","Data":"c57ac4c1a5593df89011988c787b018d87cbe6dd018b0764ccd05730f3fca962"}
Jul 29 21:14:10.274354 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:10.274324    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"
Jul 29 21:14:10.297804 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:10.297772    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753-maas-api-service-ca\") pod \"8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753\" (UID: \"8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753\") "
Jul 29 21:14:10.298204 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:10.298173    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753" (UID: "8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:14:10.398958 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:10.398876    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753-maas-api-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:14:11.127050 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:11.127015    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs" event={"ID":"8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753","Type":"ContainerDied","Data":"f2db355507329f87a51c511f3c5c8d266928e0eb8ee348088b9d50140508e6a4"}
Jul 29 21:14:11.127050 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:11.127047    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"
Jul 29 21:14:11.127277 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:11.127072    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2db355507329f87a51c511f3c5c8d266928e0eb8ee348088b9d50140508e6a4"
Jul 29 21:14:22.825847 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:22.825787    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"]
Jul 29 21:14:22.826315 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:22.826103    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx" podUID="266a157a-37a7-49c0-b016-c1687bdebdd9" containerName="payload-pre-processing" containerID="cri-o://1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b" gracePeriod=30
Jul 29 21:14:22.977622 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:22.977582    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"]
Jul 29 21:14:22.996048 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:22.996015    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6951c5fd-hvqbs"]
Jul 29 21:14:23.102199 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.102173    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:14:23.199062 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.199022    2557 generic.go:356] "Generic (PLEG): container finished" podID="266a157a-37a7-49c0-b016-c1687bdebdd9" containerID="1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b" exitCode=0
Jul 29 21:14:23.199274 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.199070    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"
Jul 29 21:14:23.199274 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.199080    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx" event={"ID":"266a157a-37a7-49c0-b016-c1687bdebdd9","Type":"ContainerDied","Data":"1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b"}
Jul 29 21:14:23.199274 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.199157    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx" event={"ID":"266a157a-37a7-49c0-b016-c1687bdebdd9","Type":"ContainerDied","Data":"5e8232315dd731af91b504cd6a1f66118c4d73bbcd80e3452f7c50b2e9d2337b"}
Jul 29 21:14:23.199274 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.199184    2557 scope.go:117] "RemoveContainer" containerID="1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b"
Jul 29 21:14:23.207101 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.207071    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zskl5\" (UniqueName: \"kubernetes.io/projected/266a157a-37a7-49c0-b016-c1687bdebdd9-kube-api-access-zskl5\") pod \"266a157a-37a7-49c0-b016-c1687bdebdd9\" (UID: \"266a157a-37a7-49c0-b016-c1687bdebdd9\") "
Jul 29 21:14:23.207279 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.207120    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/266a157a-37a7-49c0-b016-c1687bdebdd9-plugins-config-volume\") pod \"266a157a-37a7-49c0-b016-c1687bdebdd9\" (UID: \"266a157a-37a7-49c0-b016-c1687bdebdd9\") "
Jul 29 21:14:23.207558 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.207534    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/266a157a-37a7-49c0-b016-c1687bdebdd9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "266a157a-37a7-49c0-b016-c1687bdebdd9" (UID: "266a157a-37a7-49c0-b016-c1687bdebdd9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:14:23.208490 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.208467    2557 scope.go:117] "RemoveContainer" containerID="1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b"
Jul 29 21:14:23.208889 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:14:23.208867    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b\": container with ID starting with 1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b not found: ID does not exist" containerID="1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b"
Jul 29 21:14:23.208973 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.208899    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b"} err="failed to get container status \"1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b\": rpc error: code = NotFound desc = could not find container \"1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b\": container with ID starting with 1f057afdd3ea35fd02f338dbed78eb60674cda39dd88513b6bab8ab15068a79b not found: ID does not exist"
Jul 29 21:14:23.209439 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.209415    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/266a157a-37a7-49c0-b016-c1687bdebdd9-kube-api-access-zskl5" (OuterVolumeSpecName: "kube-api-access-zskl5") pod "266a157a-37a7-49c0-b016-c1687bdebdd9" (UID: "266a157a-37a7-49c0-b016-c1687bdebdd9"). InnerVolumeSpecName "kube-api-access-zskl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:14:23.308931 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.308890    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/266a157a-37a7-49c0-b016-c1687bdebdd9-plugins-config-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:14:23.308931 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.308922    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zskl5\" (UniqueName: \"kubernetes.io/projected/266a157a-37a7-49c0-b016-c1687bdebdd9-kube-api-access-zskl5\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:14:23.544712 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.544669    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"]
Jul 29 21:14:23.556274 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:23.556234    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6951c5fd-59d4475796-bqjfx"]
Jul 29 21:14:24.622122 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:24.622090    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="266a157a-37a7-49c0-b016-c1687bdebdd9" path="/var/lib/kubelet/pods/266a157a-37a7-49c0-b016-c1687bdebdd9/volumes"
Jul 29 21:14:24.622516 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:24.622412    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753" path="/var/lib/kubelet/pods/8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753/volumes"
Jul 29 21:14:31.223087 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:31.223042    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"]
Jul 29 21:14:46.243167 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.243125    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw" podUID="12d448a8-a358-496c-b1d2-c8835bbaf414" containerName="main" containerID="cri-o://4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272" gracePeriod=45
Jul 29 21:14:46.511487 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.511456    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:14:46.638119 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638091    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12d448a8-a358-496c-b1d2-c8835bbaf414-tls-certs\") pod \"12d448a8-a358-496c-b1d2-c8835bbaf414\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") "
Jul 29 21:14:46.638305 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638128    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-tmp-dir\") pod \"12d448a8-a358-496c-b1d2-c8835bbaf414\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") "
Jul 29 21:14:46.638305 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638155    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-home\") pod \"12d448a8-a358-496c-b1d2-c8835bbaf414\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") "
Jul 29 21:14:46.638305 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638245    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-dshm\") pod \"12d448a8-a358-496c-b1d2-c8835bbaf414\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") "
Jul 29 21:14:46.638305 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638266    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtkwg\" (UniqueName: \"kubernetes.io/projected/12d448a8-a358-496c-b1d2-c8835bbaf414-kube-api-access-jtkwg\") pod \"12d448a8-a358-496c-b1d2-c8835bbaf414\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") "
Jul 29 21:14:46.638305 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638283    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-model-cache\") pod \"12d448a8-a358-496c-b1d2-c8835bbaf414\" (UID: \"12d448a8-a358-496c-b1d2-c8835bbaf414\") "
Jul 29 21:14:46.638568 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638388    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "12d448a8-a358-496c-b1d2-c8835bbaf414" (UID: "12d448a8-a358-496c-b1d2-c8835bbaf414"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:14:46.638568 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638423    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-home" (OuterVolumeSpecName: "home") pod "12d448a8-a358-496c-b1d2-c8835bbaf414" (UID: "12d448a8-a358-496c-b1d2-c8835bbaf414"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:14:46.638568 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638524    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-tmp-dir\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:14:46.638686 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638575    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-home\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:14:46.638686 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.638609    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-model-cache" (OuterVolumeSpecName: "model-cache") pod "12d448a8-a358-496c-b1d2-c8835bbaf414" (UID: "12d448a8-a358-496c-b1d2-c8835bbaf414"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:14:46.640420 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.640390    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-dshm" (OuterVolumeSpecName: "dshm") pod "12d448a8-a358-496c-b1d2-c8835bbaf414" (UID: "12d448a8-a358-496c-b1d2-c8835bbaf414"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:14:46.640529 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.640445    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d448a8-a358-496c-b1d2-c8835bbaf414-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "12d448a8-a358-496c-b1d2-c8835bbaf414" (UID: "12d448a8-a358-496c-b1d2-c8835bbaf414"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:14:46.640529 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.640471    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d448a8-a358-496c-b1d2-c8835bbaf414-kube-api-access-jtkwg" (OuterVolumeSpecName: "kube-api-access-jtkwg") pod "12d448a8-a358-496c-b1d2-c8835bbaf414" (UID: "12d448a8-a358-496c-b1d2-c8835bbaf414"). InnerVolumeSpecName "kube-api-access-jtkwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:14:46.740165 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.740129    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-dshm\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:14:46.740165 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.740162    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtkwg\" (UniqueName: \"kubernetes.io/projected/12d448a8-a358-496c-b1d2-c8835bbaf414-kube-api-access-jtkwg\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:14:46.740165 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.740176    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12d448a8-a358-496c-b1d2-c8835bbaf414-model-cache\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:14:46.740165 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:46.740189    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12d448a8-a358-496c-b1d2-c8835bbaf414-tls-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:14:47.337317 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:47.337276    2557 generic.go:356] "Generic (PLEG): container finished" podID="12d448a8-a358-496c-b1d2-c8835bbaf414" containerID="4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272" exitCode=0
Jul 29 21:14:47.337317 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:47.337325    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"
Jul 29 21:14:47.337897 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:47.337363    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw" event={"ID":"12d448a8-a358-496c-b1d2-c8835bbaf414","Type":"ContainerDied","Data":"4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272"}
Jul 29 21:14:47.337897 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:47.337417    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw" event={"ID":"12d448a8-a358-496c-b1d2-c8835bbaf414","Type":"ContainerDied","Data":"4a84038a439ef1603b21223b97a59dfe44610290cef3e0b1ffd026c558e2eb53"}
Jul 29 21:14:47.337897 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:47.337442    2557 scope.go:117] "RemoveContainer" containerID="4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272"
Jul 29 21:14:47.347884 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:47.347861    2557 scope.go:117] "RemoveContainer" containerID="4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272"
Jul 29 21:14:47.348220 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:14:47.348199    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272\": container with ID starting with 4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272 not found: ID does not exist" containerID="4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272"
Jul 29 21:14:47.348295 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:47.348233    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272"} err="failed to get container status \"4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272\": rpc error: code = NotFound desc = could not find container \"4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272\": container with ID starting with 4fe8b27c590f4cfc6a07a8105979b2e889997dda658dd571750b56e453c8f272 not found: ID does not exist"
Jul 29 21:14:47.360301 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:47.360270    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"]
Jul 29 21:14:47.364740 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:47.364711    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6951c5fd/e2e-lifecycle-model-6951c5fd-kserve-5c7748f79-8wkfw"]
Jul 29 21:14:48.621919 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:48.621882    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12d448a8-a358-496c-b1d2-c8835bbaf414" path="/var/lib/kubelet/pods/12d448a8-a358-496c-b1d2-c8835bbaf414/volumes"
Jul 29 21:14:50.831294 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:50.831259    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:14:50.840602 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:14:50.840575    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:15:14.114008 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:14.113973    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"]
Jul 29 21:15:14.114527 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:14.114246    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerName="istio-proxy" containerID="cri-o://545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e" gracePeriod=30
Jul 29 21:15:19.387003 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.386929    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:15:19.440326 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440282    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-envoy\") pod \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") "
Jul 29 21:15:19.440505 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440351    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-certs\") pod \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") "
Jul 29 21:15:19.440505 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440371    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istiod-ca-cert\") pod \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") "
Jul 29 21:15:19.440505 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440390    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-data\") pod \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") "
Jul 29 21:15:19.440505 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440416    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-token\") pod \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") "
Jul 29 21:15:19.440505 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440449    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-credential-socket\") pod \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") "
Jul 29 21:15:19.440505 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440483    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpg8b\" (UniqueName: \"kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-kube-api-access-jpg8b\") pod \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") "
Jul 29 21:15:19.440775 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440518    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-podinfo\") pod \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") "
Jul 29 21:15:19.440775 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440556    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-socket\") pod \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\" (UID: \"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17\") "
Jul 29 21:15:19.440917 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440794    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" (UID: "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:15:19.440983 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.440936    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" (UID: "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:15:19.441077 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.441052    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" (UID: "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:15:19.441133 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.441083    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" (UID: "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:15:19.441460 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.441430    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" (UID: "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:15:19.442868 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.442816    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" (UID: "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:15:19.442868 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.442824    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" (UID: "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:15:19.443019 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.442948    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-kube-api-access-jpg8b" (OuterVolumeSpecName: "kube-api-access-jpg8b") pod "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" (UID: "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17"). InnerVolumeSpecName "kube-api-access-jpg8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:15:19.443019 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.442957    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" (UID: "7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:15:19.530813 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.530780    2557 generic.go:356] "Generic (PLEG): container finished" podID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerID="545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e" exitCode=0
Jul 29 21:15:19.530995 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.530860    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"
Jul 29 21:15:19.530995 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.530873    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" event={"ID":"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17","Type":"ContainerDied","Data":"545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e"}
Jul 29 21:15:19.530995 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.530937    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr" event={"ID":"7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17","Type":"ContainerDied","Data":"f799d43254a9b3401d62dfbf50904c68a544810c3289c19a37108de43d7f9c2b"}
Jul 29 21:15:19.530995 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.530966    2557 scope.go:117] "RemoveContainer" containerID="545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e"
Jul 29 21:15:19.541050 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.541025    2557 scope.go:117] "RemoveContainer" containerID="8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153"
Jul 29 21:15:19.541351 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.541334    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:15:19.541429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.541353    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:15:19.541429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.541362    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:15:19.541429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.541370    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:15:19.541429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.541378    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:15:19.541429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.541387    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:15:19.541429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.541396    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpg8b\" (UniqueName: \"kubernetes.io/projected/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-kube-api-access-jpg8b\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:15:19.541429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.541405    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:15:19.541429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.541415    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:15:19.550699 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.550673    2557 scope.go:117] "RemoveContainer" containerID="545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e"
Jul 29 21:15:19.551142 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:15:19.551115    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e\": container with ID starting with 545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e not found: ID does not exist" containerID="545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e"
Jul 29 21:15:19.551220 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.551152    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e"} err="failed to get container status \"545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e\": rpc error: code = NotFound desc = could not find container \"545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e\": container with ID starting with 545a50fa06d001a031ef58c1a5006233707218a67d9ab8e47c4f53ebb7be965e not found: ID does not exist"
Jul 29 21:15:19.551220 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.551176    2557 scope.go:117] "RemoveContainer" containerID="8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153"
Jul 29 21:15:19.551450 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:15:19.551431    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153\": container with ID starting with 8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153 not found: ID does not exist" containerID="8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153"
Jul 29 21:15:19.551537 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.551456    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153"} err="failed to get container status \"8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153\": rpc error: code = NotFound desc = could not find container \"8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153\": container with ID starting with 8a3e45a561979adc253ef073d0057778d882ab0e256454a8e8621b1b44d39153 not found: ID does not exist"
Jul 29 21:15:19.554885 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.554860    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"]
Jul 29 21:15:19.558002 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:19.557975    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6951c5fd-openshift-default-548c444d88-fztgr"]
Jul 29 21:15:20.622523 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:20.622488    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" path="/var/lib/kubelet/pods/7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17/volumes"
Jul 29 21:15:36.376219 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376182    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"]
Jul 29 21:15:36.376758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376738    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerName="istio-proxy"
Jul 29 21:15:36.376758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376759    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerName="istio-proxy"
Jul 29 21:15:36.376907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376769    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d448a8-a358-496c-b1d2-c8835bbaf414" containerName="main"
Jul 29 21:15:36.376907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376774    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d448a8-a358-496c-b1d2-c8835bbaf414" containerName="main"
Jul 29 21:15:36.376907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376785    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266a157a-37a7-49c0-b016-c1687bdebdd9" containerName="payload-pre-processing"
Jul 29 21:15:36.376907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376791    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="266a157a-37a7-49c0-b016-c1687bdebdd9" containerName="payload-pre-processing"
Jul 29 21:15:36.376907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376800    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753" containerName="revoke-keys"
Jul 29 21:15:36.376907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376805    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753" containerName="revoke-keys"
Jul 29 21:15:36.376907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376815    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerName="istio-proxy"
Jul 29 21:15:36.376907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376820    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerName="istio-proxy"
Jul 29 21:15:36.376907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376909    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="266a157a-37a7-49c0-b016-c1687bdebdd9" containerName="payload-pre-processing"
Jul 29 21:15:36.377357 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376919    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerName="istio-proxy"
Jul 29 21:15:36.377357 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376927    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d448a8-a358-496c-b1d2-c8835bbaf414" containerName="main"
Jul 29 21:15:36.377357 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.376934    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ccf881d-c4a8-45e1-bd1f-0cbaf0ef8753" containerName="revoke-keys"
Jul 29 21:15:36.379740 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.379719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.382374 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.382350    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fcb1aff7-openshift-default-dockercfg-4wnp2\""
Jul 29 21:15:36.391945 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.391917    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"]
Jul 29 21:15:36.487414 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.487371    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-token\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.487607 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.487424    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-certs\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.487607 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.487502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-envoy\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.487607 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.487550    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgwl\" (UniqueName: \"kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-kube-api-access-gcgwl\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.487607 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.487581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istiod-ca-cert\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.487758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.487616    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-credential-socket\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.487758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.487676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-data\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.487758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.487733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-socket\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.487758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.487754    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-podinfo\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.589189 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589148    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-envoy\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.589379 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589202    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgwl\" (UniqueName: \"kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-kube-api-access-gcgwl\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.589379 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589228    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istiod-ca-cert\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.589379 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-credential-socket\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.589493 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589405    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-data\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.589493 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589473    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-socket\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.589601 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-podinfo\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.589601 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-token\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.589709 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589610    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-certs\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.589709 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589685    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-credential-socket\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.590018 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.589989    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-data\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.590166 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.590048    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-certs\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.590166 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.590065    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-socket\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.590166 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.590112    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istiod-ca-cert\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.591691 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.591672    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-envoy\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.591961 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.591944    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-podinfo\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.598113 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.598084    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-token\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.598244 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.598157    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgwl\" (UniqueName: \"kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-kube-api-access-gcgwl\") pod \"e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") " pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.691674 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.691580    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:36.843942 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.843917    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"]
Jul 29 21:15:36.848967 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:15:36.848930    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab95595_1b6e_4481_89ad_c0b70ffa1d56.slice/crio-e167c9a08fc89ea57888f9ae059d551c15259b45f3728e145bef6208dd6d1eaf WatchSource:0}: Error finding container e167c9a08fc89ea57888f9ae059d551c15259b45f3728e145bef6208dd6d1eaf: Status 404 returned error can't find the container with id e167c9a08fc89ea57888f9ae059d551c15259b45f3728e145bef6208dd6d1eaf
Jul 29 21:15:36.851086 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.851043    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:15:36.851190 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.851131    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:15:36.851190 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:36.851161    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:15:37.631691 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:37.631654    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" event={"ID":"aab95595-1b6e-4481-89ad-c0b70ffa1d56","Type":"ContainerStarted","Data":"90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920"}
Jul 29 21:15:37.632119 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:37.631718    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" event={"ID":"aab95595-1b6e-4481-89ad-c0b70ffa1d56","Type":"ContainerStarted","Data":"e167c9a08fc89ea57888f9ae059d551c15259b45f3728e145bef6208dd6d1eaf"}
Jul 29 21:15:37.652902 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:37.652826    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" podStartSLOduration=1.652807213 podStartE2EDuration="1.652807213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:15:37.651352652 +0000 UTC m=+3047.502853325" watchObservedRunningTime="2026-07-29 21:15:37.652807213 +0000 UTC m=+3047.504307886"
Jul 29 21:15:37.692575 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:37.692537    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:37.697693 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:37.697664    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:38.637933 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:38.637895    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:38.638870 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:38.638828    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:51.048698 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:51.048611    2557 scope.go:117] "RemoveContainer" containerID="794996c65997abf7036a0344a8f554db4fcad4422172e6f159015c6289a4ffb4"
Jul 29 21:15:54.072038 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:54.071520    2557 patch_prober.go:28] interesting pod/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": read tcp 10.133.0.2:35882->10.133.0.76:15021: read: connection reset by peer" start-of-body=
Jul 29 21:15:54.072038 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:54.071599    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": read tcp 10.133.0.2:35882->10.133.0.76:15021: read: connection reset by peer"
Jul 29 21:15:54.735916 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:54.735880    2557 generic.go:356] "Generic (PLEG): container finished" podID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerID="90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920" exitCode=0
Jul 29 21:15:54.736134 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:54.735958    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" event={"ID":"aab95595-1b6e-4481-89ad-c0b70ffa1d56","Type":"ContainerDied","Data":"90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920"}
Jul 29 21:15:54.736430 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:54.736410    2557 scope.go:117] "RemoveContainer" containerID="90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920"
Jul 29 21:15:54.737447 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:54.737418    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:15:54.737500 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:54.737485    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:15:54.737541 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:54.737515    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:15:55.743923 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:55.743887    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" event={"ID":"aab95595-1b6e-4481-89ad-c0b70ffa1d56","Type":"ContainerStarted","Data":"fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d"}
Jul 29 21:15:56.693124 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:56.693084    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:15:56.693571 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:56.693480    2557 patch_prober.go:28] interesting pod/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 29 21:15:56.693743 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:56.693717    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 29 21:15:57.693091 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:57.693046    2557 patch_prober.go:28] interesting pod/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 29 21:15:57.693717 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:57.693680    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 29 21:15:58.693477 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:58.692966    2557 patch_prober.go:28] interesting pod/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 29 21:15:58.693477 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:58.693039    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 29 21:15:59.692678 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:59.692631    2557 patch_prober.go:28] interesting pod/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 29 21:15:59.692909 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:15:59.692695    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 29 21:16:00.696422 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:00.696388    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:16:00.696826 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:00.696758    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:16:00.697586 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:00.697569    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:16:16.068473 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.068439    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"]
Jul 29 21:16:16.069128 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.069101    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e534a33-5f0d-4988-b5c4-0a1b8b6bdd17" containerName="istio-proxy"
Jul 29 21:16:16.072309 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.072293    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.074740 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.074722    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-aa96fae3-openshift-default-dockercfg-xqw5m\""
Jul 29 21:16:16.084642 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.084623    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"]
Jul 29 21:16:16.159324 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.159299    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-certs\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.159480 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.159337    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-data\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.159480 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.159385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-istio-token\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.159480 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.159427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/384df5db-7a03-4f48-805e-a170969afe7e-istiod-ca-cert\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.159480 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.159474    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/384df5db-7a03-4f48-805e-a170969afe7e-istio-podinfo\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.159661 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.159496    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-socket\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.159661 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.159535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-credential-socket\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.159661 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.159554    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-envoy\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.159661 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.159568    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ln75\" (UniqueName: \"kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-kube-api-access-8ln75\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.260842 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.260801    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-istio-token\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261024 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.260874    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/384df5db-7a03-4f48-805e-a170969afe7e-istiod-ca-cert\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261024 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.260910    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/384df5db-7a03-4f48-805e-a170969afe7e-istio-podinfo\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261024 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.260936    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-socket\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261024 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.260966    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-credential-socket\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261024 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.260993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-envoy\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261024 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.261016    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ln75\" (UniqueName: \"kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-kube-api-access-8ln75\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261377 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.261081    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-certs\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261377 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.261125    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-data\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261488 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.261409    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-credential-socket\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261546 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.261511    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-socket\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261601 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.261560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-data\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261601 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.261583    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-certs\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.261723 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.261691    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/384df5db-7a03-4f48-805e-a170969afe7e-istiod-ca-cert\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.263370 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.263347    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-envoy\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.263534 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.263516    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/384df5db-7a03-4f48-805e-a170969afe7e-istio-podinfo\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.269409 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.269386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-istio-token\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.269593 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.269571    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ln75\" (UniqueName: \"kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-kube-api-access-8ln75\") pod \"e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") " pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.383808 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.383747    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:16.523686 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.523661    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"]
Jul 29 21:16:16.529591 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.529558    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:16:16.529697 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.529626    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:16:16.529697 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.529659    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:16:16.868399 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.868368    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" event={"ID":"384df5db-7a03-4f48-805e-a170969afe7e","Type":"ContainerStarted","Data":"1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c"}
Jul 29 21:16:16.868569 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.868426    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" event={"ID":"384df5db-7a03-4f48-805e-a170969afe7e","Type":"ContainerStarted","Data":"67c2e0b68d15fd891a3243119f3e9365acb7cc162d88845b6d431833d7efb45e"}
Jul 29 21:16:16.886936 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:16.886880    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" podStartSLOduration=0.886864544 podStartE2EDuration="886.864544ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:16:16.885662379 +0000 UTC m=+3086.737163064" watchObservedRunningTime="2026-07-29 21:16:16.886864544 +0000 UTC m=+3086.738365217"
Jul 29 21:16:17.384233 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:17.384198    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:17.389047 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:17.389026    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:17.876244 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:17.876213    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:17.877219 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:17.877194    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:33.917975 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:33.917936    2557 patch_prober.go:28] interesting pod/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 21:16:33.918416 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:33.917989    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 21:16:35.977423 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:35.977386    2557 generic.go:356] "Generic (PLEG): container finished" podID="384df5db-7a03-4f48-805e-a170969afe7e" containerID="1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c" exitCode=0
Jul 29 21:16:35.977964 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:35.977427    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" event={"ID":"384df5db-7a03-4f48-805e-a170969afe7e","Type":"ContainerDied","Data":"1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c"}
Jul 29 21:16:35.977964 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:35.977929    2557 scope.go:117] "RemoveContainer" containerID="1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c"
Jul 29 21:16:35.979081 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:35.979045    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:16:35.979149 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:35.979133    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:16:35.979190 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:35.979176    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:16:36.989603 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:36.989566    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" event={"ID":"384df5db-7a03-4f48-805e-a170969afe7e","Type":"ContainerStarted","Data":"d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900"}
Jul 29 21:16:37.384177 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:37.384147    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:37.384561 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:37.384471    2557 patch_prober.go:28] interesting pod/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 29 21:16:37.384747 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:37.384724    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 29 21:16:38.384290 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:38.384246    2557 patch_prober.go:28] interesting pod/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 29 21:16:38.384793 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:38.384322    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 29 21:16:39.384470 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:39.384434    2557 patch_prober.go:28] interesting pod/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 29 21:16:39.385044 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:39.385011    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 29 21:16:40.385047 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:40.384598    2557 patch_prober.go:28] interesting pod/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 29 21:16:40.385047 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:40.384667    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 29 21:16:41.387545 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:41.387517    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:41.387915 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:41.387794    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:41.388405 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:41.388384    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:16:51.097647 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:16:51.097615    2557 scope.go:117] "RemoveContainer" containerID="d80f3034ef2804904d9c658daad62c9d3d09dcb27202e9ac719aa7473f150210"
Jul 29 21:19:50.865489 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:19:50.865461    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:19:50.875820 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:19:50.875796    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:19:59.689233 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:19:59.689198    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"]
Jul 29 21:19:59.691684 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:19:59.691666    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"
Jul 29 21:19:59.695549 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:19:59.695528    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 21:19:59.714776 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:19:59.714752    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"]
Jul 29 21:19:59.851823 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:19:59.851798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e40d2f-4950-4e95-bf6a-53b5145053d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn\" (UID: \"37e40d2f-4950-4e95-bf6a-53b5145053d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"
Jul 29 21:19:59.952583 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:19:59.952511    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e40d2f-4950-4e95-bf6a-53b5145053d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn\" (UID: \"37e40d2f-4950-4e95-bf6a-53b5145053d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"
Jul 29 21:19:59.953130 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:19:59.953111    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e40d2f-4950-4e95-bf6a-53b5145053d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn\" (UID: \"37e40d2f-4950-4e95-bf6a-53b5145053d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"
Jul 29 21:20:00.001827 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:00.001806    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"
Jul 29 21:20:00.340517 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:00.340493    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"]
Jul 29 21:20:00.341903 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:20:00.341875    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e40d2f_4950_4e95_bf6a_53b5145053d0.slice/crio-8b3d26419755b4efd8efff9bdc6a658b10378bf5e10372ae19a3606bfbce81e1 WatchSource:0}: Error finding container 8b3d26419755b4efd8efff9bdc6a658b10378bf5e10372ae19a3606bfbce81e1: Status 404 returned error can't find the container with id 8b3d26419755b4efd8efff9bdc6a658b10378bf5e10372ae19a3606bfbce81e1
Jul 29 21:20:01.085369 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:01.085338    2557 generic.go:356] "Generic (PLEG): container finished" podID="37e40d2f-4950-4e95-bf6a-53b5145053d0" containerID="5edab6603e6e257b85a0d0646479466f44b3647584f857d2d8860f9f9543ccf1" exitCode=0
Jul 29 21:20:01.085696 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:01.085420    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn" event={"ID":"37e40d2f-4950-4e95-bf6a-53b5145053d0","Type":"ContainerDied","Data":"5edab6603e6e257b85a0d0646479466f44b3647584f857d2d8860f9f9543ccf1"}
Jul 29 21:20:01.085696 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:01.085471    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn" event={"ID":"37e40d2f-4950-4e95-bf6a-53b5145053d0","Type":"ContainerStarted","Data":"8b3d26419755b4efd8efff9bdc6a658b10378bf5e10372ae19a3606bfbce81e1"}
Jul 29 21:20:02.237057 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:02.237032    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"
Jul 29 21:20:02.271086 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:02.271064    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e40d2f-4950-4e95-bf6a-53b5145053d0-maas-api-service-ca\") pod \"37e40d2f-4950-4e95-bf6a-53b5145053d0\" (UID: \"37e40d2f-4950-4e95-bf6a-53b5145053d0\") "
Jul 29 21:20:02.271438 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:02.271412    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37e40d2f-4950-4e95-bf6a-53b5145053d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "37e40d2f-4950-4e95-bf6a-53b5145053d0" (UID: "37e40d2f-4950-4e95-bf6a-53b5145053d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:20:02.372059 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:02.371983    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e40d2f-4950-4e95-bf6a-53b5145053d0-maas-api-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:20:03.096917 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:03.096886    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"
Jul 29 21:20:03.096917 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:03.096903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn" event={"ID":"37e40d2f-4950-4e95-bf6a-53b5145053d0","Type":"ContainerDied","Data":"8b3d26419755b4efd8efff9bdc6a658b10378bf5e10372ae19a3606bfbce81e1"}
Jul 29 21:20:03.097107 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:03.096953    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b3d26419755b4efd8efff9bdc6a658b10378bf5e10372ae19a3606bfbce81e1"
Jul 29 21:20:51.143721 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:20:51.143693    2557 scope.go:117] "RemoveContainer" containerID="c57ac4c1a5593df89011988c787b018d87cbe6dd018b0764ccd05730f3fca962"
Jul 29 21:24:50.899797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:24:50.899768    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:24:50.911074 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:24:50.911056    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:25:00.292303 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.292268    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"]
Jul 29 21:25:00.292763 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.292515    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy" containerID="cri-o://fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d" gracePeriod=30
Jul 29 21:25:00.662808 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.662735    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"]
Jul 29 21:25:00.663152 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.663138    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e40d2f-4950-4e95-bf6a-53b5145053d0" containerName="revoke-keys"
Jul 29 21:25:00.663196 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.663154    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e40d2f-4950-4e95-bf6a-53b5145053d0" containerName="revoke-keys"
Jul 29 21:25:00.663232 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.663221    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e40d2f-4950-4e95-bf6a-53b5145053d0" containerName="revoke-keys"
Jul 29 21:25:00.666189 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.666165    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"
Jul 29 21:25:00.668932 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.668908    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 21:25:00.674715 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.674651    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"]
Jul 29 21:25:00.698558 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.698522    2557 patch_prober.go:28] interesting pod/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:25:00.698671 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.698577    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:25:00.786342 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.786312    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b8068b0-22e9-4d42-96a7-0f287a4f4d45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q\" (UID: \"9b8068b0-22e9-4d42-96a7-0f287a4f4d45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"
Jul 29 21:25:00.887156 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.887127    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b8068b0-22e9-4d42-96a7-0f287a4f4d45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q\" (UID: \"9b8068b0-22e9-4d42-96a7-0f287a4f4d45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"
Jul 29 21:25:00.887669 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.887651    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b8068b0-22e9-4d42-96a7-0f287a4f4d45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q\" (UID: \"9b8068b0-22e9-4d42-96a7-0f287a4f4d45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"
Jul 29 21:25:00.979026 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:00.978966    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"
Jul 29 21:25:01.114992 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:01.114961    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"]
Jul 29 21:25:01.116062 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:25:01.116032    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8068b0_22e9_4d42_96a7_0f287a4f4d45.slice/crio-5382d9d773a2f46590920834cf8502a107a52ba2d1ac522620c50f1ed2df9ac6 WatchSource:0}: Error finding container 5382d9d773a2f46590920834cf8502a107a52ba2d1ac522620c50f1ed2df9ac6: Status 404 returned error can't find the container with id 5382d9d773a2f46590920834cf8502a107a52ba2d1ac522620c50f1ed2df9ac6
Jul 29 21:25:01.678621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:01.678530    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q" event={"ID":"9b8068b0-22e9-4d42-96a7-0f287a4f4d45","Type":"ContainerStarted","Data":"30c91f521d02a3fb690fc7d32d51da3c5506574c0746d97b63590a1c1f46793e"}
Jul 29 21:25:01.678621 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:01.678585    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q" event={"ID":"9b8068b0-22e9-4d42-96a7-0f287a4f4d45","Type":"ContainerStarted","Data":"5382d9d773a2f46590920834cf8502a107a52ba2d1ac522620c50f1ed2df9ac6"}
Jul 29 21:25:01.695682 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:01.695627    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q" podStartSLOduration=1.6956123349999999 podStartE2EDuration="1.695612335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:25:01.693624957 +0000 UTC m=+3611.545125629" watchObservedRunningTime="2026-07-29 21:25:01.695612335 +0000 UTC m=+3611.547113008"
Jul 29 21:25:02.684983 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:02.684951    2557 generic.go:356] "Generic (PLEG): container finished" podID="9b8068b0-22e9-4d42-96a7-0f287a4f4d45" containerID="30c91f521d02a3fb690fc7d32d51da3c5506574c0746d97b63590a1c1f46793e" exitCode=0
Jul 29 21:25:02.685366 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:02.685018    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q" event={"ID":"9b8068b0-22e9-4d42-96a7-0f287a4f4d45","Type":"ContainerDied","Data":"30c91f521d02a3fb690fc7d32d51da3c5506574c0746d97b63590a1c1f46793e"}
Jul 29 21:25:03.022696 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:03.022661    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"]
Jul 29 21:25:03.024866 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:03.024846    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb1aff7-8zttn"]
Jul 29 21:25:03.822728 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:03.822701    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"
Jul 29 21:25:03.911919 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:03.911894    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b8068b0-22e9-4d42-96a7-0f287a4f4d45-maas-api-service-ca\") pod \"9b8068b0-22e9-4d42-96a7-0f287a4f4d45\" (UID: \"9b8068b0-22e9-4d42-96a7-0f287a4f4d45\") "
Jul 29 21:25:03.912205 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:03.912183    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b8068b0-22e9-4d42-96a7-0f287a4f4d45-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9b8068b0-22e9-4d42-96a7-0f287a4f4d45" (UID: "9b8068b0-22e9-4d42-96a7-0f287a4f4d45"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:25:04.013144 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:04.013125    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b8068b0-22e9-4d42-96a7-0f287a4f4d45-maas-api-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:04.622079 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:04.622045    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e40d2f-4950-4e95-bf6a-53b5145053d0" path="/var/lib/kubelet/pods/37e40d2f-4950-4e95-bf6a-53b5145053d0/volumes"
Jul 29 21:25:04.698222 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:04.698194    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"
Jul 29 21:25:04.698390 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:04.698219    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q" event={"ID":"9b8068b0-22e9-4d42-96a7-0f287a4f4d45","Type":"ContainerDied","Data":"5382d9d773a2f46590920834cf8502a107a52ba2d1ac522620c50f1ed2df9ac6"}
Jul 29 21:25:04.698390 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:04.698267    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5382d9d773a2f46590920834cf8502a107a52ba2d1ac522620c50f1ed2df9ac6"
Jul 29 21:25:05.552053 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.552032    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:25:05.626724 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.626660    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-certs\") pod \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") "
Jul 29 21:25:05.626724 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.626697    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-envoy\") pod \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") "
Jul 29 21:25:05.626944 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.626737    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-credential-socket\") pod \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") "
Jul 29 21:25:05.626944 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.626759    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcgwl\" (UniqueName: \"kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-kube-api-access-gcgwl\") pod \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") "
Jul 29 21:25:05.626944 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.626778    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istiod-ca-cert\") pod \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") "
Jul 29 21:25:05.626944 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.626793    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-data\") pod \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") "
Jul 29 21:25:05.626944 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.626813    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-podinfo\") pod \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") "
Jul 29 21:25:05.627210 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.626959    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aab95595-1b6e-4481-89ad-c0b70ffa1d56" (UID: "aab95595-1b6e-4481-89ad-c0b70ffa1d56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:25:05.627210 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.627032    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-token\") pod \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") "
Jul 29 21:25:05.627210 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.627075    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-socket\") pod \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\" (UID: \"aab95595-1b6e-4481-89ad-c0b70ffa1d56\") "
Jul 29 21:25:05.627210 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.627101    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aab95595-1b6e-4481-89ad-c0b70ffa1d56" (UID: "aab95595-1b6e-4481-89ad-c0b70ffa1d56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:25:05.627489 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.627242    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aab95595-1b6e-4481-89ad-c0b70ffa1d56" (UID: "aab95595-1b6e-4481-89ad-c0b70ffa1d56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:25:05.627489 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.627426    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aab95595-1b6e-4481-89ad-c0b70ffa1d56" (UID: "aab95595-1b6e-4481-89ad-c0b70ffa1d56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:25:05.627602 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.627553    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:05.627602 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.627572    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:05.627602 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.627586    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:05.627602 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.627598    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:05.627964 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.627933    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-data" (OuterVolumeSpecName: "istio-data") pod "aab95595-1b6e-4481-89ad-c0b70ffa1d56" (UID: "aab95595-1b6e-4481-89ad-c0b70ffa1d56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:25:05.629050 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.629026    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aab95595-1b6e-4481-89ad-c0b70ffa1d56" (UID: "aab95595-1b6e-4481-89ad-c0b70ffa1d56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:25:05.629158 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.629127    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-kube-api-access-gcgwl" (OuterVolumeSpecName: "kube-api-access-gcgwl") pod "aab95595-1b6e-4481-89ad-c0b70ffa1d56" (UID: "aab95595-1b6e-4481-89ad-c0b70ffa1d56"). InnerVolumeSpecName "kube-api-access-gcgwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:25:05.629207 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.629173    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aab95595-1b6e-4481-89ad-c0b70ffa1d56" (UID: "aab95595-1b6e-4481-89ad-c0b70ffa1d56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:25:05.629207 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.629179    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-token" (OuterVolumeSpecName: "istio-token") pod "aab95595-1b6e-4481-89ad-c0b70ffa1d56" (UID: "aab95595-1b6e-4481-89ad-c0b70ffa1d56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:25:05.705718 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.705691    2557 generic.go:356] "Generic (PLEG): container finished" podID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerID="fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d" exitCode=0
Jul 29 21:25:05.705851 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.705728    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" event={"ID":"aab95595-1b6e-4481-89ad-c0b70ffa1d56","Type":"ContainerDied","Data":"fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d"}
Jul 29 21:25:05.705851 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.705738    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"
Jul 29 21:25:05.705851 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.705777    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c" event={"ID":"aab95595-1b6e-4481-89ad-c0b70ffa1d56","Type":"ContainerDied","Data":"e167c9a08fc89ea57888f9ae059d551c15259b45f3728e145bef6208dd6d1eaf"}
Jul 29 21:25:05.705851 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.705810    2557 scope.go:117] "RemoveContainer" containerID="fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d"
Jul 29 21:25:05.715053 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.715037    2557 scope.go:117] "RemoveContainer" containerID="90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920"
Jul 29 21:25:05.723069 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.723055    2557 scope.go:117] "RemoveContainer" containerID="fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d"
Jul 29 21:25:05.723296 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:25:05.723280    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d\": container with ID starting with fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d not found: ID does not exist" containerID="fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d"
Jul 29 21:25:05.723345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.723302    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d"} err="failed to get container status \"fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d\": rpc error: code = NotFound desc = could not find container \"fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d\": container with ID starting with fce4416896c0536ff16592cbda35b6925282ea21f28b89864b83f3e45f86133d not found: ID does not exist"
Jul 29 21:25:05.723345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.723317    2557 scope.go:117] "RemoveContainer" containerID="90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920"
Jul 29 21:25:05.723548 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:25:05.723533    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920\": container with ID starting with 90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920 not found: ID does not exist" containerID="90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920"
Jul 29 21:25:05.723589 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.723551    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920"} err="failed to get container status \"90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920\": rpc error: code = NotFound desc = could not find container \"90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920\": container with ID starting with 90ad306a7fae5912171cecf1c9d5c2afba47ac4ad1e4eb06944f39f8065b8920 not found: ID does not exist"
Jul 29 21:25:05.728362 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.728336    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"]
Jul 29 21:25:05.728454 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.728395    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcgwl\" (UniqueName: \"kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-kube-api-access-gcgwl\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:05.728454 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.728416    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:05.728454 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.728431    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:05.728454 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.728444    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:05.728615 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.728468    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aab95595-1b6e-4481-89ad-c0b70ffa1d56-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:05.731376 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:05.731357    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fcb1aff7-openshift-default-6d596bf4b8-5c26c"]
Jul 29 21:25:06.622772 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:06.622738    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" path="/var/lib/kubelet/pods/aab95595-1b6e-4481-89ad-c0b70ffa1d56/volumes"
Jul 29 21:25:16.742323 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:16.742285    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"]
Jul 29 21:25:16.748580 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:16.748550    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aa96fae3-45v8q"]
Jul 29 21:25:18.621392 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:18.621362    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b8068b0-22e9-4d42-96a7-0f287a4f4d45" path="/var/lib/kubelet/pods/9b8068b0-22e9-4d42-96a7-0f287a4f4d45/volumes"
Jul 29 21:25:23.160176 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:23.160144    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"]
Jul 29 21:25:23.160657 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:23.160392    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy" containerID="cri-o://d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900" gracePeriod=30
Jul 29 21:25:26.390434 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:26.390396    2557 patch_prober.go:28] interesting pod/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:25:26.390792 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:26.390474    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:25:28.413746 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.413721    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:25:28.518309 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518287    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-istio-token\") pod \"384df5db-7a03-4f48-805e-a170969afe7e\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") "
Jul 29 21:25:28.518475 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518320    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-data\") pod \"384df5db-7a03-4f48-805e-a170969afe7e\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") "
Jul 29 21:25:28.518475 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518338    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-socket\") pod \"384df5db-7a03-4f48-805e-a170969afe7e\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") "
Jul 29 21:25:28.518475 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518355    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ln75\" (UniqueName: \"kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-kube-api-access-8ln75\") pod \"384df5db-7a03-4f48-805e-a170969afe7e\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") "
Jul 29 21:25:28.518475 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518380    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/384df5db-7a03-4f48-805e-a170969afe7e-istiod-ca-cert\") pod \"384df5db-7a03-4f48-805e-a170969afe7e\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") "
Jul 29 21:25:28.518475 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518403    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-envoy\") pod \"384df5db-7a03-4f48-805e-a170969afe7e\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") "
Jul 29 21:25:28.518475 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518429    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-credential-socket\") pod \"384df5db-7a03-4f48-805e-a170969afe7e\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") "
Jul 29 21:25:28.518475 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518475    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/384df5db-7a03-4f48-805e-a170969afe7e-istio-podinfo\") pod \"384df5db-7a03-4f48-805e-a170969afe7e\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") "
Jul 29 21:25:28.518885 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518543    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-certs\") pod \"384df5db-7a03-4f48-805e-a170969afe7e\" (UID: \"384df5db-7a03-4f48-805e-a170969afe7e\") "
Jul 29 21:25:28.518885 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518697    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "384df5db-7a03-4f48-805e-a170969afe7e" (UID: "384df5db-7a03-4f48-805e-a170969afe7e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:25:28.518885 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518805    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/384df5db-7a03-4f48-805e-a170969afe7e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "384df5db-7a03-4f48-805e-a170969afe7e" (UID: "384df5db-7a03-4f48-805e-a170969afe7e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:25:28.518885 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518824    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:28.519119 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.518975    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "384df5db-7a03-4f48-805e-a170969afe7e" (UID: "384df5db-7a03-4f48-805e-a170969afe7e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:25:28.519177 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.519126    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "384df5db-7a03-4f48-805e-a170969afe7e" (UID: "384df5db-7a03-4f48-805e-a170969afe7e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:25:28.519315 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.519294    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-data" (OuterVolumeSpecName: "istio-data") pod "384df5db-7a03-4f48-805e-a170969afe7e" (UID: "384df5db-7a03-4f48-805e-a170969afe7e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:25:28.520725 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.520698    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/384df5db-7a03-4f48-805e-a170969afe7e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "384df5db-7a03-4f48-805e-a170969afe7e" (UID: "384df5db-7a03-4f48-805e-a170969afe7e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:25:28.520883 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.520702    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-istio-token" (OuterVolumeSpecName: "istio-token") pod "384df5db-7a03-4f48-805e-a170969afe7e" (UID: "384df5db-7a03-4f48-805e-a170969afe7e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:25:28.520883 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.520731    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "384df5db-7a03-4f48-805e-a170969afe7e" (UID: "384df5db-7a03-4f48-805e-a170969afe7e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:25:28.520883 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.520843    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-kube-api-access-8ln75" (OuterVolumeSpecName: "kube-api-access-8ln75") pod "384df5db-7a03-4f48-805e-a170969afe7e" (UID: "384df5db-7a03-4f48-805e-a170969afe7e"). InnerVolumeSpecName "kube-api-access-8ln75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:25:28.619537 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.619509    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:28.619537 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.619533    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:28.619700 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.619542    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ln75\" (UniqueName: \"kubernetes.io/projected/384df5db-7a03-4f48-805e-a170969afe7e-kube-api-access-8ln75\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:28.619700 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.619551    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/384df5db-7a03-4f48-805e-a170969afe7e-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:28.619700 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.619559    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:28.619700 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.619568    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:28.619700 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.619575    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/384df5db-7a03-4f48-805e-a170969afe7e-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:28.619700 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.619587    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/384df5db-7a03-4f48-805e-a170969afe7e-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:25:28.829696 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.829634    2557 generic.go:356] "Generic (PLEG): container finished" podID="384df5db-7a03-4f48-805e-a170969afe7e" containerID="d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900" exitCode=0
Jul 29 21:25:28.829696 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.829685    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"
Jul 29 21:25:28.829696 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.829691    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" event={"ID":"384df5db-7a03-4f48-805e-a170969afe7e","Type":"ContainerDied","Data":"d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900"}
Jul 29 21:25:28.829888 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.829735    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27" event={"ID":"384df5db-7a03-4f48-805e-a170969afe7e","Type":"ContainerDied","Data":"67c2e0b68d15fd891a3243119f3e9365acb7cc162d88845b6d431833d7efb45e"}
Jul 29 21:25:28.829888 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.829761    2557 scope.go:117] "RemoveContainer" containerID="d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900"
Jul 29 21:25:28.838617 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.838599    2557 scope.go:117] "RemoveContainer" containerID="1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c"
Jul 29 21:25:28.846341 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.846323    2557 scope.go:117] "RemoveContainer" containerID="d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900"
Jul 29 21:25:28.846593 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:25:28.846571    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900\": container with ID starting with d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900 not found: ID does not exist" containerID="d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900"
Jul 29 21:25:28.846679 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.846600    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900"} err="failed to get container status \"d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900\": rpc error: code = NotFound desc = could not find container \"d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900\": container with ID starting with d6c8833b1ebb13c8b118c0d2dcde90181f92c0176edf8656a5bfe4a33ba1c900 not found: ID does not exist"
Jul 29 21:25:28.846679 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.846618    2557 scope.go:117] "RemoveContainer" containerID="1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c"
Jul 29 21:25:28.846855 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:25:28.846822    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c\": container with ID starting with 1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c not found: ID does not exist" containerID="1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c"
Jul 29 21:25:28.846904 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.846861    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c"} err="failed to get container status \"1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c\": rpc error: code = NotFound desc = could not find container \"1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c\": container with ID starting with 1ced4d87afa555351dafb22bd194803f4ee5cf05365ded76ee12fe771937040c not found: ID does not exist"
Jul 29 21:25:28.852249 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.852230    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"]
Jul 29 21:25:28.856665 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:28.856646    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-aa96fae3-openshift-default-56f6cb7448-drd27"]
Jul 29 21:25:30.622286 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:25:30.622250    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="384df5db-7a03-4f48-805e-a170969afe7e" path="/var/lib/kubelet/pods/384df5db-7a03-4f48-805e-a170969afe7e/volumes"
Jul 29 21:26:03.347492 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.347457    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"]
Jul 29 21:26:03.348053 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.347991    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy"
Jul 29 21:26:03.348053 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348011    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy"
Jul 29 21:26:03.348053 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348024    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy"
Jul 29 21:26:03.348053 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348033    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy"
Jul 29 21:26:03.348053 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348053    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy"
Jul 29 21:26:03.348345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348062    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy"
Jul 29 21:26:03.348345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348085    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8068b0-22e9-4d42-96a7-0f287a4f4d45" containerName="revoke-keys"
Jul 29 21:26:03.348345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348096    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8068b0-22e9-4d42-96a7-0f287a4f4d45" containerName="revoke-keys"
Jul 29 21:26:03.348345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348162    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b8068b0-22e9-4d42-96a7-0f287a4f4d45" containerName="revoke-keys"
Jul 29 21:26:03.348345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348170    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy"
Jul 29 21:26:03.348345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348177    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy"
Jul 29 21:26:03.348345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348181    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy"
Jul 29 21:26:03.348345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.348188    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="aab95595-1b6e-4481-89ad-c0b70ffa1d56" containerName="istio-proxy"
Jul 29 21:26:03.352547 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.352530    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.358918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.358607    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-b04ec1-openshift-default-dockercfg-cfd9k\""
Jul 29 21:26:03.366414 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.366389    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"]
Jul 29 21:26:03.492032 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.492007    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-socket\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.492160 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.492036    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-credential-socket\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.492160 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.492055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee52d27-d081-4499-9e26-a60de2334900-istiod-ca-cert\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.492160 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.492082    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee52d27-d081-4499-9e26-a60de2334900-istio-podinfo\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.492160 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.492132    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-istio-token\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.492313 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.492222    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-envoy\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.492313 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.492265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-data\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.492313 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.492285    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv8f6\" (UniqueName: \"kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-kube-api-access-xv8f6\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.492313 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.492302    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-certs\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.593531 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.593499    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-socket\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.593531 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.593533    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-credential-socket\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.593726 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.593553    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee52d27-d081-4499-9e26-a60de2334900-istiod-ca-cert\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.593726 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.593583    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee52d27-d081-4499-9e26-a60de2334900-istio-podinfo\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.593726 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.593611    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-istio-token\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.594079 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.594046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-envoy\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.594209 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.594142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-data\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.594209 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.594166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-credential-socket\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.594209 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.594176    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv8f6\" (UniqueName: \"kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-kube-api-access-xv8f6\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.594387 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.594213    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-certs\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.594387 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.594321    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-socket\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.601635 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.594773    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-certs\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.601635 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.595193    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee52d27-d081-4499-9e26-a60de2334900-istiod-ca-cert\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.603463 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.603425    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-data\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.603695 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.603676    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-istio-token\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.603852 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.603816    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv8f6\" (UniqueName: \"kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-kube-api-access-xv8f6\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.604874 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.604826    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-envoy\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.605220 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.605201    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee52d27-d081-4499-9e26-a60de2334900-istio-podinfo\") pod \"e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") " pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.662474 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.662451    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:03.796528 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.796505    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"]
Jul 29 21:26:03.798273 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:26:03.798243    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee52d27_d081_4499_9e26_a60de2334900.slice/crio-b9a7c6c2106127a069dbf6e7fcf3e659b0e1059a80af0ffe6d806b369ffb9c54 WatchSource:0}: Error finding container b9a7c6c2106127a069dbf6e7fcf3e659b0e1059a80af0ffe6d806b369ffb9c54: Status 404 returned error can't find the container with id b9a7c6c2106127a069dbf6e7fcf3e659b0e1059a80af0ffe6d806b369ffb9c54
Jul 29 21:26:03.800500 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.800459    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:03.800571 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.800542    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:03.800606 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:03.800582    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:04.024191 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:04.024148    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" event={"ID":"bee52d27-d081-4499-9e26-a60de2334900","Type":"ContainerStarted","Data":"24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31"}
Jul 29 21:26:04.024350 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:04.024210    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" event={"ID":"bee52d27-d081-4499-9e26-a60de2334900","Type":"ContainerStarted","Data":"b9a7c6c2106127a069dbf6e7fcf3e659b0e1059a80af0ffe6d806b369ffb9c54"}
Jul 29 21:26:04.045935 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:04.045881    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" podStartSLOduration=1.045867274 podStartE2EDuration="1.045867274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:26:04.043497319 +0000 UTC m=+3673.894997991" watchObservedRunningTime="2026-07-29 21:26:04.045867274 +0000 UTC m=+3673.897368009"
Jul 29 21:26:04.663543 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:04.663509    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:04.668204 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:04.668177    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:05.029352 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:05.029325    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:05.030259 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:05.030240    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:06.873723 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:06.873693    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"]
Jul 29 21:26:06.874255 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:06.874236    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy"
Jul 29 21:26:06.874338 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:06.874259    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="384df5db-7a03-4f48-805e-a170969afe7e" containerName="istio-proxy"
Jul 29 21:26:06.877047 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:06.877027    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:26:06.882964 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:06.882949    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-b04ec1-dockercfg-9ppzn\""
Jul 29 21:26:06.885124 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:06.885082    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-b04ec1\""
Jul 29 21:26:06.888360 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:06.888340    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"]
Jul 29 21:26:07.024203 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:07.024167    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7592b9-98e9-4555-9538-87143b2eea52-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn\" (UID: \"1f7592b9-98e9-4555-9538-87143b2eea52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:26:07.024372 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:07.024209    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk9wq\" (UniqueName: \"kubernetes.io/projected/1f7592b9-98e9-4555-9538-87143b2eea52-kube-api-access-rk9wq\") pod \"payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn\" (UID: \"1f7592b9-98e9-4555-9538-87143b2eea52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:26:07.125023 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:07.124943    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7592b9-98e9-4555-9538-87143b2eea52-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn\" (UID: \"1f7592b9-98e9-4555-9538-87143b2eea52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:26:07.125023 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:07.124981    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk9wq\" (UniqueName: \"kubernetes.io/projected/1f7592b9-98e9-4555-9538-87143b2eea52-kube-api-access-rk9wq\") pod \"payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn\" (UID: \"1f7592b9-98e9-4555-9538-87143b2eea52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:26:07.125691 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:07.125670    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7592b9-98e9-4555-9538-87143b2eea52-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn\" (UID: \"1f7592b9-98e9-4555-9538-87143b2eea52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:26:07.133525 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:07.133497    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk9wq\" (UniqueName: \"kubernetes.io/projected/1f7592b9-98e9-4555-9538-87143b2eea52-kube-api-access-rk9wq\") pod \"payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn\" (UID: \"1f7592b9-98e9-4555-9538-87143b2eea52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:26:07.188453 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:07.188429    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:26:07.330025 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:07.330000    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"]
Jul 29 21:26:07.331653 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:26:07.331627    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7592b9_98e9_4555_9538_87143b2eea52.slice/crio-5853031642adf10e0c9a242b01a151f6161a0b974a4fc913ec07f15d77e61738 WatchSource:0}: Error finding container 5853031642adf10e0c9a242b01a151f6161a0b974a4fc913ec07f15d77e61738: Status 404 returned error can't find the container with id 5853031642adf10e0c9a242b01a151f6161a0b974a4fc913ec07f15d77e61738
Jul 29 21:26:08.049501 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:08.049441    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn" event={"ID":"1f7592b9-98e9-4555-9538-87143b2eea52","Type":"ContainerStarted","Data":"c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0"}
Jul 29 21:26:08.050006 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:08.049549    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:26:08.050006 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:08.049576    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn" event={"ID":"1f7592b9-98e9-4555-9538-87143b2eea52","Type":"ContainerStarted","Data":"5853031642adf10e0c9a242b01a151f6161a0b974a4fc913ec07f15d77e61738"}
Jul 29 21:26:08.065355 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:08.065303    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn" podStartSLOduration=2.06528989 podStartE2EDuration="2.06528989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:26:08.065264342 +0000 UTC m=+3677.916765017" watchObservedRunningTime="2026-07-29 21:26:08.06528989 +0000 UTC m=+3677.916790561"
Jul 29 21:26:19.057135 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:19.057103    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:26:19.120688 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:19.120660    2557 generic.go:356] "Generic (PLEG): container finished" podID="bee52d27-d081-4499-9e26-a60de2334900" containerID="24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31" exitCode=0
Jul 29 21:26:19.120873 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:19.120736    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" event={"ID":"bee52d27-d081-4499-9e26-a60de2334900","Type":"ContainerDied","Data":"24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31"}
Jul 29 21:26:19.121154 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:19.121139    2557 scope.go:117] "RemoveContainer" containerID="24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31"
Jul 29 21:26:19.122145 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:19.122118    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:19.122215 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:19.122179    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:19.122255 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:19.122220    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:20.029598 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:20.029568    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:20.128272 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:20.128241    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" event={"ID":"bee52d27-d081-4499-9e26-a60de2334900","Type":"ContainerStarted","Data":"51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43"}
Jul 29 21:26:20.663395 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:20.663366    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:20.664233 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:20.664203    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 29 21:26:20.664369 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:20.664268    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 29 21:26:21.662789 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:21.662755    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 29 21:26:21.663178 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:21.662815    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 29 21:26:22.662749 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:22.662713    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 29 21:26:22.662931 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:22.662780    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 29 21:26:23.663019 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:23.662987    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 29 21:26:23.663378 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:23.663049    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 29 21:26:24.666872 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:24.666828    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:24.667230 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:24.667124    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:24.667842 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:24.667814    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:26:31.694567 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.694516    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"]
Jul 29 21:26:31.697377 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.697360    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.703035 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.703015    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-46f813-openshift-default-dockercfg-fz4hl\""
Jul 29 21:26:31.716533 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.716511    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"]
Jul 29 21:26:31.731599 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.731573    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-certs\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.731694 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.731610    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-data\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.731694 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.731659    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-socket\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.731765 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.731699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-podinfo\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.731765 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.731748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-credential-socket\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.731881 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.731764    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-envoy\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.731881 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.731812    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwbfn\" (UniqueName: \"kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-kube-api-access-bwbfn\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.731954 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.731907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istiod-ca-cert\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.731954 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.731934    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-token\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833031 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.832994    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-certs\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833031 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-data\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833291 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833053    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-socket\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833291 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833076    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-podinfo\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833291 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833125    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-credential-socket\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833291 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833143    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-envoy\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833291 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833176    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwbfn\" (UniqueName: \"kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-kube-api-access-bwbfn\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833291 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833230    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istiod-ca-cert\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833291 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-token\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833663 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833471    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-data\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833663 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833538    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-socket\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833663 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833658    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-credential-socket\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.833796 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833698    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-certs\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.834006 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.833991    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istiod-ca-cert\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.835491 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.835470    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-envoy\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.835634 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.835617    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-podinfo\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.841774 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.841751    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-token\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:31.841966 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:31.841949    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwbfn\" (UniqueName: \"kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-kube-api-access-bwbfn\") pod \"e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") " pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:32.007275 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:32.007196    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:32.138785 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:32.138756    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"]
Jul 29 21:26:32.139724 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:26:32.139699    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2c0bd0_cace_4b31_a7c4_d86936339b2b.slice/crio-6eba8e12da908450e6c5474b8f6a35653b86a0c0703b59d48486febb159e26cd WatchSource:0}: Error finding container 6eba8e12da908450e6c5474b8f6a35653b86a0c0703b59d48486febb159e26cd: Status 404 returned error can't find the container with id 6eba8e12da908450e6c5474b8f6a35653b86a0c0703b59d48486febb159e26cd
Jul 29 21:26:32.141964 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:32.141930    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:32.142059 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:32.141997    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:32.142059 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:32.142024    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:32.193874 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:32.193822    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" event={"ID":"7d2c0bd0-cace-4b31-a7c4-d86936339b2b","Type":"ContainerStarted","Data":"6eba8e12da908450e6c5474b8f6a35653b86a0c0703b59d48486febb159e26cd"}
Jul 29 21:26:33.201234 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:33.201198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" event={"ID":"7d2c0bd0-cace-4b31-a7c4-d86936339b2b","Type":"ContainerStarted","Data":"f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387"}
Jul 29 21:26:33.221310 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:33.221243    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" podStartSLOduration=2.221229957 podStartE2EDuration="2.221229957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:26:33.221041279 +0000 UTC m=+3703.072541950" watchObservedRunningTime="2026-07-29 21:26:33.221229957 +0000 UTC m=+3703.072730629"
Jul 29 21:26:34.007481 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:34.007454    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:34.012058 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:34.012036    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:34.206664 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:34.206641    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:34.207575 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:34.207559    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:49.344993 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:49.344963    2557 patch_prober.go:28] interesting pod/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": read tcp 10.133.0.2:47834->10.133.0.82:15021: read: connection reset by peer" start-of-body=
Jul 29 21:26:49.345349 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:49.345036    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": read tcp 10.133.0.2:47834->10.133.0.82:15021: read: connection reset by peer"
Jul 29 21:26:50.297233 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:50.297201    2557 generic.go:356] "Generic (PLEG): container finished" podID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerID="f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387" exitCode=0
Jul 29 21:26:50.297402 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:50.297272    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" event={"ID":"7d2c0bd0-cace-4b31-a7c4-d86936339b2b","Type":"ContainerDied","Data":"f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387"}
Jul 29 21:26:50.297650 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:50.297635    2557 scope.go:117] "RemoveContainer" containerID="f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387"
Jul 29 21:26:50.298780 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:50.298746    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:50.298908 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:50.298849    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:50.298908 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:50.298896    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:26:51.213184 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:51.213153    2557 scope.go:117] "RemoveContainer" containerID="5edab6603e6e257b85a0d0646479466f44b3647584f857d2d8860f9f9543ccf1"
Jul 29 21:26:51.305340 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:51.305295    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" event={"ID":"7d2c0bd0-cace-4b31-a7c4-d86936339b2b","Type":"ContainerStarted","Data":"b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc"}
Jul 29 21:26:52.008215 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:52.008177    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:52.008481 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:52.008456    2557 patch_prober.go:28] interesting pod/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Jul 29 21:26:52.008594 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:52.008524    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Jul 29 21:26:53.007847 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:53.007801    2557 patch_prober.go:28] interesting pod/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Jul 29 21:26:53.008223 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:53.007873    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Jul 29 21:26:54.008309 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:54.008272    2557 patch_prober.go:28] interesting pod/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Jul 29 21:26:54.008683 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:54.008327    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Jul 29 21:26:55.007789 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:55.007754    2557 patch_prober.go:28] interesting pod/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Jul 29 21:26:55.007986 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:55.007808    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Jul 29 21:26:56.011188 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:56.011158    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:56.011619 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:56.011604    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:26:56.012235 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:26:56.012219    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:27:05.429489 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.429457    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"]
Jul 29 21:27:05.432972 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.432956    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.435497 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.435476    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b04ec1\"/\"openshift-service-ca.crt\""
Jul 29 21:27:05.436573 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.436550    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b04ec1\"/\"default-dockercfg-2fdxm\""
Jul 29 21:27:05.436677 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.436656    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b04ec1\"/\"kube-root-ca.crt\""
Jul 29 21:27:05.436855 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.436822    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b04ec1\"/\"test-model-b04ec1-kserve-self-signed-certs\""
Jul 29 21:27:05.443058 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.443040    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"]
Jul 29 21:27:05.526662 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.526639    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-tmp-dir\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.526807 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.526686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-model-cache\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.526807 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.526735    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-home\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.526807 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.526760    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-dshm\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.526929 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.526805    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5232e1df-dc4b-476f-a894-c165f24cfe8c-tls-certs\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.526929 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.526824    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkxfd\" (UniqueName: \"kubernetes.io/projected/5232e1df-dc4b-476f-a894-c165f24cfe8c-kube-api-access-nkxfd\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.627790 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.627749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-model-cache\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.627942 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.627808    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-home\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.627942 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.627851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-dshm\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.627942 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.627896    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5232e1df-dc4b-476f-a894-c165f24cfe8c-tls-certs\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.627942 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.627921    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxfd\" (UniqueName: \"kubernetes.io/projected/5232e1df-dc4b-476f-a894-c165f24cfe8c-kube-api-access-nkxfd\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.628120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.627982    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-tmp-dir\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.628232 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.628209    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-home\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.628275 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.628262    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-model-cache\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.628339 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.628326    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-tmp-dir\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.630026 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.630006    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-dshm\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.630383 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.630365    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5232e1df-dc4b-476f-a894-c165f24cfe8c-tls-certs\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.636106 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.636087    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkxfd\" (UniqueName: \"kubernetes.io/projected/5232e1df-dc4b-476f-a894-c165f24cfe8c-kube-api-access-nkxfd\") pod \"test-model-b04ec1-kserve-6c669c696c-l9dc5\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") " pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.743224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.743138    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:05.880860 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:05.880784    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"]
Jul 29 21:27:05.883106 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:27:05.883076    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5232e1df_dc4b_476f_a894_c165f24cfe8c.slice/crio-e69419004cb32f1bc174872c0cb36bcd445a90b9b4403fb5def0332e68e2382c WatchSource:0}: Error finding container e69419004cb32f1bc174872c0cb36bcd445a90b9b4403fb5def0332e68e2382c: Status 404 returned error can't find the container with id e69419004cb32f1bc174872c0cb36bcd445a90b9b4403fb5def0332e68e2382c
Jul 29 21:27:06.386871 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:06.386806    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5" event={"ID":"5232e1df-dc4b-476f-a894-c165f24cfe8c","Type":"ContainerStarted","Data":"bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138"}
Jul 29 21:27:06.387017 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:06.386877    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5" event={"ID":"5232e1df-dc4b-476f-a894-c165f24cfe8c","Type":"ContainerStarted","Data":"e69419004cb32f1bc174872c0cb36bcd445a90b9b4403fb5def0332e68e2382c"}
Jul 29 21:27:06.405932 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:06.405887    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5" podStartSLOduration=1.405873197 podStartE2EDuration="1.405873197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:27:06.403581162 +0000 UTC m=+3736.255081837" watchObservedRunningTime="2026-07-29 21:27:06.405873197 +0000 UTC m=+3736.257373869"
Jul 29 21:27:15.743471 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:15.743437    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:15.743981 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:15.743513    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:15.755951 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:15.755930    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:27:16.452758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:27:16.452734    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:28:35.272632 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:35.272593    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"]
Jul 29 21:28:47.181070 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.181034    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"]
Jul 29 21:28:47.181594 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.181319    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn" podUID="1f7592b9-98e9-4555-9538-87143b2eea52" containerName="payload-pre-processing" containerID="cri-o://c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0" gracePeriod=30
Jul 29 21:28:47.468244 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.468219    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:28:47.525343 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.525314    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7592b9-98e9-4555-9538-87143b2eea52-plugins-config-volume\") pod \"1f7592b9-98e9-4555-9538-87143b2eea52\" (UID: \"1f7592b9-98e9-4555-9538-87143b2eea52\") "
Jul 29 21:28:47.525512 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.525404    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk9wq\" (UniqueName: \"kubernetes.io/projected/1f7592b9-98e9-4555-9538-87143b2eea52-kube-api-access-rk9wq\") pod \"1f7592b9-98e9-4555-9538-87143b2eea52\" (UID: \"1f7592b9-98e9-4555-9538-87143b2eea52\") "
Jul 29 21:28:47.525681 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.525657    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f7592b9-98e9-4555-9538-87143b2eea52-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f7592b9-98e9-4555-9538-87143b2eea52" (UID: "1f7592b9-98e9-4555-9538-87143b2eea52"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:28:47.525788 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.525771    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7592b9-98e9-4555-9538-87143b2eea52-plugins-config-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:28:47.527642 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.527616    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7592b9-98e9-4555-9538-87143b2eea52-kube-api-access-rk9wq" (OuterVolumeSpecName: "kube-api-access-rk9wq") pod "1f7592b9-98e9-4555-9538-87143b2eea52" (UID: "1f7592b9-98e9-4555-9538-87143b2eea52"). InnerVolumeSpecName "kube-api-access-rk9wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:28:47.626541 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.626515    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk9wq\" (UniqueName: \"kubernetes.io/projected/1f7592b9-98e9-4555-9538-87143b2eea52-kube-api-access-rk9wq\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:28:47.935548 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.935520    2557 generic.go:356] "Generic (PLEG): container finished" podID="1f7592b9-98e9-4555-9538-87143b2eea52" containerID="c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0" exitCode=0
Jul 29 21:28:47.935718 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.935572    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"
Jul 29 21:28:47.935718 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.935591    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn" event={"ID":"1f7592b9-98e9-4555-9538-87143b2eea52","Type":"ContainerDied","Data":"c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0"}
Jul 29 21:28:47.935718 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.935655    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn" event={"ID":"1f7592b9-98e9-4555-9538-87143b2eea52","Type":"ContainerDied","Data":"5853031642adf10e0c9a242b01a151f6161a0b974a4fc913ec07f15d77e61738"}
Jul 29 21:28:47.935718 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.935686    2557 scope.go:117] "RemoveContainer" containerID="c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0"
Jul 29 21:28:47.945781 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.945763    2557 scope.go:117] "RemoveContainer" containerID="c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0"
Jul 29 21:28:47.946055 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:28:47.946035    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0\": container with ID starting with c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0 not found: ID does not exist" containerID="c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0"
Jul 29 21:28:47.946125 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.946062    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0"} err="failed to get container status \"c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0\": rpc error: code = NotFound desc = could not find container \"c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0\": container with ID starting with c75f88015a3c582e5f6babebf7fc2d37e5992b6b2ab74415220f12ba8cdb73c0 not found: ID does not exist"
Jul 29 21:28:47.965395 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.965372    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"]
Jul 29 21:28:47.977264 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:47.977243    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b04ec1-8b966dc5b-pspdn"]
Jul 29 21:28:48.621285 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:48.621253    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f7592b9-98e9-4555-9538-87143b2eea52" path="/var/lib/kubelet/pods/1f7592b9-98e9-4555-9538-87143b2eea52/volumes"
Jul 29 21:28:50.291457 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.291423    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5" podUID="5232e1df-dc4b-476f-a894-c165f24cfe8c" containerName="main" containerID="cri-o://bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138" gracePeriod=45
Jul 29 21:28:50.545980 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.545924    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:28:50.651312 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651285    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-dshm\") pod \"5232e1df-dc4b-476f-a894-c165f24cfe8c\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") "
Jul 29 21:28:50.651436 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651322    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-tmp-dir\") pod \"5232e1df-dc4b-476f-a894-c165f24cfe8c\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") "
Jul 29 21:28:50.651436 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651342    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkxfd\" (UniqueName: \"kubernetes.io/projected/5232e1df-dc4b-476f-a894-c165f24cfe8c-kube-api-access-nkxfd\") pod \"5232e1df-dc4b-476f-a894-c165f24cfe8c\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") "
Jul 29 21:28:50.651436 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651398    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-home\") pod \"5232e1df-dc4b-476f-a894-c165f24cfe8c\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") "
Jul 29 21:28:50.651553 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651444    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-model-cache\") pod \"5232e1df-dc4b-476f-a894-c165f24cfe8c\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") "
Jul 29 21:28:50.651553 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651510    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5232e1df-dc4b-476f-a894-c165f24cfe8c-tls-certs\") pod \"5232e1df-dc4b-476f-a894-c165f24cfe8c\" (UID: \"5232e1df-dc4b-476f-a894-c165f24cfe8c\") "
Jul 29 21:28:50.651650 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651565    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5232e1df-dc4b-476f-a894-c165f24cfe8c" (UID: "5232e1df-dc4b-476f-a894-c165f24cfe8c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:28:50.651724 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651697    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-model-cache" (OuterVolumeSpecName: "model-cache") pod "5232e1df-dc4b-476f-a894-c165f24cfe8c" (UID: "5232e1df-dc4b-476f-a894-c165f24cfe8c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:28:50.651724 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651709    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-home" (OuterVolumeSpecName: "home") pod "5232e1df-dc4b-476f-a894-c165f24cfe8c" (UID: "5232e1df-dc4b-476f-a894-c165f24cfe8c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:28:50.651864 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651774    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-model-cache\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:28:50.651864 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.651792    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-tmp-dir\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:28:50.653365 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.653342    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-dshm" (OuterVolumeSpecName: "dshm") pod "5232e1df-dc4b-476f-a894-c165f24cfe8c" (UID: "5232e1df-dc4b-476f-a894-c165f24cfe8c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:28:50.653466 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.653400    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5232e1df-dc4b-476f-a894-c165f24cfe8c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5232e1df-dc4b-476f-a894-c165f24cfe8c" (UID: "5232e1df-dc4b-476f-a894-c165f24cfe8c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:28:50.653466 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.653425    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5232e1df-dc4b-476f-a894-c165f24cfe8c-kube-api-access-nkxfd" (OuterVolumeSpecName: "kube-api-access-nkxfd") pod "5232e1df-dc4b-476f-a894-c165f24cfe8c" (UID: "5232e1df-dc4b-476f-a894-c165f24cfe8c"). InnerVolumeSpecName "kube-api-access-nkxfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:28:50.752325 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.752300    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkxfd\" (UniqueName: \"kubernetes.io/projected/5232e1df-dc4b-476f-a894-c165f24cfe8c-kube-api-access-nkxfd\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:28:50.752325 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.752320    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-home\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:28:50.752509 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.752330    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5232e1df-dc4b-476f-a894-c165f24cfe8c-tls-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:28:50.752509 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.752340    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5232e1df-dc4b-476f-a894-c165f24cfe8c-dshm\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:28:50.953540 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.953472    2557 generic.go:356] "Generic (PLEG): container finished" podID="5232e1df-dc4b-476f-a894-c165f24cfe8c" containerID="bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138" exitCode=0
Jul 29 21:28:50.953540 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.953525    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"
Jul 29 21:28:50.953728 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.953556    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5" event={"ID":"5232e1df-dc4b-476f-a894-c165f24cfe8c","Type":"ContainerDied","Data":"bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138"}
Jul 29 21:28:50.953728 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.953595    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5" event={"ID":"5232e1df-dc4b-476f-a894-c165f24cfe8c","Type":"ContainerDied","Data":"e69419004cb32f1bc174872c0cb36bcd445a90b9b4403fb5def0332e68e2382c"}
Jul 29 21:28:50.953728 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.953613    2557 scope.go:117] "RemoveContainer" containerID="bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138"
Jul 29 21:28:50.962414 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.962397    2557 scope.go:117] "RemoveContainer" containerID="bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138"
Jul 29 21:28:50.962667 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:28:50.962643    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138\": container with ID starting with bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138 not found: ID does not exist" containerID="bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138"
Jul 29 21:28:50.962756 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.962672    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138"} err="failed to get container status \"bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138\": rpc error: code = NotFound desc = could not find container \"bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138\": container with ID starting with bfd30297da25384c8fa704060a4902737a1e0052265f8f8258f8995387b24138 not found: ID does not exist"
Jul 29 21:28:50.976981 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.976953    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"]
Jul 29 21:28:50.984852 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:50.981788    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b04ec1/test-model-b04ec1-kserve-6c669c696c-l9dc5"]
Jul 29 21:28:52.621463 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:52.621432    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5232e1df-dc4b-476f-a894-c165f24cfe8c" path="/var/lib/kubelet/pods/5232e1df-dc4b-476f-a894-c165f24cfe8c/volumes"
Jul 29 21:28:54.662081 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:54.662046    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"]
Jul 29 21:28:54.662481 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:54.662240    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy" containerID="cri-o://51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43" gracePeriod=30
Jul 29 21:28:54.668765 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:54.668738    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:28:54.668901 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:54.668801    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:28:59.918573 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:28:59.918545    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:29:00.005966 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.005875    2557 generic.go:356] "Generic (PLEG): container finished" podID="bee52d27-d081-4499-9e26-a60de2334900" containerID="51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43" exitCode=0
Jul 29 21:29:00.005966 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.005934    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"
Jul 29 21:29:00.006191 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.005958    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" event={"ID":"bee52d27-d081-4499-9e26-a60de2334900","Type":"ContainerDied","Data":"51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43"}
Jul 29 21:29:00.006191 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.006014    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k" event={"ID":"bee52d27-d081-4499-9e26-a60de2334900","Type":"ContainerDied","Data":"b9a7c6c2106127a069dbf6e7fcf3e659b0e1059a80af0ffe6d806b369ffb9c54"}
Jul 29 21:29:00.006191 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.006036    2557 scope.go:117] "RemoveContainer" containerID="51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43"
Jul 29 21:29:00.014676 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.014660    2557 scope.go:117] "RemoveContainer" containerID="24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31"
Jul 29 21:29:00.023077 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.023058    2557 scope.go:117] "RemoveContainer" containerID="51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43"
Jul 29 21:29:00.023318 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:29:00.023299    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43\": container with ID starting with 51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43 not found: ID does not exist" containerID="51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43"
Jul 29 21:29:00.023380 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.023325    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43"} err="failed to get container status \"51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43\": rpc error: code = NotFound desc = could not find container \"51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43\": container with ID starting with 51bee92d34769837568dd2a26b3a6ada402c55f82a66191e9a1de5d5a455bd43 not found: ID does not exist"
Jul 29 21:29:00.023380 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.023342    2557 scope.go:117] "RemoveContainer" containerID="24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31"
Jul 29 21:29:00.023551 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:29:00.023536    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31\": container with ID starting with 24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31 not found: ID does not exist" containerID="24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31"
Jul 29 21:29:00.023594 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.023556    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31"} err="failed to get container status \"24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31\": rpc error: code = NotFound desc = could not find container \"24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31\": container with ID starting with 24d10ba2a8a584638c8b55e226d5e87e69b1ba6e92227a59f1c0b389ba0a4a31 not found: ID does not exist"
Jul 29 21:29:00.036917 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.036893    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-certs\") pod \"bee52d27-d081-4499-9e26-a60de2334900\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") "
Jul 29 21:29:00.037017 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.036939    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-istio-token\") pod \"bee52d27-d081-4499-9e26-a60de2334900\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") "
Jul 29 21:29:00.037017 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.036980    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-socket\") pod \"bee52d27-d081-4499-9e26-a60de2334900\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") "
Jul 29 21:29:00.037017 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.036999    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-envoy\") pod \"bee52d27-d081-4499-9e26-a60de2334900\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") "
Jul 29 21:29:00.037170 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037049    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee52d27-d081-4499-9e26-a60de2334900-istiod-ca-cert\") pod \"bee52d27-d081-4499-9e26-a60de2334900\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") "
Jul 29 21:29:00.037170 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037073    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-credential-socket\") pod \"bee52d27-d081-4499-9e26-a60de2334900\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") "
Jul 29 21:29:00.037170 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037127    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv8f6\" (UniqueName: \"kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-kube-api-access-xv8f6\") pod \"bee52d27-d081-4499-9e26-a60de2334900\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") "
Jul 29 21:29:00.037170 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037155    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-data\") pod \"bee52d27-d081-4499-9e26-a60de2334900\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") "
Jul 29 21:29:00.037380 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037182    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bee52d27-d081-4499-9e26-a60de2334900" (UID: "bee52d27-d081-4499-9e26-a60de2334900"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:29:00.037380 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037201    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee52d27-d081-4499-9e26-a60de2334900-istio-podinfo\") pod \"bee52d27-d081-4499-9e26-a60de2334900\" (UID: \"bee52d27-d081-4499-9e26-a60de2334900\") "
Jul 29 21:29:00.037510 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037376    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bee52d27-d081-4499-9e26-a60de2334900" (UID: "bee52d27-d081-4499-9e26-a60de2334900"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:29:00.037563 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037513    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bee52d27-d081-4499-9e26-a60de2334900" (UID: "bee52d27-d081-4499-9e26-a60de2334900"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:29:00.037563 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037456    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bee52d27-d081-4499-9e26-a60de2334900-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bee52d27-d081-4499-9e26-a60de2334900" (UID: "bee52d27-d081-4499-9e26-a60de2334900"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:29:00.037563 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037543    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:00.037718 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.037563    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:00.038097 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.038070    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-data" (OuterVolumeSpecName: "istio-data") pod "bee52d27-d081-4499-9e26-a60de2334900" (UID: "bee52d27-d081-4499-9e26-a60de2334900"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:29:00.039263 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.039233    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bee52d27-d081-4499-9e26-a60de2334900" (UID: "bee52d27-d081-4499-9e26-a60de2334900"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:29:00.039371 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.039353    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bee52d27-d081-4499-9e26-a60de2334900-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bee52d27-d081-4499-9e26-a60de2334900" (UID: "bee52d27-d081-4499-9e26-a60de2334900"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:29:00.039424 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.039352    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-istio-token" (OuterVolumeSpecName: "istio-token") pod "bee52d27-d081-4499-9e26-a60de2334900" (UID: "bee52d27-d081-4499-9e26-a60de2334900"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:29:00.039424 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.039367    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-kube-api-access-xv8f6" (OuterVolumeSpecName: "kube-api-access-xv8f6") pod "bee52d27-d081-4499-9e26-a60de2334900" (UID: "bee52d27-d081-4499-9e26-a60de2334900"). InnerVolumeSpecName "kube-api-access-xv8f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:29:00.138906 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.138872    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv8f6\" (UniqueName: \"kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-kube-api-access-xv8f6\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:00.138906 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.138900    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:00.138906 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.138909    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee52d27-d081-4499-9e26-a60de2334900-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:00.139140 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.138917    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee52d27-d081-4499-9e26-a60de2334900-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:00.139140 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.138926    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:00.139140 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.138934    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee52d27-d081-4499-9e26-a60de2334900-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:00.139140 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.138943    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee52d27-d081-4499-9e26-a60de2334900-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:00.337443 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.337414    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"]
Jul 29 21:29:00.344988 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.344963    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-b04ec1-openshift-default-5b78d8b4d4-s5v6k"]
Jul 29 21:29:00.621891 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:00.621812    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bee52d27-d081-4499-9e26-a60de2334900" path="/var/lib/kubelet/pods/bee52d27-d081-4499-9e26-a60de2334900/volumes"
Jul 29 21:29:12.418770 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:12.418689    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"]
Jul 29 21:29:12.419166 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:12.418913    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy" containerID="cri-o://b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc" gracePeriod=30
Jul 29 21:29:13.297827 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.297791    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"]
Jul 29 21:29:13.298204 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.298191    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f7592b9-98e9-4555-9538-87143b2eea52" containerName="payload-pre-processing"
Jul 29 21:29:13.298245 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.298206    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f7592b9-98e9-4555-9538-87143b2eea52" containerName="payload-pre-processing"
Jul 29 21:29:13.298245 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.298218    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy"
Jul 29 21:29:13.298245 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.298224    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy"
Jul 29 21:29:13.298245 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.298243    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5232e1df-dc4b-476f-a894-c165f24cfe8c" containerName="main"
Jul 29 21:29:13.298384 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.298249    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5232e1df-dc4b-476f-a894-c165f24cfe8c" containerName="main"
Jul 29 21:29:13.298384 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.298298    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5232e1df-dc4b-476f-a894-c165f24cfe8c" containerName="main"
Jul 29 21:29:13.298384 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.298309    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy"
Jul 29 21:29:13.298384 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.298315    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy"
Jul 29 21:29:13.298384 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.298322    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f7592b9-98e9-4555-9538-87143b2eea52" containerName="payload-pre-processing"
Jul 29 21:29:13.301473 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.301456    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.309739 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.309718    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-0109d4-openshift-default-dockercfg-rn878\""
Jul 29 21:29:13.316099 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.316077    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"]
Jul 29 21:29:13.356747 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.356720    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-envoy\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.356884 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.356751    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-socket\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.356884 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.356768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istiod-ca-cert\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.356884 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.356795    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-certs\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.357003 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.356876    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-podinfo\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.357003 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.356905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-data\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.357003 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.356921    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-token\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.357003 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.356957    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdmn\" (UniqueName: \"kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-kube-api-access-vcdmn\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.357003 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.356982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-credential-socket\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458427 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458391    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-certs\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-podinfo\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458464    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-data\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458487    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-token\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458515    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdmn\" (UniqueName: \"kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-kube-api-access-vcdmn\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458564    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-credential-socket\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458677    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-envoy\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458709    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-socket\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458733    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istiod-ca-cert\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458809    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-certs\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.458918 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.458901    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-data\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.459494 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.459031    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-credential-socket\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.459494 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.459143    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-socket\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.459494 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.459487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istiod-ca-cert\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.460882 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.460865    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-envoy\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.460882 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.460874    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-podinfo\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.467287 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.467264    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-token\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.467370 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.467327    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdmn\" (UniqueName: \"kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-kube-api-access-vcdmn\") pod \"e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") " pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.611408 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.611321    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:13.765894 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.765867    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"]
Jul 29 21:29:13.766766 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:29:13.766735    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56fe0f49_3d0d_469d_a5f9_61fe3a851f8e.slice/crio-473cc37286ee77e37856f4d6a9473516ee846a3f02f27cc3fc386b43ee302493 WatchSource:0}: Error finding container 473cc37286ee77e37856f4d6a9473516ee846a3f02f27cc3fc386b43ee302493: Status 404 returned error can't find the container with id 473cc37286ee77e37856f4d6a9473516ee846a3f02f27cc3fc386b43ee302493
Jul 29 21:29:13.769003 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.768964    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:29:13.769080 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.769061    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:29:13.769132 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:13.769114    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:29:14.085328 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:14.085277    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" event={"ID":"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e","Type":"ContainerStarted","Data":"3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54"}
Jul 29 21:29:14.085523 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:14.085391    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" event={"ID":"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e","Type":"ContainerStarted","Data":"473cc37286ee77e37856f4d6a9473516ee846a3f02f27cc3fc386b43ee302493"}
Jul 29 21:29:14.108220 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:14.108153    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" podStartSLOduration=1.10813927 podStartE2EDuration="1.10813927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:29:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:29:14.10677419 +0000 UTC m=+3863.958274864" watchObservedRunningTime="2026-07-29 21:29:14.10813927 +0000 UTC m=+3863.959639942"
Jul 29 21:29:14.612027 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:14.611991    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:14.621803 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:14.621779    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:15.090907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:15.090875    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:15.091877 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:15.091857    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:17.675652 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.675631    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:29:17.698077 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698021    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-socket\") pod \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") "
Jul 29 21:29:17.698189 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698084    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-token\") pod \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") "
Jul 29 21:29:17.698189 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698119    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istiod-ca-cert\") pod \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") "
Jul 29 21:29:17.698189 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698149    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-podinfo\") pod \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") "
Jul 29 21:29:17.698189 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698174    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwbfn\" (UniqueName: \"kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-kube-api-access-bwbfn\") pod \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") "
Jul 29 21:29:17.698394 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698206    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-envoy\") pod \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") "
Jul 29 21:29:17.698394 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698271    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-credential-socket\") pod \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") "
Jul 29 21:29:17.698394 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698315    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-data\") pod \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") "
Jul 29 21:29:17.698394 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698353    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-certs\") pod \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\" (UID: \"7d2c0bd0-cace-4b31-a7c4-d86936339b2b\") "
Jul 29 21:29:17.698661 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698422    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d2c0bd0-cace-4b31-a7c4-d86936339b2b" (UID: "7d2c0bd0-cace-4b31-a7c4-d86936339b2b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:29:17.698661 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698505    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d2c0bd0-cace-4b31-a7c4-d86936339b2b" (UID: "7d2c0bd0-cace-4b31-a7c4-d86936339b2b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:29:17.698786 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698687    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:17.698786 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698704    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:17.698786 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698747    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d2c0bd0-cace-4b31-a7c4-d86936339b2b" (UID: "7d2c0bd0-cace-4b31-a7c4-d86936339b2b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:29:17.699036 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.698990    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d2c0bd0-cace-4b31-a7c4-d86936339b2b" (UID: "7d2c0bd0-cace-4b31-a7c4-d86936339b2b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:29:17.700083 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.700045    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d2c0bd0-cace-4b31-a7c4-d86936339b2b" (UID: "7d2c0bd0-cace-4b31-a7c4-d86936339b2b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:29:17.701476 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.701404    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d2c0bd0-cace-4b31-a7c4-d86936339b2b" (UID: "7d2c0bd0-cace-4b31-a7c4-d86936339b2b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:29:17.701476 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.701406    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-kube-api-access-bwbfn" (OuterVolumeSpecName: "kube-api-access-bwbfn") pod "7d2c0bd0-cace-4b31-a7c4-d86936339b2b" (UID: "7d2c0bd0-cace-4b31-a7c4-d86936339b2b"). InnerVolumeSpecName "kube-api-access-bwbfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:29:17.701681 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.701648    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d2c0bd0-cace-4b31-a7c4-d86936339b2b" (UID: "7d2c0bd0-cace-4b31-a7c4-d86936339b2b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:29:17.702039 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.702020    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d2c0bd0-cace-4b31-a7c4-d86936339b2b" (UID: "7d2c0bd0-cace-4b31-a7c4-d86936339b2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:29:17.800050 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.800023    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:17.800050 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.800047    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:17.800050 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.800055    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:17.800235 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.800062    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:17.800235 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.800070    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwbfn\" (UniqueName: \"kubernetes.io/projected/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-kube-api-access-bwbfn\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:17.800235 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.800080    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:17.800235 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:17.800089    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2c0bd0-cace-4b31-a7c4-d86936339b2b-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:29:18.107967 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.107932    2557 generic.go:356] "Generic (PLEG): container finished" podID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerID="b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc" exitCode=0
Jul 29 21:29:18.108148 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.107982    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"
Jul 29 21:29:18.108148 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.108013    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" event={"ID":"7d2c0bd0-cace-4b31-a7c4-d86936339b2b","Type":"ContainerDied","Data":"b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc"}
Jul 29 21:29:18.108148 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.108064    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6" event={"ID":"7d2c0bd0-cace-4b31-a7c4-d86936339b2b","Type":"ContainerDied","Data":"6eba8e12da908450e6c5474b8f6a35653b86a0c0703b59d48486febb159e26cd"}
Jul 29 21:29:18.108148 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.108092    2557 scope.go:117] "RemoveContainer" containerID="b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc"
Jul 29 21:29:18.117865 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.117850    2557 scope.go:117] "RemoveContainer" containerID="f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387"
Jul 29 21:29:18.125824 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.125809    2557 scope.go:117] "RemoveContainer" containerID="b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc"
Jul 29 21:29:18.126196 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:29:18.126171    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc\": container with ID starting with b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc not found: ID does not exist" containerID="b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc"
Jul 29 21:29:18.126283 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.126203    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc"} err="failed to get container status \"b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc\": rpc error: code = NotFound desc = could not find container \"b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc\": container with ID starting with b6b057153c11d874f2c2f35fc24c09960093de6580faa9738fe18e09dbc2c5bc not found: ID does not exist"
Jul 29 21:29:18.126283 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.126219    2557 scope.go:117] "RemoveContainer" containerID="f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387"
Jul 29 21:29:18.126472 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:29:18.126453    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387\": container with ID starting with f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387 not found: ID does not exist" containerID="f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387"
Jul 29 21:29:18.126510 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.126479    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387"} err="failed to get container status \"f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387\": rpc error: code = NotFound desc = could not find container \"f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387\": container with ID starting with f0bff2855495ccdc710f951ff8a48fb2b05e743acfaba8663aa5f8486b84e387 not found: ID does not exist"
Jul 29 21:29:18.133077 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.133055    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"]
Jul 29 21:29:18.137436 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.137416    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-46f813-openshift-default-df74fb664-vd6d6"]
Jul 29 21:29:18.621415 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:18.621380    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" path="/var/lib/kubelet/pods/7d2c0bd0-cace-4b31-a7c4-d86936339b2b/volumes"
Jul 29 21:29:30.131171 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:30.130927    2557 patch_prober.go:28] interesting pod/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": read tcp 10.133.0.2:34404->10.133.0.84:15021: read: connection reset by peer" start-of-body=
Jul 29 21:29:30.131171 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:30.130988    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": read tcp 10.133.0.2:34404->10.133.0.84:15021: read: connection reset by peer"
Jul 29 21:29:30.175561 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:30.175528    2557 generic.go:356] "Generic (PLEG): container finished" podID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerID="3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54" exitCode=0
Jul 29 21:29:30.175679 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:30.175582    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" event={"ID":"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e","Type":"ContainerDied","Data":"3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54"}
Jul 29 21:29:30.176094 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:30.176074    2557 scope.go:117] "RemoveContainer" containerID="3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54"
Jul 29 21:29:30.177190 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:30.177158    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:29:30.177264 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:30.177231    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:29:30.177312 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:30.177263    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:29:31.186638 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:31.186597    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" event={"ID":"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e","Type":"ContainerStarted","Data":"be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42"}
Jul 29 21:29:31.612507 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:31.612472    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:31.612711 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:31.612660    2557 patch_prober.go:28] interesting pod/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Jul 29 21:29:31.612794 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:31.612717    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Jul 29 21:29:32.612052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:32.612014    2557 patch_prober.go:28] interesting pod/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Jul 29 21:29:32.612453 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:32.612067    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Jul 29 21:29:33.612167 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:33.612131    2557 patch_prober.go:28] interesting pod/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Jul 29 21:29:33.612580 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:33.612203    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Jul 29 21:29:34.612187 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:34.612156    2557 patch_prober.go:28] interesting pod/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Jul 29 21:29:34.612597 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:34.612208    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Jul 29 21:29:35.615505 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:35.615469    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:35.616007 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:35.615944    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:35.616509 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:35.616490    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:29:41.783449 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.783413    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"]
Jul 29 21:29:41.784005 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.783984    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy"
Jul 29 21:29:41.784389 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.784007    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy"
Jul 29 21:29:41.784389 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.784023    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy"
Jul 29 21:29:41.784389 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.784031    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee52d27-d081-4499-9e26-a60de2334900" containerName="istio-proxy"
Jul 29 21:29:41.784389 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.784048    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy"
Jul 29 21:29:41.784389 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.784056    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy"
Jul 29 21:29:41.784389 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.784157    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy"
Jul 29 21:29:41.784389 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.784168    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2c0bd0-cace-4b31-a7c4-d86936339b2b" containerName="istio-proxy"
Jul 29 21:29:41.787371 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.787350    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:41.790243 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.790217    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-dfd5ca-openshift-default-dockercfg-m8cjx\""
Jul 29 21:29:41.800244 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.800223    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"]
Jul 29 21:29:41.904958 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.904926    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-certs\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:41.905118 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.904962    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r8cl\" (UniqueName: \"kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-kube-api-access-5r8cl\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:41.905118 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.904996    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-data\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:41.905118 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.905092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-token\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:41.905228 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.905177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-envoy\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:41.905228 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.905203    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istiod-ca-cert\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:41.905293 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.905234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-credential-socket\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:41.905293 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.905256    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-socket\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:41.905293 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:41.905282    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-podinfo\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.005906 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.005876    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-envoy\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006070 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.005911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istiod-ca-cert\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006070 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.005938    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-credential-socket\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006070 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.005968    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-socket\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006070 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.006005    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-podinfo\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006070 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.006057    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-certs\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006306 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.006193    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8cl\" (UniqueName: \"kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-kube-api-access-5r8cl\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006306 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.006249    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-data\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006426 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.006307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-token\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006426 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.006383    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-credential-socket\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006537 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.006468    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-socket\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006731 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.006709    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istiod-ca-cert\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006731 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.006718    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-certs\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.006876 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.006711    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-data\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.008167 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.008150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-envoy\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.008401 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.008383    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-podinfo\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.015050 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.015025    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r8cl\" (UniqueName: \"kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-kube-api-access-5r8cl\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.015165 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.015076    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-token\") pod \"e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") " pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.098037 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.097986    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:42.237030 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.237001    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"]
Jul 29 21:29:42.238399 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:29:42.238373    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8451d0_c73a_40f6_a6df_a97e7975d2e8.slice/crio-c7883b463d286ba2ae3be97352f242a45ca0b0cc64dc12007cccfb03c18f1b40 WatchSource:0}: Error finding container c7883b463d286ba2ae3be97352f242a45ca0b0cc64dc12007cccfb03c18f1b40: Status 404 returned error can't find the container with id c7883b463d286ba2ae3be97352f242a45ca0b0cc64dc12007cccfb03c18f1b40
Jul 29 21:29:42.240861 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.240800    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:29:42.240933 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.240883    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:29:42.240933 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.240913    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:29:42.252177 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:42.252153    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" event={"ID":"5d8451d0-c73a-40f6-a6df-a97e7975d2e8","Type":"ContainerStarted","Data":"c7883b463d286ba2ae3be97352f242a45ca0b0cc64dc12007cccfb03c18f1b40"}
Jul 29 21:29:43.259151 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:43.259111    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" event={"ID":"5d8451d0-c73a-40f6-a6df-a97e7975d2e8","Type":"ContainerStarted","Data":"7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894"}
Jul 29 21:29:43.284752 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:43.284706    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" podStartSLOduration=2.284691528 podStartE2EDuration="2.284691528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:29:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:29:43.283362951 +0000 UTC m=+3893.134863634" watchObservedRunningTime="2026-07-29 21:29:43.284691528 +0000 UTC m=+3893.136192201"
Jul 29 21:29:44.099108 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:44.099075    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:44.103921 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:44.103897    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:44.265389 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:44.265360    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:44.266275 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:44.266256    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:29:50.934122 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:50.934098    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:29:50.945556 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:29:50.945530    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:30:00.055986 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.055379    2557 patch_prober.go:28] interesting pod/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": read tcp 10.133.0.2:50354->10.133.0.85:15021: read: connection reset by peer" start-of-body=
Jul 29 21:30:00.055986 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.055451    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": read tcp 10.133.0.2:50354->10.133.0.85:15021: read: connection reset by peer"
Jul 29 21:30:00.134335 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.134296    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756010-9n254"]
Jul 29 21:30:00.137750 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.137732    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-9n254"
Jul 29 21:30:00.140161 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.140142    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 21:30:00.146188 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.146153    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756010-9n254"]
Jul 29 21:30:00.149130 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.149109    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-9n254"
Jul 29 21:30:00.297538 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.297504    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756010-9n254"]
Jul 29 21:30:00.299304 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:30:00.299269    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d91ebf4_3aa1_4a12_b389_c0186196a85f.slice/crio-cd8c6313ecf348d4aa124de31b365f278111b7c78c9007409d36803b5b7bd209 WatchSource:0}: Error finding container cd8c6313ecf348d4aa124de31b365f278111b7c78c9007409d36803b5b7bd209: Status 404 returned error can't find the container with id cd8c6313ecf348d4aa124de31b365f278111b7c78c9007409d36803b5b7bd209
Jul 29 21:30:00.357797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.357763    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-9n254" event={"ID":"4d91ebf4-3aa1-4a12-b389-c0186196a85f","Type":"ContainerStarted","Data":"cd8c6313ecf348d4aa124de31b365f278111b7c78c9007409d36803b5b7bd209"}
Jul 29 21:30:00.359195 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.359172    2557 generic.go:356] "Generic (PLEG): container finished" podID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerID="7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894" exitCode=0
Jul 29 21:30:00.359299 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.359241    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" event={"ID":"5d8451d0-c73a-40f6-a6df-a97e7975d2e8","Type":"ContainerDied","Data":"7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894"}
Jul 29 21:30:00.359638 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.359623    2557 scope.go:117] "RemoveContainer" containerID="7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894"
Jul 29 21:30:00.360615 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.360588    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:30:00.360713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.360663    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:30:00.360713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:00.360695    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:30:01.367231 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:01.367195    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" event={"ID":"5d8451d0-c73a-40f6-a6df-a97e7975d2e8","Type":"ContainerStarted","Data":"bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9"}
Jul 29 21:30:01.368887 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:01.368850    2557 generic.go:356] "Generic (PLEG): container finished" podID="4d91ebf4-3aa1-4a12-b389-c0186196a85f" containerID="063e876cbb16d999e6fee6bbf83284e53200647ceb1054fe3c9979fb90676f20" exitCode=0
Jul 29 21:30:01.369029 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:01.368928    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-9n254" event={"ID":"4d91ebf4-3aa1-4a12-b389-c0186196a85f","Type":"ContainerDied","Data":"063e876cbb16d999e6fee6bbf83284e53200647ceb1054fe3c9979fb90676f20"}
Jul 29 21:30:02.098890 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:02.098825    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:30:02.099438 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:02.099408    2557 patch_prober.go:28] interesting pod/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Jul 29 21:30:02.099620 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:02.099587    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Jul 29 21:30:02.554671 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:02.554645    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-9n254"
Jul 29 21:30:03.098652 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:03.098615    2557 patch_prober.go:28] interesting pod/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Jul 29 21:30:03.098825 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:03.098665    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Jul 29 21:30:03.388212 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:03.388116    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-9n254" event={"ID":"4d91ebf4-3aa1-4a12-b389-c0186196a85f","Type":"ContainerDied","Data":"cd8c6313ecf348d4aa124de31b365f278111b7c78c9007409d36803b5b7bd209"}
Jul 29 21:30:03.388212 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:03.388182    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd8c6313ecf348d4aa124de31b365f278111b7c78c9007409d36803b5b7bd209"
Jul 29 21:30:03.388451 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:03.388254    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-9n254"
Jul 29 21:30:03.629133 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:03.629091    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9"]
Jul 29 21:30:03.636155 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:03.636134    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755965-bsdw9"]
Jul 29 21:30:04.099510 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:04.099477    2557 patch_prober.go:28] interesting pod/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Jul 29 21:30:04.099676 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:04.099520    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Jul 29 21:30:04.621782 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:04.621749    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e0ce931-c52f-4851-aa07-29511873cc1e" path="/var/lib/kubelet/pods/7e0ce931-c52f-4851-aa07-29511873cc1e/volumes"
Jul 29 21:30:05.098804 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:05.098771    2557 patch_prober.go:28] interesting pod/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Jul 29 21:30:05.099278 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:05.098898    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Jul 29 21:30:06.102317 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:06.102286    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:30:06.102681 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:06.102648    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:30:06.103295 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:06.103274    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:30:13.199134 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.199100    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"]
Jul 29 21:30:13.199497 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.199473    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d91ebf4-3aa1-4a12-b389-c0186196a85f" containerName="cleanup"
Jul 29 21:30:13.199497 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.199484    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d91ebf4-3aa1-4a12-b389-c0186196a85f" containerName="cleanup"
Jul 29 21:30:13.199581 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.199547    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d91ebf4-3aa1-4a12-b389-c0186196a85f" containerName="cleanup"
Jul 29 21:30:13.202418 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.202399    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"
Jul 29 21:30:13.204999 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.204982    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 21:30:13.209946 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.209647    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"]
Jul 29 21:30:13.298044 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.298023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f1b98e-543a-4e1e-8798-22ceaffb4488-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw\" (UID: \"68f1b98e-543a-4e1e-8798-22ceaffb4488\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"
Jul 29 21:30:13.399075 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.399052    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f1b98e-543a-4e1e-8798-22ceaffb4488-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw\" (UID: \"68f1b98e-543a-4e1e-8798-22ceaffb4488\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"
Jul 29 21:30:13.399651 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.399633    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f1b98e-543a-4e1e-8798-22ceaffb4488-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw\" (UID: \"68f1b98e-543a-4e1e-8798-22ceaffb4488\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"
Jul 29 21:30:13.514519 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.514499    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"
Jul 29 21:30:13.653504 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:13.653482    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"]
Jul 29 21:30:13.655083 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:30:13.655058    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f1b98e_543a_4e1e_8798_22ceaffb4488.slice/crio-865f5182b21d6d67dfb1e490281be5a09395d293f281bc7c88fd249c6c23eabd WatchSource:0}: Error finding container 865f5182b21d6d67dfb1e490281be5a09395d293f281bc7c88fd249c6c23eabd: Status 404 returned error can't find the container with id 865f5182b21d6d67dfb1e490281be5a09395d293f281bc7c88fd249c6c23eabd
Jul 29 21:30:14.450378 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:14.450349    2557 generic.go:356] "Generic (PLEG): container finished" podID="68f1b98e-543a-4e1e-8798-22ceaffb4488" containerID="78ec136f059436e47ef1d9579bcc2ab27ceabac0b1f4a29f689723c7b4627fd1" exitCode=0
Jul 29 21:30:14.450695 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:14.450390    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw" event={"ID":"68f1b98e-543a-4e1e-8798-22ceaffb4488","Type":"ContainerDied","Data":"78ec136f059436e47ef1d9579bcc2ab27ceabac0b1f4a29f689723c7b4627fd1"}
Jul 29 21:30:14.450695 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:14.450427    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw" event={"ID":"68f1b98e-543a-4e1e-8798-22ceaffb4488","Type":"ContainerStarted","Data":"865f5182b21d6d67dfb1e490281be5a09395d293f281bc7c88fd249c6c23eabd"}
Jul 29 21:30:15.610793 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:15.610771    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"
Jul 29 21:30:15.719636 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:15.719564    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f1b98e-543a-4e1e-8798-22ceaffb4488-maas-api-service-ca\") pod \"68f1b98e-543a-4e1e-8798-22ceaffb4488\" (UID: \"68f1b98e-543a-4e1e-8798-22ceaffb4488\") "
Jul 29 21:30:15.719932 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:15.719909    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f1b98e-543a-4e1e-8798-22ceaffb4488-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "68f1b98e-543a-4e1e-8798-22ceaffb4488" (UID: "68f1b98e-543a-4e1e-8798-22ceaffb4488"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:30:15.820603 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:15.820578    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f1b98e-543a-4e1e-8798-22ceaffb4488-maas-api-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:16.462538 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:16.462508    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"
Jul 29 21:30:16.462695 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:16.462543    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw" event={"ID":"68f1b98e-543a-4e1e-8798-22ceaffb4488","Type":"ContainerDied","Data":"865f5182b21d6d67dfb1e490281be5a09395d293f281bc7c88fd249c6c23eabd"}
Jul 29 21:30:16.462695 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:16.462590    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="865f5182b21d6d67dfb1e490281be5a09395d293f281bc7c88fd249c6c23eabd"
Jul 29 21:30:25.886817 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:25.886783    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"]
Jul 29 21:30:25.890428 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:25.890392    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0109d4-rp5jw"]
Jul 29 21:30:26.621396 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:26.621352    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f1b98e-543a-4e1e-8798-22ceaffb4488" path="/var/lib/kubelet/pods/68f1b98e-543a-4e1e-8798-22ceaffb4488/volumes"
Jul 29 21:30:33.036659 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:33.036620    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"]
Jul 29 21:30:33.037164 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:33.036845    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy" containerID="cri-o://be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42" gracePeriod=30
Jul 29 21:30:35.618485 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:35.618445    2557 patch_prober.go:28] interesting pod/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:30:35.618983 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:35.618503    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:30:38.301533 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.301458    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:30:38.427273 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427211    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-envoy\") pod \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") "
Jul 29 21:30:38.427273 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427285    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istiod-ca-cert\") pod \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") "
Jul 29 21:30:38.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427329    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-socket\") pod \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") "
Jul 29 21:30:38.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427377    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-certs\") pod \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") "
Jul 29 21:30:38.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427425    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcdmn\" (UniqueName: \"kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-kube-api-access-vcdmn\") pod \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") "
Jul 29 21:30:38.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427486    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-podinfo\") pod \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") "
Jul 29 21:30:38.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427516    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-token\") pod \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") "
Jul 29 21:30:38.427538 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427540    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-data\") pod \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") "
Jul 29 21:30:38.427907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427624    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-credential-socket\") pod \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\" (UID: \"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e\") "
Jul 29 21:30:38.427907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427686    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" (UID: "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:38.427907 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427752    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" (UID: "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:30:38.428077 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.427989    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" (UID: "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:38.428077 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.428009    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" (UID: "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:38.428077 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.428048    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:38.428077 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.428066    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:38.428999 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.428971    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" (UID: "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:38.429826 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.429799    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" (UID: "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:38.430051 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.430031    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" (UID: "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:30:38.430116 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.430081    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" (UID: "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:30:38.430116 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.430099    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-kube-api-access-vcdmn" (OuterVolumeSpecName: "kube-api-access-vcdmn") pod "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" (UID: "56fe0f49-3d0d-469d-a5f9-61fe3a851f8e"). InnerVolumeSpecName "kube-api-access-vcdmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:30:38.529322 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.529273    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:38.529322 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.529313    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:38.529322 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.529324    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:38.529322 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.529334    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcdmn\" (UniqueName: \"kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-kube-api-access-vcdmn\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:38.529710 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.529344    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:38.529710 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.529353    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:38.529710 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.529360    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:38.589636 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.589530    2557 generic.go:356] "Generic (PLEG): container finished" podID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerID="be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42" exitCode=0
Jul 29 21:30:38.589636 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.589592    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"
Jul 29 21:30:38.589636 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.589616    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" event={"ID":"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e","Type":"ContainerDied","Data":"be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42"}
Jul 29 21:30:38.589949 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.589710    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n" event={"ID":"56fe0f49-3d0d-469d-a5f9-61fe3a851f8e","Type":"ContainerDied","Data":"473cc37286ee77e37856f4d6a9473516ee846a3f02f27cc3fc386b43ee302493"}
Jul 29 21:30:38.589949 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.589743    2557 scope.go:117] "RemoveContainer" containerID="be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42"
Jul 29 21:30:38.600300 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.600267    2557 scope.go:117] "RemoveContainer" containerID="3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54"
Jul 29 21:30:38.609284 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.609261    2557 scope.go:117] "RemoveContainer" containerID="be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42"
Jul 29 21:30:38.609617 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:30:38.609594    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42\": container with ID starting with be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42 not found: ID does not exist" containerID="be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42"
Jul 29 21:30:38.609680 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.609627    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42"} err="failed to get container status \"be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42\": rpc error: code = NotFound desc = could not find container \"be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42\": container with ID starting with be7fb08fe54725cb3f2ed46ba1b74314eebcecb8a4014651c73068436669ef42 not found: ID does not exist"
Jul 29 21:30:38.609680 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.609643    2557 scope.go:117] "RemoveContainer" containerID="3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54"
Jul 29 21:30:38.609969 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:30:38.609949    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54\": container with ID starting with 3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54 not found: ID does not exist" containerID="3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54"
Jul 29 21:30:38.610034 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.609976    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54"} err="failed to get container status \"3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54\": rpc error: code = NotFound desc = could not find container \"3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54\": container with ID starting with 3cdf41791d22358ec14a2196f1662a95ec3c8e07d813f4a94c1898cf696deb54 not found: ID does not exist"
Jul 29 21:30:38.625437 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.625405    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"]
Jul 29 21:30:38.634537 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:38.634508    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-0109d4-openshift-default-54fb68d6b8-rxz4n"]
Jul 29 21:30:40.622168 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:40.622132    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" path="/var/lib/kubelet/pods/56fe0f49-3d0d-469d-a5f9-61fe3a851f8e/volumes"
Jul 29 21:30:50.817974 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:50.817875    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"]
Jul 29 21:30:50.818400 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:50.818140    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy" containerID="cri-o://bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9" gracePeriod=30
Jul 29 21:30:51.104894 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.104797    2557 patch_prober.go:28] interesting pod/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:30:51.105041 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.104906    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:30:51.275932 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.275897    2557 scope.go:117] "RemoveContainer" containerID="3f924d23055f4f7d09da32f8a3775eef61d14b8c7fe508ce2743db22916c36ee"
Jul 29 21:30:51.651688 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.651650    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"]
Jul 29 21:30:51.652101 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.652087    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f1b98e-543a-4e1e-8798-22ceaffb4488" containerName="revoke-keys"
Jul 29 21:30:51.652162 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.652103    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f1b98e-543a-4e1e-8798-22ceaffb4488" containerName="revoke-keys"
Jul 29 21:30:51.652162 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.652125    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy"
Jul 29 21:30:51.652162 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.652130    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy"
Jul 29 21:30:51.652162 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.652139    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy"
Jul 29 21:30:51.652162 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.652145    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy"
Jul 29 21:30:51.652313 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.652204    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="68f1b98e-543a-4e1e-8798-22ceaffb4488" containerName="revoke-keys"
Jul 29 21:30:51.652313 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.652214    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy"
Jul 29 21:30:51.652313 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.652221    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fe0f49-3d0d-469d-a5f9-61fe3a851f8e" containerName="istio-proxy"
Jul 29 21:30:51.657367 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.657343    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.660611 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.660587    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-5f7d51-openshift-default-dockercfg-nnw86\""
Jul 29 21:30:51.671947 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.671910    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"]
Jul 29 21:30:51.758305 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.758266    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-credential-socket\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.758529 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.758314    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzxfn\" (UniqueName: \"kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-kube-api-access-wzxfn\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.758529 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.758417    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-envoy\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.758529 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.758471    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-data\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.758529 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.758502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-podinfo\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.758699 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.758553    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istiod-ca-cert\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.758699 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.758595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-token\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.758699 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.758626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-certs\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.758699 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.758659    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-socket\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.859273 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859233    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istiod-ca-cert\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.859795 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-token\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.859795 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859323    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-certs\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.859795 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859352    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-socket\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.859795 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-credential-socket\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.860224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859889    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzxfn\" (UniqueName: \"kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-kube-api-access-wzxfn\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.860224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859947    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-envoy\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.860224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859977    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-credential-socket\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.860224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-data\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.860224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.860042    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-podinfo\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.860224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.860124    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istiod-ca-cert\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.860224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859774    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-certs\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.860224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.859816    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-socket\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.860224 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.860260    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-data\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.862940 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.862817    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-envoy\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.863353 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.863331    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-podinfo\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.868690 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.868664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-token\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.868993 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.868971    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzxfn\" (UniqueName: \"kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-kube-api-access-wzxfn\") pod \"e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") " pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:51.969090 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:51.968988    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:52.121724 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:52.121700    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"]
Jul 29 21:30:52.123572 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:30:52.123543    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b3f20a_b43e_4022_b6f0_c8382b313c26.slice/crio-18270730a466065f81365c542bd1470098fcae11842ddd2ec7fc77b9c0efff79 WatchSource:0}: Error finding container 18270730a466065f81365c542bd1470098fcae11842ddd2ec7fc77b9c0efff79: Status 404 returned error can't find the container with id 18270730a466065f81365c542bd1470098fcae11842ddd2ec7fc77b9c0efff79
Jul 29 21:30:52.126182 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:52.126145    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:30:52.126261 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:52.126217    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:30:52.126261 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:52.126243    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:30:52.669985 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:52.669946    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" event={"ID":"b5b3f20a-b43e-4022-b6f0-c8382b313c26","Type":"ContainerStarted","Data":"bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb"}
Jul 29 21:30:52.670216 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:52.670002    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" event={"ID":"b5b3f20a-b43e-4022-b6f0-c8382b313c26","Type":"ContainerStarted","Data":"18270730a466065f81365c542bd1470098fcae11842ddd2ec7fc77b9c0efff79"}
Jul 29 21:30:52.692878 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:52.692802    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" podStartSLOduration=1.692767174 podStartE2EDuration="1.692767174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:30:52.691190721 +0000 UTC m=+3962.542691409" watchObservedRunningTime="2026-07-29 21:30:52.692767174 +0000 UTC m=+3962.544267847"
Jul 29 21:30:52.969378 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:52.969283    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:53.974366 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:53.974337    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:54.684315 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:54.684279    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:54.685518 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:54.685487    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:30:56.110344 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.110319    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:30:56.200771 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.200720    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-socket\") pod \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") "
Jul 29 21:30:56.201008 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.200793    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-token\") pod \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") "
Jul 29 21:30:56.201008 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.200862    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-data\") pod \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") "
Jul 29 21:30:56.201008 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.200886    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-certs\") pod \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") "
Jul 29 21:30:56.201008 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.200957    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istiod-ca-cert\") pod \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") "
Jul 29 21:30:56.201008 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.200991    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-envoy\") pod \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") "
Jul 29 21:30:56.201287 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.201015    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r8cl\" (UniqueName: \"kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-kube-api-access-5r8cl\") pod \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") "
Jul 29 21:30:56.201287 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.201060    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-podinfo\") pod \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") "
Jul 29 21:30:56.201287 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.201073    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d8451d0-c73a-40f6-a6df-a97e7975d2e8" (UID: "5d8451d0-c73a-40f6-a6df-a97e7975d2e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:56.201287 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.201095    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-credential-socket\") pod \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\" (UID: \"5d8451d0-c73a-40f6-a6df-a97e7975d2e8\") "
Jul 29 21:30:56.201287 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.201270    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d8451d0-c73a-40f6-a6df-a97e7975d2e8" (UID: "5d8451d0-c73a-40f6-a6df-a97e7975d2e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:56.201557 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.201391    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d8451d0-c73a-40f6-a6df-a97e7975d2e8" (UID: "5d8451d0-c73a-40f6-a6df-a97e7975d2e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:30:56.201557 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.201436    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:56.201557 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.201454    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:56.201557 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.201478    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d8451d0-c73a-40f6-a6df-a97e7975d2e8" (UID: "5d8451d0-c73a-40f6-a6df-a97e7975d2e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:56.201876 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.201851    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d8451d0-c73a-40f6-a6df-a97e7975d2e8" (UID: "5d8451d0-c73a-40f6-a6df-a97e7975d2e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:56.203125 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.203105    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d8451d0-c73a-40f6-a6df-a97e7975d2e8" (UID: "5d8451d0-c73a-40f6-a6df-a97e7975d2e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:30:56.203337 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.203309    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d8451d0-c73a-40f6-a6df-a97e7975d2e8" (UID: "5d8451d0-c73a-40f6-a6df-a97e7975d2e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:56.203624 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.203606    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d8451d0-c73a-40f6-a6df-a97e7975d2e8" (UID: "5d8451d0-c73a-40f6-a6df-a97e7975d2e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:30:56.203683 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.203629    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-kube-api-access-5r8cl" (OuterVolumeSpecName: "kube-api-access-5r8cl") pod "5d8451d0-c73a-40f6-a6df-a97e7975d2e8" (UID: "5d8451d0-c73a-40f6-a6df-a97e7975d2e8"). InnerVolumeSpecName "kube-api-access-5r8cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:30:56.302503 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.302456    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:56.302503 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.302498    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:56.302503 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.302506    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:56.302503 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.302516    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:56.302799 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.302524    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r8cl\" (UniqueName: \"kubernetes.io/projected/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-kube-api-access-5r8cl\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:56.302799 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.302534    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:56.302799 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.302542    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d8451d0-c73a-40f6-a6df-a97e7975d2e8-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:30:56.695776 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.695731    2557 generic.go:356] "Generic (PLEG): container finished" podID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerID="bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9" exitCode=0
Jul 29 21:30:56.695973 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.695798    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"
Jul 29 21:30:56.695973 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.695820    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" event={"ID":"5d8451d0-c73a-40f6-a6df-a97e7975d2e8","Type":"ContainerDied","Data":"bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9"}
Jul 29 21:30:56.695973 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.695899    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6" event={"ID":"5d8451d0-c73a-40f6-a6df-a97e7975d2e8","Type":"ContainerDied","Data":"c7883b463d286ba2ae3be97352f242a45ca0b0cc64dc12007cccfb03c18f1b40"}
Jul 29 21:30:56.695973 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.695923    2557 scope.go:117] "RemoveContainer" containerID="bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9"
Jul 29 21:30:56.705399 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.705376    2557 scope.go:117] "RemoveContainer" containerID="7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894"
Jul 29 21:30:56.714892 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.714874    2557 scope.go:117] "RemoveContainer" containerID="bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9"
Jul 29 21:30:56.714979 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.714870    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"]
Jul 29 21:30:56.715229 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:30:56.715206    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9\": container with ID starting with bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9 not found: ID does not exist" containerID="bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9"
Jul 29 21:30:56.715296 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.715238    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9"} err="failed to get container status \"bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9\": rpc error: code = NotFound desc = could not find container \"bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9\": container with ID starting with bb082697e234ffecd6af0f191e2a9ffe8789f30fa4f2bfaeca3fafbab61f43d9 not found: ID does not exist"
Jul 29 21:30:56.715296 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.715259    2557 scope.go:117] "RemoveContainer" containerID="7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894"
Jul 29 21:30:56.715513 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:30:56.715495    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894\": container with ID starting with 7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894 not found: ID does not exist" containerID="7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894"
Jul 29 21:30:56.715569 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.715520    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894"} err="failed to get container status \"7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894\": rpc error: code = NotFound desc = could not find container \"7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894\": container with ID starting with 7bbc5e7e2a2cded19a99784168c6a9a7582b59f44672c991b85096f31f268894 not found: ID does not exist"
Jul 29 21:30:56.720307 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:56.720282    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-dfd5ca-openshift-default-9684bdbbd-qgrs6"]
Jul 29 21:30:58.622320 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:30:58.622287    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" path="/var/lib/kubelet/pods/5d8451d0-c73a-40f6-a6df-a97e7975d2e8/volumes"
Jul 29 21:31:09.697871 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:09.697808    2557 patch_prober.go:28] interesting pod/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": read tcp 10.133.0.2:53448->10.133.0.88:15021: read: connection reset by peer" start-of-body=
Jul 29 21:31:09.698238 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:09.697896    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": read tcp 10.133.0.2:53448->10.133.0.88:15021: read: connection reset by peer"
Jul 29 21:31:09.777156 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:09.777120    2557 generic.go:356] "Generic (PLEG): container finished" podID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerID="bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb" exitCode=0
Jul 29 21:31:09.777331 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:09.777171    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" event={"ID":"b5b3f20a-b43e-4022-b6f0-c8382b313c26","Type":"ContainerDied","Data":"bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb"}
Jul 29 21:31:09.777598 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:09.777585    2557 scope.go:117] "RemoveContainer" containerID="bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb"
Jul 29 21:31:09.778643 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:09.778618    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:31:09.778697 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:09.778684    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:31:09.778736 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:09.778718    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:31:10.784473 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:10.784438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" event={"ID":"b5b3f20a-b43e-4022-b6f0-c8382b313c26","Type":"ContainerStarted","Data":"95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef"}
Jul 29 21:31:10.969223 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:10.969182    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:31:10.969462 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:10.969439    2557 patch_prober.go:28] interesting pod/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 29 21:31:10.969511 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:10.969491    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 29 21:31:11.970193 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:11.970155    2557 patch_prober.go:28] interesting pod/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 29 21:31:11.970775 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:11.970743    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 29 21:31:12.970468 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:12.970420    2557 patch_prober.go:28] interesting pod/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 29 21:31:12.971005 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:12.970505    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 29 21:31:13.970226 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:13.970178    2557 patch_prober.go:28] interesting pod/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 29 21:31:13.970447 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:13.970254    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 29 21:31:14.970126 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:14.970080    2557 patch_prober.go:28] interesting pod/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 29 21:31:14.970658 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:14.970158    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 29 21:31:15.973317 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:15.973278    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:31:15.973707 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:15.973561    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:31:15.974356 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:15.974339    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:31:20.216942 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.216901    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"]
Jul 29 21:31:20.217345 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.217335    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy"
Jul 29 21:31:20.217391 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.217349    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy"
Jul 29 21:31:20.217391 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.217367    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy"
Jul 29 21:31:20.217391 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.217373    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy"
Jul 29 21:31:20.217493 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.217452    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy"
Jul 29 21:31:20.217493 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.217463    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d8451d0-c73a-40f6-a6df-a97e7975d2e8" containerName="istio-proxy"
Jul 29 21:31:20.221029 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.221007    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.223859 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.223820    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-eee583-openshift-default-dockercfg-85rhm\""
Jul 29 21:31:20.233942 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.233910    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"]
Jul 29 21:31:20.329713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.328436    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-data\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.329713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.328484    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-token\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.329713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.328517    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j67r4\" (UniqueName: \"kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-kube-api-access-j67r4\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.329713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.328543    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-certs\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.329713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.328580    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-podinfo\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.329713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.328621    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-credential-socket\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.329713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.328640    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istiod-ca-cert\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.329713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.328693    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-envoy\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.329713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.328747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-socket\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.429943 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.429888    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-data\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.429943 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.429941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-token\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430231 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.429969    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67r4\" (UniqueName: \"kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-kube-api-access-j67r4\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430231 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.429993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-certs\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430231 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.430018    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-podinfo\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430231 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.430051    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-credential-socket\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430231 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.430068    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istiod-ca-cert\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430231 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.430125    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-envoy\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430231 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.430174    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-socket\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430673 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.430376    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-data\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430673 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.430398    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-certs\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430673 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.430487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-credential-socket\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.430673 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.430645    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-socket\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.431012 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.430990    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istiod-ca-cert\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.432508 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.432482    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-envoy\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.432743 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.432719    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-podinfo\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.440703 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.440670    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-token\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.440979 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.440957    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j67r4\" (UniqueName: \"kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-kube-api-access-j67r4\") pod \"e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") " pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.532046 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.532000    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:20.691175 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.691145    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"]
Jul 29 21:31:20.692253 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:31:20.692227    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d3c624_8ffd_49f2_806b_f1b9cd01b3b3.slice/crio-f0a42b7149e12fff25505b27ec267eeede140c2695ec342e88e1900c9f4fb10f WatchSource:0}: Error finding container f0a42b7149e12fff25505b27ec267eeede140c2695ec342e88e1900c9f4fb10f: Status 404 returned error can't find the container with id f0a42b7149e12fff25505b27ec267eeede140c2695ec342e88e1900c9f4fb10f
Jul 29 21:31:20.694506 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.694471    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:31:20.694604 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.694563    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:31:20.694604 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.694594    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:31:20.848101 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.848000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" event={"ID":"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3","Type":"ContainerStarted","Data":"5ec4bf39e0e97b041027ec14a23724a26f3608f9bceb5c593dd17e8e3645efbb"}
Jul 29 21:31:20.848101 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.848068    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" event={"ID":"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3","Type":"ContainerStarted","Data":"f0a42b7149e12fff25505b27ec267eeede140c2695ec342e88e1900c9f4fb10f"}
Jul 29 21:31:20.867535 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:20.867470    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" podStartSLOduration=0.867448039 podStartE2EDuration="867.448039ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:31:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:31:20.866957211 +0000 UTC m=+3990.718457885" watchObservedRunningTime="2026-07-29 21:31:20.867448039 +0000 UTC m=+3990.718948714"
Jul 29 21:31:21.532409 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:21.532367    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:21.537824 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:21.537794    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:21.854781 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:21.854682    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:21.855717 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:21.855699    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:37.806498 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:37.806308    2557 patch_prober.go:28] interesting pod/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": read tcp 10.133.0.2:43306->10.133.0.89:15021: read: connection reset by peer" start-of-body=
Jul 29 21:31:37.806498 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:37.806381    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": read tcp 10.133.0.2:43306->10.133.0.89:15021: read: connection reset by peer"
Jul 29 21:31:37.952408 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:37.952372    2557 generic.go:356] "Generic (PLEG): container finished" podID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerID="5ec4bf39e0e97b041027ec14a23724a26f3608f9bceb5c593dd17e8e3645efbb" exitCode=0
Jul 29 21:31:37.952587 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:37.952457    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" event={"ID":"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3","Type":"ContainerDied","Data":"5ec4bf39e0e97b041027ec14a23724a26f3608f9bceb5c593dd17e8e3645efbb"}
Jul 29 21:31:37.952983 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:37.952966    2557 scope.go:117] "RemoveContainer" containerID="5ec4bf39e0e97b041027ec14a23724a26f3608f9bceb5c593dd17e8e3645efbb"
Jul 29 21:31:37.954023 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:37.953997    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:31:37.954084 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:37.954064    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:31:37.954121 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:37.954095    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 21:31:38.960530 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:38.960491    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" event={"ID":"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3","Type":"ContainerStarted","Data":"082acb3652c4fde4f5c0e0085d80bac6dca70dc118a25600f3d98787637c68d0"}
Jul 29 21:31:39.532679 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:39.532636    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:39.533022 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:39.533001    2557 patch_prober.go:28] interesting pod/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Jul 29 21:31:39.533082 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:39.533057    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Jul 29 21:31:40.533413 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:40.533370    2557 patch_prober.go:28] interesting pod/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Jul 29 21:31:40.533876 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:40.533450    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Jul 29 21:31:41.533415 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:41.533378    2557 patch_prober.go:28] interesting pod/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Jul 29 21:31:41.533596 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:41.533446    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Jul 29 21:31:42.533089 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:42.533049    2557 patch_prober.go:28] interesting pod/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Jul 29 21:31:42.533277 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:42.533104    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Jul 29 21:31:43.536663 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:43.536627    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:43.537091 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:43.536870    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:43.537672 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:43.537654    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:31:51.302786 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:31:51.302753    2557 scope.go:117] "RemoveContainer" containerID="30c91f521d02a3fb690fc7d32d51da3c5506574c0746d97b63590a1c1f46793e"
Jul 29 21:32:02.132797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.132758    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"]
Jul 29 21:32:02.136601 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.136573    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.141210 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.141172    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5f7d51\"/\"auth-test-model-5f7d51-kserve-self-signed-certs\""
Jul 29 21:32:02.141210 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.141200    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5f7d51\"/\"openshift-service-ca.crt\""
Jul 29 21:32:02.141531 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.141246    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5f7d51\"/\"default-dockercfg-467pw\""
Jul 29 21:32:02.141531 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.141182    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5f7d51\"/\"kube-root-ca.crt\""
Jul 29 21:32:02.145139 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.144821    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"]
Jul 29 21:32:02.207815 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.207779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87gk\" (UniqueName: \"kubernetes.io/projected/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-kube-api-access-r87gk\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.208039 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.207880    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-dshm\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.208039 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.207967    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-model-cache\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.208039 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.207994    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tmp-dir\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.208039 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.208033    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-home\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.208221 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.208056    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tls-certs\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.309575 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.309538    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r87gk\" (UniqueName: \"kubernetes.io/projected/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-kube-api-access-r87gk\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.309769 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.309600    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-dshm\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.309769 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.309650    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-model-cache\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.309769 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.309665    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tmp-dir\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.309769 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.309699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-home\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.309769 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.309722    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tls-certs\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.310209 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.310184    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-home\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.310300 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.310191    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-model-cache\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.310360 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.310326    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tmp-dir\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.312052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.312029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-dshm\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.312371 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.312349    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tls-certs\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.318177 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.318147    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87gk\" (UniqueName: \"kubernetes.io/projected/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-kube-api-access-r87gk\") pod \"auth-test-model-5f7d51-kserve-594497b64c-7x5gs\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") " pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.447901 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.447801    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:02.599955 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:02.599923    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"]
Jul 29 21:32:02.601035 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:32:02.601008    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbdfd8fe_aabb_45b0_b7c4_6f38e1cc1ec7.slice/crio-2b2fbcd4e450158b02181521559f378bb116c0a9257087cdf6e4197b9d261c2e WatchSource:0}: Error finding container 2b2fbcd4e450158b02181521559f378bb116c0a9257087cdf6e4197b9d261c2e: Status 404 returned error can't find the container with id 2b2fbcd4e450158b02181521559f378bb116c0a9257087cdf6e4197b9d261c2e
Jul 29 21:32:03.107267 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:03.107227    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs" event={"ID":"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7","Type":"ContainerStarted","Data":"c0e36badfeb7f4eac60507786c9e3a0b8dd0d82732af9358a624a148c0bec73a"}
Jul 29 21:32:03.107267 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:03.107271    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs" event={"ID":"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7","Type":"ContainerStarted","Data":"2b2fbcd4e450158b02181521559f378bb116c0a9257087cdf6e4197b9d261c2e"}
Jul 29 21:32:03.126731 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:03.126664    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs" podStartSLOduration=1.126644086 podStartE2EDuration="1.126644086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:32:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:32:03.124262027 +0000 UTC m=+4032.975762699" watchObservedRunningTime="2026-07-29 21:32:03.126644086 +0000 UTC m=+4032.978144759"
Jul 29 21:32:12.448252 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:12.448151    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:12.448252 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:12.448237    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:12.461248 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:12.461219    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:32:13.175103 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:32:13.175074    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:34:50.970764 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:34:50.970735    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:34:50.984115 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:34:50.984087    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:36:51.367200 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:36:51.367107    2557 scope.go:117] "RemoveContainer" containerID="78ec136f059436e47ef1d9579bcc2ab27ceabac0b1f4a29f689723c7b4627fd1"
Jul 29 21:37:08.827685 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:08.827649    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"]
Jul 29 21:37:23.847449 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:23.847382    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs" podUID="dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" containerName="main" containerID="cri-o://c0e36badfeb7f4eac60507786c9e3a0b8dd0d82732af9358a624a148c0bec73a" gracePeriod=45
Jul 29 21:37:23.967202 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:23.967167    2557 generic.go:356] "Generic (PLEG): container finished" podID="dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" containerID="c0e36badfeb7f4eac60507786c9e3a0b8dd0d82732af9358a624a148c0bec73a" exitCode=0
Jul 29 21:37:23.967365 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:23.967241    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs" event={"ID":"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7","Type":"ContainerDied","Data":"c0e36badfeb7f4eac60507786c9e3a0b8dd0d82732af9358a624a148c0bec73a"}
Jul 29 21:37:24.112772 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.112696    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:37:24.143948 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.143916    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r87gk\" (UniqueName: \"kubernetes.io/projected/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-kube-api-access-r87gk\") pod \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") "
Jul 29 21:37:24.144109 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.143965    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-home\") pod \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") "
Jul 29 21:37:24.144109 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.144010    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tls-certs\") pod \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") "
Jul 29 21:37:24.144109 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.144086    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-model-cache\") pod \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") "
Jul 29 21:37:24.144268 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.144108    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-dshm\") pod \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") "
Jul 29 21:37:24.144268 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.144133    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tmp-dir\") pod \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\" (UID: \"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7\") "
Jul 29 21:37:24.144387 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.144257    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-home" (OuterVolumeSpecName: "home") pod "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" (UID: "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:37:24.144387 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.144371    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-model-cache" (OuterVolumeSpecName: "model-cache") pod "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" (UID: "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:37:24.144566 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.144544    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-home\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:37:24.144648 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.144574    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-model-cache\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:37:24.144648 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.144538    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" (UID: "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:37:24.146795 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.146772    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" (UID: "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:37:24.146930 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.146824    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-kube-api-access-r87gk" (OuterVolumeSpecName: "kube-api-access-r87gk") pod "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" (UID: "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7"). InnerVolumeSpecName "kube-api-access-r87gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:37:24.146930 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.146822    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-dshm" (OuterVolumeSpecName: "dshm") pod "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" (UID: "dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:37:24.245982 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.245941    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tmp-dir\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:37:24.245982 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.245973    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r87gk\" (UniqueName: \"kubernetes.io/projected/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-kube-api-access-r87gk\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:37:24.245982 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.245982    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-tls-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:37:24.245982 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.245992    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7-dshm\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:37:24.976058 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.975960    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs" event={"ID":"dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7","Type":"ContainerDied","Data":"2b2fbcd4e450158b02181521559f378bb116c0a9257087cdf6e4197b9d261c2e"}
Jul 29 21:37:24.976058 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.975986    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"
Jul 29 21:37:24.976058 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.976026    2557 scope.go:117] "RemoveContainer" containerID="c0e36badfeb7f4eac60507786c9e3a0b8dd0d82732af9358a624a148c0bec73a"
Jul 29 21:37:24.998713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:24.998682    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"]
Jul 29 21:37:25.003992 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:25.003964    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/auth-test-model-5f7d51-kserve-594497b64c-7x5gs"]
Jul 29 21:37:26.622044 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:37:26.622009    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" path="/var/lib/kubelet/pods/dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7/volumes"
Jul 29 21:39:51.005975 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:39:51.005887    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:39:51.021869 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:39:51.021823    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-288tq_c330c3b6-c273-4544-9233-0002fd74a823/ovn-acl-logging/0.log"
Jul 29 21:40:57.942104 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.942063    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"]
Jul 29 21:40:57.942696 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.942675    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" containerName="main"
Jul 29 21:40:57.942787 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.942700    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" containerName="main"
Jul 29 21:40:57.942876 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.942794    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbdfd8fe-aabb-45b0-b7c4-6f38e1cc1ec7" containerName="main"
Jul 29 21:40:57.945944 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.945923    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:57.948646 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.948623    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5f7d51\"/\"openshift-service-ca.crt\""
Jul 29 21:40:57.949996 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.949971    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5f7d51\"/\"kube-root-ca.crt\""
Jul 29 21:40:57.950109 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.950024    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5f7d51\"/\"default-dockercfg-467pw\""
Jul 29 21:40:57.950109 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.950026    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5f7d51\"/\"rate-test-model-5f7d51-kserve-self-signed-certs\""
Jul 29 21:40:57.956260 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.956231    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"]
Jul 29 21:40:57.999462 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.999413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zft7\" (UniqueName: \"kubernetes.io/projected/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-kube-api-access-6zft7\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:57.999678 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.999547    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tmp-dir\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:57.999678 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.999652    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-home\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:57.999678 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.999676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tls-certs\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:57.999877 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.999698    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-dshm\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:57.999877 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:57.999717    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-model-cache\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.100501 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.100462    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tmp-dir\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.100715 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.100520    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-home\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.100715 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.100544    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tls-certs\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.100715 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.100570    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-dshm\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.100715 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.100594    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-model-cache\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.100715 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.100653    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zft7\" (UniqueName: \"kubernetes.io/projected/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-kube-api-access-6zft7\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.101050 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.100996    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tmp-dir\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.101050 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.101020    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-home\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.101124 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.101112    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-model-cache\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.102908 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.102884    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-dshm\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.103206 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.103189    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tls-certs\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.110480 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.110455    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zft7\" (UniqueName: \"kubernetes.io/projected/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-kube-api-access-6zft7\") pod \"rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") " pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.256075 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.255982    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:40:58.414435 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:58.414402    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"]
Jul 29 21:40:58.414744 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:40:58.414716    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8630eb8f_76f2_47b2_9201_bd08a28b3b8f.slice/crio-6d81b28208358f63db73e8b0c6263d4cd846edfe23d336328634210863c22540 WatchSource:0}: Error finding container 6d81b28208358f63db73e8b0c6263d4cd846edfe23d336328634210863c22540: Status 404 returned error can't find the container with id 6d81b28208358f63db73e8b0c6263d4cd846edfe23d336328634210863c22540
Jul 29 21:40:59.200022 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:59.199984    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n" event={"ID":"8630eb8f-76f2-47b2-9201-bd08a28b3b8f","Type":"ContainerStarted","Data":"e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868"}
Jul 29 21:40:59.200022 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:59.200030    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n" event={"ID":"8630eb8f-76f2-47b2-9201-bd08a28b3b8f","Type":"ContainerStarted","Data":"6d81b28208358f63db73e8b0c6263d4cd846edfe23d336328634210863c22540"}
Jul 29 21:40:59.227026 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:40:59.226958    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n" podStartSLOduration=2.226936533 podStartE2EDuration="2.226936533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:40:59.223409134 +0000 UTC m=+4569.074909807" watchObservedRunningTime="2026-07-29 21:40:59.226936533 +0000 UTC m=+4569.078437211"
Jul 29 21:41:08.256144 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:41:08.256102    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:41:08.256630 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:41:08.256234    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:41:08.268994 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:41:08.268964    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:41:09.268560 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:41:09.268531    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:42:57.413107 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:57.413022    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"]
Jul 29 21:42:58.454069 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:58.454027    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"]
Jul 29 21:42:58.457454 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:58.457436    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"
Jul 29 21:42:58.460436 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:58.460414    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wpqrc\""
Jul 29 21:42:58.465816 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:58.465747    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"]
Jul 29 21:42:58.559346 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:58.559300    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05a10427-1eb7-4918-b9c0-6bd46150b1ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm\" (UID: \"05a10427-1eb7-4918-b9c0-6bd46150b1ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"
Jul 29 21:42:58.660629 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:58.660584    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05a10427-1eb7-4918-b9c0-6bd46150b1ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm\" (UID: \"05a10427-1eb7-4918-b9c0-6bd46150b1ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"
Jul 29 21:42:58.661287 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:58.661258    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05a10427-1eb7-4918-b9c0-6bd46150b1ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm\" (UID: \"05a10427-1eb7-4918-b9c0-6bd46150b1ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"
Jul 29 21:42:58.770559 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:58.770513    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"
Jul 29 21:42:58.922817 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:58.922787    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"]
Jul 29 21:42:58.924900 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:42:58.924871    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a10427_1eb7_4918_b9c0_6bd46150b1ee.slice/crio-96fe4d030f2562a7acd2ffbea3fd66f1e36158fd8bc0922c32c6a6cb72692c80 WatchSource:0}: Error finding container 96fe4d030f2562a7acd2ffbea3fd66f1e36158fd8bc0922c32c6a6cb72692c80: Status 404 returned error can't find the container with id 96fe4d030f2562a7acd2ffbea3fd66f1e36158fd8bc0922c32c6a6cb72692c80
Jul 29 21:42:59.901147 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:59.901114    2557 generic.go:356] "Generic (PLEG): container finished" podID="05a10427-1eb7-4918-b9c0-6bd46150b1ee" containerID="f8938819328ca69442b295000e78bba99f253d3b2a9dc06dda6c70b60405807d" exitCode=0
Jul 29 21:42:59.901619 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:59.901183    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm" event={"ID":"05a10427-1eb7-4918-b9c0-6bd46150b1ee","Type":"ContainerDied","Data":"f8938819328ca69442b295000e78bba99f253d3b2a9dc06dda6c70b60405807d"}
Jul 29 21:42:59.901619 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:42:59.901229    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm" event={"ID":"05a10427-1eb7-4918-b9c0-6bd46150b1ee","Type":"ContainerStarted","Data":"96fe4d030f2562a7acd2ffbea3fd66f1e36158fd8bc0922c32c6a6cb72692c80"}
Jul 29 21:43:01.049538 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:01.049512    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"
Jul 29 21:43:01.083592 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:01.083560    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05a10427-1eb7-4918-b9c0-6bd46150b1ee-maas-api-service-ca\") pod \"05a10427-1eb7-4918-b9c0-6bd46150b1ee\" (UID: \"05a10427-1eb7-4918-b9c0-6bd46150b1ee\") "
Jul 29 21:43:01.083970 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:01.083947    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a10427-1eb7-4918-b9c0-6bd46150b1ee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "05a10427-1eb7-4918-b9c0-6bd46150b1ee" (UID: "05a10427-1eb7-4918-b9c0-6bd46150b1ee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:43:01.184477 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:01.184368    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05a10427-1eb7-4918-b9c0-6bd46150b1ee-maas-api-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:01.913342 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:01.913314    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"
Jul 29 21:43:01.913342 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:01.913328    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm" event={"ID":"05a10427-1eb7-4918-b9c0-6bd46150b1ee","Type":"ContainerDied","Data":"96fe4d030f2562a7acd2ffbea3fd66f1e36158fd8bc0922c32c6a6cb72692c80"}
Jul 29 21:43:01.913569 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:01.913386    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96fe4d030f2562a7acd2ffbea3fd66f1e36158fd8bc0922c32c6a6cb72692c80"
Jul 29 21:43:09.108188 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:09.108137    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"]
Jul 29 21:43:09.110783 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:09.110750    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5f7d51-x8lmm"]
Jul 29 21:43:10.622632 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:10.622595    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05a10427-1eb7-4918-b9c0-6bd46150b1ee" path="/var/lib/kubelet/pods/05a10427-1eb7-4918-b9c0-6bd46150b1ee/volumes"
Jul 29 21:43:12.432500 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.432450    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n" podUID="8630eb8f-76f2-47b2-9201-bd08a28b3b8f" containerName="main" containerID="cri-o://e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868" gracePeriod=45
Jul 29 21:43:12.694205 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.694134    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:43:12.800713 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.800681    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zft7\" (UniqueName: \"kubernetes.io/projected/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-kube-api-access-6zft7\") pod \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") "
Jul 29 21:43:12.800939 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.800742    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-model-cache\") pod \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") "
Jul 29 21:43:12.800939 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.800781    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tmp-dir\") pod \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") "
Jul 29 21:43:12.800939 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.800817    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-dshm\") pod \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") "
Jul 29 21:43:12.800939 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.800861    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-home\") pod \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") "
Jul 29 21:43:12.800939 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.800889    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tls-certs\") pod \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\" (UID: \"8630eb8f-76f2-47b2-9201-bd08a28b3b8f\") "
Jul 29 21:43:12.801220 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.801010    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-model-cache" (OuterVolumeSpecName: "model-cache") pod "8630eb8f-76f2-47b2-9201-bd08a28b3b8f" (UID: "8630eb8f-76f2-47b2-9201-bd08a28b3b8f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:12.801220 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.801091    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8630eb8f-76f2-47b2-9201-bd08a28b3b8f" (UID: "8630eb8f-76f2-47b2-9201-bd08a28b3b8f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:12.801220 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.801155    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-home" (OuterVolumeSpecName: "home") pod "8630eb8f-76f2-47b2-9201-bd08a28b3b8f" (UID: "8630eb8f-76f2-47b2-9201-bd08a28b3b8f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:12.801383 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.801269    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-model-cache\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:12.801383 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.801309    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tmp-dir\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:12.801383 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.801318    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-home\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:12.803097 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.803071    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-dshm" (OuterVolumeSpecName: "dshm") pod "8630eb8f-76f2-47b2-9201-bd08a28b3b8f" (UID: "8630eb8f-76f2-47b2-9201-bd08a28b3b8f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:12.803183 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.803136    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8630eb8f-76f2-47b2-9201-bd08a28b3b8f" (UID: "8630eb8f-76f2-47b2-9201-bd08a28b3b8f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:43:12.803183 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.803164    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-kube-api-access-6zft7" (OuterVolumeSpecName: "kube-api-access-6zft7") pod "8630eb8f-76f2-47b2-9201-bd08a28b3b8f" (UID: "8630eb8f-76f2-47b2-9201-bd08a28b3b8f"). InnerVolumeSpecName "kube-api-access-6zft7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:43:12.902662 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.902625    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-dshm\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:12.902662 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.902658    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-tls-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:12.902894 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.902673    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zft7\" (UniqueName: \"kubernetes.io/projected/8630eb8f-76f2-47b2-9201-bd08a28b3b8f-kube-api-access-6zft7\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:12.986283 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.986190    2557 generic.go:356] "Generic (PLEG): container finished" podID="8630eb8f-76f2-47b2-9201-bd08a28b3b8f" containerID="e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868" exitCode=0
Jul 29 21:43:12.986283 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.986269    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"
Jul 29 21:43:12.986506 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.986264    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n" event={"ID":"8630eb8f-76f2-47b2-9201-bd08a28b3b8f","Type":"ContainerDied","Data":"e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868"}
Jul 29 21:43:12.986506 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.986389    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n" event={"ID":"8630eb8f-76f2-47b2-9201-bd08a28b3b8f","Type":"ContainerDied","Data":"6d81b28208358f63db73e8b0c6263d4cd846edfe23d336328634210863c22540"}
Jul 29 21:43:12.986506 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.986412    2557 scope.go:117] "RemoveContainer" containerID="e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868"
Jul 29 21:43:12.997039 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.997015    2557 scope.go:117] "RemoveContainer" containerID="e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868"
Jul 29 21:43:12.997397 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:43:12.997379    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868\": container with ID starting with e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868 not found: ID does not exist" containerID="e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868"
Jul 29 21:43:12.997462 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:12.997405    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868"} err="failed to get container status \"e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868\": rpc error: code = NotFound desc = could not find container \"e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868\": container with ID starting with e1526c441aa96dde848eb6bf23717aa8ab82078be8f581a6a3cfcce578f18868 not found: ID does not exist"
Jul 29 21:43:13.009668 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:13.009629    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"]
Jul 29 21:43:13.016063 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:13.016033    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5f7d51/rate-test-model-5f7d51-kserve-6bfc69f6b7-d9w9n"]
Jul 29 21:43:14.622576 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:14.622538    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8630eb8f-76f2-47b2-9201-bd08a28b3b8f" path="/var/lib/kubelet/pods/8630eb8f-76f2-47b2-9201-bd08a28b3b8f/volumes"
Jul 29 21:43:15.949403 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:15.949363    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"]
Jul 29 21:43:15.949909 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:15.949647    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy" containerID="cri-o://95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef" gracePeriod=30
Jul 29 21:43:15.976330 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:15.976292    2557 patch_prober.go:28] interesting pod/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:43:15.976520 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:15.976369    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:43:21.217212 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.217135    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:43:21.278640 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.278597    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-certs\") pod \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") "
Jul 29 21:43:21.278883 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.278700    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzxfn\" (UniqueName: \"kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-kube-api-access-wzxfn\") pod \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") "
Jul 29 21:43:21.278883 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.278733    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-credential-socket\") pod \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") "
Jul 29 21:43:21.278883 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.278768    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-data\") pod \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") "
Jul 29 21:43:21.278883 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.278794    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-envoy\") pod \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") "
Jul 29 21:43:21.278883 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.278827    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-socket\") pod \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") "
Jul 29 21:43:21.279176 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.278904    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-podinfo\") pod \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") "
Jul 29 21:43:21.279176 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.278943    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istiod-ca-cert\") pod \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") "
Jul 29 21:43:21.279176 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.278958    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5b3f20a-b43e-4022-b6f0-c8382b313c26" (UID: "b5b3f20a-b43e-4022-b6f0-c8382b313c26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:21.279176 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.278983    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-token\") pod \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\" (UID: \"b5b3f20a-b43e-4022-b6f0-c8382b313c26\") "
Jul 29 21:43:21.279176 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.279021    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5b3f20a-b43e-4022-b6f0-c8382b313c26" (UID: "b5b3f20a-b43e-4022-b6f0-c8382b313c26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:21.279443 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.279179    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5b3f20a-b43e-4022-b6f0-c8382b313c26" (UID: "b5b3f20a-b43e-4022-b6f0-c8382b313c26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:21.279443 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.279341    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5b3f20a-b43e-4022-b6f0-c8382b313c26" (UID: "b5b3f20a-b43e-4022-b6f0-c8382b313c26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:43:21.279443 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.279417    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:21.279443 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.279437    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:21.279650 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.279451    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:21.280051 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.279954    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5b3f20a-b43e-4022-b6f0-c8382b313c26" (UID: "b5b3f20a-b43e-4022-b6f0-c8382b313c26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:21.281300 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.281266    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5b3f20a-b43e-4022-b6f0-c8382b313c26" (UID: "b5b3f20a-b43e-4022-b6f0-c8382b313c26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:43:21.281429 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.281407    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-kube-api-access-wzxfn" (OuterVolumeSpecName: "kube-api-access-wzxfn") pod "b5b3f20a-b43e-4022-b6f0-c8382b313c26" (UID: "b5b3f20a-b43e-4022-b6f0-c8382b313c26"). InnerVolumeSpecName "kube-api-access-wzxfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:43:21.281562 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.281536    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5b3f20a-b43e-4022-b6f0-c8382b313c26" (UID: "b5b3f20a-b43e-4022-b6f0-c8382b313c26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:43:21.281661 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.281632    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5b3f20a-b43e-4022-b6f0-c8382b313c26" (UID: "b5b3f20a-b43e-4022-b6f0-c8382b313c26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:21.380525 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.380485    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:21.380525 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.380519    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:21.380525 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.380528    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:21.380525 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.380537    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzxfn\" (UniqueName: \"kubernetes.io/projected/b5b3f20a-b43e-4022-b6f0-c8382b313c26-kube-api-access-wzxfn\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:21.380810 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.380546    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:21.380810 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:21.380555    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5b3f20a-b43e-4022-b6f0-c8382b313c26-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:22.039301 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.039264    2557 generic.go:356] "Generic (PLEG): container finished" podID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerID="95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef" exitCode=0
Jul 29 21:43:22.039489 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.039321    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"
Jul 29 21:43:22.039489 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.039359    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" event={"ID":"b5b3f20a-b43e-4022-b6f0-c8382b313c26","Type":"ContainerDied","Data":"95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef"}
Jul 29 21:43:22.039489 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.039422    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s" event={"ID":"b5b3f20a-b43e-4022-b6f0-c8382b313c26","Type":"ContainerDied","Data":"18270730a466065f81365c542bd1470098fcae11842ddd2ec7fc77b9c0efff79"}
Jul 29 21:43:22.039489 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.039452    2557 scope.go:117] "RemoveContainer" containerID="95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef"
Jul 29 21:43:22.050027 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.050004    2557 scope.go:117] "RemoveContainer" containerID="bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb"
Jul 29 21:43:22.059398 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.059378    2557 scope.go:117] "RemoveContainer" containerID="95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef"
Jul 29 21:43:22.059731 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:43:22.059711    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef\": container with ID starting with 95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef not found: ID does not exist" containerID="95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef"
Jul 29 21:43:22.059890 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.059745    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef"} err="failed to get container status \"95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef\": rpc error: code = NotFound desc = could not find container \"95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef\": container with ID starting with 95eadb3a5684d48206df232cdf1f7ff9b9e1f53d521459f79b668822302b5fef not found: ID does not exist"
Jul 29 21:43:22.059890 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.059765    2557 scope.go:117] "RemoveContainer" containerID="bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb"
Jul 29 21:43:22.060042 ip-10-0-137-228 kubenswrapper[2557]: E0729 21:43:22.060025    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb\": container with ID starting with bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb not found: ID does not exist" containerID="bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb"
Jul 29 21:43:22.060083 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.060049    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb"} err="failed to get container status \"bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb\": rpc error: code = NotFound desc = could not find container \"bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb\": container with ID starting with bf20dbbc39578d7ccd87cf8d84a4d88a1a944c608e20c3185d9d230de5f805cb not found: ID does not exist"
Jul 29 21:43:22.064566 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.064533    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"]
Jul 29 21:43:22.069411 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.069377    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-5f7d51-openshift-default-6d59558b44-74k2s"]
Jul 29 21:43:22.621670 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:22.621635    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" path="/var/lib/kubelet/pods/b5b3f20a-b43e-4022-b6f0-c8382b313c26/volumes"
Jul 29 21:43:33.933419 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:33.933378    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"]
Jul 29 21:43:33.933983 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:33.933590    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy" containerID="cri-o://082acb3652c4fde4f5c0e0085d80bac6dca70dc118a25600f3d98787637c68d0" gracePeriod=30
Jul 29 21:43:39.142660 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.142626    2557 generic.go:356] "Generic (PLEG): container finished" podID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerID="082acb3652c4fde4f5c0e0085d80bac6dca70dc118a25600f3d98787637c68d0" exitCode=0
Jul 29 21:43:39.143092 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.142700    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" event={"ID":"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3","Type":"ContainerDied","Data":"082acb3652c4fde4f5c0e0085d80bac6dca70dc118a25600f3d98787637c68d0"}
Jul 29 21:43:39.143092 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.142764    2557 scope.go:117] "RemoveContainer" containerID="5ec4bf39e0e97b041027ec14a23724a26f3608f9bceb5c593dd17e8e3645efbb"
Jul 29 21:43:39.205215 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.205142    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:43:39.250197 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250161    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-socket\") pod \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") "
Jul 29 21:43:39.250394 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250238    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-data\") pod \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") "
Jul 29 21:43:39.250394 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250275    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-credential-socket\") pod \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") "
Jul 29 21:43:39.250394 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250328    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istiod-ca-cert\") pod \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") "
Jul 29 21:43:39.250394 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250355    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-certs\") pod \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") "
Jul 29 21:43:39.250615 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250427    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-podinfo\") pod \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") "
Jul 29 21:43:39.250615 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250460    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" (UID: "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:39.250615 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250483    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-envoy\") pod \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") "
Jul 29 21:43:39.250615 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250518    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j67r4\" (UniqueName: \"kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-kube-api-access-j67r4\") pod \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") "
Jul 29 21:43:39.250615 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250552    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-token\") pod \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\" (UID: \"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3\") "
Jul 29 21:43:39.250920 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250614    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" (UID: "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:39.250920 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250651    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" (UID: "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:39.250920 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250908    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:39.251088 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250929    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-credential-socket\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:39.251088 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250926    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" (UID: "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:43:39.251088 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.250943    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-workload-certs\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:39.251554 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.251522    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" (UID: "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:39.252734 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.252708    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" (UID: "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:43:39.252923 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.252907    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" (UID: "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:43:39.253037 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.253018    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" (UID: "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:43:39.253339 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.253314    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-kube-api-access-j67r4" (OuterVolumeSpecName: "kube-api-access-j67r4") pod "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" (UID: "e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3"). InnerVolumeSpecName "kube-api-access-j67r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:43:39.352080 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.352041    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j67r4\" (UniqueName: \"kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-kube-api-access-j67r4\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:39.352080 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.352076    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-token\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:39.352080 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.352086    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-data\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:39.352328 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.352095    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istiod-ca-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:39.352328 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.352103    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-podinfo\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:39.352328 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:39.352110    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3-istio-envoy\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\""
Jul 29 21:43:40.149464 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:40.149421    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6" event={"ID":"e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3","Type":"ContainerDied","Data":"f0a42b7149e12fff25505b27ec267eeede140c2695ec342e88e1900c9f4fb10f"}
Jul 29 21:43:40.149946 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:40.149488    2557 scope.go:117] "RemoveContainer" containerID="082acb3652c4fde4f5c0e0085d80bac6dca70dc118a25600f3d98787637c68d0"
Jul 29 21:43:40.149946 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:40.149434    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"
Jul 29 21:43:40.179855 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:40.177277    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"]
Jul 29 21:43:40.182959 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:40.182930    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-eee583-openshift-default-5d4c5bff56-2wwc6"]
Jul 29 21:43:40.201221 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:40.201194    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-h548v_91d0bf53-c14a-4ac6-9627-5dba01121ce1/manager/0.log"
Jul 29 21:43:40.315967 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:40.315938    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xmlwr_ae68cfb6-0301-48e5-87bc-72c07d320bf9/manager/0.log"
Jul 29 21:43:40.555547 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:40.555519    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cwnjm_77b3cf15-3ff5-4e13-b14a-f22d102a26a0/server/0.log"
Jul 29 21:43:40.621655 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:40.621616    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" path="/var/lib/kubelet/pods/e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3/volumes"
Jul 29 21:43:40.683544 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:40.683507    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xpzr6_33408537-b79a-459f-a7e2-ec571f5feeb5/manager/0.log"
Jul 29 21:43:41.079063 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:41.079035    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f7855d79-wx5zt_2fd88db1-e87e-429f-a1ce-aa6e840875eb/manager/0.log"
Jul 29 21:43:41.086620 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:41.086594    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f7855d79-wx5zt_2fd88db1-e87e-429f-a1ce-aa6e840875eb/copy-manifests/0.log"
Jul 29 21:43:41.579196 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:41.579164    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755980-v75j8_84904cd5-2367-497e-974d-15d2d9f5e8ed/cleanup/0.log"
Jul 29 21:43:41.817469 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:41.817437    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29756010-9n254_4d91ebf4-3aa1-4a12-b389-c0186196a85f/cleanup/0.log"
Jul 29 21:43:41.937774 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:41.937701    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-cwv7l_b61315b5-e5a2-4246-a40a-d7509d7a81a2/postgres/0.log"
Jul 29 21:43:42.765699 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:42.765668    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2_fb61c181-9076-4746-b5cf-eca70827c766/util/0.log"
Jul 29 21:43:42.772248 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:42.772223    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2_fb61c181-9076-4746-b5cf-eca70827c766/pull/0.log"
Jul 29 21:43:42.778260 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:42.778230    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2_fb61c181-9076-4746-b5cf-eca70827c766/extract/0.log"
Jul 29 21:43:42.900853 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:42.900812    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j_440b00df-bc2b-4ed3-8a42-4ebd47720b1b/pull/0.log"
Jul 29 21:43:42.908081 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:42.908058    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j_440b00df-bc2b-4ed3-8a42-4ebd47720b1b/extract/0.log"
Jul 29 21:43:42.914133 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:42.914111    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j_440b00df-bc2b-4ed3-8a42-4ebd47720b1b/util/0.log"
Jul 29 21:43:43.030277 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.030200    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph_68b6d40b-0b68-4433-83e7-315a667027f2/util/0.log"
Jul 29 21:43:43.037292 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.037264    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph_68b6d40b-0b68-4433-83e7-315a667027f2/pull/0.log"
Jul 29 21:43:43.045778 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.045750    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph_68b6d40b-0b68-4433-83e7-315a667027f2/extract/0.log"
Jul 29 21:43:43.166991 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.166958    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb_95a8d424-e295-43a4-8b2e-7afcfb4e2637/util/0.log"
Jul 29 21:43:43.173985 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.173957    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb_95a8d424-e295-43a4-8b2e-7afcfb4e2637/pull/0.log"
Jul 29 21:43:43.180457 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.180422    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb_95a8d424-e295-43a4-8b2e-7afcfb4e2637/extract/0.log"
Jul 29 21:43:43.429151 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.429051    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5s5qm_5c0894a4-bcb4-4da9-9fe1-5fc422e78a5f/manager/0.log"
Jul 29 21:43:43.550141 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.550100    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ntgfq_455a7330-7baf-4a37-8916-16ba962756a0/manager/0.log"
Jul 29 21:43:43.669149 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.669119    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-wfr4c_3039e992-6d30-435d-9feb-fe0814783693/kuadrant-console-plugin/0.log"
Jul 29 21:43:43.788440 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.788392    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vrvgb_c038a2b2-e008-406e-a64c-2651b6c5a75f/registry-server/0.log"
Jul 29 21:43:43.910683 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:43.910653    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pwf4n_02a561b3-9f37-4a0f-bc73-c7d942ad3186/manager/0.log"
Jul 29 21:43:44.524196 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:44.524168    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps_89769e32-80be-49ba-aa95-af3ddcadc513/istio-proxy/0.log"
Jul 29 21:43:44.886296 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:44.886212    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b588c995f-mhxpn_76e1e37e-c08a-4518-ad99-7ed75310d0dd/kube-auth-proxy/0.log"
Jul 29 21:43:45.010027 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:45.009997    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2xv2q_1a1c02e7-2946-4031-b6f6-84e282df5ff2/istio-proxy/1.log"
Jul 29 21:43:45.132129 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:45.132080    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7pnxq_b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6/payload-pre-processing/0.log"
Jul 29 21:43:45.259430 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:45.259336    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q9t74_2a2a6527-da5b-4e56-8919-c7c94769d089/payload-processing/0.log"
Jul 29 21:43:45.379194 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:45.379160    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f74bf69c-f78lr_95d50892-1cfa-47c2-a1d4-9aef77704cc7/router/0.log"
Jul 29 21:43:45.861045 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:45.861016    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-76rxh_a0c43f87-7e5f-49d0-af06-4943ed3095f1/main/0.log"
Jul 29 21:43:45.980180 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:45.980149    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-t6llj_069104d0-1f06-4cd7-8a7d-de7c0d179923/main/0.log"
Jul 29 21:43:51.873385 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873348    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pwwzw/must-gather-rdcj6"]
Jul 29 21:43:51.873797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873745    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy"
Jul 29 21:43:51.873797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873757    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy"
Jul 29 21:43:51.873797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873770    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy"
Jul 29 21:43:51.873797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873776    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy"
Jul 29 21:43:51.873797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873786    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy"
Jul 29 21:43:51.873797 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873791    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873806    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05a10427-1eb7-4918-b9c0-6bd46150b1ee" containerName="revoke-keys"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873812    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="05a10427-1eb7-4918-b9c0-6bd46150b1ee" containerName="revoke-keys"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873818    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873823    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873843    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8630eb8f-76f2-47b2-9201-bd08a28b3b8f" containerName="main"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873849    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8630eb8f-76f2-47b2-9201-bd08a28b3b8f" containerName="main"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873911    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873918    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873926    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8630eb8f-76f2-47b2-9201-bd08a28b3b8f" containerName="main"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.873933    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="05a10427-1eb7-4918-b9c0-6bd46150b1ee" containerName="revoke-keys"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.874032    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5b3f20a-b43e-4022-b6f0-c8382b313c26" containerName="istio-proxy"
Jul 29 21:43:51.874052 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.874038    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d3c624-8ffd-49f2-806b-f1b9cd01b3b3" containerName="istio-proxy"
Jul 29 21:43:51.878657 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.878614    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pwwzw/must-gather-rdcj6"
Jul 29 21:43:51.881815 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.881785    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pwwzw\"/\"openshift-service-ca.crt\""
Jul 29 21:43:51.881985 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.881873    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pwwzw\"/\"default-dockercfg-5976b\""
Jul 29 21:43:51.883030 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.883012    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pwwzw\"/\"kube-root-ca.crt\""
Jul 29 21:43:51.886758 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.886733    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pwwzw/must-gather-rdcj6"]
Jul 29 21:43:51.967740 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.967692    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f425e846-472c-4a79-87db-a63d45612af8-must-gather-output\") pod \"must-gather-rdcj6\" (UID: \"f425e846-472c-4a79-87db-a63d45612af8\") " pod="openshift-must-gather-pwwzw/must-gather-rdcj6"
Jul 29 21:43:51.967990 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:51.967892    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frptt\" (UniqueName: \"kubernetes.io/projected/f425e846-472c-4a79-87db-a63d45612af8-kube-api-access-frptt\") pod \"must-gather-rdcj6\" (UID: \"f425e846-472c-4a79-87db-a63d45612af8\") " pod="openshift-must-gather-pwwzw/must-gather-rdcj6"
Jul 29 21:43:52.069215 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:52.069170    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frptt\" (UniqueName: \"kubernetes.io/projected/f425e846-472c-4a79-87db-a63d45612af8-kube-api-access-frptt\") pod \"must-gather-rdcj6\" (UID: \"f425e846-472c-4a79-87db-a63d45612af8\") " pod="openshift-must-gather-pwwzw/must-gather-rdcj6"
Jul 29 21:43:52.069215 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:52.069220    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f425e846-472c-4a79-87db-a63d45612af8-must-gather-output\") pod \"must-gather-rdcj6\" (UID: \"f425e846-472c-4a79-87db-a63d45612af8\") " pod="openshift-must-gather-pwwzw/must-gather-rdcj6"
Jul 29 21:43:52.069561 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:52.069545    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f425e846-472c-4a79-87db-a63d45612af8-must-gather-output\") pod \"must-gather-rdcj6\" (UID: \"f425e846-472c-4a79-87db-a63d45612af8\") " pod="openshift-must-gather-pwwzw/must-gather-rdcj6"
Jul 29 21:43:52.078333 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:52.078308    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frptt\" (UniqueName: \"kubernetes.io/projected/f425e846-472c-4a79-87db-a63d45612af8-kube-api-access-frptt\") pod \"must-gather-rdcj6\" (UID: \"f425e846-472c-4a79-87db-a63d45612af8\") " pod="openshift-must-gather-pwwzw/must-gather-rdcj6"
Jul 29 21:43:52.189355 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:52.189248    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pwwzw/must-gather-rdcj6"
Jul 29 21:43:52.338392 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:52.338194    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pwwzw/must-gather-rdcj6"]
Jul 29 21:43:52.341242 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:43:52.341199    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf425e846_472c_4a79_87db_a63d45612af8.slice/crio-4a8714870664790131f3d9b211243620286f9e28f7becb023b60fca58b56c807 WatchSource:0}: Error finding container 4a8714870664790131f3d9b211243620286f9e28f7becb023b60fca58b56c807: Status 404 returned error can't find the container with id 4a8714870664790131f3d9b211243620286f9e28f7becb023b60fca58b56c807
Jul 29 21:43:52.343096 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:52.343078    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 21:43:53.221691 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:53.221661    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pwwzw/must-gather-rdcj6" event={"ID":"f425e846-472c-4a79-87db-a63d45612af8","Type":"ContainerStarted","Data":"4a8714870664790131f3d9b211243620286f9e28f7becb023b60fca58b56c807"}
Jul 29 21:43:54.233184 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:54.233141    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pwwzw/must-gather-rdcj6" event={"ID":"f425e846-472c-4a79-87db-a63d45612af8","Type":"ContainerStarted","Data":"518bd6251905357707187c6ee6713f1dfdc00b276b6eedfaaa1041744e71cb02"}
Jul 29 21:43:54.233697 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:54.233201    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pwwzw/must-gather-rdcj6" event={"ID":"f425e846-472c-4a79-87db-a63d45612af8","Type":"ContainerStarted","Data":"9a0b6ff81765b3a7c5b6cee817b782ba9a313a825bfcb42b10fe2dff6264443c"}
Jul 29 21:43:54.253037 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:54.252970    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pwwzw/must-gather-rdcj6" podStartSLOduration=2.462190525 podStartE2EDuration="3.252943478s" totalImagesPullingTime="790.752953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:43:54.251075346 +0000 UTC m=+4744.102576019" watchObservedRunningTime="2026-07-29 21:43:54.252943478 +0000 UTC m=+4744.104444153"
Jul 29 21:43:54.775271 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:54.775243    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-knpwg_0e56f612-eb45-4aef-acff-46673cd9a779/global-pull-secret-syncer/0.log"
Jul 29 21:43:54.927370 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:54.927335    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pfr9g_e4e2a3d5-4194-45d3-9898-5d9d2e0f4546/konnectivity-agent/0.log"
Jul 29 21:43:55.030312 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:55.030232    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-228.ec2.internal_e51e885d9de0c47fa459d70fe2d1f945/haproxy/0.log"
Jul 29 21:43:59.469963 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.469912    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2_fb61c181-9076-4746-b5cf-eca70827c766/extract/0.log"
Jul 29 21:43:59.505626 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.505597    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2_fb61c181-9076-4746-b5cf-eca70827c766/util/0.log"
Jul 29 21:43:59.526997 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.526967    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v6sh2_fb61c181-9076-4746-b5cf-eca70827c766/pull/0.log"
Jul 29 21:43:59.553864 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.553704    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j_440b00df-bc2b-4ed3-8a42-4ebd47720b1b/extract/0.log"
Jul 29 21:43:59.575310 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.575283    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j_440b00df-bc2b-4ed3-8a42-4ebd47720b1b/util/0.log"
Jul 29 21:43:59.603517 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.603478    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8v5j_440b00df-bc2b-4ed3-8a42-4ebd47720b1b/pull/0.log"
Jul 29 21:43:59.639120 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.639091    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph_68b6d40b-0b68-4433-83e7-315a667027f2/extract/0.log"
Jul 29 21:43:59.662738 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.662703    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph_68b6d40b-0b68-4433-83e7-315a667027f2/util/0.log"
Jul 29 21:43:59.691200 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.691170    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v2jph_68b6d40b-0b68-4433-83e7-315a667027f2/pull/0.log"
Jul 29 21:43:59.733493 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.733406    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb_95a8d424-e295-43a4-8b2e-7afcfb4e2637/extract/0.log"
Jul 29 21:43:59.757415 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.757383    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb_95a8d424-e295-43a4-8b2e-7afcfb4e2637/util/0.log"
Jul 29 21:43:59.776735 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:43:59.776676    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tqxsb_95a8d424-e295-43a4-8b2e-7afcfb4e2637/pull/0.log"
Jul 29 21:44:00.414067 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:00.414030    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5s5qm_5c0894a4-bcb4-4da9-9fe1-5fc422e78a5f/manager/0.log"
Jul 29 21:44:00.439750 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:00.439709    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ntgfq_455a7330-7baf-4a37-8916-16ba962756a0/manager/0.log"
Jul 29 21:44:00.467917 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:00.467886    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-wfr4c_3039e992-6d30-435d-9feb-fe0814783693/kuadrant-console-plugin/0.log"
Jul 29 21:44:00.548035 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:00.547998    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vrvgb_c038a2b2-e008-406e-a64c-2651b6c5a75f/registry-server/0.log"
Jul 29 21:44:00.656679 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:00.656250    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pwf4n_02a561b3-9f37-4a0f-bc73-c7d942ad3186/manager/0.log"
Jul 29 21:44:03.154066 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:03.154036    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wqxth_8df5c6f1-cdd2-4817-a06f-bee05705c74a/node-exporter/0.log"
Jul 29 21:44:03.175557 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:03.175525    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wqxth_8df5c6f1-cdd2-4817-a06f-bee05705c74a/kube-rbac-proxy/0.log"
Jul 29 21:44:03.199489 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:03.199453    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wqxth_8df5c6f1-cdd2-4817-a06f-bee05705c74a/init-textfile/0.log"
Jul 29 21:44:04.995124 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:04.995099    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-qh7wc_e19b3f58-74da-489b-9c3d-8c45d9c64a55/networking-console-plugin/0.log"
Jul 29 21:44:05.034055 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.034011    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"]
Jul 29 21:44:05.040456 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.040420    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.048079 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.048042    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"]
Jul 29 21:44:05.113390 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.113340    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-lib-modules\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.113665 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.113641    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8npsm\" (UniqueName: \"kubernetes.io/projected/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-kube-api-access-8npsm\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.113802 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.113784    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-podres\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.114007 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.113989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-sys\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.114142 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.114128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-proc\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.215549 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.215513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-lib-modules\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.215549 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.215553    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8npsm\" (UniqueName: \"kubernetes.io/projected/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-kube-api-access-8npsm\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.215549 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.215576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-podres\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.215897 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.215632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-sys\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.215897 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.215661    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-proc\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.215897 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.215709    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-lib-modules\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.215897 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.215761    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-proc\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.215897 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.215763    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-sys\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.215897 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.215799    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-podres\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.225695 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.225651    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8npsm\" (UniqueName: \"kubernetes.io/projected/741ceae1-1a8b-4d1b-b158-cb6d17b5074a-kube-api-access-8npsm\") pod \"perf-node-gather-daemonset-ww692\" (UID: \"741ceae1-1a8b-4d1b-b158-cb6d17b5074a\") " pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.364578 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.364531    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:05.606086 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:05.603484    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"]
Jul 29 21:44:05.606086 ip-10-0-137-228 kubenswrapper[2557]: W0729 21:44:05.605497    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod741ceae1_1a8b_4d1b_b158_cb6d17b5074a.slice/crio-76cdc2c83a7922d09541b5c1635af19de6ac0d0c4282e97408f792f30ac6b550 WatchSource:0}: Error finding container 76cdc2c83a7922d09541b5c1635af19de6ac0d0c4282e97408f792f30ac6b550: Status 404 returned error can't find the container with id 76cdc2c83a7922d09541b5c1635af19de6ac0d0c4282e97408f792f30ac6b550
Jul 29 21:44:06.223583 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:06.223554    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77dccd7df-lv4lz_6e7d65a5-a7e9-4d9a-b7d7-b614561ec6c1/console/0.log"
Jul 29 21:44:06.348119 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:06.348075    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692" event={"ID":"741ceae1-1a8b-4d1b-b158-cb6d17b5074a","Type":"ContainerStarted","Data":"3c30c77d0b156389a4ccac2fe90c9291e91de4cfddeedc2dee4624f90d39f4e5"}
Jul 29 21:44:06.348328 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:06.348145    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692" event={"ID":"741ceae1-1a8b-4d1b-b158-cb6d17b5074a","Type":"ContainerStarted","Data":"76cdc2c83a7922d09541b5c1635af19de6ac0d0c4282e97408f792f30ac6b550"}
Jul 29 21:44:06.348998 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:06.348975    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:06.366985 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:06.366915    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692" podStartSLOduration=1.3668932790000001 podStartE2EDuration="1.366893279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:44:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:44:06.36460314 +0000 UTC m=+4756.216103814" watchObservedRunningTime="2026-07-29 21:44:06.366893279 +0000 UTC m=+4756.218393952"
Jul 29 21:44:06.858917 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:06.858888    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-25sqr_2ff3c073-347c-499a-ad34-33d881a5a1ec/volume-data-source-validator/0.log"
Jul 29 21:44:07.897858 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:07.897803    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b58fv_54871aa4-68a9-4d32-95ab-739033a2ed18/dns/0.log"
Jul 29 21:44:07.938672 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:07.938642    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b58fv_54871aa4-68a9-4d32-95ab-739033a2ed18/kube-rbac-proxy/0.log"
Jul 29 21:44:08.076679 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:08.076641    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hzht2_a68fc4eb-49d9-4406-a5c9-5bfce7a9ba25/dns-node-resolver/0.log"
Jul 29 21:44:08.712496 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:08.712465    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z7xkh_9f929d08-18ca-42de-b80c-4395c73e9293/node-ca/0.log"
Jul 29 21:44:09.629938 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:09.629899    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps_89769e32-80be-49ba-aa95-af3ddcadc513/istio-proxy/0.log"
Jul 29 21:44:09.966564 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:09.966435    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b588c995f-mhxpn_76e1e37e-c08a-4518-ad99-7ed75310d0dd/kube-auth-proxy/0.log"
Jul 29 21:44:09.999437 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:09.999399    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2xv2q_1a1c02e7-2946-4031-b6f6-84e282df5ff2/istio-proxy/0.log"
Jul 29 21:44:10.036165 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:10.036132    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2xv2q_1a1c02e7-2946-4031-b6f6-84e282df5ff2/istio-proxy/1.log"
Jul 29 21:44:10.074940 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:10.074900    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7pnxq_b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6/payload-pre-processing/0.log"
Jul 29 21:44:10.110178 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:10.110142    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q9t74_2a2a6527-da5b-4e56-8919-c7c94769d089/payload-processing/0.log"
Jul 29 21:44:10.131238 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:10.131210    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f74bf69c-f78lr_95d50892-1cfa-47c2-a1d4-9aef77704cc7/router/0.log"
Jul 29 21:44:10.969333 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:10.969305    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-85hjr_f4854a11-af39-4d3c-88fc-7d67a9189d01/serve-healthcheck-canary/0.log"
Jul 29 21:44:11.637846 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:11.637805    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxwgp_adfde4e5-4550-46b8-8795-f6ddc2a24978/kube-rbac-proxy/0.log"
Jul 29 21:44:11.657749 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:11.657717    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxwgp_adfde4e5-4550-46b8-8795-f6ddc2a24978/exporter/0.log"
Jul 29 21:44:11.678635 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:11.678606    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxwgp_adfde4e5-4550-46b8-8795-f6ddc2a24978/extractor/0.log"
Jul 29 21:44:13.378817 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:13.378745    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pwwzw/perf-node-gather-daemonset-ww692"
Jul 29 21:44:13.905433 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:13.905401    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-h548v_91d0bf53-c14a-4ac6-9627-5dba01121ce1/manager/0.log"
Jul 29 21:44:14.173565 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:14.173485    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xmlwr_ae68cfb6-0301-48e5-87bc-72c07d320bf9/manager/0.log"
Jul 29 21:44:14.485577 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:14.485496    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cwnjm_77b3cf15-3ff5-4e13-b14a-f22d102a26a0/server/0.log"
Jul 29 21:44:14.581507 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:14.581472    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xpzr6_33408537-b79a-459f-a7e2-ec571f5feeb5/manager/0.log"
Jul 29 21:44:14.861339 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:14.861305    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f7855d79-wx5zt_2fd88db1-e87e-429f-a1ce-aa6e840875eb/manager/0.log"
Jul 29 21:44:14.888197 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:14.888172    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f7855d79-wx5zt_2fd88db1-e87e-429f-a1ce-aa6e840875eb/copy-manifests/0.log"
Jul 29 21:44:15.220734 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:15.220637    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps_89769e32-80be-49ba-aa95-af3ddcadc513/istio-proxy/0.log"
Jul 29 21:44:15.540192 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:15.540162    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b588c995f-mhxpn_76e1e37e-c08a-4518-ad99-7ed75310d0dd/kube-auth-proxy/0.log"
Jul 29 21:44:15.566132 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:15.566102    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2xv2q_1a1c02e7-2946-4031-b6f6-84e282df5ff2/istio-proxy/0.log"
Jul 29 21:44:15.608266 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:15.608222    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2xv2q_1a1c02e7-2946-4031-b6f6-84e282df5ff2/istio-proxy/1.log"
Jul 29 21:44:15.632311 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:15.632274    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7pnxq_b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6/payload-pre-processing/0.log"
Jul 29 21:44:15.657848 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:15.657363    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q9t74_2a2a6527-da5b-4e56-8919-c7c94769d089/payload-processing/0.log"
Jul 29 21:44:15.677752 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:15.677719    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f74bf69c-f78lr_95d50892-1cfa-47c2-a1d4-9aef77704cc7/router/0.log"
Jul 29 21:44:17.184215 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:17.184177    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-9blps_89769e32-80be-49ba-aa95-af3ddcadc513/istio-proxy/0.log"
Jul 29 21:44:17.486945 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:17.486857    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b588c995f-mhxpn_76e1e37e-c08a-4518-ad99-7ed75310d0dd/kube-auth-proxy/0.log"
Jul 29 21:44:17.508303 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:17.508262    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2xv2q_1a1c02e7-2946-4031-b6f6-84e282df5ff2/istio-proxy/0.log"
Jul 29 21:44:17.541934 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:17.541854    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2xv2q_1a1c02e7-2946-4031-b6f6-84e282df5ff2/istio-proxy/1.log"
Jul 29 21:44:17.585770 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:17.585734    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7pnxq_b3d70d9f-e5ef-4bd6-8fed-f9ff8c5e0bb6/payload-pre-processing/0.log"
Jul 29 21:44:17.610799 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:17.610767    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q9t74_2a2a6527-da5b-4e56-8919-c7c94769d089/payload-processing/0.log"
Jul 29 21:44:17.628928 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:17.628900    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f74bf69c-f78lr_95d50892-1cfa-47c2-a1d4-9aef77704cc7/router/0.log"
Jul 29 21:44:21.247916 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:21.247883    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bhp65_667ca380-f4d7-476e-a3fb-d7e9eb106206/migrator/0.log"
Jul 29 21:44:21.267912 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:21.267882    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bhp65_667ca380-f4d7-476e-a3fb-d7e9eb106206/graceful-termination/0.log"
Jul 29 21:44:22.822707 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:22.822681    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfxpl_236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb/kube-multus-additional-cni-plugins/0.log"
Jul 29 21:44:22.843928 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:22.843903    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfxpl_236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb/egress-router-binary-copy/0.log"
Jul 29 21:44:22.867079 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:22.867051    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfxpl_236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb/cni-plugins/0.log"
Jul 29 21:44:22.893254 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:22.888692    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfxpl_236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb/bond-cni-plugin/0.log"
Jul 29 21:44:22.913204 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:22.913176    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfxpl_236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb/routeoverride-cni/0.log"
Jul 29 21:44:22.934495 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:22.934470    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfxpl_236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb/whereabouts-cni-bincopy/0.log"
Jul 29 21:44:22.962644 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:22.962612    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfxpl_236b7ae6-6e4e-4a86-8ded-0ea4d873dbdb/whereabouts-cni/0.log"
Jul 29 21:44:23.184867 ip-10-0-137-228 kubenswrapper[2557]: I0729 21:44:23.184709    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dz2nm_2b9d713d-351f-440b-b69d-07ef0ef69141/kube-multus/0.log"