Jul 28 17:34:19.285393 ip-10-0-142-195 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 17:34:19.676226 ip-10-0-142-195 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:34:19.676226 ip-10-0-142-195 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 17:34:19.676226 ip-10-0-142-195 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:34:19.676226 ip-10-0-142-195 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 17:34:19.676226 ip-10-0-142-195 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:34:19.677153 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.677065    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 17:34:19.682002 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.681987    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:34:19.682002 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682001    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682005    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682008    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682011    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682015    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682018    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682023    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682027    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682030    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682033    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682036    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682039    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682042    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682044    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682047    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682050    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682053    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682055    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682058    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682061    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:34:19.682064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682064    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682066    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682069    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682072    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682075    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682078    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682081    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682083    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682085    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682088    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682104    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682107    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682110    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682112    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682115    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682117    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682120    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682123    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682126    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:34:19.682559 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682129    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682131    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682134    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682136    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682138    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682141    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682143    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682146    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682148    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682151    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682153    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682156    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682158    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682161    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682165    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682169    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682172    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682176    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682179    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:34:19.683021 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682182    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682185    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682188    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682191    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682193    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682196    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682198    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682201    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682203    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682206    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682208    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682212    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682215    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682217    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682220    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682223    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682225    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682228    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682230    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682233    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:34:19.683498 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682235    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682239    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682243    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682246    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682249    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682252    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682254    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682256    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682260    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682263    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682266    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682269    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682294    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682297    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682301    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682304    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682307    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682310    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682313    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:34:19.683981 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.682316    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684398    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684407    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684410    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684413    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684416    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684420    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684423    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684426    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684428    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684431    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684434    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684437    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684439    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684442    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684445    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684448    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684450    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684453    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684456    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:34:19.684475 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684458    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684461    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684463    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684466    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684468    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684471    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684474    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684477    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684480    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684483    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684486    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684489    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684493    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684496    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684499    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684502    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684505    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684507    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684510    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684513    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:34:19.684971 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684516    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684519    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684522    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684525    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684527    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684530    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684533    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684535    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684538    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684540    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684543    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684546    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684548    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684551    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684553    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684556    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684558    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684561    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684564    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684566    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:34:19.685710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684568    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684571    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684573    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684576    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684579    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684581    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684584    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684587    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684589    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684592    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684594    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684598    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684601    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684604    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684606    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684609    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684611    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684614    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684617    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:34:19.686406 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684620    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684623    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684626    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684629    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684631    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684634    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684636    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684640    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684642    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684645    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684647    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684650    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684652    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684655    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684658    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684660    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684663    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684665    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684668    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684670    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:34:19.686871 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.684673    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685534    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685545    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685550    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685555    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685560    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685564    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685569    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685573    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685578    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685585    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685597    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685602    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685607    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685612    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685617    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685621    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685626    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685651    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:34:19.687371 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685670    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685677    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685683    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685689    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685694    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685700    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685705    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685709    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685715    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685721    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685728    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685734    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685746    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685751    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685755    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685760    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685765    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685770    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685775    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685780    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:34:19.687866 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685785    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685789    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685794    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685798    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685808    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685813    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685819    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685824    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685829    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685834    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685839    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685843    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685858    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685864    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685871    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685874    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685876    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685879    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685882    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:34:19.688364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685885    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.685890    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686025    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686032    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686035    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686039    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686042    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686045    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686048    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686051    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686053    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686056    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686059    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686061    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686064    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686066    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686069    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686072    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686074    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686077    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:34:19.688838 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686079    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686082    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686087    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686104    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686109    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686114    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686117    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686121    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686124    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686126    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686129    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686132    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686134    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686137    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686139    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686142    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686144    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686149    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686152    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686156    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:34:19.689358 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686158    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686161    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686230    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686238    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686244    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686249    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686260    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686263    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686267    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686271    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686275    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686278    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686281    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686285    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686288    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686291    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686294    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686298    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686301    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686304    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686309    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686311    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686315    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686318    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 17:34:19.689875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686321    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686325    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686328    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686331    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686334    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686338    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686341    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686344    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686347    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686350    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686355    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686357    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686360    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686363    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686366    2561 flags.go:64] FLAG: --enable-server="true"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686369    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686375    2561 flags.go:64] FLAG: --event-burst="100"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686378    2561 flags.go:64] FLAG: --event-qps="50"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686381    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686384    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686387    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686391    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686394    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686396    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686399    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 28 17:34:19.690493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686403    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686406    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686409    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686413    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686416    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686419    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686422    2561 flags.go:64] FLAG: --feature-gates=""
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686427    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686430    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686433    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686436    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686439    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686442    2561 flags.go:64] FLAG: --help="false"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686444    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-142-195.ec2.internal"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686448    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686451    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686453    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686457    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686461    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686464    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686467    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686470    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686472    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 17:34:19.691103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686475    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686478    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686481    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686484    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686487    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686490    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686493    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686495    2561 flags.go:64] FLAG: --lock-file=""
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686500    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686503    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686506    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686511    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686514    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686518    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686521    2561 flags.go:64] FLAG: --logging-format="text"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686524    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686527    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686530    2561 flags.go:64] FLAG: --manifest-url=""
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686532    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686537    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686539    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686543    2561 flags.go:64] FLAG: --max-pods="110"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686546    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686549    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686552    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 17:34:19.691704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686555    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686558    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686561    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686564    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686572    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686575    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686578    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686581    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686584    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686589    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686592    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686595    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686598    2561 flags.go:64] FLAG: --port="10250"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686601    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686604    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05e7a72f4ce194194"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686607    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686615    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686618    2561 flags.go:64] FLAG: --register-node="true"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686622    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686625    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686628    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686632    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686635    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686638    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686641    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 17:34:19.692330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686644    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686647    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686650    2561 flags.go:64] FLAG: --runonce="false"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686653    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686657    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686660    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686663    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686665    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686669    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686672    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686675    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686678    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686680    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686683    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686686    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686689    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686692    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686695    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686701    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686704    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686707    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686710    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686713    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686718    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686720    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 17:34:19.693056 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686723    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686726    2561 flags.go:64] FLAG: --v="2"
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686730    2561 flags.go:64] FLAG: --version="false"
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686734    2561 flags.go:64] FLAG: --vmodule=""
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686738    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.686741    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686851    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686855    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686858    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686862    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686865    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686868    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686870    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686873    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686876    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686879    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686882    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686884    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686887    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686890    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686893    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686895    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:34:19.693725 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686898    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686901    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686903    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686906    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686908    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686911    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686914    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686917    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686922    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686926    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686930    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686932    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686935    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686939    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686942    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686945    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686948    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686950    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686953    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:34:19.694291 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686955    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686958    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686961    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686964    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686966    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686969    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686972    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686974    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686977    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686980    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686982    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686985    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686988    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686990    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686993    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686995    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.686998    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687000    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687003    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687006    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687008    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:34:19.694754 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687012    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687015    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687018    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687020    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687023    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687025    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687028    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687031    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687034    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687037    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687039    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687042    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687044    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687047    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687049    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687052    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687055    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687057    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687060    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:34:19.695294 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687062    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687065    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687068    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687070    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687073    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687076    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687078    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687081    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687083    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687086    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687088    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687107    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687110    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687114    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687117    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687119    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687122    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687124    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687127    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:34:19.695756 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687130    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687133    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687137    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687141    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.687144    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.687746    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.694001    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.694015    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.694029    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.694035    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694112    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694118    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694122    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694125    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:34:19.696227 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694128    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694131    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694134    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694137    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694140    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694143    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694145    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694148    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694151    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694154    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694156    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694159    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694163    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694167    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694169    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694172    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694175    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694178    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694180    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:34:19.696582 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694183    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694186    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694188    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694191    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694193    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694196    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694200    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694203    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694205    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694208    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694211    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694213    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694216    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694218    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694220    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694223    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694226    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694228    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694231    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694233    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:34:19.697041 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694236    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694238    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694241    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694243    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694246    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694248    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694251    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694253    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694256    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694259    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694261    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694264    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694266    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694269    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694271    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694274    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694277    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694279    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694283    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:34:19.697541 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694285    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694288    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694291    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694293    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694296    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694299    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694301    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694304    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694307    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694309    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694312    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694314    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694317    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694319    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694322    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694324    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694327    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694329    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694332    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694335    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:34:19.698016 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694337    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694340    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694342    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694345    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694348    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694353    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694357    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694360    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694363    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694366    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694369    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694372    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694374    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694377    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694380    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694382    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:34:19.698506 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694385    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.694390    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694501    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694505    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694507    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694510    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694513    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694515    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694517    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694520    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694522    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694525    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694528    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694530    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694533    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:34:19.698897 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694536    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694538    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694541    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694543    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694547    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694551    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694554    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694557    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694560    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694563    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694566    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694568    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694572    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694575    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694577    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694580    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694583    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694585    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694588    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:34:19.699282 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694590    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694594    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694597    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694600    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694603    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694606    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694609    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694611    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694614    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694616    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694619    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694621    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694624    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694626    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694629    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694631    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694634    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694636    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694639    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694642    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:34:19.699760 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694644    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694647    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694650    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694652    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694655    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694658    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694660    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694663    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694666    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694668    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694671    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694673    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694676    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694678    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694681    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694683    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694686    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694688    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694692    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:34:19.700256 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694696    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694698    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694701    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694704    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694707    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694709    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694712    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694715    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694717    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694720    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694722    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694725    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694727    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694730    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694733    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694735    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694738    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694740    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694743    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694745    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:34:19.700707 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694748    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694751    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694753    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694757    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694759    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694762    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694765    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:19.694767    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.694772    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.694864    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.696781    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.698211    2561 server.go:1019] "Starting client certificate rotation"
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.698307    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 17:34:19.701356 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.698335    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 17:34:19.701674 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.700796    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 17:34:19.702426 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.702411    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 17:34:19.708422 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.708405    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 28 17:34:19.710510 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.710496    2561 log.go:25] "Validated CRI v1 image API"
Jul 28 17:34:19.711366 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.711343    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 17:34:19.716022 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.715978    2561 fs.go:135] Filesystem UUIDs: map[57c91dbc-239c-4006-8536-fb620fbdfb7e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 970156e1-9a26-49eb-bdc1-84f6e8d32357:/dev/nvme0n1p4]
Jul 28 17:34:19.716117 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.716021    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 17:34:19.721518 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.721413    2561 manager.go:216] Machine: {Timestamp:2026-07-28 17:34:19.720077999 +0000 UTC m=+0.320674824 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098186 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cef331521276dc88c2f64fde7afc7 SystemUUID:ec2cef33-1521-276d-c88c-2f64fde7afc7 BootID:3b2758d4-e8a3-4910-bc7d-e860145595c8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9e:f8:8b:87:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9e:f8:8b:87:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:2c:f1:f1:51:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 17:34:19.721518 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.721508    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 17:34:19.721630 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.721570    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 17:34:19.724727 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.724703    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 17:34:19.724851 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.724728    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-195.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 17:34:19.725418 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.725408    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 17:34:19.725477 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.725421    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 17:34:19.725477 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.725432    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 17:34:19.725901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.725890    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 17:34:19.726510 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.726496    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 17:34:19.726644 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.726633    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 17:34:19.728384 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.728372    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 17:34:19.728495 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.728485    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 17:34:19.728527 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.728516    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 17:34:19.728558 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.728529    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 17:34:19.728558 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.728552    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 17:34:19.728614 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.728564    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 28 17:34:19.728614 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.728576    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 17:34:19.728922 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.728910    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 17:34:19.728975 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.728929    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 17:34:19.730978 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.730960    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 17:34:19.732808 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.732793    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 17:34:19.732883 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.732832    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 17:34:19.734436 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734422    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 17:34:19.734519 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734442    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 17:34:19.734519 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734451    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 17:34:19.734519 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734459    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 17:34:19.734519 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734470    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 17:34:19.734519 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734478    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 17:34:19.734519 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734489    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 17:34:19.734519 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734497    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 17:34:19.734519 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734507    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 17:34:19.734519 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734515    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 17:34:19.734781 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734527    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 17:34:19.734781 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.734535    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 17:34:19.735355 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.735343    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 17:34:19.735415 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.735357    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 17:34:19.738186 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.738172    2561 server.go:1268] "Started kubelet"
Jul 28 17:34:19.738302 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.738271    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 17:34:19.738525 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.738472    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 17:34:19.738608 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.738572    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 17:34:19.738913 ip-10-0-142-195 systemd[1]: Started Kubernetes Kubelet.
Jul 28 17:34:19.739262 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.739243    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-195.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 17:34:19.739357 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.739317    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 17:34:19.739412 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.739343    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 17:34:19.740146 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.740068    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 17:34:19.740684 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.740665    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 17:34:19.744730 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.744714    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 17:34:19.745042 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.744146    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-195.ec2.internal.18c68490cc62886e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-195.ec2.internal,UID:ip-10-0-142-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-195.ec2.internal,},FirstTimestamp:2026-07-28 17:34:19.738146926 +0000 UTC m=+0.338743750,LastTimestamp:2026-07-28 17:34:19.738146926 +0000 UTC m=+0.338743750,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-195.ec2.internal,}"
Jul 28 17:34:19.746613 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.746599    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 17:34:19.746678 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.746602    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 17:34:19.747154 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.747131    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:19.747800 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.747779    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 17:34:19.748034 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748014    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 17:34:19.748118 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748034    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 17:34:19.748181 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748138    2561 factory.go:55] Registering systemd factory
Jul 28 17:34:19.748181 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748154    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 28 17:34:19.748275 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748234    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 17:34:19.748275 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748242    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 17:34:19.748392 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748377    2561 factory.go:153] Registering CRI-O factory
Jul 28 17:34:19.748440 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748397    2561 factory.go:223] Registration of the crio container factory successfully
Jul 28 17:34:19.748493 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748460    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 17:34:19.748540 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748503    2561 factory.go:103] Registering Raw factory
Jul 28 17:34:19.748540 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.748520    2561 manager.go:1196] Started watching for new ooms in manager
Jul 28 17:34:19.749067 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.749051    2561 manager.go:349] Starting recovery of all containers
Jul 28 17:34:19.756320 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.756293    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 17:34:19.756516 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.756493    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 17:34:19.761111 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.761078    2561 manager.go:354] Recovery completed
Jul 28 17:34:19.765315 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.765303    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:34:19.766969 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.766953    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:34:19.767019 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.766982    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:34:19.767019 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.766992    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:34:19.767860 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.767847    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 17:34:19.767860 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.767858    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 17:34:19.767945 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.767869    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:34:19.767945 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.767871    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 17:34:19.768609 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.768593    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:34:19.768685 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.768623    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:34:19.768685 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.768637    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:34:19.769502 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.769483    2561 policy_none.go:49] "None policy: Start"
Jul 28 17:34:19.769502 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.769504    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 17:34:19.769651 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.769520    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 17:34:19.769651 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.769523    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-195.ec2.internal.18c68490ce1a536e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-195.ec2.internal,UID:ip-10-0-142-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-195.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-195.ec2.internal,},FirstTimestamp:2026-07-28 17:34:19.766969198 +0000 UTC m=+0.367566025,LastTimestamp:2026-07-28 17:34:19.766969198 +0000 UTC m=+0.367566025,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-195.ec2.internal,}"
Jul 28 17:34:19.770488 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.770468    2561 policy_none.go:47] "Start"
Jul 28 17:34:19.780235 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.780067    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-195.ec2.internal.18c68490ce1a9771  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-195.ec2.internal,UID:ip-10-0-142-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-195.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-195.ec2.internal,},FirstTimestamp:2026-07-28 17:34:19.766986609 +0000 UTC m=+0.367583434,LastTimestamp:2026-07-28 17:34:19.766986609 +0000 UTC m=+0.367583434,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-195.ec2.internal,}"
Jul 28 17:34:19.791266 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.791206    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-195.ec2.internal.18c68490ce1abd5a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-195.ec2.internal,UID:ip-10-0-142-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-195.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-195.ec2.internal,},FirstTimestamp:2026-07-28 17:34:19.766996314 +0000 UTC m=+0.367593137,LastTimestamp:2026-07-28 17:34:19.766996314 +0000 UTC m=+0.367593137,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-195.ec2.internal,}"
Jul 28 17:34:19.792540 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.792523    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cx8kp"
Jul 28 17:34:19.799335 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.799307    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cx8kp"
Jul 28 17:34:19.800784 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.800722    2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-195.ec2.internal.18c68490ce1a536e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-195.ec2.internal.18c68490ce1a536e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-195.ec2.internal,UID:ip-10-0-142-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-195.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-195.ec2.internal,},FirstTimestamp:2026-07-28 17:34:19.766969198 +0000 UTC m=+0.367566025,LastTimestamp:2026-07-28 17:34:19.768607686 +0000 UTC m=+0.369204513,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-195.ec2.internal,}"
Jul 28 17:34:19.807653 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.807634    2561 manager.go:337] "Starting Device Plugin manager"
Jul 28 17:34:19.807725 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.807657    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 17:34:19.807725 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.807667    2561 server.go:87] "Starting device plugin registration server"
Jul 28 17:34:19.807843 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.807831    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 17:34:19.807897 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.807844    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 17:34:19.807953 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.807932    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 17:34:19.808030 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.808014    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 17:34:19.808030 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.808029    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 17:34:19.808494 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.808474    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 17:34:19.808565 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.808526    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:19.908292 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.908268    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:34:19.909222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.908983    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:34:19.909222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.909008    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:34:19.909222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.909016    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:34:19.909222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.909042    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-195.ec2.internal"
Jul 28 17:34:19.912613 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.912592    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 17:34:19.913911 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.913886    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 17:34:19.914030 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.913932    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 17:34:19.914030 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.913955    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 17:34:19.914030 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.913996    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 17:34:19.916461 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.916445    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:34:19.918451 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:19.918434    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-195.ec2.internal"
Jul 28 17:34:19.918526 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.918458    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-195.ec2.internal\": node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:19.962664 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:19.962616    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.014264 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.014243    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal"]
Jul 28 17:34:20.014321 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.014298    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:34:20.015631 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.015615    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:34:20.015716 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.015646    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:34:20.015716 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.015660    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:34:20.017247 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.017232    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:34:20.017357 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.017343    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.017404 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.017379    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:34:20.017900 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.017876    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:34:20.017900 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.017889    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:34:20.017900 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.017901    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:34:20.018033 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.017913    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:34:20.018033 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.017915    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:34:20.018033 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.017926    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:34:20.019293 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.019275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.019387 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.019299    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:34:20.019931 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.019917    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:34:20.020017 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.019945    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:34:20.020017 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.019959    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:34:20.038753 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.038727    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-195.ec2.internal\" not found" node="ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.043356 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.043337    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-195.ec2.internal\" not found" node="ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.050906 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.050889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0881bcea08f6b0adf41cdc8568d9ec46-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal\" (UID: \"0881bcea08f6b0adf41cdc8568d9ec46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.050963 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.050918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0881bcea08f6b0adf41cdc8568d9ec46-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal\" (UID: \"0881bcea08f6b0adf41cdc8568d9ec46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.050963 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.050936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49081ef257dd473af8f28ab50c3a3bc9-config\") pod \"kube-apiserver-proxy-ip-10-0-142-195.ec2.internal\" (UID: \"49081ef257dd473af8f28ab50c3a3bc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.063809 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.063789    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.151657 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.151636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0881bcea08f6b0adf41cdc8568d9ec46-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal\" (UID: \"0881bcea08f6b0adf41cdc8568d9ec46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.151709 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.151603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0881bcea08f6b0adf41cdc8568d9ec46-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal\" (UID: \"0881bcea08f6b0adf41cdc8568d9ec46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.151709 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.151688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0881bcea08f6b0adf41cdc8568d9ec46-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal\" (UID: \"0881bcea08f6b0adf41cdc8568d9ec46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.151709 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.151706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49081ef257dd473af8f28ab50c3a3bc9-config\") pod \"kube-apiserver-proxy-ip-10-0-142-195.ec2.internal\" (UID: \"49081ef257dd473af8f28ab50c3a3bc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.151805 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.151743    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49081ef257dd473af8f28ab50c3a3bc9-config\") pod \"kube-apiserver-proxy-ip-10-0-142-195.ec2.internal\" (UID: \"49081ef257dd473af8f28ab50c3a3bc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.151805 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.151764    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0881bcea08f6b0adf41cdc8568d9ec46-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal\" (UID: \"0881bcea08f6b0adf41cdc8568d9ec46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.164684 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.164660    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.264874 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.264852    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.347355 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.347328    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.347466 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.347332    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:20.365069 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.365046    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.466012 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.465992    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.566108 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.566041    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.575387 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.575368    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:34:20.666414 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.666388    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.697658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.697616    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 17:34:20.698067 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.697761    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 17:34:20.698067 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.697798    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 17:34:20.753030 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.753004    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:34:20.767366 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.767340    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.803742 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.803709    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:29:20 +0000 UTC" deadline="2028-03-28 13:24:45.727214766 +0000 UTC"
Jul 28 17:34:20.803742 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.803739    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14611h50m24.923478292s"
Jul 28 17:34:20.867650 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.867627    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.912906 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:20.912881    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49081ef257dd473af8f28ab50c3a3bc9.slice/crio-8c2cf0df2bd42cc26321cb8bdce1c6450e6cfbe16285ef9798110c2bb38c9ed3 WatchSource:0}: Error finding container 8c2cf0df2bd42cc26321cb8bdce1c6450e6cfbe16285ef9798110c2bb38c9ed3: Status 404 returned error can't find the container with id 8c2cf0df2bd42cc26321cb8bdce1c6450e6cfbe16285ef9798110c2bb38c9ed3
Jul 28 17:34:20.919544 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.919524    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:34:20.953437 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.953415    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:34:20.954393 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.954369    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:34:20.954470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.954399    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:34:20.954470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:20.954421    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:34:20.968242 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:20.968217    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:20.987704 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:20.987684    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0881bcea08f6b0adf41cdc8568d9ec46.slice/crio-a2a11b8db64d1bc0c2bd6e1fd90f0d375ce4e24792c0bfc4bb74caca7d26c928 WatchSource:0}: Error finding container a2a11b8db64d1bc0c2bd6e1fd90f0d375ce4e24792c0bfc4bb74caca7d26c928: Status 404 returned error can't find the container with id a2a11b8db64d1bc0c2bd6e1fd90f0d375ce4e24792c0bfc4bb74caca7d26c928
Jul 28 17:34:21.068729 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.068701    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:21.169128 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.169050    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-195.ec2.internal\" not found"
Jul 28 17:34:21.183522 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.183504    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:34:21.248454 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.248427    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:21.264451 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.264432    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 17:34:21.265703 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.265687    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal"
Jul 28 17:34:21.275881 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.275856    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 17:34:21.685002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.684976    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:34:21.729728 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.729706    2561 apiserver.go:52] "Watching apiserver"
Jul 28 17:34:21.738588 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.738446    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 17:34:21.740962 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.740931    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-fp84n","kube-system/global-pull-secret-syncer-2fb74","kube-system/konnectivity-agent-m5fxb","kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm","openshift-multus/multus-7r7k5","openshift-ovn-kubernetes/ovnkube-node-67cwv","openshift-cluster-node-tuning-operator/tuned-58lq6","openshift-dns/node-resolver-2m9zc","openshift-image-registry/node-ca-k58z5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal","openshift-multus/multus-additional-cni-plugins-9stv7","openshift-multus/network-metrics-daemon-8kbgj","openshift-network-diagnostics/network-check-target-gjhzc"]
Jul 28 17:34:21.742465 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.742435    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.744753 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.744717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:21.744846 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.744786    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:21.746362 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.746335    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 17:34:21.746465 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.746402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.746528 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.746471    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 17:34:21.747498 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.746324    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4gtmw\""
Jul 28 17:34:21.747498 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.746947    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 17:34:21.747498 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.747385    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 17:34:21.748952 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.748571    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 17:34:21.749844 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.749825    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sn5x6\""
Jul 28 17:34:21.749963 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.749831    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 17:34:21.750557 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.750037    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 17:34:21.750709 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.750691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:21.753797 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.753775    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 17:34:21.753896 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.753831    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-88zs2\""
Jul 28 17:34:21.754138 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.754112    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:21.754227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.754191    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 17:34:21.755897 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.755873    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.756807 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.756784    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 17:34:21.756945 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.756787    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 17:34:21.757465 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.757443    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jdtlk\""
Jul 28 17:34:21.757703 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.757675    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 17:34:21.758408 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.758389    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 17:34:21.758752 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.758733    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 17:34:21.758832 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.758757    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2qcbp\""
Jul 28 17:34:21.758887 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.758838    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 17:34:21.760313 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760290    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-cnibin\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.760393 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-socket-dir-parent\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.760393 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-hostroot\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.760500 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aea57872-e0ce-4d85-acd5-93fa27993d87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.760500 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-var-lib-cni-bin\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.760605 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-var-lib-kubelet\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.760605 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.760605 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea57872-e0ce-4d85-acd5-93fa27993d87-cni-binary-copy\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.760605 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-system-cni-dir\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.760605 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-cni-dir\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.760863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-cni-binary-copy\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.760863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2bbz\" (UniqueName: \"kubernetes.io/projected/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-kube-api-access-d2bbz\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:21.760863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zzfb\" (UniqueName: \"kubernetes.io/projected/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-kube-api-access-9zzfb\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.760863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-os-release\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.760863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b94a8c0-d42f-47a0-b67c-7fde407b12ac-tmp-dir\") pod \"node-resolver-2m9zc\" (UID: \"1b94a8c0-d42f-47a0-b67c-7fde407b12ac\") " pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:21.760863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760803    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-conf-dir\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.760863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-system-cni-dir\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.760863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b94a8c0-d42f-47a0-b67c-7fde407b12ac-hosts-file\") pod \"node-resolver-2m9zc\" (UID: \"1b94a8c0-d42f-47a0-b67c-7fde407b12ac\") " pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-cnibin\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.760981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-os-release\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.761007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-var-lib-cni-multus\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.761052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-run-multus-certs\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.761092    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.761141    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aea57872-e0ce-4d85-acd5-93fa27993d87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.761172    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtznc\" (UniqueName: \"kubernetes.io/projected/aea57872-e0ce-4d85-acd5-93fa27993d87-kube-api-access-vtznc\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.761213    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-run-k8s-cni-cncf-io\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.761263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-run-netns\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.761289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-daemon-config\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.761312    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-etc-kubernetes\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.761361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.761338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl5gb\" (UniqueName: \"kubernetes.io/projected/1b94a8c0-d42f-47a0-b67c-7fde407b12ac-kube-api-access-jl5gb\") pod \"node-resolver-2m9zc\" (UID: \"1b94a8c0-d42f-47a0-b67c-7fde407b12ac\") " pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:21.762387 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.762364    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.763673 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.763652    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 17:34:21.763774 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.763724    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fwsnf\""
Jul 28 17:34:21.763881 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.763864    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 17:34:21.763940 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.763921    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 17:34:21.764090 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.764074    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 17:34:21.764149 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.764135    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 17:34:21.764314 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.764282    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:21.764732 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.764703    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 17:34:21.764846 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.764827    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:34:21.765240 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.765213    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:21.765488 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.765471    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nzlx8\""
Jul 28 17:34:21.765764 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.765744    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 17:34:21.767770 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.766946    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:21.767770 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.767031    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:21.767770 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.767442    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5hpl6\""
Jul 28 17:34:21.767770 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.767569    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 17:34:21.767770 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.767709    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:34:21.768071 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.767946    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 17:34:21.768071 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.767980    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 17:34:21.768755 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.768737    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 17:34:21.768854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.768835    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xvgnl\""
Jul 28 17:34:21.768955 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.768843    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 17:34:21.769054 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.769038    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:21.769126 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.769096    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:21.791395 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.791377    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tzh2t"
Jul 28 17:34:21.800604 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.800586    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tzh2t"
Jul 28 17:34:21.849755 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.849730    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 17:34:21.861834 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.861808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-tuned\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.861935 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.861852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b94a8c0-d42f-47a0-b67c-7fde407b12ac-hosts-file\") pod \"node-resolver-2m9zc\" (UID: \"1b94a8c0-d42f-47a0-b67c-7fde407b12ac\") " pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:21.861935 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.861881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-ovnkube-config\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.862058 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.861930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-sysconfig\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.862058 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.861959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b94a8c0-d42f-47a0-b67c-7fde407b12ac-hosts-file\") pod \"node-resolver-2m9zc\" (UID: \"1b94a8c0-d42f-47a0-b67c-7fde407b12ac\") " pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:21.862058 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.861981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl5gb\" (UniqueName: \"kubernetes.io/projected/1b94a8c0-d42f-47a0-b67c-7fde407b12ac-kube-api-access-jl5gb\") pod \"node-resolver-2m9zc\" (UID: \"1b94a8c0-d42f-47a0-b67c-7fde407b12ac\") " pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:21.862292 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862086    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-sys-fs\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.862292 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m98cd\" (UniqueName: \"kubernetes.io/projected/b598e926-ab22-4cd2-a8d0-709f76cfd1e6-kube-api-access-m98cd\") pod \"iptables-alerter-fp84n\" (UID: \"b598e926-ab22-4cd2-a8d0-709f76cfd1e6\") " pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:21.862292 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75e89921-c386-4800-9960-c394f55f715a-agent-certs\") pod \"konnectivity-agent-m5fxb\" (UID: \"75e89921-c386-4800-9960-c394f55f715a\") " pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:21.862292 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-var-lib-openvswitch\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.862292 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862218    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-cnibin\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.862292 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:21.862292 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aea57872-e0ce-4d85-acd5-93fa27993d87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-run-k8s-cni-cncf-io\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-cnibin\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-daemon-config\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862400    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-etc-kubernetes\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-device-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-systemd-units\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-slash\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtznc\" (UniqueName: \"kubernetes.io/projected/aea57872-e0ce-4d85-acd5-93fa27993d87-kube-api-access-vtznc\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-systemd\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-cnibin\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-hostroot\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c71f9d00-2131-426f-9461-555c7f32b213-serviceca\") pod \"node-ca-k58z5\" (UID: \"c71f9d00-2131-426f-9461-555c7f32b213\") " pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:21.862643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-run-ovn-kubernetes\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-ovnkube-script-lib\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-host\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-var-lib-cni-bin\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-var-lib-kubelet\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea57872-e0ce-4d85-acd5-93fa27993d87-cni-binary-copy\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-run-systemd\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862810    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-cni-bin\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e15129dd-6899-49b9-a8b0-821b4f6ad555-tmp\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-dbus\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkmk8\" (UniqueName: \"kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8\") pod \"network-check-target-gjhzc\" (UID: \"37ea1a6f-03d0-4d5c-83ac-650dc64dc493\") " pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-cni-dir\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-daemon-config\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-cni-binary-copy\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl5pl\" (UniqueName: \"kubernetes.io/projected/c71f9d00-2131-426f-9461-555c7f32b213-kube-api-access-nl5pl\") pod \"node-ca-k58z5\" (UID: \"c71f9d00-2131-426f-9461-555c7f32b213\") " pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.862994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-cni-netd\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-run-netns\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.863324 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.863040    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863042    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-var-lib-kubelet\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lx4g\" (UniqueName: \"kubernetes.io/projected/e15129dd-6899-49b9-a8b0-821b4f6ad555-kube-api-access-2lx4g\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-os-release\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.863110    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs podName:ef8b54a7-67f6-4c25-bbab-a0623ea4ca12 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:22.363090091 +0000 UTC m=+2.963686920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs") pod "network-metrics-daemon-8kbgj" (UID: "ef8b54a7-67f6-4c25-bbab-a0623ea4ca12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-ovn-node-metrics-cert\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-lib-modules\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863184    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-os-release\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863213    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-conf-dir\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-etc-kubernetes\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-system-cni-dir\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863288    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-system-cni-dir\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863554    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-cnibin\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863607    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-hostroot\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-var-lib-cni-bin\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863776    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-var-lib-kubelet\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.863836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863830    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aea57872-e0ce-4d85-acd5-93fa27993d87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.863885    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-run-k8s-cni-cncf-io\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864111    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-conf-dir\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864147    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-log-socket\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-env-overrides\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-kubelet-config\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea57872-e0ce-4d85-acd5-93fa27993d87-cni-binary-copy\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b598e926-ab22-4cd2-a8d0-709f76cfd1e6-iptables-alerter-script\") pod \"iptables-alerter-fp84n\" (UID: \"b598e926-ab22-4cd2-a8d0-709f76cfd1e6\") " pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75e89921-c386-4800-9960-c394f55f715a-konnectivity-ca\") pod \"konnectivity-agent-m5fxb\" (UID: \"75e89921-c386-4800-9960-c394f55f715a\") " pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864398    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-cni-dir\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.864470 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-os-release\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-var-lib-cni-multus\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-run-multus-certs\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-run\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864610    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea57872-e0ce-4d85-acd5-93fa27993d87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864578    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-os-release\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864612    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-run-netns\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-run-netns\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864665    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-run-multus-certs\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864666    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wz7x\" (UniqueName: \"kubernetes.io/projected/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-kube-api-access-8wz7x\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-host-var-lib-cni-multus\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864703    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-kubernetes\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864757    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-sysctl-d\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-sysctl-conf\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864795    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-cni-binary-copy\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-sys\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.865108 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-socket-dir-parent\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aea57872-e0ce-4d85-acd5-93fa27993d87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864912    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-multus-socket-dir-parent\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-registration-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-run-openvswitch\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.864988    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865013    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-socket-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c71f9d00-2131-426f-9461-555c7f32b213-host\") pod \"node-ca-k58z5\" (UID: \"c71f9d00-2131-426f-9461-555c7f32b213\") " pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865063    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlw5c\" (UniqueName: \"kubernetes.io/projected/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-kube-api-access-dlw5c\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-system-cni-dir\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bbz\" (UniqueName: \"kubernetes.io/projected/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-kube-api-access-d2bbz\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-system-cni-dir\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-kubelet\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-run-ovn\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-modprobe-d\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b598e926-ab22-4cd2-a8d0-709f76cfd1e6-host-slash\") pod \"iptables-alerter-fp84n\" (UID: \"b598e926-ab22-4cd2-a8d0-709f76cfd1e6\") " pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:21.865819 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865314    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aea57872-e0ce-4d85-acd5-93fa27993d87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.866603 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-etc-openvswitch\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.866603 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865365    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-node-log\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.866603 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zzfb\" (UniqueName: \"kubernetes.io/projected/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-kube-api-access-9zzfb\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.866603 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b94a8c0-d42f-47a0-b67c-7fde407b12ac-tmp-dir\") pod \"node-resolver-2m9zc\" (UID: \"1b94a8c0-d42f-47a0-b67c-7fde407b12ac\") " pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:21.866603 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.865787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b94a8c0-d42f-47a0-b67c-7fde407b12ac-tmp-dir\") pod \"node-resolver-2m9zc\" (UID: \"1b94a8c0-d42f-47a0-b67c-7fde407b12ac\") " pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:21.871094 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.871069    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 17:34:21.875699 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.875198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl5gb\" (UniqueName: \"kubernetes.io/projected/1b94a8c0-d42f-47a0-b67c-7fde407b12ac-kube-api-access-jl5gb\") pod \"node-resolver-2m9zc\" (UID: \"1b94a8c0-d42f-47a0-b67c-7fde407b12ac\") " pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:21.875699 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.875208    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2bbz\" (UniqueName: \"kubernetes.io/projected/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-kube-api-access-d2bbz\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:21.875699 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.875493    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zzfb\" (UniqueName: \"kubernetes.io/projected/e77521fc-2cce-4674-9a4e-6e9c56dbf97d-kube-api-access-9zzfb\") pod \"multus-7r7k5\" (UID: \"e77521fc-2cce-4674-9a4e-6e9c56dbf97d\") " pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:21.876221 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.876198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtznc\" (UniqueName: \"kubernetes.io/projected/aea57872-e0ce-4d85-acd5-93fa27993d87-kube-api-access-vtznc\") pod \"multus-additional-cni-plugins-9stv7\" (UID: \"aea57872-e0ce-4d85-acd5-93fa27993d87\") " pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:21.920545 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.920500    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal" event={"ID":"0881bcea08f6b0adf41cdc8568d9ec46","Type":"ContainerStarted","Data":"a2a11b8db64d1bc0c2bd6e1fd90f0d375ce4e24792c0bfc4bb74caca7d26c928"}
Jul 28 17:34:21.923000 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.922944    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal" event={"ID":"49081ef257dd473af8f28ab50c3a3bc9","Type":"ContainerStarted","Data":"8c2cf0df2bd42cc26321cb8bdce1c6450e6cfbe16285ef9798110c2bb38c9ed3"}
Jul 28 17:34:21.966441 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.966441 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966411    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-log-socket\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.966441 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-env-overrides\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.966658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-kubelet-config\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:21.966658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.966658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b598e926-ab22-4cd2-a8d0-709f76cfd1e6-iptables-alerter-script\") pod \"iptables-alerter-fp84n\" (UID: \"b598e926-ab22-4cd2-a8d0-709f76cfd1e6\") " pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:21.966658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75e89921-c386-4800-9960-c394f55f715a-konnectivity-ca\") pod \"konnectivity-agent-m5fxb\" (UID: \"75e89921-c386-4800-9960-c394f55f715a\") " pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:21.966658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966536    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.966658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966543    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-run\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.966658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966580    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-run\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.966658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wz7x\" (UniqueName: \"kubernetes.io/projected/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-kube-api-access-8wz7x\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.966658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-log-socket\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.966658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-kubernetes\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-sysctl-d\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-sysctl-conf\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-sys\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-registration-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966796    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-run-openvswitch\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-socket-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c71f9d00-2131-426f-9461-555c7f32b213-host\") pod \"node-ca-k58z5\" (UID: \"c71f9d00-2131-426f-9461-555c7f32b213\") " pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlw5c\" (UniqueName: \"kubernetes.io/projected/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-kube-api-access-dlw5c\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-kubelet\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.966978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-run-ovn\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-modprobe-d\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b598e926-ab22-4cd2-a8d0-709f76cfd1e6-host-slash\") pod \"iptables-alerter-fp84n\" (UID: \"b598e926-ab22-4cd2-a8d0-709f76cfd1e6\") " pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967049    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967065    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-env-overrides\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.967205 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-etc-openvswitch\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-node-log\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-tuned\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967130    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-kubelet-config\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-ovnkube-config\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-sysconfig\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-sys-fs\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m98cd\" (UniqueName: \"kubernetes.io/projected/b598e926-ab22-4cd2-a8d0-709f76cfd1e6-kube-api-access-m98cd\") pod \"iptables-alerter-fp84n\" (UID: \"b598e926-ab22-4cd2-a8d0-709f76cfd1e6\") " pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75e89921-c386-4800-9960-c394f55f715a-agent-certs\") pod \"konnectivity-agent-m5fxb\" (UID: \"75e89921-c386-4800-9960-c394f55f715a\") " pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c71f9d00-2131-426f-9461-555c7f32b213-host\") pod \"node-ca-k58z5\" (UID: \"c71f9d00-2131-426f-9461-555c7f32b213\") " pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-var-lib-openvswitch\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-device-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-systemd-units\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-slash\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-systemd\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967460    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c71f9d00-2131-426f-9461-555c7f32b213-serviceca\") pod \"node-ca-k58z5\" (UID: \"c71f9d00-2131-426f-9461-555c7f32b213\") " pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967467    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b598e926-ab22-4cd2-a8d0-709f76cfd1e6-iptables-alerter-script\") pod \"iptables-alerter-fp84n\" (UID: \"b598e926-ab22-4cd2-a8d0-709f76cfd1e6\") " pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:21.968151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-run-ovn-kubernetes\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-ovnkube-script-lib\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967541    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-host\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-kubernetes\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-run-systemd\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967607    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-cni-bin\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-sysctl-d\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e15129dd-6899-49b9-a8b0-821b4f6ad555-tmp\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-dbus\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmk8\" (UniqueName: \"kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8\") pod \"network-check-target-gjhzc\" (UID: \"37ea1a6f-03d0-4d5c-83ac-650dc64dc493\") " pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967707    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-sysctl-conf\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl5pl\" (UniqueName: \"kubernetes.io/projected/c71f9d00-2131-426f-9461-555c7f32b213-kube-api-access-nl5pl\") pod \"node-ca-k58z5\" (UID: \"c71f9d00-2131-426f-9461-555c7f32b213\") " pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-sys\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967753    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-cni-netd\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967770    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-registration-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-run-netns\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967794    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-run-openvswitch\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-var-lib-kubelet\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75e89921-c386-4800-9960-c394f55f715a-konnectivity-ca\") pod \"konnectivity-agent-m5fxb\" (UID: \"75e89921-c386-4800-9960-c394f55f715a\") " pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967834    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lx4g\" (UniqueName: \"kubernetes.io/projected/e15129dd-6899-49b9-a8b0-821b4f6ad555-kube-api-access-2lx4g\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.967849    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-ovn-node-metrics-cert\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.967889    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret podName:e90f86d2-419b-4d0e-adf0-ffb6bb39aab4 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:22.467875945 +0000 UTC m=+3.068472758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret") pod "global-pull-secret-syncer-2fb74" (UID: "e90f86d2-419b-4d0e-adf0-ffb6bb39aab4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.967903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-lib-modules\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-lib-modules\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-socket-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968138    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-systemd-units\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b598e926-ab22-4cd2-a8d0-709f76cfd1e6-host-slash\") pod \"iptables-alerter-fp84n\" (UID: \"b598e926-ab22-4cd2-a8d0-709f76cfd1e6\") " pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968249    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-node-log\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968305    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-sysconfig\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968382    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-kubelet\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-sys-fs\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968400    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-run-ovn\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.969901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968420    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-etc-openvswitch\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-slash\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968462    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-systemd\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968477    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-var-lib-openvswitch\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-modprobe-d\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-host\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-device-dir\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-run-systemd\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-run-ovn-kubernetes\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968879    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-ovnkube-config\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-cni-bin\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-run-netns\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.968971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-ovnkube-script-lib\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.969009    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-host-cni-netd\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.969036    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e15129dd-6899-49b9-a8b0-821b4f6ad555-var-lib-kubelet\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.969087    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-dbus\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:21.970854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.969450    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c71f9d00-2131-426f-9461-555c7f32b213-serviceca\") pod \"node-ca-k58z5\" (UID: \"c71f9d00-2131-426f-9461-555c7f32b213\") " pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:21.971686 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.970953    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e15129dd-6899-49b9-a8b0-821b4f6ad555-etc-tuned\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.971818 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.971793    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e15129dd-6899-49b9-a8b0-821b4f6ad555-tmp\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.972847 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.972822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-ovn-node-metrics-cert\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.974878 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.974832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75e89921-c386-4800-9960-c394f55f715a-agent-certs\") pod \"konnectivity-agent-m5fxb\" (UID: \"75e89921-c386-4800-9960-c394f55f715a\") " pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:21.976987 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.976951    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:34:21.977168 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.976993    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:34:21.977168 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.977007    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tkmk8 for pod openshift-network-diagnostics/network-check-target-gjhzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:21.977168 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:21.977069    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8 podName:37ea1a6f-03d0-4d5c-83ac-650dc64dc493 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:22.477052083 +0000 UTC m=+3.077648912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tkmk8" (UniqueName: "kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8") pod "network-check-target-gjhzc" (UID: "37ea1a6f-03d0-4d5c-83ac-650dc64dc493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:21.980652 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.980586    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wz7x\" (UniqueName: \"kubernetes.io/projected/f1e38d26-f5d7-4721-8023-c86e5e4e65f1-kube-api-access-8wz7x\") pod \"aws-ebs-csi-driver-node-gpphm\" (UID: \"f1e38d26-f5d7-4721-8023-c86e5e4e65f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:21.982443 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.982393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlw5c\" (UniqueName: \"kubernetes.io/projected/9d2818ed-b591-41e8-8f44-4b8f0cf3ed44-kube-api-access-dlw5c\") pod \"ovnkube-node-67cwv\" (UID: \"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:21.982697 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.982674    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m98cd\" (UniqueName: \"kubernetes.io/projected/b598e926-ab22-4cd2-a8d0-709f76cfd1e6-kube-api-access-m98cd\") pod \"iptables-alerter-fp84n\" (UID: \"b598e926-ab22-4cd2-a8d0-709f76cfd1e6\") " pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:21.982818 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.982796    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lx4g\" (UniqueName: \"kubernetes.io/projected/e15129dd-6899-49b9-a8b0-821b4f6ad555-kube-api-access-2lx4g\") pod \"tuned-58lq6\" (UID: \"e15129dd-6899-49b9-a8b0-821b4f6ad555\") " pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:21.983592 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:21.983556    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl5pl\" (UniqueName: \"kubernetes.io/projected/c71f9d00-2131-426f-9461-555c7f32b213-kube-api-access-nl5pl\") pod \"node-ca-k58z5\" (UID: \"c71f9d00-2131-426f-9461-555c7f32b213\") " pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:22.057503 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.057367    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7r7k5"
Jul 28 17:34:22.068686 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.068639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9stv7"
Jul 28 17:34:22.079447 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.079418    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2m9zc"
Jul 28 17:34:22.086434 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.086413    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k58z5"
Jul 28 17:34:22.095243 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.095217    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm"
Jul 28 17:34:22.104323 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.104171    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:22.118188 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.118010    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-58lq6"
Jul 28 17:34:22.129800 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.129774    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fp84n"
Jul 28 17:34:22.137530 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.137507    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:22.371893 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.371856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:22.372074 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:22.372000    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:22.372074 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:22.372067    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs podName:ef8b54a7-67f6-4c25-bbab-a0623ea4ca12 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:23.372050187 +0000 UTC m=+3.972647021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs") pod "network-metrics-daemon-8kbgj" (UID: "ef8b54a7-67f6-4c25-bbab-a0623ea4ca12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:22.472293 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.472253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:22.472468 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:22.472412    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:22.472538 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:22.472493    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret podName:e90f86d2-419b-4d0e-adf0-ffb6bb39aab4 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:23.472471522 +0000 UTC m=+4.073068339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret") pod "global-pull-secret-syncer-2fb74" (UID: "e90f86d2-419b-4d0e-adf0-ffb6bb39aab4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:22.573296 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.573259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmk8\" (UniqueName: \"kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8\") pod \"network-check-target-gjhzc\" (UID: \"37ea1a6f-03d0-4d5c-83ac-650dc64dc493\") " pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:22.573443 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:22.573415    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:34:22.573443 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:22.573433    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:34:22.573536 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:22.573446    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tkmk8 for pod openshift-network-diagnostics/network-check-target-gjhzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:22.573536 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:22.573512    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8 podName:37ea1a6f-03d0-4d5c-83ac-650dc64dc493 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:23.573492144 +0000 UTC m=+4.174088977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkmk8" (UniqueName: "kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8") pod "network-check-target-gjhzc" (UID: "37ea1a6f-03d0-4d5c-83ac-650dc64dc493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:22.803735 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.803660    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:29:22 +0000 UTC" deadline="2028-01-20 14:24:22.710807019 +0000 UTC"
Jul 28 17:34:22.803735 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.803723    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12980h49m59.90708776s"
Jul 28 17:34:22.818906 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.818878    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:34:22.914458 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:22.914432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:22.914598 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:22.914550    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:23.105960 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:23.105918    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb598e926_ab22_4cd2_a8d0_709f76cfd1e6.slice/crio-0e0fadad555031b31f98dbe41edc32bfee42000be199fd4df3b81ac8728d8802 WatchSource:0}: Error finding container 0e0fadad555031b31f98dbe41edc32bfee42000be199fd4df3b81ac8728d8802: Status 404 returned error can't find the container with id 0e0fadad555031b31f98dbe41edc32bfee42000be199fd4df3b81ac8728d8802
Jul 28 17:34:23.108243 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:23.108188    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71f9d00_2131_426f_9461_555c7f32b213.slice/crio-df1732f48200bb50adcb1b59118b78e21162f23490ea396d0987286d1f8ddbe5 WatchSource:0}: Error finding container df1732f48200bb50adcb1b59118b78e21162f23490ea396d0987286d1f8ddbe5: Status 404 returned error can't find the container with id df1732f48200bb50adcb1b59118b78e21162f23490ea396d0987286d1f8ddbe5
Jul 28 17:34:23.111364 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:23.111339    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e89921_c386_4800_9960_c394f55f715a.slice/crio-ca9fbe3e052c5d37e1480dc5cfbc5092bdce98cdf49c398a0741aa0f0603a959 WatchSource:0}: Error finding container ca9fbe3e052c5d37e1480dc5cfbc5092bdce98cdf49c398a0741aa0f0603a959: Status 404 returned error can't find the container with id ca9fbe3e052c5d37e1480dc5cfbc5092bdce98cdf49c398a0741aa0f0603a959
Jul 28 17:34:23.113872 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:23.113246    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea57872_e0ce_4d85_acd5_93fa27993d87.slice/crio-1be0b819bff03953c50feaac21a578a82d59d684cbc99998950dca26a0e78c16 WatchSource:0}: Error finding container 1be0b819bff03953c50feaac21a578a82d59d684cbc99998950dca26a0e78c16: Status 404 returned error can't find the container with id 1be0b819bff03953c50feaac21a578a82d59d684cbc99998950dca26a0e78c16
Jul 28 17:34:23.115356 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:23.115333    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2818ed_b591_41e8_8f44_4b8f0cf3ed44.slice/crio-9883683e403b503724266924a3d7bcb2691e796ad99f2b463928d7023666c6cd WatchSource:0}: Error finding container 9883683e403b503724266924a3d7bcb2691e796ad99f2b463928d7023666c6cd: Status 404 returned error can't find the container with id 9883683e403b503724266924a3d7bcb2691e796ad99f2b463928d7023666c6cd
Jul 28 17:34:23.116710 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:23.116635    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b94a8c0_d42f_47a0_b67c_7fde407b12ac.slice/crio-be9380f3e1d4434f34c2dc6631247698b107cc937ee621d297ec918eab417f92 WatchSource:0}: Error finding container be9380f3e1d4434f34c2dc6631247698b107cc937ee621d297ec918eab417f92: Status 404 returned error can't find the container with id be9380f3e1d4434f34c2dc6631247698b107cc937ee621d297ec918eab417f92
Jul 28 17:34:23.117461 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:23.117116    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e38d26_f5d7_4721_8023_c86e5e4e65f1.slice/crio-5b3c821b1aeb84b19a9fcc162e6939e440b56d8dc9e2cb5792ce12d82a686fd8 WatchSource:0}: Error finding container 5b3c821b1aeb84b19a9fcc162e6939e440b56d8dc9e2cb5792ce12d82a686fd8: Status 404 returned error can't find the container with id 5b3c821b1aeb84b19a9fcc162e6939e440b56d8dc9e2cb5792ce12d82a686fd8
Jul 28 17:34:23.118065 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:23.117983    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15129dd_6899_49b9_a8b0_821b4f6ad555.slice/crio-a3270b4ba2930b92d8bfcab096fde871b20aa942252c29541b33f077857cf674 WatchSource:0}: Error finding container a3270b4ba2930b92d8bfcab096fde871b20aa942252c29541b33f077857cf674: Status 404 returned error can't find the container with id a3270b4ba2930b92d8bfcab096fde871b20aa942252c29541b33f077857cf674
Jul 28 17:34:23.119008 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:23.118974    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77521fc_2cce_4674_9a4e_6e9c56dbf97d.slice/crio-effe67bead83b5213f9519b3601324f1212fef6707dced48991df4e1150112c0 WatchSource:0}: Error finding container effe67bead83b5213f9519b3601324f1212fef6707dced48991df4e1150112c0: Status 404 returned error can't find the container with id effe67bead83b5213f9519b3601324f1212fef6707dced48991df4e1150112c0
Jul 28 17:34:23.378874 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.378698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:23.378971 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:23.378852    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:23.378971 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:23.378957    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs podName:ef8b54a7-67f6-4c25-bbab-a0623ea4ca12 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:25.37893966 +0000 UTC m=+5.979536476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs") pod "network-metrics-daemon-8kbgj" (UID: "ef8b54a7-67f6-4c25-bbab-a0623ea4ca12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:23.479572 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.479547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:23.479679 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:23.479667    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:23.479723 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:23.479711    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret podName:e90f86d2-419b-4d0e-adf0-ffb6bb39aab4 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:25.479698929 +0000 UTC m=+6.080295742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret") pod "global-pull-secret-syncer-2fb74" (UID: "e90f86d2-419b-4d0e-adf0-ffb6bb39aab4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:23.594191 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.594109    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmk8\" (UniqueName: \"kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8\") pod \"network-check-target-gjhzc\" (UID: \"37ea1a6f-03d0-4d5c-83ac-650dc64dc493\") " pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:23.594340 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:23.594322    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:34:23.594412 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:23.594349    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:34:23.594412 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:23.594365    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tkmk8 for pod openshift-network-diagnostics/network-check-target-gjhzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:23.594526 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:23.594431    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8 podName:37ea1a6f-03d0-4d5c-83ac-650dc64dc493 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:25.594410882 +0000 UTC m=+6.195007698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkmk8" (UniqueName: "kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8") pod "network-check-target-gjhzc" (UID: "37ea1a6f-03d0-4d5c-83ac-650dc64dc493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:23.804735 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.804669    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:29:22 +0000 UTC" deadline="2028-01-09 13:48:39.015089664 +0000 UTC"
Jul 28 17:34:23.804735 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.804734    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12716h14m15.210359839s"
Jul 28 17:34:23.916934 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.916325    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:23.916934 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:23.916466    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:23.916934 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.916520    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:23.916934 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:23.916656    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:23.945297 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.945267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9stv7" event={"ID":"aea57872-e0ce-4d85-acd5-93fa27993d87","Type":"ContainerStarted","Data":"1be0b819bff03953c50feaac21a578a82d59d684cbc99998950dca26a0e78c16"}
Jul 28 17:34:23.953302 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.953222    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m5fxb" event={"ID":"75e89921-c386-4800-9960-c394f55f715a","Type":"ContainerStarted","Data":"ca9fbe3e052c5d37e1480dc5cfbc5092bdce98cdf49c398a0741aa0f0603a959"}
Jul 28 17:34:23.960655 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.960569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fp84n" event={"ID":"b598e926-ab22-4cd2-a8d0-709f76cfd1e6","Type":"ContainerStarted","Data":"0e0fadad555031b31f98dbe41edc32bfee42000be199fd4df3b81ac8728d8802"}
Jul 28 17:34:23.971251 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.970286    2561 generic.go:356] "Generic (PLEG): container finished" podID="0881bcea08f6b0adf41cdc8568d9ec46" containerID="d82db56dd3bd40bea655ff2400d1552e233f343dc576e9b4caef30e9e343a570" exitCode=0
Jul 28 17:34:23.971251 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.970361    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal" event={"ID":"0881bcea08f6b0adf41cdc8568d9ec46","Type":"ContainerDied","Data":"d82db56dd3bd40bea655ff2400d1552e233f343dc576e9b4caef30e9e343a570"}
Jul 28 17:34:23.981211 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.981155    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv" event={"ID":"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44","Type":"ContainerStarted","Data":"9883683e403b503724266924a3d7bcb2691e796ad99f2b463928d7023666c6cd"}
Jul 28 17:34:23.999910 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:23.999831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k58z5" event={"ID":"c71f9d00-2131-426f-9461-555c7f32b213","Type":"ContainerStarted","Data":"df1732f48200bb50adcb1b59118b78e21162f23490ea396d0987286d1f8ddbe5"}
Jul 28 17:34:24.027658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:24.027255    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal" event={"ID":"49081ef257dd473af8f28ab50c3a3bc9","Type":"ContainerStarted","Data":"5f32171f935a1cff0e74481683ea690599404a286836bc458c1e2c7a6cbf0d0b"}
Jul 28 17:34:24.031992 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:24.031966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7r7k5" event={"ID":"e77521fc-2cce-4674-9a4e-6e9c56dbf97d","Type":"ContainerStarted","Data":"effe67bead83b5213f9519b3601324f1212fef6707dced48991df4e1150112c0"}
Jul 28 17:34:24.056747 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:24.056678    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-58lq6" event={"ID":"e15129dd-6899-49b9-a8b0-821b4f6ad555","Type":"ContainerStarted","Data":"a3270b4ba2930b92d8bfcab096fde871b20aa942252c29541b33f077857cf674"}
Jul 28 17:34:24.067927 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:24.067901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm" event={"ID":"f1e38d26-f5d7-4721-8023-c86e5e4e65f1","Type":"ContainerStarted","Data":"5b3c821b1aeb84b19a9fcc162e6939e440b56d8dc9e2cb5792ce12d82a686fd8"}
Jul 28 17:34:24.072513 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:24.072459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2m9zc" event={"ID":"1b94a8c0-d42f-47a0-b67c-7fde407b12ac","Type":"ContainerStarted","Data":"be9380f3e1d4434f34c2dc6631247698b107cc937ee621d297ec918eab417f92"}
Jul 28 17:34:24.914961 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:24.914927    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:24.915482 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:24.915073    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:25.087444 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:25.087410    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal" event={"ID":"0881bcea08f6b0adf41cdc8568d9ec46","Type":"ContainerStarted","Data":"aa14f1de173699b22a96f6a9a700fa1385d870ce04de20c5a0d5d449bc1f7b44"}
Jul 28 17:34:25.106854 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:25.106277    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-195.ec2.internal" podStartSLOduration=3.10625643 podStartE2EDuration="3.10625643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:24.062670101 +0000 UTC m=+4.663266940" watchObservedRunningTime="2026-07-28 17:34:25.10625643 +0000 UTC m=+5.706853272"
Jul 28 17:34:25.408451 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:25.408406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:25.408638 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:25.408590    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:25.408708 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:25.408652    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs podName:ef8b54a7-67f6-4c25-bbab-a0623ea4ca12 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:29.408630924 +0000 UTC m=+10.009227746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs") pod "network-metrics-daemon-8kbgj" (UID: "ef8b54a7-67f6-4c25-bbab-a0623ea4ca12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:25.509366 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:25.509331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:25.509540 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:25.509468    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:25.509540 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:25.509530    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret podName:e90f86d2-419b-4d0e-adf0-ffb6bb39aab4 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:29.509510727 +0000 UTC m=+10.110107542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret") pod "global-pull-secret-syncer-2fb74" (UID: "e90f86d2-419b-4d0e-adf0-ffb6bb39aab4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:25.609812 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:25.609772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmk8\" (UniqueName: \"kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8\") pod \"network-check-target-gjhzc\" (UID: \"37ea1a6f-03d0-4d5c-83ac-650dc64dc493\") " pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:25.611137 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:25.609999    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:34:25.611137 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:25.610024    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:34:25.611137 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:25.610039    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tkmk8 for pod openshift-network-diagnostics/network-check-target-gjhzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:25.611137 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:25.610115    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8 podName:37ea1a6f-03d0-4d5c-83ac-650dc64dc493 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:29.610093788 +0000 UTC m=+10.210690622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkmk8" (UniqueName: "kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8") pod "network-check-target-gjhzc" (UID: "37ea1a6f-03d0-4d5c-83ac-650dc64dc493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:25.917672 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:25.916929    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:25.917672 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:25.917071    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:25.917672 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:25.917139    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:25.917672 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:25.917235    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:26.914799 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:26.914750    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:26.914992 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:26.914907    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:27.914778 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:27.914749    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:27.915236 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:27.914883    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:27.915236 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:27.914702    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:27.915364 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:27.915341    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:28.915081 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:28.914538    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:28.915081 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:28.914703    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:29.444244 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:29.444199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:29.444452 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:29.444426    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:29.444520 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:29.444507    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs podName:ef8b54a7-67f6-4c25-bbab-a0623ea4ca12 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:37.444483801 +0000 UTC m=+18.045080635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs") pod "network-metrics-daemon-8kbgj" (UID: "ef8b54a7-67f6-4c25-bbab-a0623ea4ca12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:29.545080 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:29.545042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:29.545280 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:29.545260    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:29.545355 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:29.545328    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret podName:e90f86d2-419b-4d0e-adf0-ffb6bb39aab4 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:37.545308095 +0000 UTC m=+18.145904933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret") pod "global-pull-secret-syncer-2fb74" (UID: "e90f86d2-419b-4d0e-adf0-ffb6bb39aab4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:29.646235 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:29.646191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmk8\" (UniqueName: \"kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8\") pod \"network-check-target-gjhzc\" (UID: \"37ea1a6f-03d0-4d5c-83ac-650dc64dc493\") " pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:29.646416 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:29.646362    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:34:29.646416 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:29.646383    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:34:29.646416 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:29.646397    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tkmk8 for pod openshift-network-diagnostics/network-check-target-gjhzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:29.646603 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:29.646469    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8 podName:37ea1a6f-03d0-4d5c-83ac-650dc64dc493 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:37.646449548 +0000 UTC m=+18.247046380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkmk8" (UniqueName: "kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8") pod "network-check-target-gjhzc" (UID: "37ea1a6f-03d0-4d5c-83ac-650dc64dc493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:29.917432 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:29.917393    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:29.917957 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:29.917539    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:29.918024 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:29.917992    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:29.918140 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:29.918117    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:30.915203 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:30.915167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:30.915387 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:30.915328    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:31.915977 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:31.915240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:31.915977 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:31.915380    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:31.915977 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:31.915828    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:31.915977 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:31.915926    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:32.914332 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:32.914298    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:32.914513 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:32.914446    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:33.915220 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:33.915186    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:33.915710 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:33.915201    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:33.915710 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:33.915335    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:33.915710 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:33.915373    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:34.914875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:34.914850    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:34.914963 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:34.914944    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:35.914487 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:35.914454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:35.914880 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:35.914592    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:35.914880 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:35.914627    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:35.914880 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:35.914746    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:36.914963 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:36.914931    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:36.915486 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:36.915073    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:37.508663 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:37.508625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:37.508904 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:37.508794    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:37.508904 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:37.508861    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs podName:ef8b54a7-67f6-4c25-bbab-a0623ea4ca12 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:53.508843467 +0000 UTC m=+34.109440282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs") pod "network-metrics-daemon-8kbgj" (UID: "ef8b54a7-67f6-4c25-bbab-a0623ea4ca12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:37.608960 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:37.608927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:37.609161 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:37.609039    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:37.609161 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:37.609087    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret podName:e90f86d2-419b-4d0e-adf0-ffb6bb39aab4 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:53.609074781 +0000 UTC m=+34.209671591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret") pod "global-pull-secret-syncer-2fb74" (UID: "e90f86d2-419b-4d0e-adf0-ffb6bb39aab4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:37.710148 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:37.710115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmk8\" (UniqueName: \"kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8\") pod \"network-check-target-gjhzc\" (UID: \"37ea1a6f-03d0-4d5c-83ac-650dc64dc493\") " pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:37.710309 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:37.710279    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:34:37.710309 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:37.710304    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:34:37.710427 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:37.710318    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tkmk8 for pod openshift-network-diagnostics/network-check-target-gjhzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:37.710427 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:37.710375    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8 podName:37ea1a6f-03d0-4d5c-83ac-650dc64dc493 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:53.710361158 +0000 UTC m=+34.310957969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkmk8" (UniqueName: "kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8") pod "network-check-target-gjhzc" (UID: "37ea1a6f-03d0-4d5c-83ac-650dc64dc493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:37.914568 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:37.914492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:37.914717 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:37.914627    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:37.914717 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:37.914677    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:37.914832 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:37.914804    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:38.915157 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:38.915123    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:38.915588 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:38.915263    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:39.915813 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:39.915778    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:39.915813 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:39.915809    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:39.916281 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:39.915899    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:39.916281 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:39.916012    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:40.915015 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:40.914986    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:40.915193 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:40.915104    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:41.914397 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:41.914367    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:41.914774 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:41.914474    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:41.914774 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:41.914541    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:41.914774 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:41.914624    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:42.914525 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:42.914230    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:42.915315 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:42.914626    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:43.125392 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.125363    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv" event={"ID":"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44","Type":"ContainerStarted","Data":"70ac90d4a95cc1c5c9577af84b9bc287bd70d5eebebc0e929a902e54ecf5326d"}
Jul 28 17:34:43.125499 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.125456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv" event={"ID":"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44","Type":"ContainerStarted","Data":"beaa41e3c19959a738575d0f545fe979302c8c9c6d5893dab744a07da21b3830"}
Jul 28 17:34:43.125570 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.125522    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv" event={"ID":"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44","Type":"ContainerStarted","Data":"5760b0d6c04a23e85d3d9f09aed14f5107e29190cc7d4ee366884c8844ed4d9f"}
Jul 28 17:34:43.125625 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.125575    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv" event={"ID":"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44","Type":"ContainerStarted","Data":"0858dc318b9c951274177d3f8bd26d7256b73dc462f94aabe03d56f9fb072b86"}
Jul 28 17:34:43.125679 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.125628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv" event={"ID":"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44","Type":"ContainerStarted","Data":"ed518bb74f22334e39060d7eb55377b76d870c739aa1a57c55890adc8ab1e3a9"}
Jul 28 17:34:43.126882 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.126860    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k58z5" event={"ID":"c71f9d00-2131-426f-9461-555c7f32b213","Type":"ContainerStarted","Data":"69af7b30c1cecb6b8e4a31eea123d4b07963ecd5911bff9103f8b76e91f14a90"}
Jul 28 17:34:43.128358 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.128338    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7r7k5" event={"ID":"e77521fc-2cce-4674-9a4e-6e9c56dbf97d","Type":"ContainerStarted","Data":"a3c68e36bc70e7a0992c2f43a3f476beab72d3bc578ac204f99ee86a9e0b6908"}
Jul 28 17:34:43.129723 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.129700    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-58lq6" event={"ID":"e15129dd-6899-49b9-a8b0-821b4f6ad555","Type":"ContainerStarted","Data":"4a6da6fb9979f27edaada307c7df1523d037e8f7e1f8277d1a541f2ef1966558"}
Jul 28 17:34:43.130995 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.130978    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm" event={"ID":"f1e38d26-f5d7-4721-8023-c86e5e4e65f1","Type":"ContainerStarted","Data":"c92840c819d4b0fcff941c4ad8e1282659eb2b8200c9fdfa6c095a9c2fa8b96a"}
Jul 28 17:34:43.132136 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.132120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2m9zc" event={"ID":"1b94a8c0-d42f-47a0-b67c-7fde407b12ac","Type":"ContainerStarted","Data":"49d717a42a8b5e877c2022b5b76a98d2d2a9c78f336b5d855959c869a13fe839"}
Jul 28 17:34:43.133417 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.133395    2561 generic.go:356] "Generic (PLEG): container finished" podID="aea57872-e0ce-4d85-acd5-93fa27993d87" containerID="729a8bbb3f11ef7247f3aa3018857c05bda07822a066b4df8dd7a158b47bcc5b" exitCode=0
Jul 28 17:34:43.133494 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.133459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9stv7" event={"ID":"aea57872-e0ce-4d85-acd5-93fa27993d87","Type":"ContainerDied","Data":"729a8bbb3f11ef7247f3aa3018857c05bda07822a066b4df8dd7a158b47bcc5b"}
Jul 28 17:34:43.134865 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.134839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m5fxb" event={"ID":"75e89921-c386-4800-9960-c394f55f715a","Type":"ContainerStarted","Data":"c0a0b8848efa484918e67eb67dca71bea9f618a751bea3e65c4f2f7dbf9af257"}
Jul 28 17:34:43.149021 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.148985    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k58z5" podStartSLOduration=2.726332351 podStartE2EDuration="22.148971737s" totalImagesPullingTime="19.422639386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:43.148765898 +0000 UTC m=+23.749362734" watchObservedRunningTime="2026-07-28 17:34:43.148971737 +0000 UTC m=+23.749568570"
Jul 28 17:34:43.149141 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.149053    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-195.ec2.internal" podStartSLOduration=21.149045686 podStartE2EDuration="21.149045686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:25.105860411 +0000 UTC m=+5.706457248" watchObservedRunningTime="2026-07-28 17:34:43.149045686 +0000 UTC m=+23.749642518"
Jul 28 17:34:43.190175 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.190071    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-58lq6" podStartSLOduration=2.780620339 podStartE2EDuration="22.190058725s" totalImagesPullingTime="19.409438386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:43.189570459 +0000 UTC m=+23.790167293" watchObservedRunningTime="2026-07-28 17:34:43.190058725 +0000 UTC m=+23.790655557"
Jul 28 17:34:43.210636 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.210596    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m5fxb" podStartSLOduration=2.798741553 podStartE2EDuration="22.210584114s" totalImagesPullingTime="19.411842561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:43.210074445 +0000 UTC m=+23.810671269" watchObservedRunningTime="2026-07-28 17:34:43.210584114 +0000 UTC m=+23.811180947"
Jul 28 17:34:43.231757 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.231711    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7r7k5" podStartSLOduration=3.771825506 podStartE2EDuration="23.231699303s" totalImagesPullingTime="19.459873797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:43.231352762 +0000 UTC m=+23.831949598" watchObservedRunningTime="2026-07-28 17:34:43.231699303 +0000 UTC m=+23.832296135"
Jul 28 17:34:43.252513 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.252458    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2m9zc" podStartSLOduration=3.832715706 podStartE2EDuration="23.252444534s" totalImagesPullingTime="19.419728828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:43.252314261 +0000 UTC m=+23.852911095" watchObservedRunningTime="2026-07-28 17:34:43.252444534 +0000 UTC m=+23.853041367"
Jul 28 17:34:43.914593 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.914566    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:43.915011 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.914686    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:43.915011 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:43.914796    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:43.915011 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:43.914688    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:43.988646 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:43.988622    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 17:34:44.139114 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:44.139030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm" event={"ID":"f1e38d26-f5d7-4721-8023-c86e5e4e65f1","Type":"ContainerStarted","Data":"449397d38f33c67085b99013f8c8d8b57b1c174ccda418be34e3212da4bf5fc4"}
Jul 28 17:34:44.140589 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:44.140559    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fp84n" event={"ID":"b598e926-ab22-4cd2-a8d0-709f76cfd1e6","Type":"ContainerStarted","Data":"d4218586eb2bbc7197114a81fa0b870cafb8bdf6ce7adaca4e8c2aee56619d4d"}
Jul 28 17:34:44.143962 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:44.143939    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv" event={"ID":"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44","Type":"ContainerStarted","Data":"fe1054825f5c3e9c399fd6ff672b1b4a103d9623a2d537d3f5d7d56451c9e2f6"}
Jul 28 17:34:44.158266 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:44.158228    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fp84n" podStartSLOduration=3.739254719 podStartE2EDuration="23.158215936s" totalImagesPullingTime="19.418961217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:44.157912085 +0000 UTC m=+24.758508918" watchObservedRunningTime="2026-07-28 17:34:44.158215936 +0000 UTC m=+24.758812768"
Jul 28 17:34:44.821073 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:44.820965    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T17:34:43.988642587Z","UUID":"058e2d52-d4bb-427a-ac8d-e6bbaae4e337","Handler":null,"Name":"","Endpoint":""}
Jul 28 17:34:44.822568 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:44.822540    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 17:34:44.822685 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:44.822581    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 17:34:44.914335 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:44.914298    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:44.914471 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:44.914426    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:45.914245 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:45.914184    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:45.914625 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:45.914310    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:45.914625 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:45.914368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:45.914625 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:45.914480    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:46.163285 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:46.163046    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv" event={"ID":"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44","Type":"ContainerStarted","Data":"c781bb60c36e731b6fc1d5e10ad41ea1273cbea60f12eda541cef7881bd5d277"}
Jul 28 17:34:46.165389 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:46.165314    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm" event={"ID":"f1e38d26-f5d7-4721-8023-c86e5e4e65f1","Type":"ContainerStarted","Data":"2ba6664e9e710fde398f1e161bcb3262aa20be1a4843128791dded6a80a37688"}
Jul 28 17:34:46.188197 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:46.188154    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpphm" podStartSLOduration=2.981891742 podStartE2EDuration="25.188138803s" totalImagesPullingTime="22.206247061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:46.187605186 +0000 UTC m=+26.788202020" watchObservedRunningTime="2026-07-28 17:34:46.188138803 +0000 UTC m=+26.788735636"
Jul 28 17:34:46.914379 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:46.914348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:46.914783 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:46.914497    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:47.898399 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:47.898233    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:47.898710 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:47.898694    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:47.914893 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:47.914869    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:47.915588 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:47.914909    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:47.915588 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:47.914946    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:47.915588 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:47.915032    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:48.174279 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.174250    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv" event={"ID":"9d2818ed-b591-41e8-8f44-4b8f0cf3ed44","Type":"ContainerStarted","Data":"eb76474f46595b653711e6e7a0d81e2f5bd23857447fa1769c5e38cf61ceaa16"}
Jul 28 17:34:48.174402 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.174364    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:48.174472 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.174420    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:48.176333 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.176307    2561 generic.go:356] "Generic (PLEG): container finished" podID="aea57872-e0ce-4d85-acd5-93fa27993d87" containerID="6d65672f6b5ead2a88e12ef90ab61104f6fb5f3f8fca385642769fd8c0945bed" exitCode=0
Jul 28 17:34:48.176465 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.176397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9stv7" event={"ID":"aea57872-e0ce-4d85-acd5-93fa27993d87","Type":"ContainerDied","Data":"6d65672f6b5ead2a88e12ef90ab61104f6fb5f3f8fca385642769fd8c0945bed"}
Jul 28 17:34:48.176712 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.176664    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:48.176940 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.176920    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m5fxb"
Jul 28 17:34:48.190855 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.190835    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:48.191405 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.191388    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:48.210130 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.210082    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv" podStartSLOduration=7.714252213 podStartE2EDuration="27.210071289s" totalImagesPullingTime="19.495819076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:48.2098727 +0000 UTC m=+28.810469532" watchObservedRunningTime="2026-07-28 17:34:48.210071289 +0000 UTC m=+28.810668122"
Jul 28 17:34:48.914386 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:48.914359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:48.914665 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:48.914465    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:49.178113 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:49.178077    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 17:34:49.210188 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:49.210166    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:34:49.915347 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:49.915311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:49.915530 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:49.915414    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:49.915530 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:49.915468    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:49.915659 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:49.915528    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:49.917834 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:49.917809    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2fb74"]
Jul 28 17:34:49.918953 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:49.918931    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gjhzc"]
Jul 28 17:34:49.921556 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:49.921534    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8kbgj"]
Jul 28 17:34:49.921650 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:49.921637    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:49.921730 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:49.921712    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:50.182563 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:50.182491    2561 generic.go:356] "Generic (PLEG): container finished" podID="aea57872-e0ce-4d85-acd5-93fa27993d87" containerID="67adb23f4b38cbc184186aaffc005fe1266104dea79a674d9a29d5935dd2d8bb" exitCode=0
Jul 28 17:34:50.183002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:50.182593    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9stv7" event={"ID":"aea57872-e0ce-4d85-acd5-93fa27993d87","Type":"ContainerDied","Data":"67adb23f4b38cbc184186aaffc005fe1266104dea79a674d9a29d5935dd2d8bb"}
Jul 28 17:34:50.183002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:50.182768    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:50.183002 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:50.182874    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:50.183002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:50.182889    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:50.183002 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:50.182980    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:51.914663 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:51.914465    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:51.915026 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:51.914474    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:51.915026 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:51.914698    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:51.915026 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:51.914482    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:51.915026 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:51.914831    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:51.915026 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:51.914920    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:52.189503 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:52.189431    2561 generic.go:356] "Generic (PLEG): container finished" podID="aea57872-e0ce-4d85-acd5-93fa27993d87" containerID="e0fd3d8477729b5a6f7e192a109c576012fb6874ad39c742c8c9685047321593" exitCode=0
Jul 28 17:34:52.189503 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:52.189492    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9stv7" event={"ID":"aea57872-e0ce-4d85-acd5-93fa27993d87","Type":"ContainerDied","Data":"e0fd3d8477729b5a6f7e192a109c576012fb6874ad39c742c8c9685047321593"}
Jul 28 17:34:53.530196 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:53.530164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:53.530661 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.530283    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:53.530661 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.530340    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs podName:ef8b54a7-67f6-4c25-bbab-a0623ea4ca12 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:25.530322858 +0000 UTC m=+66.130919672 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs") pod "network-metrics-daemon-8kbgj" (UID: "ef8b54a7-67f6-4c25-bbab-a0623ea4ca12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:34:53.631385 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:53.631357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:53.631537 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.631471    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:53.631537 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.631535    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret podName:e90f86d2-419b-4d0e-adf0-ffb6bb39aab4 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:25.631516306 +0000 UTC m=+66.232113122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret") pod "global-pull-secret-syncer-2fb74" (UID: "e90f86d2-419b-4d0e-adf0-ffb6bb39aab4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:34:53.732181 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:53.732147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmk8\" (UniqueName: \"kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8\") pod \"network-check-target-gjhzc\" (UID: \"37ea1a6f-03d0-4d5c-83ac-650dc64dc493\") " pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:53.732310 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.732265    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:34:53.732310 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.732286    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:34:53.732310 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.732298    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tkmk8 for pod openshift-network-diagnostics/network-check-target-gjhzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:53.732464 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.732345    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8 podName:37ea1a6f-03d0-4d5c-83ac-650dc64dc493 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:25.732332064 +0000 UTC m=+66.332928875 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkmk8" (UniqueName: "kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8") pod "network-check-target-gjhzc" (UID: "37ea1a6f-03d0-4d5c-83ac-650dc64dc493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:34:53.914375 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:53.914299    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:53.914516 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:53.914307    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:53.914516 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.914426    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kbgj" podUID="ef8b54a7-67f6-4c25-bbab-a0623ea4ca12"
Jul 28 17:34:53.914627 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.914540    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fb74" podUID="e90f86d2-419b-4d0e-adf0-ffb6bb39aab4"
Jul 28 17:34:53.914627 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:53.914597    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:53.914740 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:53.914668    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjhzc" podUID="37ea1a6f-03d0-4d5c-83ac-650dc64dc493"
Jul 28 17:34:55.193224 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.193199    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-195.ec2.internal" event="NodeReady"
Jul 28 17:34:55.193783 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.193331    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 17:34:55.229751 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.229718    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-757d54b64c-rtskd"]
Jul 28 17:34:55.232437 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.232416    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.235244 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.235211    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 17:34:55.235361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.235298    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7jzp\""
Jul 28 17:34:55.235361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.235298    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 17:34:55.235361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.235336    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 17:34:55.243624 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.242663    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 17:34:55.245711 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.245690    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bln5h"]
Jul 28 17:34:55.248666 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.248636    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-757d54b64c-rtskd"]
Jul 28 17:34:55.248767 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.248671    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-flctc"]
Jul 28 17:34:55.248767 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.248751    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.251198 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.251174    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-flctc"
Jul 28 17:34:55.252444 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.252424    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lxmvx\""
Jul 28 17:34:55.252953 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.252933    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 17:34:55.253045 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.252960    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 17:34:55.253655 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.253632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7mzg2\""
Jul 28 17:34:55.253887 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.253869    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 17:34:55.253971 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.253883    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 17:34:55.253971 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.253897    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 17:34:55.259139 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.259120    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bln5h"]
Jul 28 17:34:55.264797 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.264777    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-flctc"]
Jul 28 17:34:55.345697 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345627    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/08759346-76d5-4965-8ae5-18f60700eefa-ca-trust-extracted\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.345697 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scth8\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-kube-api-access-scth8\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.345697 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.345935 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-trusted-ca\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.345935 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345763    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23bc825a-ecbd-43d1-8975-1b4c8877a57a-config-volume\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.345935 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-registry-certificates\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.345935 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.345935 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-image-registry-private-configuration\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.345935 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23bc825a-ecbd-43d1-8975-1b4c8877a57a-tmp-dir\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.345935 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-bound-sa-token\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.346222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.345989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45kc6\" (UniqueName: \"kubernetes.io/projected/23bc825a-ecbd-43d1-8975-1b4c8877a57a-kube-api-access-45kc6\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.346222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.346034    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-installation-pull-secrets\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.446890 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.446862    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.447007 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.446897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-image-registry-private-configuration\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.447007 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.446995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23bc825a-ecbd-43d1-8975-1b4c8877a57a-tmp-dir\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.447156 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:55.447013    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:34:55.447156 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:55.447109    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls podName:23bc825a-ecbd-43d1-8975-1b4c8877a57a nodeName:}" failed. No retries permitted until 2026-07-28 17:34:55.947070476 +0000 UTC m=+36.547667291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls") pod "dns-default-bln5h" (UID: "23bc825a-ecbd-43d1-8975-1b4c8877a57a") : secret "dns-default-metrics-tls" not found
Jul 28 17:34:55.447262 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-bound-sa-token\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.447316 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45kc6\" (UniqueName: \"kubernetes.io/projected/23bc825a-ecbd-43d1-8975-1b4c8877a57a-kube-api-access-45kc6\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.447368 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447330    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-installation-pull-secrets\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.447422 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/08759346-76d5-4965-8ae5-18f60700eefa-ca-trust-extracted\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.447472 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447422    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scth8\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-kube-api-access-scth8\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.447472 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.447575 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-trusted-ca\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.447575 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447520    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/895a724c-ab30-4e82-91b9-c71aaa41e7f5-cert\") pod \"ingress-canary-flctc\" (UID: \"895a724c-ab30-4e82-91b9-c71aaa41e7f5\") " pod="openshift-ingress-canary/ingress-canary-flctc"
Jul 28 17:34:55.447575 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23bc825a-ecbd-43d1-8975-1b4c8877a57a-config-volume\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.447712 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447572    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-registry-certificates\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.447712 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2sx2\" (UniqueName: \"kubernetes.io/projected/895a724c-ab30-4e82-91b9-c71aaa41e7f5-kube-api-access-s2sx2\") pod \"ingress-canary-flctc\" (UID: \"895a724c-ab30-4e82-91b9-c71aaa41e7f5\") " pod="openshift-ingress-canary/ingress-canary-flctc"
Jul 28 17:34:55.447712 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447624    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23bc825a-ecbd-43d1-8975-1b4c8877a57a-tmp-dir\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.447849 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:55.447740    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:34:55.447849 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:55.447756    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757d54b64c-rtskd: secret "image-registry-tls" not found
Jul 28 17:34:55.447849 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:55.447808    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls podName:08759346-76d5-4965-8ae5-18f60700eefa nodeName:}" failed. No retries permitted until 2026-07-28 17:34:55.947788634 +0000 UTC m=+36.548385450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls") pod "image-registry-757d54b64c-rtskd" (UID: "08759346-76d5-4965-8ae5-18f60700eefa") : secret "image-registry-tls" not found
Jul 28 17:34:55.447999 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.447895    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/08759346-76d5-4965-8ae5-18f60700eefa-ca-trust-extracted\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.448261 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.448240    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-registry-certificates\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.448436 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.448413    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23bc825a-ecbd-43d1-8975-1b4c8877a57a-config-volume\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.448751 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.448727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-trusted-ca\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.451724 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.451700    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-image-registry-private-configuration\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.451724 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.451710    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-installation-pull-secrets\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.457088 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.457060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-bound-sa-token\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.458154 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.458135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45kc6\" (UniqueName: \"kubernetes.io/projected/23bc825a-ecbd-43d1-8975-1b4c8877a57a-kube-api-access-45kc6\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.458445 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.458428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scth8\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-kube-api-access-scth8\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.548281 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.548255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/895a724c-ab30-4e82-91b9-c71aaa41e7f5-cert\") pod \"ingress-canary-flctc\" (UID: \"895a724c-ab30-4e82-91b9-c71aaa41e7f5\") " pod="openshift-ingress-canary/ingress-canary-flctc"
Jul 28 17:34:55.548412 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.548293    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2sx2\" (UniqueName: \"kubernetes.io/projected/895a724c-ab30-4e82-91b9-c71aaa41e7f5-kube-api-access-s2sx2\") pod \"ingress-canary-flctc\" (UID: \"895a724c-ab30-4e82-91b9-c71aaa41e7f5\") " pod="openshift-ingress-canary/ingress-canary-flctc"
Jul 28 17:34:55.550741 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.550716    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/895a724c-ab30-4e82-91b9-c71aaa41e7f5-cert\") pod \"ingress-canary-flctc\" (UID: \"895a724c-ab30-4e82-91b9-c71aaa41e7f5\") " pod="openshift-ingress-canary/ingress-canary-flctc"
Jul 28 17:34:55.557213 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.557188    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2sx2\" (UniqueName: \"kubernetes.io/projected/895a724c-ab30-4e82-91b9-c71aaa41e7f5-kube-api-access-s2sx2\") pod \"ingress-canary-flctc\" (UID: \"895a724c-ab30-4e82-91b9-c71aaa41e7f5\") " pod="openshift-ingress-canary/ingress-canary-flctc"
Jul 28 17:34:55.567151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.567133    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-flctc"
Jul 28 17:34:55.914743 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.914703    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:34:55.914743 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.914722    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:34:55.914968 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.914702    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:34:55.918222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.917942    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 17:34:55.918222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.918026    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 17:34:55.918222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.918080    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z5ccl\""
Jul 28 17:34:55.918222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.918027    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 17:34:55.918509 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.918337    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c22cz\""
Jul 28 17:34:55.918943 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.918926    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 17:34:55.950553 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.950533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:55.950663 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:55.950598    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:55.950736 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:55.950696    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:34:55.950736 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:55.950705    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:34:55.950736 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:55.950722    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757d54b64c-rtskd: secret "image-registry-tls" not found
Jul 28 17:34:55.950877 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:55.950789    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls podName:23bc825a-ecbd-43d1-8975-1b4c8877a57a nodeName:}" failed. No retries permitted until 2026-07-28 17:34:56.950767005 +0000 UTC m=+37.551363843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls") pod "dns-default-bln5h" (UID: "23bc825a-ecbd-43d1-8975-1b4c8877a57a") : secret "dns-default-metrics-tls" not found
Jul 28 17:34:55.950877 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:55.950811    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls podName:08759346-76d5-4965-8ae5-18f60700eefa nodeName:}" failed. No retries permitted until 2026-07-28 17:34:56.950800349 +0000 UTC m=+37.551397161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls") pod "image-registry-757d54b64c-rtskd" (UID: "08759346-76d5-4965-8ae5-18f60700eefa") : secret "image-registry-tls" not found
Jul 28 17:34:56.283358 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:56.283331    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-flctc"]
Jul 28 17:34:56.286980 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:56.286954    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895a724c_ab30_4e82_91b9_c71aaa41e7f5.slice/crio-64e9a2818483fdaa318bd4ff32ca475eeacad3d7559824007ed54df4a9552fdb WatchSource:0}: Error finding container 64e9a2818483fdaa318bd4ff32ca475eeacad3d7559824007ed54df4a9552fdb: Status 404 returned error can't find the container with id 64e9a2818483fdaa318bd4ff32ca475eeacad3d7559824007ed54df4a9552fdb
Jul 28 17:34:56.956988 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:56.956950    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:56.957157 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:56.957020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:56.957157 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:56.957137    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:34:56.957256 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:56.957199    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls podName:23bc825a-ecbd-43d1-8975-1b4c8877a57a nodeName:}" failed. No retries permitted until 2026-07-28 17:34:58.957181588 +0000 UTC m=+39.557778404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls") pod "dns-default-bln5h" (UID: "23bc825a-ecbd-43d1-8975-1b4c8877a57a") : secret "dns-default-metrics-tls" not found
Jul 28 17:34:56.957256 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:56.957135    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:34:56.957256 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:56.957233    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757d54b64c-rtskd: secret "image-registry-tls" not found
Jul 28 17:34:56.957416 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:56.957273    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls podName:08759346-76d5-4965-8ae5-18f60700eefa nodeName:}" failed. No retries permitted until 2026-07-28 17:34:58.957261039 +0000 UTC m=+39.557857862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls") pod "image-registry-757d54b64c-rtskd" (UID: "08759346-76d5-4965-8ae5-18f60700eefa") : secret "image-registry-tls" not found
Jul 28 17:34:57.205952 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.205916    2561 generic.go:356] "Generic (PLEG): container finished" podID="aea57872-e0ce-4d85-acd5-93fa27993d87" containerID="e859ecbc6b86bfdb3e46683696fcacb3f1d7a0970d760f69c9b942de19a9ea54" exitCode=0
Jul 28 17:34:57.206111 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.206001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9stv7" event={"ID":"aea57872-e0ce-4d85-acd5-93fa27993d87","Type":"ContainerDied","Data":"e859ecbc6b86bfdb3e46683696fcacb3f1d7a0970d760f69c9b942de19a9ea54"}
Jul 28 17:34:57.207438 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.207356    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-flctc" event={"ID":"895a724c-ab30-4e82-91b9-c71aaa41e7f5","Type":"ContainerStarted","Data":"64e9a2818483fdaa318bd4ff32ca475eeacad3d7559824007ed54df4a9552fdb"}
Jul 28 17:34:57.767564 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.767517    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-wdx84"]
Jul 28 17:34:57.770903 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.770884    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:57.773864 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.773843    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 28 17:34:57.773962 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.773946    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wkzbx\""
Jul 28 17:34:57.775065 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.775042    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 28 17:34:57.775708 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.775547    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 17:34:57.775786 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.775751    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 17:34:57.780553 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.780529    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 28 17:34:57.783923 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.783905    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-wdx84"]
Jul 28 17:34:57.866078 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.866050    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7"]
Jul 28 17:34:57.868991 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.868970    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7"
Jul 28 17:34:57.871879 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.871858    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vrzj5\""
Jul 28 17:34:57.878116 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.878068    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7"]
Jul 28 17:34:57.884146 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.884128    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-cbrrn"]
Jul 28 17:34:57.886781 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.886766    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns"]
Jul 28 17:34:57.886890 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.886874    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:57.889497 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.889477    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns"
Jul 28 17:34:57.889589 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.889572    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 28 17:34:57.889764 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.889739    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 28 17:34:57.890433 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.890413    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6p6f7\""
Jul 28 17:34:57.890718 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.890700    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:34:57.890801 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.890763    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 28 17:34:57.893564 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.893165    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mc2fd\""
Jul 28 17:34:57.893564 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.893439    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:34:57.893746 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.893728    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 17:34:57.896559 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.896538    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 28 17:34:57.900402 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.900326    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns"]
Jul 28 17:34:57.901192 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.901173    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-cbrrn"]
Jul 28 17:34:57.963817 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.963797    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2383fc0a-e439-463b-b5ca-a8803d864945-tmp\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:57.963920 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.963825    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsgqr\" (UniqueName: \"kubernetes.io/projected/2383fc0a-e439-463b-b5ca-a8803d864945-kube-api-access-hsgqr\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:57.963920 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.963908    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2383fc0a-e439-463b-b5ca-a8803d864945-serving-cert\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:57.963988 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.963936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2383fc0a-e439-463b-b5ca-a8803d864945-snapshots\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:57.964024 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.963989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2383fc0a-e439-463b-b5ca-a8803d864945-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:57.964024 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:57.964005    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2383fc0a-e439-463b-b5ca-a8803d864945-service-ca-bundle\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.064642 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2383fc0a-e439-463b-b5ca-a8803d864945-serving-cert\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.064642 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w24j\" (UniqueName: \"kubernetes.io/projected/36b0f1e0-0329-4c51-9419-86206354722e-kube-api-access-7w24j\") pod \"network-check-source-7d88cb55d8-dj2d7\" (UID: \"36b0f1e0-0329-4c51-9419-86206354722e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7"
Jul 28 17:34:58.064775 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2383fc0a-e439-463b-b5ca-a8803d864945-snapshots\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.064775 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-config\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.064775 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-serving-cert\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.064775 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064712    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq9cx\" (UniqueName: \"kubernetes.io/projected/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-kube-api-access-tq9cx\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.064933 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2383fc0a-e439-463b-b5ca-a8803d864945-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.064933 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2383fc0a-e439-463b-b5ca-a8803d864945-service-ca-bundle\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.064933 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2383fc0a-e439-463b-b5ca-a8803d864945-tmp\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.064933 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsgqr\" (UniqueName: \"kubernetes.io/projected/2383fc0a-e439-463b-b5ca-a8803d864945-kube-api-access-hsgqr\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.064933 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-trusted-ca\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.064933 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.064914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr4sl\" (UniqueName: \"kubernetes.io/projected/9ed8b99d-180d-426f-8820-6f5ae7a52a4c-kube-api-access-kr4sl\") pod \"volume-data-source-validator-549c6d54cf-kl7ns\" (UID: \"9ed8b99d-180d-426f-8820-6f5ae7a52a4c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns"
Jul 28 17:34:58.065318 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.065300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2383fc0a-e439-463b-b5ca-a8803d864945-tmp\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.065456 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.065438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2383fc0a-e439-463b-b5ca-a8803d864945-service-ca-bundle\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.065533 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.065509    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2383fc0a-e439-463b-b5ca-a8803d864945-snapshots\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.066018 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.066001    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2383fc0a-e439-463b-b5ca-a8803d864945-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.068168 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.068152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2383fc0a-e439-463b-b5ca-a8803d864945-serving-cert\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.074537 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.074512    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsgqr\" (UniqueName: \"kubernetes.io/projected/2383fc0a-e439-463b-b5ca-a8803d864945-kube-api-access-hsgqr\") pod \"insights-operator-5885fdb759-wdx84\" (UID: \"2383fc0a-e439-463b-b5ca-a8803d864945\") " pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.082331 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.082315    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-wdx84"
Jul 28 17:34:58.166074 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.165404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-config\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.166074 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.165454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-serving-cert\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.166074 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.165484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq9cx\" (UniqueName: \"kubernetes.io/projected/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-kube-api-access-tq9cx\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.166074 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.165586    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-trusted-ca\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.166074 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.165615    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr4sl\" (UniqueName: \"kubernetes.io/projected/9ed8b99d-180d-426f-8820-6f5ae7a52a4c-kube-api-access-kr4sl\") pod \"volume-data-source-validator-549c6d54cf-kl7ns\" (UID: \"9ed8b99d-180d-426f-8820-6f5ae7a52a4c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns"
Jul 28 17:34:58.166074 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.165701    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w24j\" (UniqueName: \"kubernetes.io/projected/36b0f1e0-0329-4c51-9419-86206354722e-kube-api-access-7w24j\") pod \"network-check-source-7d88cb55d8-dj2d7\" (UID: \"36b0f1e0-0329-4c51-9419-86206354722e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7"
Jul 28 17:34:58.167026 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.166997    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-config\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.167171 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.167087    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-trusted-ca\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.169123 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.168973    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-serving-cert\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.175723 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.175699    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq9cx\" (UniqueName: \"kubernetes.io/projected/021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8-kube-api-access-tq9cx\") pod \"console-operator-584dcb6b54-cbrrn\" (UID: \"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.176286 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.176265    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr4sl\" (UniqueName: \"kubernetes.io/projected/9ed8b99d-180d-426f-8820-6f5ae7a52a4c-kube-api-access-kr4sl\") pod \"volume-data-source-validator-549c6d54cf-kl7ns\" (UID: \"9ed8b99d-180d-426f-8820-6f5ae7a52a4c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns"
Jul 28 17:34:58.176889 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.176865    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w24j\" (UniqueName: \"kubernetes.io/projected/36b0f1e0-0329-4c51-9419-86206354722e-kube-api-access-7w24j\") pod \"network-check-source-7d88cb55d8-dj2d7\" (UID: \"36b0f1e0-0329-4c51-9419-86206354722e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7"
Jul 28 17:34:58.180634 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.180486    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7"
Jul 28 17:34:58.199246 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.199221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:34:58.205265 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.205240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns"
Jul 28 17:34:58.215564 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.215537    2561 generic.go:356] "Generic (PLEG): container finished" podID="aea57872-e0ce-4d85-acd5-93fa27993d87" containerID="98047914d85b86512efdd4efcf1502e9a61701c2f31db51a4fbcc331ef2eae82" exitCode=0
Jul 28 17:34:58.215658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.215607    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9stv7" event={"ID":"aea57872-e0ce-4d85-acd5-93fa27993d87","Type":"ContainerDied","Data":"98047914d85b86512efdd4efcf1502e9a61701c2f31db51a4fbcc331ef2eae82"}
Jul 28 17:34:58.233921 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.233475    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-wdx84"]
Jul 28 17:34:58.337633 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.337606    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7"]
Jul 28 17:34:58.342074 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:58.342046    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b0f1e0_0329_4c51_9419_86206354722e.slice/crio-080ce24250ea70a5b144668d15d72e304a9dc76cb13a2f384abf207360cd2350 WatchSource:0}: Error finding container 080ce24250ea70a5b144668d15d72e304a9dc76cb13a2f384abf207360cd2350: Status 404 returned error can't find the container with id 080ce24250ea70a5b144668d15d72e304a9dc76cb13a2f384abf207360cd2350
Jul 28 17:34:58.357784 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.357758    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-cbrrn"]
Jul 28 17:34:58.360170 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:58.360144    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021de76a_5c1f_4d8b_9fdc_3daaf3c65cb8.slice/crio-fe106d27238bb2eeb381f7e1c37c05581377aa833a3002622b00e5da7952a79f WatchSource:0}: Error finding container fe106d27238bb2eeb381f7e1c37c05581377aa833a3002622b00e5da7952a79f: Status 404 returned error can't find the container with id fe106d27238bb2eeb381f7e1c37c05581377aa833a3002622b00e5da7952a79f
Jul 28 17:34:58.368533 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.368509    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns"]
Jul 28 17:34:58.370965 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:34:58.370943    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed8b99d_180d_426f_8820_6f5ae7a52a4c.slice/crio-67a980c57b1178a200410ea7062d6ab59118e51e69f24a7602b0af11aabea536 WatchSource:0}: Error finding container 67a980c57b1178a200410ea7062d6ab59118e51e69f24a7602b0af11aabea536: Status 404 returned error can't find the container with id 67a980c57b1178a200410ea7062d6ab59118e51e69f24a7602b0af11aabea536
Jul 28 17:34:58.971513 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.971483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:34:58.972242 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:58.971540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:34:58.972242 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:58.971679    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:34:58.972242 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:58.971731    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls podName:23bc825a-ecbd-43d1-8975-1b4c8877a57a nodeName:}" failed. No retries permitted until 2026-07-28 17:35:02.971713949 +0000 UTC m=+43.572310760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls") pod "dns-default-bln5h" (UID: "23bc825a-ecbd-43d1-8975-1b4c8877a57a") : secret "dns-default-metrics-tls" not found
Jul 28 17:34:58.972242 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:58.971683    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:34:58.972242 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:58.971779    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757d54b64c-rtskd: secret "image-registry-tls" not found
Jul 28 17:34:58.972242 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:34:58.971823    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls podName:08759346-76d5-4965-8ae5-18f60700eefa nodeName:}" failed. No retries permitted until 2026-07-28 17:35:02.971810756 +0000 UTC m=+43.572407583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls") pod "image-registry-757d54b64c-rtskd" (UID: "08759346-76d5-4965-8ae5-18f60700eefa") : secret "image-registry-tls" not found
Jul 28 17:34:59.224796 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:59.224723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9stv7" event={"ID":"aea57872-e0ce-4d85-acd5-93fa27993d87","Type":"ContainerStarted","Data":"cb246ae5e78d05b31ddbeb10b9eac86dabe9b4549f8ded1a69add5dadbe8fb34"}
Jul 28 17:34:59.225820 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:59.225795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-wdx84" event={"ID":"2383fc0a-e439-463b-b5ca-a8803d864945","Type":"ContainerStarted","Data":"1f71b1b4942237b2bf63f85f2279990f81a79a589650fec0cd90b92c67ffafc1"}
Jul 28 17:34:59.226840 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:59.226819    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns" event={"ID":"9ed8b99d-180d-426f-8820-6f5ae7a52a4c","Type":"ContainerStarted","Data":"67a980c57b1178a200410ea7062d6ab59118e51e69f24a7602b0af11aabea536"}
Jul 28 17:34:59.227855 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:59.227834    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" event={"ID":"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8","Type":"ContainerStarted","Data":"fe106d27238bb2eeb381f7e1c37c05581377aa833a3002622b00e5da7952a79f"}
Jul 28 17:34:59.228834 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:59.228816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7" event={"ID":"36b0f1e0-0329-4c51-9419-86206354722e","Type":"ContainerStarted","Data":"080ce24250ea70a5b144668d15d72e304a9dc76cb13a2f384abf207360cd2350"}
Jul 28 17:34:59.250305 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:34:59.250264    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9stv7" podStartSLOduration=9.439846691 podStartE2EDuration="39.250251959s" totalImagesPullingTime="29.810405268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:59.248318418 +0000 UTC m=+39.848915251" watchObservedRunningTime="2026-07-28 17:34:59.250251959 +0000 UTC m=+39.850848791"
Jul 28 17:35:00.234973 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:00.234684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-flctc" event={"ID":"895a724c-ab30-4e82-91b9-c71aaa41e7f5","Type":"ContainerStarted","Data":"830e009660e0466aeeed311f71fb2505008c4d21846837fa93d73175aff73eda"}
Jul 28 17:35:00.252782 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:00.252721    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-flctc" podStartSLOduration=1.9344023479999999 podStartE2EDuration="5.252701741s" totalImagesPullingTime="3.318299393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:00.252021881 +0000 UTC m=+40.852618715" watchObservedRunningTime="2026-07-28 17:35:00.252701741 +0000 UTC m=+40.853298576"
Jul 28 17:35:02.852111 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:02.852070    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-767g4"]
Jul 28 17:35:02.868829 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:02.868804    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-767g4"]
Jul 28 17:35:02.868974 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:02.868953    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-767g4"
Jul 28 17:35:02.872225 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:02.872206    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 17:35:02.873281 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:02.873264    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kd6sz\""
Jul 28 17:35:02.873353 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:02.873304    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 17:35:02.901966 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:02.901938    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96jkj\" (UniqueName: \"kubernetes.io/projected/151361e3-6472-4146-8bcc-a07642a27801-kube-api-access-96jkj\") pod \"migrator-6865c9967-767g4\" (UID: \"151361e3-6472-4146-8bcc-a07642a27801\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-767g4"
Jul 28 17:35:03.002775 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:03.002742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:35:03.002877 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:03.002804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:35:03.002930 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:03.002886    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:35:03.002980 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:03.002920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96jkj\" (UniqueName: \"kubernetes.io/projected/151361e3-6472-4146-8bcc-a07642a27801-kube-api-access-96jkj\") pod \"migrator-6865c9967-767g4\" (UID: \"151361e3-6472-4146-8bcc-a07642a27801\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-767g4"
Jul 28 17:35:03.002980 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:03.002949    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls podName:23bc825a-ecbd-43d1-8975-1b4c8877a57a nodeName:}" failed. No retries permitted until 2026-07-28 17:35:11.00293371 +0000 UTC m=+51.603530522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls") pod "dns-default-bln5h" (UID: "23bc825a-ecbd-43d1-8975-1b4c8877a57a") : secret "dns-default-metrics-tls" not found
Jul 28 17:35:03.003088 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:03.002888    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:35:03.003088 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:03.003000    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757d54b64c-rtskd: secret "image-registry-tls" not found
Jul 28 17:35:03.003088 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:03.003075    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls podName:08759346-76d5-4965-8ae5-18f60700eefa nodeName:}" failed. No retries permitted until 2026-07-28 17:35:11.003056501 +0000 UTC m=+51.603653314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls") pod "image-registry-757d54b64c-rtskd" (UID: "08759346-76d5-4965-8ae5-18f60700eefa") : secret "image-registry-tls" not found
Jul 28 17:35:03.014232 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:03.014213    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96jkj\" (UniqueName: \"kubernetes.io/projected/151361e3-6472-4146-8bcc-a07642a27801-kube-api-access-96jkj\") pod \"migrator-6865c9967-767g4\" (UID: \"151361e3-6472-4146-8bcc-a07642a27801\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-767g4"
Jul 28 17:35:03.178164 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:03.178082    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-767g4"
Jul 28 17:35:04.010563 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.010522    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-767g4"]
Jul 28 17:35:04.017017 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:35:04.016975    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151361e3_6472_4146_8bcc_a07642a27801.slice/crio-2493d779a77cb65f2681044f6a1b370da7beb9db5a5514fb765ec224afc0763d WatchSource:0}: Error finding container 2493d779a77cb65f2681044f6a1b370da7beb9db5a5514fb765ec224afc0763d: Status 404 returned error can't find the container with id 2493d779a77cb65f2681044f6a1b370da7beb9db5a5514fb765ec224afc0763d
Jul 28 17:35:04.247210 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.247174    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-wdx84" event={"ID":"2383fc0a-e439-463b-b5ca-a8803d864945","Type":"ContainerStarted","Data":"8f98d4ff2e90cf39f0a99b4bd14e9402958a21b418148bb8cdee74553ba5eaee"}
Jul 28 17:35:04.248411 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.248386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-767g4" event={"ID":"151361e3-6472-4146-8bcc-a07642a27801","Type":"ContainerStarted","Data":"2493d779a77cb65f2681044f6a1b370da7beb9db5a5514fb765ec224afc0763d"}
Jul 28 17:35:04.249909 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.249880    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns" event={"ID":"9ed8b99d-180d-426f-8820-6f5ae7a52a4c","Type":"ContainerStarted","Data":"3be421d6b4d448eb53edef4852966306ebd083913b2b274ede569f88e4149fad"}
Jul 28 17:35:04.251537 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.251518    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/0.log"
Jul 28 17:35:04.251629 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.251554    2561 generic.go:356] "Generic (PLEG): container finished" podID="021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8" containerID="6381f72e088cb999f5af01601d415f891e5b03afbfb9de1228d3994c07e0c597" exitCode=255
Jul 28 17:35:04.251682 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.251630    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" event={"ID":"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8","Type":"ContainerDied","Data":"6381f72e088cb999f5af01601d415f891e5b03afbfb9de1228d3994c07e0c597"}
Jul 28 17:35:04.251785 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.251764    2561 scope.go:117] "RemoveContainer" containerID="6381f72e088cb999f5af01601d415f891e5b03afbfb9de1228d3994c07e0c597"
Jul 28 17:35:04.253328 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.253306    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7" event={"ID":"36b0f1e0-0329-4c51-9419-86206354722e","Type":"ContainerStarted","Data":"495b5f266c0abfc15d34cd658e94b6e5e816da7210f5d88b471daf8d832d8770"}
Jul 28 17:35:04.266342 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.266298    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-wdx84" podStartSLOduration=1.62354728 podStartE2EDuration="7.266286613s" totalImagesPullingTime="5.642739333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:04.265112502 +0000 UTC m=+44.865709332" watchObservedRunningTime="2026-07-28 17:35:04.266286613 +0000 UTC m=+44.866883445"
Jul 28 17:35:04.281077 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.281032    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-kl7ns" podStartSLOduration=1.7966180619999998 podStartE2EDuration="7.281016635s" totalImagesPullingTime="5.484398573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:04.280657802 +0000 UTC m=+44.881254637" watchObservedRunningTime="2026-07-28 17:35:04.281016635 +0000 UTC m=+44.881613469"
Jul 28 17:35:04.313632 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.312578    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dj2d7" podStartSLOduration=1.770533997 podStartE2EDuration="7.312560009s" totalImagesPullingTime="5.542026012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:04.311704254 +0000 UTC m=+44.912301086" watchObservedRunningTime="2026-07-28 17:35:04.312560009 +0000 UTC m=+44.913156843"
Jul 28 17:35:04.931155 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.931128    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hnnjp"]
Jul 28 17:35:04.947054 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.947031    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hnnjp"]
Jul 28 17:35:04.947214 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.947162    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:04.949775 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.949753    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 17:35:04.950939 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.950911    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 17:35:04.950939 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.950923    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 17:35:04.951213 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.951194    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-c7tfx\""
Jul 28 17:35:04.951328 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:04.951257    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 17:35:05.019641 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.019617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r4qx\" (UniqueName: \"kubernetes.io/projected/980853f0-ab5b-48ab-892d-cae112284875-kube-api-access-6r4qx\") pod \"service-ca-658d7b7c78-hnnjp\" (UID: \"980853f0-ab5b-48ab-892d-cae112284875\") " pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:05.019993 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.019730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/980853f0-ab5b-48ab-892d-cae112284875-signing-key\") pod \"service-ca-658d7b7c78-hnnjp\" (UID: \"980853f0-ab5b-48ab-892d-cae112284875\") " pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:05.019993 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.019799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/980853f0-ab5b-48ab-892d-cae112284875-signing-cabundle\") pod \"service-ca-658d7b7c78-hnnjp\" (UID: \"980853f0-ab5b-48ab-892d-cae112284875\") " pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:05.120904 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.120845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r4qx\" (UniqueName: \"kubernetes.io/projected/980853f0-ab5b-48ab-892d-cae112284875-kube-api-access-6r4qx\") pod \"service-ca-658d7b7c78-hnnjp\" (UID: \"980853f0-ab5b-48ab-892d-cae112284875\") " pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:05.121041 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.120904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/980853f0-ab5b-48ab-892d-cae112284875-signing-key\") pod \"service-ca-658d7b7c78-hnnjp\" (UID: \"980853f0-ab5b-48ab-892d-cae112284875\") " pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:05.121041 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.120935    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/980853f0-ab5b-48ab-892d-cae112284875-signing-cabundle\") pod \"service-ca-658d7b7c78-hnnjp\" (UID: \"980853f0-ab5b-48ab-892d-cae112284875\") " pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:05.121618 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.121600    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/980853f0-ab5b-48ab-892d-cae112284875-signing-cabundle\") pod \"service-ca-658d7b7c78-hnnjp\" (UID: \"980853f0-ab5b-48ab-892d-cae112284875\") " pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:05.123249 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.123232    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/980853f0-ab5b-48ab-892d-cae112284875-signing-key\") pod \"service-ca-658d7b7c78-hnnjp\" (UID: \"980853f0-ab5b-48ab-892d-cae112284875\") " pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:05.130494 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.130467    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r4qx\" (UniqueName: \"kubernetes.io/projected/980853f0-ab5b-48ab-892d-cae112284875-kube-api-access-6r4qx\") pod \"service-ca-658d7b7c78-hnnjp\" (UID: \"980853f0-ab5b-48ab-892d-cae112284875\") " pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:05.231173 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.231067    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5rkdl"]
Jul 28 17:35:05.244032 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.244006    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.245459 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.245432    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5rkdl"]
Jul 28 17:35:05.246418 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.246396    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 17:35:05.246504 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.246401    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xj8mn\""
Jul 28 17:35:05.246504 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.246408    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 17:35:05.258368 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.258349    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/1.log"
Jul 28 17:35:05.258896 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.258876    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/0.log"
Jul 28 17:35:05.259011 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.258917    2561 generic.go:356] "Generic (PLEG): container finished" podID="021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8" containerID="4996dd38e6aa932120252fb9d9138997dd5ebcf46d4c038cac31a9d1d1c48a0d" exitCode=255
Jul 28 17:35:05.259080 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.259047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" event={"ID":"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8","Type":"ContainerDied","Data":"4996dd38e6aa932120252fb9d9138997dd5ebcf46d4c038cac31a9d1d1c48a0d"}
Jul 28 17:35:05.259155 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.259127    2561 scope.go:117] "RemoveContainer" containerID="6381f72e088cb999f5af01601d415f891e5b03afbfb9de1228d3994c07e0c597"
Jul 28 17:35:05.259845 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.259317    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp"
Jul 28 17:35:05.259963 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.259912    2561 scope.go:117] "RemoveContainer" containerID="4996dd38e6aa932120252fb9d9138997dd5ebcf46d4c038cac31a9d1d1c48a0d"
Jul 28 17:35:05.260081 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:05.260056    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-cbrrn_openshift-console-operator(021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" podUID="021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8"
Jul 28 17:35:05.322689 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.322654    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.322808 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.322788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.322860 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.322831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aecd2a92-b706-4ba2-96b5-93314f768397-crio-socket\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.322947 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.322925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75bc7\" (UniqueName: \"kubernetes.io/projected/aecd2a92-b706-4ba2-96b5-93314f768397-kube-api-access-75bc7\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.322988 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.322966    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aecd2a92-b706-4ba2-96b5-93314f768397-data-volume\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.423991 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.423920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aecd2a92-b706-4ba2-96b5-93314f768397-crio-socket\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.423991 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.423980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75bc7\" (UniqueName: \"kubernetes.io/projected/aecd2a92-b706-4ba2-96b5-93314f768397-kube-api-access-75bc7\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.424227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.424015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aecd2a92-b706-4ba2-96b5-93314f768397-data-volume\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.424227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.424130    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.424227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.424175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aecd2a92-b706-4ba2-96b5-93314f768397-crio-socket\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.424227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.424189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.424429 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:05.424253    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:35:05.424429 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:05.424318    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:35:05.424429 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:05.424330    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm podName:aecd2a92-b706-4ba2-96b5-93314f768397 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:05.924310687 +0000 UTC m=+46.524907521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5rkdl" (UID: "aecd2a92-b706-4ba2-96b5-93314f768397") : configmap "kube-rbac-proxy" not found
Jul 28 17:35:05.424429 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:05.424381    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls podName:aecd2a92-b706-4ba2-96b5-93314f768397 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:05.924364536 +0000 UTC m=+46.524961350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5rkdl" (UID: "aecd2a92-b706-4ba2-96b5-93314f768397") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:35:05.424429 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.424379    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aecd2a92-b706-4ba2-96b5-93314f768397-data-volume\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.434520 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.434493    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75bc7\" (UniqueName: \"kubernetes.io/projected/aecd2a92-b706-4ba2-96b5-93314f768397-kube-api-access-75bc7\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.646946 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.646843    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hnnjp"]
Jul 28 17:35:05.649315 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:35:05.649287    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980853f0_ab5b_48ab_892d_cae112284875.slice/crio-9fe85f4aff32a7bee4c4dc57cb2e1cde0123894f3c0afb6bfc672f0a39d158ba WatchSource:0}: Error finding container 9fe85f4aff32a7bee4c4dc57cb2e1cde0123894f3c0afb6bfc672f0a39d158ba: Status 404 returned error can't find the container with id 9fe85f4aff32a7bee4c4dc57cb2e1cde0123894f3c0afb6bfc672f0a39d158ba
Jul 28 17:35:05.928141 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.928119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.928214 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:05.928169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:05.928267 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:05.928250    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:35:05.928306 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:05.928281    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:35:05.928337 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:05.928317    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm podName:aecd2a92-b706-4ba2-96b5-93314f768397 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:06.928301857 +0000 UTC m=+47.528898668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5rkdl" (UID: "aecd2a92-b706-4ba2-96b5-93314f768397") : configmap "kube-rbac-proxy" not found
Jul 28 17:35:05.928337 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:05.928331    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls podName:aecd2a92-b706-4ba2-96b5-93314f768397 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:06.928325465 +0000 UTC m=+47.528922275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5rkdl" (UID: "aecd2a92-b706-4ba2-96b5-93314f768397") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:35:06.263272 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:06.263243    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-767g4" event={"ID":"151361e3-6472-4146-8bcc-a07642a27801","Type":"ContainerStarted","Data":"64a59d4da0e7dcd7736b83b35da0d8e628e912a347afc6757ca8c3448a4bab63"}
Jul 28 17:35:06.263625 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:06.263298    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-767g4" event={"ID":"151361e3-6472-4146-8bcc-a07642a27801","Type":"ContainerStarted","Data":"4e7159327d4a2a591c8aa3592cee7ecd42b5d60f4cd33f56def9854d22cdf17e"}
Jul 28 17:35:06.264369 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:06.264349    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp" event={"ID":"980853f0-ab5b-48ab-892d-cae112284875","Type":"ContainerStarted","Data":"9fe85f4aff32a7bee4c4dc57cb2e1cde0123894f3c0afb6bfc672f0a39d158ba"}
Jul 28 17:35:06.265654 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:06.265638    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/1.log"
Jul 28 17:35:06.265909 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:06.265895    2561 scope.go:117] "RemoveContainer" containerID="4996dd38e6aa932120252fb9d9138997dd5ebcf46d4c038cac31a9d1d1c48a0d"
Jul 28 17:35:06.266030 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:06.266014    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-cbrrn_openshift-console-operator(021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" podUID="021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8"
Jul 28 17:35:06.281720 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:06.281682    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-767g4" podStartSLOduration=2.372791998 podStartE2EDuration="4.281669773s" totalImagesPullingTime="1.908877775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:06.280705455 +0000 UTC m=+46.881302312" watchObservedRunningTime="2026-07-28 17:35:06.281669773 +0000 UTC m=+46.882266605"
Jul 28 17:35:06.937338 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:06.937262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:06.937502 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:06.937371    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:35:06.937502 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:06.937390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:06.937502 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:06.937430    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm podName:aecd2a92-b706-4ba2-96b5-93314f768397 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:08.937416502 +0000 UTC m=+49.538013312 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5rkdl" (UID: "aecd2a92-b706-4ba2-96b5-93314f768397") : configmap "kube-rbac-proxy" not found
Jul 28 17:35:06.937674 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:06.937514    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:35:06.937674 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:06.937580    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls podName:aecd2a92-b706-4ba2-96b5-93314f768397 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:08.937553243 +0000 UTC m=+49.538150054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5rkdl" (UID: "aecd2a92-b706-4ba2-96b5-93314f768397") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:35:07.429087 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:07.429059    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2m9zc_1b94a8c0-d42f-47a0-b67c-7fde407b12ac/dns-node-resolver/0.log"
Jul 28 17:35:08.200134 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:08.200108    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:35:08.200319 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:08.200163    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:35:08.200892 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:08.200863    2561 scope.go:117] "RemoveContainer" containerID="4996dd38e6aa932120252fb9d9138997dd5ebcf46d4c038cac31a9d1d1c48a0d"
Jul 28 17:35:08.203827 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:08.201208    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-cbrrn_openshift-console-operator(021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" podUID="021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8"
Jul 28 17:35:08.629330 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:08.629305    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k58z5_c71f9d00-2131-426f-9461-555c7f32b213/node-ca/0.log"
Jul 28 17:35:08.951479 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:08.951418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:08.951634 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:08.951511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:08.951634 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:08.951550    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:35:08.951634 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:08.951590    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:35:08.951634 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:08.951606    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls podName:aecd2a92-b706-4ba2-96b5-93314f768397 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:12.951590429 +0000 UTC m=+53.552187239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5rkdl" (UID: "aecd2a92-b706-4ba2-96b5-93314f768397") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:35:08.951839 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:08.951638    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm podName:aecd2a92-b706-4ba2-96b5-93314f768397 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:12.951627387 +0000 UTC m=+53.552224198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5rkdl" (UID: "aecd2a92-b706-4ba2-96b5-93314f768397") : configmap "kube-rbac-proxy" not found
Jul 28 17:35:09.229288 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:09.229228    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-flctc_895a724c-ab30-4e82-91b9-c71aaa41e7f5/serve-healthcheck-canary/0.log"
Jul 28 17:35:09.278305 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:09.278277    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp" event={"ID":"980853f0-ab5b-48ab-892d-cae112284875","Type":"ContainerStarted","Data":"7432e8ffcc763cea64d4207ccdd3025b1eb968aaf5b03575343dec8c0623fb9f"}
Jul 28 17:35:09.295124 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:09.295062    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-hnnjp" podStartSLOduration=2.2742479749999998 podStartE2EDuration="5.295046699s" totalImagesPullingTime="3.020798724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:09.294463166 +0000 UTC m=+49.895060011" watchObservedRunningTime="2026-07-28 17:35:09.295046699 +0000 UTC m=+49.895643540"
Jul 28 17:35:09.630220 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:09.630197    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-767g4_151361e3-6472-4146-8bcc-a07642a27801/migrator/0.log"
Jul 28 17:35:09.829575 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:09.829546    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-767g4_151361e3-6472-4146-8bcc-a07642a27801/graceful-termination/0.log"
Jul 28 17:35:11.066862 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:11.066822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:35:11.067321 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:11.066906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:35:11.067321 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:11.066990    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:35:11.067321 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:11.067057    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls podName:23bc825a-ecbd-43d1-8975-1b4c8877a57a nodeName:}" failed. No retries permitted until 2026-07-28 17:35:27.067038833 +0000 UTC m=+67.667635665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls") pod "dns-default-bln5h" (UID: "23bc825a-ecbd-43d1-8975-1b4c8877a57a") : secret "dns-default-metrics-tls" not found
Jul 28 17:35:11.067321 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:11.067072    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:35:11.067321 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:11.067118    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757d54b64c-rtskd: secret "image-registry-tls" not found
Jul 28 17:35:11.067321 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:11.067183    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls podName:08759346-76d5-4965-8ae5-18f60700eefa nodeName:}" failed. No retries permitted until 2026-07-28 17:35:27.067165719 +0000 UTC m=+67.667762534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls") pod "image-registry-757d54b64c-rtskd" (UID: "08759346-76d5-4965-8ae5-18f60700eefa") : secret "image-registry-tls" not found
Jul 28 17:35:12.987396 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:12.987360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:12.987880 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:12.987423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:12.987880 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:12.987537    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:35:12.987880 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:12.987615    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls podName:aecd2a92-b706-4ba2-96b5-93314f768397 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:20.987595606 +0000 UTC m=+61.588192427 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5rkdl" (UID: "aecd2a92-b706-4ba2-96b5-93314f768397") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:35:12.987880 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:12.987833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aecd2a92-b706-4ba2-96b5-93314f768397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:19.915572 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:19.915541    2561 scope.go:117] "RemoveContainer" containerID="4996dd38e6aa932120252fb9d9138997dd5ebcf46d4c038cac31a9d1d1c48a0d"
Jul 28 17:35:20.314410 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:20.314385    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:35:20.314870 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:20.314852    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/1.log"
Jul 28 17:35:20.314936 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:20.314888    2561 generic.go:356] "Generic (PLEG): container finished" podID="021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8" containerID="402fe16ff11df23e32de205f6b50f9f04fbf666e67b4e56257671b5421ff7220" exitCode=255
Jul 28 17:35:20.314936 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:20.314926    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" event={"ID":"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8","Type":"ContainerDied","Data":"402fe16ff11df23e32de205f6b50f9f04fbf666e67b4e56257671b5421ff7220"}
Jul 28 17:35:20.315002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:20.314977    2561 scope.go:117] "RemoveContainer" containerID="4996dd38e6aa932120252fb9d9138997dd5ebcf46d4c038cac31a9d1d1c48a0d"
Jul 28 17:35:20.315321 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:20.315298    2561 scope.go:117] "RemoveContainer" containerID="402fe16ff11df23e32de205f6b50f9f04fbf666e67b4e56257671b5421ff7220"
Jul 28 17:35:20.315514 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:20.315492    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-cbrrn_openshift-console-operator(021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" podUID="021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8"
Jul 28 17:35:21.043517 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:21.043484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:21.045918 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:21.045885    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aecd2a92-b706-4ba2-96b5-93314f768397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rkdl\" (UID: \"aecd2a92-b706-4ba2-96b5-93314f768397\") " pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:21.156548 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:21.156524    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xj8mn\""
Jul 28 17:35:21.164751 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:21.164724    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5rkdl"
Jul 28 17:35:21.201828 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:21.201802    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cwv"
Jul 28 17:35:21.319390 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:21.319318    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:35:21.320844 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:21.320825    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5rkdl"]
Jul 28 17:35:21.322973 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:35:21.322950    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecd2a92_b706_4ba2_96b5_93314f768397.slice/crio-3e0cdd4e6319808d162a7b4cd325256ea7598a227fb26e99302f41a9f8b99860 WatchSource:0}: Error finding container 3e0cdd4e6319808d162a7b4cd325256ea7598a227fb26e99302f41a9f8b99860: Status 404 returned error can't find the container with id 3e0cdd4e6319808d162a7b4cd325256ea7598a227fb26e99302f41a9f8b99860
Jul 28 17:35:22.324679 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:22.324634    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5rkdl" event={"ID":"aecd2a92-b706-4ba2-96b5-93314f768397","Type":"ContainerStarted","Data":"3e0cdd4e6319808d162a7b4cd325256ea7598a227fb26e99302f41a9f8b99860"}
Jul 28 17:35:25.582687 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.582651    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:35:25.585739 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.585717    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 17:35:25.595881 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.595853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8b54a7-67f6-4c25-bbab-a0623ea4ca12-metrics-certs\") pod \"network-metrics-daemon-8kbgj\" (UID: \"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12\") " pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:35:25.636183 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.636164    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z5ccl\""
Jul 28 17:35:25.643603 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.643582    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kbgj"
Jul 28 17:35:25.683405 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.683378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:35:25.686654 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.686635    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 17:35:25.695743 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.695723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e90f86d2-419b-4d0e-adf0-ffb6bb39aab4-original-pull-secret\") pod \"global-pull-secret-syncer-2fb74\" (UID: \"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4\") " pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:35:25.784625 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.784593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmk8\" (UniqueName: \"kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8\") pod \"network-check-target-gjhzc\" (UID: \"37ea1a6f-03d0-4d5c-83ac-650dc64dc493\") " pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:35:25.787057 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.787035    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkmk8\" (UniqueName: \"kubernetes.io/projected/37ea1a6f-03d0-4d5c-83ac-650dc64dc493-kube-api-access-tkmk8\") pod \"network-check-target-gjhzc\" (UID: \"37ea1a6f-03d0-4d5c-83ac-650dc64dc493\") " pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:35:25.926797 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.926721    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fb74"
Jul 28 17:35:25.941441 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.941421    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c22cz\""
Jul 28 17:35:25.949509 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:25.949489    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:35:26.519266 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.519241    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8kbgj"]
Jul 28 17:35:26.522485 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:35:26.522460    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8b54a7_67f6_4c25_bbab_a0623ea4ca12.slice/crio-deda5d1eeba9aaa6bf1f3630200796eda58f0a40ea21d2ccccc86b3d255b8e28 WatchSource:0}: Error finding container deda5d1eeba9aaa6bf1f3630200796eda58f0a40ea21d2ccccc86b3d255b8e28: Status 404 returned error can't find the container with id deda5d1eeba9aaa6bf1f3630200796eda58f0a40ea21d2ccccc86b3d255b8e28
Jul 28 17:35:26.745576 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.745551    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2fb74"]
Jul 28 17:35:26.748454 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.748431    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gjhzc"]
Jul 28 17:35:26.748908 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:35:26.748887    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90f86d2_419b_4d0e_adf0_ffb6bb39aab4.slice/crio-801456e8a1711aec2e490be70369e01f831a6b3dfc2927c0ce748dbe0fdcecf8 WatchSource:0}: Error finding container 801456e8a1711aec2e490be70369e01f831a6b3dfc2927c0ce748dbe0fdcecf8: Status 404 returned error can't find the container with id 801456e8a1711aec2e490be70369e01f831a6b3dfc2927c0ce748dbe0fdcecf8
Jul 28 17:35:26.751056 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:35:26.751035    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ea1a6f_03d0_4d5c_83ac_650dc64dc493.slice/crio-f151581e4cea5d8cdeecb8be246bb00ab1bd4e8ad07b70c14fb3f38c48151687 WatchSource:0}: Error finding container f151581e4cea5d8cdeecb8be246bb00ab1bd4e8ad07b70c14fb3f38c48151687: Status 404 returned error can't find the container with id f151581e4cea5d8cdeecb8be246bb00ab1bd4e8ad07b70c14fb3f38c48151687
Jul 28 17:35:26.872362 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.872338    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"]
Jul 28 17:35:26.874075 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.874061    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"
Jul 28 17:35:26.876859 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.876838    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bsfhr\""
Jul 28 17:35:26.877811 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.877793    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 17:35:26.878066 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.878047    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 17:35:26.878978 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.878960    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"]
Jul 28 17:35:26.881035 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.880989    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:26.883273 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.883251    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"]
Jul 28 17:35:26.883915 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.883896    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 28 17:35:26.884771 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.884743    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 28 17:35:26.884891 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.884770    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 28 17:35:26.884891 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.884828    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 17:35:26.885076 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.885057    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 17:35:26.885361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.885346    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:26.885831 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.885811    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 28 17:35:26.885831 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.885818    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 17:35:26.888949 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.888668    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 17:35:26.889720 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.889700    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"]
Jul 28 17:35:26.905378 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.905360    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"]
Jul 28 17:35:26.906239 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.906221    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"]
Jul 28 17:35:26.993516 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxqt\" (UniqueName: \"kubernetes.io/projected/1200993f-eaeb-4b61-a8bf-49b204100e30-kube-api-access-ccxqt\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:26.993646 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1a5ede28-dfa1-48fa-93fd-651a49d21298-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cd66b7b5b-srdnd\" (UID: \"1a5ede28-dfa1-48fa-93fd-651a49d21298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:26.993646 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993557    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-ca\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:26.993646 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1200993f-eaeb-4b61-a8bf-49b204100e30-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:26.993805 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:26.993805 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a5ede28-dfa1-48fa-93fd-651a49d21298-tmp\") pod \"klusterlet-addon-workmgr-7cd66b7b5b-srdnd\" (UID: \"1a5ede28-dfa1-48fa-93fd-651a49d21298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:26.993805 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c15e565f-1151-4447-992b-c9a6c5d80fef-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cgbdb\" (UID: \"c15e565f-1151-4447-992b-c9a6c5d80fef\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"
Jul 28 17:35:26.993805 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-hub\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:26.993805 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993793    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:26.994075 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c15e565f-1151-4447-992b-c9a6c5d80fef-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cgbdb\" (UID: \"c15e565f-1151-4447-992b-c9a6c5d80fef\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"
Jul 28 17:35:26.994075 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:26.993909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sm56\" (UniqueName: \"kubernetes.io/projected/1a5ede28-dfa1-48fa-93fd-651a49d21298-kube-api-access-2sm56\") pod \"klusterlet-addon-workmgr-7cd66b7b5b-srdnd\" (UID: \"1a5ede28-dfa1-48fa-93fd-651a49d21298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:27.094652 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-ca\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.094652 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1200993f-eaeb-4b61-a8bf-49b204100e30-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.094652 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.094839 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a5ede28-dfa1-48fa-93fd-651a49d21298-tmp\") pod \"klusterlet-addon-workmgr-7cd66b7b5b-srdnd\" (UID: \"1a5ede28-dfa1-48fa-93fd-651a49d21298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:27.094839 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c15e565f-1151-4447-992b-c9a6c5d80fef-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cgbdb\" (UID: \"c15e565f-1151-4447-992b-c9a6c5d80fef\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"
Jul 28 17:35:27.094839 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094726    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-hub\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.094839 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094761    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.094839 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:35:27.095023 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c15e565f-1151-4447-992b-c9a6c5d80fef-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cgbdb\" (UID: \"c15e565f-1151-4447-992b-c9a6c5d80fef\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"
Jul 28 17:35:27.095023 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sm56\" (UniqueName: \"kubernetes.io/projected/1a5ede28-dfa1-48fa-93fd-651a49d21298-kube-api-access-2sm56\") pod \"klusterlet-addon-workmgr-7cd66b7b5b-srdnd\" (UID: \"1a5ede28-dfa1-48fa-93fd-651a49d21298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:27.095023 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxqt\" (UniqueName: \"kubernetes.io/projected/1200993f-eaeb-4b61-a8bf-49b204100e30-kube-api-access-ccxqt\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.095023 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:35:27.095023 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.094923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1a5ede28-dfa1-48fa-93fd-651a49d21298-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cd66b7b5b-srdnd\" (UID: \"1a5ede28-dfa1-48fa-93fd-651a49d21298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:27.096491 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.095857    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c15e565f-1151-4447-992b-c9a6c5d80fef-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cgbdb\" (UID: \"c15e565f-1151-4447-992b-c9a6c5d80fef\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"
Jul 28 17:35:27.096491 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.095880    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1200993f-eaeb-4b61-a8bf-49b204100e30-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.096491 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.096185    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a5ede28-dfa1-48fa-93fd-651a49d21298-tmp\") pod \"klusterlet-addon-workmgr-7cd66b7b5b-srdnd\" (UID: \"1a5ede28-dfa1-48fa-93fd-651a49d21298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:27.098489 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.098468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.099365 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.099323    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23bc825a-ecbd-43d1-8975-1b4c8877a57a-metrics-tls\") pod \"dns-default-bln5h\" (UID: \"23bc825a-ecbd-43d1-8975-1b4c8877a57a\") " pod="openshift-dns/dns-default-bln5h"
Jul 28 17:35:27.099611 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.099588    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.100674 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.100074    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") pod \"image-registry-757d54b64c-rtskd\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") " pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:35:27.100674 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.100495    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c15e565f-1151-4447-992b-c9a6c5d80fef-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cgbdb\" (UID: \"c15e565f-1151-4447-992b-c9a6c5d80fef\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"
Jul 28 17:35:27.101067 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.101041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-ca\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.101197 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.101067    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1200993f-eaeb-4b61-a8bf-49b204100e30-hub\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.103247 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.103221    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1a5ede28-dfa1-48fa-93fd-651a49d21298-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cd66b7b5b-srdnd\" (UID: \"1a5ede28-dfa1-48fa-93fd-651a49d21298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:27.105000 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.104979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxqt\" (UniqueName: \"kubernetes.io/projected/1200993f-eaeb-4b61-a8bf-49b204100e30-kube-api-access-ccxqt\") pod \"cluster-proxy-proxy-agent-5667d784f-4fvkl\" (UID: \"1200993f-eaeb-4b61-a8bf-49b204100e30\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.105956 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.105930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sm56\" (UniqueName: \"kubernetes.io/projected/1a5ede28-dfa1-48fa-93fd-651a49d21298-kube-api-access-2sm56\") pod \"klusterlet-addon-workmgr-7cd66b7b5b-srdnd\" (UID: \"1a5ede28-dfa1-48fa-93fd-651a49d21298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:27.183654 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.183632    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"
Jul 28 17:35:27.201554 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.201534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"
Jul 28 17:35:27.207571 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.207552    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:27.348360 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.348113    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7jzp\""
Jul 28 17:35:27.353454 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.353344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8kbgj" event={"ID":"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12","Type":"ContainerStarted","Data":"deda5d1eeba9aaa6bf1f3630200796eda58f0a40ea21d2ccccc86b3d255b8e28"}
Jul 28 17:35:27.355665 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.355443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:35:27.360309 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.360252    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2fb74" event={"ID":"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4","Type":"ContainerStarted","Data":"801456e8a1711aec2e490be70369e01f831a6b3dfc2927c0ce748dbe0fdcecf8"}
Jul 28 17:35:27.363113 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.363059    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5rkdl" event={"ID":"aecd2a92-b706-4ba2-96b5-93314f768397","Type":"ContainerStarted","Data":"ea1fbd9e1251ed6ad133a1a023eb36b78bb09fefa855367b73fb624dcd0553bf"}
Jul 28 17:35:27.366124 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.365581    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gjhzc" event={"ID":"37ea1a6f-03d0-4d5c-83ac-650dc64dc493","Type":"ContainerStarted","Data":"93906e1a576df3ed169acd96b14f9bef91d99c3e1199b2710997727c7c6a19cb"}
Jul 28 17:35:27.366124 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.365621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gjhzc" event={"ID":"37ea1a6f-03d0-4d5c-83ac-650dc64dc493","Type":"ContainerStarted","Data":"f151581e4cea5d8cdeecb8be246bb00ab1bd4e8ad07b70c14fb3f38c48151687"}
Jul 28 17:35:27.366817 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.366409    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:35:27.366817 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.366627    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lxmvx\""
Jul 28 17:35:27.370003 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.369972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bln5h"
Jul 28 17:35:27.374288 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.373930    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb"]
Jul 28 17:35:27.392781 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.392737    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gjhzc" podStartSLOduration=66.392704176 podStartE2EDuration="1m6.392704176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:27.389693252 +0000 UTC m=+67.990290088" watchObservedRunningTime="2026-07-28 17:35:27.392704176 +0000 UTC m=+67.993301010"
Jul 28 17:35:27.404022 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.403798    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl"]
Jul 28 17:35:27.417647 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.417589    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"]
Jul 28 17:35:27.421270 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:35:27.421241    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5ede28_dfa1_48fa_93fd_651a49d21298.slice/crio-c2cb880bd1065045a83cf6f8a060fecdbc5079e65feaaa6d336105a81822a5db WatchSource:0}: Error finding container c2cb880bd1065045a83cf6f8a060fecdbc5079e65feaaa6d336105a81822a5db: Status 404 returned error can't find the container with id c2cb880bd1065045a83cf6f8a060fecdbc5079e65feaaa6d336105a81822a5db
Jul 28 17:35:27.558836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.558558    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-757d54b64c-rtskd"]
Jul 28 17:35:27.562172 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:35:27.561949    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08759346_76d5_4965_8ae5_18f60700eefa.slice/crio-40e8aa3c6ec6f642e9ee754be02176c0d73323ff96493ef6a8d2c3b6cd8a93da WatchSource:0}: Error finding container 40e8aa3c6ec6f642e9ee754be02176c0d73323ff96493ef6a8d2c3b6cd8a93da: Status 404 returned error can't find the container with id 40e8aa3c6ec6f642e9ee754be02176c0d73323ff96493ef6a8d2c3b6cd8a93da
Jul 28 17:35:27.574283 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:27.574260    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bln5h"]
Jul 28 17:35:27.578261 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:35:27.578192    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bc825a_ecbd_43d1_8975_1b4c8877a57a.slice/crio-f08bd347056aa91c36a01638dd49148380a8f34c3fcf209afa2e42d85aec96c2 WatchSource:0}: Error finding container f08bd347056aa91c36a01638dd49148380a8f34c3fcf209afa2e42d85aec96c2: Status 404 returned error can't find the container with id f08bd347056aa91c36a01638dd49148380a8f34c3fcf209afa2e42d85aec96c2
Jul 28 17:35:28.199841 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.199752    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:35:28.199841 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.199819    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:35:28.200357 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.200252    2561 scope.go:117] "RemoveContainer" containerID="402fe16ff11df23e32de205f6b50f9f04fbf666e67b4e56257671b5421ff7220"
Jul 28 17:35:28.200701 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:28.200481    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-cbrrn_openshift-console-operator(021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" podUID="021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8"
Jul 28 17:35:28.373160 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.373123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bln5h" event={"ID":"23bc825a-ecbd-43d1-8975-1b4c8877a57a","Type":"ContainerStarted","Data":"f08bd347056aa91c36a01638dd49148380a8f34c3fcf209afa2e42d85aec96c2"}
Jul 28 17:35:28.375297 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.375266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-757d54b64c-rtskd" event={"ID":"08759346-76d5-4965-8ae5-18f60700eefa","Type":"ContainerStarted","Data":"29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318"}
Jul 28 17:35:28.375431 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.375319    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-757d54b64c-rtskd" event={"ID":"08759346-76d5-4965-8ae5-18f60700eefa","Type":"ContainerStarted","Data":"40e8aa3c6ec6f642e9ee754be02176c0d73323ff96493ef6a8d2c3b6cd8a93da"}
Jul 28 17:35:28.376047 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.376028    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:35:28.377577 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.377527    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd" event={"ID":"1a5ede28-dfa1-48fa-93fd-651a49d21298","Type":"ContainerStarted","Data":"c2cb880bd1065045a83cf6f8a060fecdbc5079e65feaaa6d336105a81822a5db"}
Jul 28 17:35:28.378882 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.378856    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl" event={"ID":"1200993f-eaeb-4b61-a8bf-49b204100e30","Type":"ContainerStarted","Data":"8bd1776ca5782e5ec906bfa96eeb7dbeb13b5a5af833fbcc6565f2bbfc04a76b"}
Jul 28 17:35:28.380560 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.380505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb" event={"ID":"c15e565f-1151-4447-992b-c9a6c5d80fef","Type":"ContainerStarted","Data":"18f77bb780d8460bde8a235210e67d74ce171c7078e5d1bb59f9dd2cbf054f0c"}
Jul 28 17:35:28.400289 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:28.399111    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-757d54b64c-rtskd" podStartSLOduration=67.399076217 podStartE2EDuration="1m7.399076217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:28.398883488 +0000 UTC m=+68.999480322" watchObservedRunningTime="2026-07-28 17:35:28.399076217 +0000 UTC m=+68.999673051"
Jul 28 17:35:38.428612 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.428522    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8kbgj" event={"ID":"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12","Type":"ContainerStarted","Data":"2d018af701db2b9e9610c5893aa6dbddf2c1503fc49ea262ab2e83ab00a5b336"}
Jul 28 17:35:38.428612 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.428587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8kbgj" event={"ID":"ef8b54a7-67f6-4c25-bbab-a0623ea4ca12","Type":"ContainerStarted","Data":"fd1d98679d660b5fc0ee0fc856d85fecb9ce96682df4abbdd731276a1d367fcb"}
Jul 28 17:35:38.430062 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.430034    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2fb74" event={"ID":"e90f86d2-419b-4d0e-adf0-ffb6bb39aab4","Type":"ContainerStarted","Data":"af562def4c776e176f568acfa4b34784132ad3e3274561fbc1450dbd58d6a304"}
Jul 28 17:35:38.431462 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.431435    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd" event={"ID":"1a5ede28-dfa1-48fa-93fd-651a49d21298","Type":"ContainerStarted","Data":"73024d2f55121c78e411426347f5de42ca50233637aae910ae080ae02c0abe2a"}
Jul 28 17:35:38.431655 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.431633    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:38.433336 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.433316    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd"
Jul 28 17:35:38.433741 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.433722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl" event={"ID":"1200993f-eaeb-4b61-a8bf-49b204100e30","Type":"ContainerStarted","Data":"b0287b4cd9a9723cf8378ab50f02fa0c19d082460556417fb0b12f5b4771f9fd"}
Jul 28 17:35:38.433820 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.433755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl" event={"ID":"1200993f-eaeb-4b61-a8bf-49b204100e30","Type":"ContainerStarted","Data":"dda108d2c70d886587e077b065fc9617a4943a876a4e97e964b2f84f9d16435f"}
Jul 28 17:35:38.433820 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.433775    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl" event={"ID":"1200993f-eaeb-4b61-a8bf-49b204100e30","Type":"ContainerStarted","Data":"412b7db054ae91c4bd120e1d2df9e9ff675ee77a32c0628be2801a986ca601f8"}
Jul 28 17:35:38.435206 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.435179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb" event={"ID":"c15e565f-1151-4447-992b-c9a6c5d80fef","Type":"ContainerStarted","Data":"13349760fa0ae1dcff7c3bd0f58d31e089557c5ebc94b1914acbd8d2110f748f"}
Jul 28 17:35:38.436741 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.436721    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5rkdl" event={"ID":"aecd2a92-b706-4ba2-96b5-93314f768397","Type":"ContainerStarted","Data":"2e8c4ff51c4a741a5fc9ba087a979e30d5fc3342de4cb26985b3526b7fcfcb03"}
Jul 28 17:35:38.438418 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.438399    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bln5h" event={"ID":"23bc825a-ecbd-43d1-8975-1b4c8877a57a","Type":"ContainerStarted","Data":"c23b284cb16d54aaeba3a41e4d490ced09a1881e16d99e24eebc5570510669ae"}
Jul 28 17:35:38.438503 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.438433    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bln5h" event={"ID":"23bc825a-ecbd-43d1-8975-1b4c8877a57a","Type":"ContainerStarted","Data":"dcc4b6b761f25a03b7448f4257b945941f25bfec1b4b346ce8b797d96a632f9d"}
Jul 28 17:35:38.438542 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.438533    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bln5h"
Jul 28 17:35:38.447841 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.447801    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8kbgj" podStartSLOduration=69.901999472 podStartE2EDuration="1m18.44779042s" totalImagesPullingTime="8.545790948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:38.446724485 +0000 UTC m=+79.047321318" watchObservedRunningTime="2026-07-28 17:35:38.44779042 +0000 UTC m=+79.048387253"
Jul 28 17:35:38.467381 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.467346    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cgbdb" podStartSLOduration=2.020701332 podStartE2EDuration="12.467334503s" totalImagesPullingTime="10.446633171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:38.467152016 +0000 UTC m=+79.067748850" watchObservedRunningTime="2026-07-28 17:35:38.467334503 +0000 UTC m=+79.067931336"
Jul 28 17:35:38.489057 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.489010    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5667d784f-4fvkl" podStartSLOduration=1.9382924080000001 podStartE2EDuration="12.488994682s" totalImagesPullingTime="10.550702274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:38.487971831 +0000 UTC m=+79.088568668" watchObservedRunningTime="2026-07-28 17:35:38.488994682 +0000 UTC m=+79.089591515"
Jul 28 17:35:38.506797 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.506757    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2fb74" podStartSLOduration=66.32636439 podStartE2EDuration="1m17.506745387s" totalImagesPullingTime="11.180380997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:38.505971442 +0000 UTC m=+79.106568275" watchObservedRunningTime="2026-07-28 17:35:38.506745387 +0000 UTC m=+79.107342197"
Jul 28 17:35:38.530218 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.530174    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd66b7b5b-srdnd" podStartSLOduration=2.020632953 podStartE2EDuration="12.530156222s" totalImagesPullingTime="10.509523269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:38.529714702 +0000 UTC m=+79.130311564" watchObservedRunningTime="2026-07-28 17:35:38.530156222 +0000 UTC m=+79.130753056"
Jul 28 17:35:38.551478 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:38.551441    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bln5h" podStartSLOduration=33.202399429 podStartE2EDuration="43.551427926s" totalImagesPullingTime="10.349028497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:38.550566377 +0000 UTC m=+79.151163212" watchObservedRunningTime="2026-07-28 17:35:38.551427926 +0000 UTC m=+79.152024759"
Jul 28 17:35:40.915147 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:40.915088    2561 scope.go:117] "RemoveContainer" containerID="402fe16ff11df23e32de205f6b50f9f04fbf666e67b4e56257671b5421ff7220"
Jul 28 17:35:41.460252 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:41.460232    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:35:41.460364 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:41.460278    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" event={"ID":"021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8","Type":"ContainerStarted","Data":"ae8db4da1ddfb0ac8c1c3c401e1963db6b3a57164655342f68e7e6bb6b70b3e4"}
Jul 28 17:35:41.460570 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:41.460551    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:35:41.461977 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:41.461941    2561 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-cbrrn container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body=
Jul 28 17:35:41.462053 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:41.462022    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" podUID="021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused"
Jul 28 17:35:41.477856 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:41.477813    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn" podStartSLOduration=38.953472499 podStartE2EDuration="44.477798489s" totalImagesPullingTime="5.52432599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:41.477084666 +0000 UTC m=+82.077681500" watchObservedRunningTime="2026-07-28 17:35:41.477798489 +0000 UTC m=+82.078395321"
Jul 28 17:35:42.467128 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:42.466942    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5rkdl" event={"ID":"aecd2a92-b706-4ba2-96b5-93314f768397","Type":"ContainerStarted","Data":"474d25bb8b38e4a4ab82d421701f35b11a966a5af9518cc1a853d9dc0d448c41"}
Jul 28 17:35:42.476237 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:42.476205    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-cbrrn"
Jul 28 17:35:42.487694 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:42.487641    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5rkdl" podStartSLOduration=17.515238985 podStartE2EDuration="37.487622194s" totalImagesPullingTime="19.972383209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:35:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:42.487526395 +0000 UTC m=+83.088123218" watchObservedRunningTime="2026-07-28 17:35:42.487622194 +0000 UTC m=+83.088219031"
Jul 28 17:35:46.321882 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.321854    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9vvld"]
Jul 28 17:35:46.326382 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.326359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.329685 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.329664    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 17:35:46.329909 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.329716    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 17:35:46.330609 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.330591    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 17:35:46.331389 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.330909    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p6zg4\""
Jul 28 17:35:46.331389 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.330978    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 17:35:46.331543 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.331023    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 17:35:46.331543 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.331028    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 17:35:46.449425 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.449405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96fc0659-8ae2-462e-8765-eea74a43b1f7-metrics-client-ca\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.449514 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.449440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.449514 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.449459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96fc0659-8ae2-462e-8765-eea74a43b1f7-root\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.449514 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.449482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km68n\" (UniqueName: \"kubernetes.io/projected/96fc0659-8ae2-462e-8765-eea74a43b1f7-kube-api-access-km68n\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.449674 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.449580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-tls\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.449674 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.449616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.449674 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.449652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96fc0659-8ae2-462e-8765-eea74a43b1f7-sys\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.449815 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.449684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-textfile\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.449815 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.449717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-wtmp\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.550933 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.550913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96fc0659-8ae2-462e-8765-eea74a43b1f7-metrics-client-ca\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551039 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.550944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551039 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.550960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96fc0659-8ae2-462e-8765-eea74a43b1f7-root\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551039 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km68n\" (UniqueName: \"kubernetes.io/projected/96fc0659-8ae2-462e-8765-eea74a43b1f7-kube-api-access-km68n\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551230 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551044    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96fc0659-8ae2-462e-8765-eea74a43b1f7-root\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551230 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-tls\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551230 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551113    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551230 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:46.551130    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 17:35:46.551230 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96fc0659-8ae2-462e-8765-eea74a43b1f7-sys\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551230 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-textfile\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551230 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:35:46.551192    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-tls podName:96fc0659-8ae2-462e-8765-eea74a43b1f7 nodeName:}" failed. No retries permitted until 2026-07-28 17:35:47.05117391 +0000 UTC m=+87.651770720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-tls") pod "node-exporter-9vvld" (UID: "96fc0659-8ae2-462e-8765-eea74a43b1f7") : secret "node-exporter-tls" not found
Jul 28 17:35:46.551230 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-wtmp\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551624 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96fc0659-8ae2-462e-8765-eea74a43b1f7-sys\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551624 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551365    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-wtmp\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551624 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551545    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96fc0659-8ae2-462e-8765-eea74a43b1f7-metrics-client-ca\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551803 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551778    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.551937 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.551922    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-textfile\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.553706 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.553686    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:46.562508 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:46.562479    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km68n\" (UniqueName: \"kubernetes.io/projected/96fc0659-8ae2-462e-8765-eea74a43b1f7-kube-api-access-km68n\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:47.055826 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:47.055794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-tls\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:47.058036 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:47.058006    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96fc0659-8ae2-462e-8765-eea74a43b1f7-node-exporter-tls\") pod \"node-exporter-9vvld\" (UID: \"96fc0659-8ae2-462e-8765-eea74a43b1f7\") " pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:47.238268 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:47.238240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9vvld"
Jul 28 17:35:47.253163 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:35:47.253140    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96fc0659_8ae2_462e_8765_eea74a43b1f7.slice/crio-0527fc0ba1a61ec2635cc93186915ec0918d235eb5ec44e8a8fd4eaba5607b61 WatchSource:0}: Error finding container 0527fc0ba1a61ec2635cc93186915ec0918d235eb5ec44e8a8fd4eaba5607b61: Status 404 returned error can't find the container with id 0527fc0ba1a61ec2635cc93186915ec0918d235eb5ec44e8a8fd4eaba5607b61
Jul 28 17:35:47.360265 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:47.360217    2561 patch_prober.go:28] interesting pod/image-registry-757d54b64c-rtskd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 17:35:47.360265 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:47.360254    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-757d54b64c-rtskd" podUID="08759346-76d5-4965-8ae5-18f60700eefa" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:35:47.490805 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:47.490770    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vvld" event={"ID":"96fc0659-8ae2-462e-8765-eea74a43b1f7","Type":"ContainerStarted","Data":"0527fc0ba1a61ec2635cc93186915ec0918d235eb5ec44e8a8fd4eaba5607b61"}
Jul 28 17:35:48.453225 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:48.453169    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bln5h"
Jul 28 17:35:48.497113 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:48.497067    2561 generic.go:356] "Generic (PLEG): container finished" podID="96fc0659-8ae2-462e-8765-eea74a43b1f7" containerID="3aee82177b53f9f04a5366d560b967bb722c012b8fd78c202d227f64d106a212" exitCode=0
Jul 28 17:35:48.497246 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:48.497150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vvld" event={"ID":"96fc0659-8ae2-462e-8765-eea74a43b1f7","Type":"ContainerDied","Data":"3aee82177b53f9f04a5366d560b967bb722c012b8fd78c202d227f64d106a212"}
Jul 28 17:35:49.198355 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:49.198324    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-757d54b64c-rtskd"]
Jul 28 17:35:49.202687 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:49.202666    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:35:49.503530 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:49.503503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vvld" event={"ID":"96fc0659-8ae2-462e-8765-eea74a43b1f7","Type":"ContainerStarted","Data":"5bf73e5b2f0e3596ca0d35357514be5214ce70b73be25f9dd2404e201eccfe97"}
Jul 28 17:35:49.503874 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:49.503548    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vvld" event={"ID":"96fc0659-8ae2-462e-8765-eea74a43b1f7","Type":"ContainerStarted","Data":"47e61c9dfe4b3d8078bdf21218a3eb12c70e12d7d5cc02248fc5cea7ed286149"}
Jul 28 17:35:49.524402 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:49.524348    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9vvld" podStartSLOduration=2.517751691 podStartE2EDuration="3.524329967s" totalImagesPullingTime="943.74892ms" totalInitContainerRuntime="62.829356ms" isStatefulPod=true podCreationTimestamp="2026-07-28 17:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:49.52211273 +0000 UTC m=+90.122709555" watchObservedRunningTime="2026-07-28 17:35:49.524329967 +0000 UTC m=+90.124926802"
Jul 28 17:35:59.390043 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:35:59.390016    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gjhzc"
Jul 28 17:36:14.217341 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.217304    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-757d54b64c-rtskd" podUID="08759346-76d5-4965-8ae5-18f60700eefa" containerName="registry" containerID="cri-o://29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318" gracePeriod=30
Jul 28 17:36:14.488950 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.488928    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:36:14.596448 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.596415    2561 generic.go:356] "Generic (PLEG): container finished" podID="08759346-76d5-4965-8ae5-18f60700eefa" containerID="29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318" exitCode=0
Jul 28 17:36:14.596562 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.596459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-757d54b64c-rtskd" event={"ID":"08759346-76d5-4965-8ae5-18f60700eefa","Type":"ContainerDied","Data":"29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318"}
Jul 28 17:36:14.596562 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.596463    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-757d54b64c-rtskd"
Jul 28 17:36:14.596562 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.596504    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-757d54b64c-rtskd" event={"ID":"08759346-76d5-4965-8ae5-18f60700eefa","Type":"ContainerDied","Data":"40e8aa3c6ec6f642e9ee754be02176c0d73323ff96493ef6a8d2c3b6cd8a93da"}
Jul 28 17:36:14.596562 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.596529    2561 scope.go:117] "RemoveContainer" containerID="29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318"
Jul 28 17:36:14.606086 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.606036    2561 scope.go:117] "RemoveContainer" containerID="29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318"
Jul 28 17:36:14.606494 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:36:14.606475    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318\": container with ID starting with 29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318 not found: ID does not exist" containerID="29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318"
Jul 28 17:36:14.606564 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.606503    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318"} err="failed to get container status \"29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318\": rpc error: code = NotFound desc = could not find container \"29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318\": container with ID starting with 29c965b7642459e9d37c3f51c911c9fc39ec2f4d1fd305ae8fa97fcbf829d318 not found: ID does not exist"
Jul 28 17:36:14.639242 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639223    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/08759346-76d5-4965-8ae5-18f60700eefa-ca-trust-extracted\") pod \"08759346-76d5-4965-8ae5-18f60700eefa\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") "
Jul 28 17:36:14.639336 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639258    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-registry-certificates\") pod \"08759346-76d5-4965-8ae5-18f60700eefa\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") "
Jul 28 17:36:14.639336 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639279    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") pod \"08759346-76d5-4965-8ae5-18f60700eefa\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") "
Jul 28 17:36:14.639336 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639310    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scth8\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-kube-api-access-scth8\") pod \"08759346-76d5-4965-8ae5-18f60700eefa\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") "
Jul 28 17:36:14.639496 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639345    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-image-registry-private-configuration\") pod \"08759346-76d5-4965-8ae5-18f60700eefa\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") "
Jul 28 17:36:14.639550 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639493    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-bound-sa-token\") pod \"08759346-76d5-4965-8ae5-18f60700eefa\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") "
Jul 28 17:36:14.639550 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639544    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-trusted-ca\") pod \"08759346-76d5-4965-8ae5-18f60700eefa\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") "
Jul 28 17:36:14.639651 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639585    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-installation-pull-secrets\") pod \"08759346-76d5-4965-8ae5-18f60700eefa\" (UID: \"08759346-76d5-4965-8ae5-18f60700eefa\") "
Jul 28 17:36:14.639720 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639695    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "08759346-76d5-4965-8ae5-18f60700eefa" (UID: "08759346-76d5-4965-8ae5-18f60700eefa"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:36:14.639920 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639891    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-registry-certificates\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:36:14.639997 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.639970    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "08759346-76d5-4965-8ae5-18f60700eefa" (UID: "08759346-76d5-4965-8ae5-18f60700eefa"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:36:14.642003 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.641969    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-kube-api-access-scth8" (OuterVolumeSpecName: "kube-api-access-scth8") pod "08759346-76d5-4965-8ae5-18f60700eefa" (UID: "08759346-76d5-4965-8ae5-18f60700eefa"). InnerVolumeSpecName "kube-api-access-scth8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:36:14.642146 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.642057    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "08759346-76d5-4965-8ae5-18f60700eefa" (UID: "08759346-76d5-4965-8ae5-18f60700eefa"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:36:14.642146 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.642132    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "08759346-76d5-4965-8ae5-18f60700eefa" (UID: "08759346-76d5-4965-8ae5-18f60700eefa"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:36:14.642254 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.642165    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "08759346-76d5-4965-8ae5-18f60700eefa" (UID: "08759346-76d5-4965-8ae5-18f60700eefa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:36:14.642254 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.642194    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "08759346-76d5-4965-8ae5-18f60700eefa" (UID: "08759346-76d5-4965-8ae5-18f60700eefa"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:36:14.650546 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.650526    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08759346-76d5-4965-8ae5-18f60700eefa-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "08759346-76d5-4965-8ae5-18f60700eefa" (UID: "08759346-76d5-4965-8ae5-18f60700eefa"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:36:14.740377 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.740330    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-bound-sa-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:36:14.740377 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.740350    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/08759346-76d5-4965-8ae5-18f60700eefa-trusted-ca\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:36:14.740377 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.740359    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-installation-pull-secrets\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:36:14.740377 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.740374    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/08759346-76d5-4965-8ae5-18f60700eefa-ca-trust-extracted\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:36:14.740540 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.740387    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-registry-tls\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:36:14.740540 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.740400    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scth8\" (UniqueName: \"kubernetes.io/projected/08759346-76d5-4965-8ae5-18f60700eefa-kube-api-access-scth8\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:36:14.740540 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.740414    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/08759346-76d5-4965-8ae5-18f60700eefa-image-registry-private-configuration\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:36:14.921466 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.921346    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-757d54b64c-rtskd"]
Jul 28 17:36:14.926046 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:14.926021    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-757d54b64c-rtskd"]
Jul 28 17:36:15.919748 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:15.919709    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08759346-76d5-4965-8ae5-18f60700eefa" path="/var/lib/kubelet/pods/08759346-76d5-4965-8ae5-18f60700eefa/volumes"
Jul 28 17:36:25.640243 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:25.640207    2561 generic.go:356] "Generic (PLEG): container finished" podID="2383fc0a-e439-463b-b5ca-a8803d864945" containerID="8f98d4ff2e90cf39f0a99b4bd14e9402958a21b418148bb8cdee74553ba5eaee" exitCode=0
Jul 28 17:36:25.640689 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:25.640269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-wdx84" event={"ID":"2383fc0a-e439-463b-b5ca-a8803d864945","Type":"ContainerDied","Data":"8f98d4ff2e90cf39f0a99b4bd14e9402958a21b418148bb8cdee74553ba5eaee"}
Jul 28 17:36:25.640689 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:25.640574    2561 scope.go:117] "RemoveContainer" containerID="8f98d4ff2e90cf39f0a99b4bd14e9402958a21b418148bb8cdee74553ba5eaee"
Jul 28 17:36:26.648010 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:36:26.647972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-wdx84" event={"ID":"2383fc0a-e439-463b-b5ca-a8803d864945","Type":"ContainerStarted","Data":"c4ad61d271e3e60aaa144e6363c1d7bee14e1a18c49f16078009dccb51ca3474"}
Jul 28 17:39:19.758734 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:39:19.758705    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:39:19.763072 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:39:19.763047    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:39:19.775274 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:39:19.775124    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 17:40:16.869861 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:16.869768    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"]
Jul 28 17:40:16.870336 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:16.870081    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08759346-76d5-4965-8ae5-18f60700eefa" containerName="registry"
Jul 28 17:40:16.870336 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:16.870109    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="08759346-76d5-4965-8ae5-18f60700eefa" containerName="registry"
Jul 28 17:40:16.870336 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:16.870178    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="08759346-76d5-4965-8ae5-18f60700eefa" containerName="registry"
Jul 28 17:40:16.873692 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:16.873663    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"
Jul 28 17:40:16.877884 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:16.877858    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-g4czx\""
Jul 28 17:40:16.878039 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:16.877861    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:40:16.879249 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:16.879208    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 17:40:16.881503 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:16.881474    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"]
Jul 28 17:40:17.016464 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:17.016436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a1c6020-3cef-4138-816b-43c33d0a62c1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mwskh\" (UID: \"1a1c6020-3cef-4138-816b-43c33d0a62c1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"
Jul 28 17:40:17.016640 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:17.016538    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2lqn\" (UniqueName: \"kubernetes.io/projected/1a1c6020-3cef-4138-816b-43c33d0a62c1-kube-api-access-b2lqn\") pod \"openshift-lws-operator-fd8ccff4c-mwskh\" (UID: \"1a1c6020-3cef-4138-816b-43c33d0a62c1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"
Jul 28 17:40:17.117962 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:17.117932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2lqn\" (UniqueName: \"kubernetes.io/projected/1a1c6020-3cef-4138-816b-43c33d0a62c1-kube-api-access-b2lqn\") pod \"openshift-lws-operator-fd8ccff4c-mwskh\" (UID: \"1a1c6020-3cef-4138-816b-43c33d0a62c1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"
Jul 28 17:40:17.118139 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:17.117985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a1c6020-3cef-4138-816b-43c33d0a62c1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mwskh\" (UID: \"1a1c6020-3cef-4138-816b-43c33d0a62c1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"
Jul 28 17:40:17.118304 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:17.118284    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a1c6020-3cef-4138-816b-43c33d0a62c1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mwskh\" (UID: \"1a1c6020-3cef-4138-816b-43c33d0a62c1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"
Jul 28 17:40:17.129556 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:17.129500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2lqn\" (UniqueName: \"kubernetes.io/projected/1a1c6020-3cef-4138-816b-43c33d0a62c1-kube-api-access-b2lqn\") pod \"openshift-lws-operator-fd8ccff4c-mwskh\" (UID: \"1a1c6020-3cef-4138-816b-43c33d0a62c1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"
Jul 28 17:40:17.185374 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:17.185353    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"
Jul 28 17:40:17.313912 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:17.313884    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh"]
Jul 28 17:40:17.316942 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:40:17.316918    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a1c6020_3cef_4138_816b_43c33d0a62c1.slice/crio-fd10f7ff1f469fe73e8a4bf5094b4d953462fe7838eb8b028d1d3ec52eff4aae WatchSource:0}: Error finding container fd10f7ff1f469fe73e8a4bf5094b4d953462fe7838eb8b028d1d3ec52eff4aae: Status 404 returned error can't find the container with id fd10f7ff1f469fe73e8a4bf5094b4d953462fe7838eb8b028d1d3ec52eff4aae
Jul 28 17:40:17.318884 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:17.318866    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:40:17.515059 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:17.515028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh" event={"ID":"1a1c6020-3cef-4138-816b-43c33d0a62c1","Type":"ContainerStarted","Data":"fd10f7ff1f469fe73e8a4bf5094b4d953462fe7838eb8b028d1d3ec52eff4aae"}
Jul 28 17:40:20.529894 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:20.529858    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh" event={"ID":"1a1c6020-3cef-4138-816b-43c33d0a62c1","Type":"ContainerStarted","Data":"b4edd40b140927103072a11cb768b2ce4663f4319b2c14e4de1c6a97e68a2f11"}
Jul 28 17:40:20.551208 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:20.551166    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mwskh" podStartSLOduration=1.96748775 podStartE2EDuration="4.551150969s" totalImagesPullingTime="2.583663219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:40:20.54982718 +0000 UTC m=+361.150424013" watchObservedRunningTime="2026-07-28 17:40:20.551150969 +0000 UTC m=+361.151747839"
Jul 28 17:40:37.554904 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.554865    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"]
Jul 28 17:40:37.561724 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.561706    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.564342 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.564307    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 17:40:37.564569 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.564531    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-djnth\""
Jul 28 17:40:37.565206 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.564846    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 17:40:37.565206 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.564915    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 17:40:37.565206 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.564997    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 17:40:37.595606 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.595580    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"]
Jul 28 17:40:37.654885 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.654866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a64e393-3b41-4e30-9481-beca23a922f8-tmp\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.654988 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.654899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a64e393-3b41-4e30-9481-beca23a922f8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.654988 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.654919    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2fwl\" (UniqueName: \"kubernetes.io/projected/9a64e393-3b41-4e30-9481-beca23a922f8-kube-api-access-k2fwl\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.655079 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.654992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a64e393-3b41-4e30-9481-beca23a922f8-manifests\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.655079 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.655018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a64e393-3b41-4e30-9481-beca23a922f8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.755922 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.755894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a64e393-3b41-4e30-9481-beca23a922f8-manifests\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.756011 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.755924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a64e393-3b41-4e30-9481-beca23a922f8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.756011 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.755955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a64e393-3b41-4e30-9481-beca23a922f8-tmp\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.756011 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.755985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a64e393-3b41-4e30-9481-beca23a922f8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.756224 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.756011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2fwl\" (UniqueName: \"kubernetes.io/projected/9a64e393-3b41-4e30-9481-beca23a922f8-kube-api-access-k2fwl\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.756322 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.756289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a64e393-3b41-4e30-9481-beca23a922f8-manifests\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.758334 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.758304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a64e393-3b41-4e30-9481-beca23a922f8-tmp\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.758672 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.758650    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a64e393-3b41-4e30-9481-beca23a922f8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.758754 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.758685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a64e393-3b41-4e30-9481-beca23a922f8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.767380 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.767355    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2fwl\" (UniqueName: \"kubernetes.io/projected/9a64e393-3b41-4e30-9481-beca23a922f8-kube-api-access-k2fwl\") pod \"opendatahub-operator-controller-manager-5c7c5665b5-fr8dz\" (UID: \"9a64e393-3b41-4e30-9481-beca23a922f8\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:37.875300 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:37.875243    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:38.017906 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:38.017882    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"]
Jul 28 17:40:38.020877 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:40:38.020841    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a64e393_3b41_4e30_9481_beca23a922f8.slice/crio-9ec8e44699c026929626aab3948344a46a85d4165d5e4e7c877b9d0f4aa19200 WatchSource:0}: Error finding container 9ec8e44699c026929626aab3948344a46a85d4165d5e4e7c877b9d0f4aa19200: Status 404 returned error can't find the container with id 9ec8e44699c026929626aab3948344a46a85d4165d5e4e7c877b9d0f4aa19200
Jul 28 17:40:38.600306 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:38.600265    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz" event={"ID":"9a64e393-3b41-4e30-9481-beca23a922f8","Type":"ContainerStarted","Data":"9ec8e44699c026929626aab3948344a46a85d4165d5e4e7c877b9d0f4aa19200"}
Jul 28 17:40:41.619103 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:41.619056    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz" event={"ID":"9a64e393-3b41-4e30-9481-beca23a922f8","Type":"ContainerStarted","Data":"00dd8c7aef820d3cd5ff2f990e6cae36ce553511b4c940a5bc594698011b6d6e"}
Jul 28 17:40:42.625216 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:42.625183    2561 generic.go:356] "Generic (PLEG): container finished" podID="9a64e393-3b41-4e30-9481-beca23a922f8" containerID="00dd8c7aef820d3cd5ff2f990e6cae36ce553511b4c940a5bc594698011b6d6e" exitCode=0
Jul 28 17:40:42.625576 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:42.625282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz" event={"ID":"9a64e393-3b41-4e30-9481-beca23a922f8","Type":"ContainerDied","Data":"00dd8c7aef820d3cd5ff2f990e6cae36ce553511b4c940a5bc594698011b6d6e"}
Jul 28 17:40:43.631029 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:43.630987    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz" event={"ID":"9a64e393-3b41-4e30-9481-beca23a922f8","Type":"ContainerStarted","Data":"ab32bed365bc4b38e9d4a2f76d57d4cd0c314fc33518a2a3a3a08ed17a949f33"}
Jul 28 17:40:43.631452 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:43.631079    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:43.656399 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:43.656355    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz" podStartSLOduration=2.345309263 podStartE2EDuration="6.65633977s" totalImagesPullingTime="3.239885304s" totalInitContainerRuntime="1.071145203s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:40:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:40:43.654626816 +0000 UTC m=+384.255223640" watchObservedRunningTime="2026-07-28 17:40:43.65633977 +0000 UTC m=+384.256936603"
Jul 28 17:40:54.636933 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:54.636899    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c7c5665b5-fr8dz"
Jul 28 17:40:55.616223 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.616189    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"]
Jul 28 17:40:55.624624 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.624602    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.627542 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.627523    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 17:40:55.628670 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.628645    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 17:40:55.628772 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.628676    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 17:40:55.628838 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.628655    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-prcts\""
Jul 28 17:40:55.631042 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.631019    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"]
Jul 28 17:40:55.790796 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.790767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e32e97e-2aeb-42cb-9537-f04305fd24eb-cert\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.791212 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.790812    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e32e97e-2aeb-42cb-9537-f04305fd24eb-manager-config\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.791212 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.790837    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x44n2\" (UniqueName: \"kubernetes.io/projected/8e32e97e-2aeb-42cb-9537-f04305fd24eb-kube-api-access-x44n2\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.791212 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.790903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e32e97e-2aeb-42cb-9537-f04305fd24eb-metrics-cert\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.892002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.891935    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e32e97e-2aeb-42cb-9537-f04305fd24eb-metrics-cert\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.892002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.891979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e32e97e-2aeb-42cb-9537-f04305fd24eb-cert\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.892226 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.892006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e32e97e-2aeb-42cb-9537-f04305fd24eb-manager-config\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.892226 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.892025    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x44n2\" (UniqueName: \"kubernetes.io/projected/8e32e97e-2aeb-42cb-9537-f04305fd24eb-kube-api-access-x44n2\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.892704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.892680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e32e97e-2aeb-42cb-9537-f04305fd24eb-manager-config\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.894361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.894339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e32e97e-2aeb-42cb-9537-f04305fd24eb-metrics-cert\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.894562 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.894541    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e32e97e-2aeb-42cb-9537-f04305fd24eb-cert\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.900700 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.900678    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x44n2\" (UniqueName: \"kubernetes.io/projected/8e32e97e-2aeb-42cb-9537-f04305fd24eb-kube-api-access-x44n2\") pod \"lws-controller-manager-8c847c87f-b6k9p\" (UID: \"8e32e97e-2aeb-42cb-9537-f04305fd24eb\") " pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:55.934738 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:55.934717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:56.066406 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:56.066382    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"]
Jul 28 17:40:56.068720 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:40:56.068691    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e32e97e_2aeb_42cb_9537_f04305fd24eb.slice/crio-99dd683b3839f3b3a9155d32ed80b2bb5a7a45269baa27c0a37b04b40198c7d2 WatchSource:0}: Error finding container 99dd683b3839f3b3a9155d32ed80b2bb5a7a45269baa27c0a37b04b40198c7d2: Status 404 returned error can't find the container with id 99dd683b3839f3b3a9155d32ed80b2bb5a7a45269baa27c0a37b04b40198c7d2
Jul 28 17:40:56.688488 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:56.688453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p" event={"ID":"8e32e97e-2aeb-42cb-9537-f04305fd24eb","Type":"ContainerStarted","Data":"99dd683b3839f3b3a9155d32ed80b2bb5a7a45269baa27c0a37b04b40198c7d2"}
Jul 28 17:40:57.693518 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:57.693487    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p" event={"ID":"8e32e97e-2aeb-42cb-9537-f04305fd24eb","Type":"ContainerStarted","Data":"b4a2fbcce3bae1857092eea31191f6be6005744c674e301bd65b2146f308987c"}
Jul 28 17:40:57.693893 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:57.693622    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:40:57.714452 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:40:57.714407    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p" podStartSLOduration=1.190392441 podStartE2EDuration="2.714391699s" totalImagesPullingTime="1.523999258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:40:57.713221098 +0000 UTC m=+398.313817931" watchObservedRunningTime="2026-07-28 17:40:57.714391699 +0000 UTC m=+398.314988531"
Jul 28 17:41:08.699430 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:08.699398    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8c847c87f-b6k9p"
Jul 28 17:41:16.032361 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.032323    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"]
Jul 28 17:41:16.040707 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.040677    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.043366 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.043342    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 17:41:16.043366 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.043353    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 17:41:16.043567 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.043433    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 17:41:16.043567 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.043468    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-795vf\""
Jul 28 17:41:16.047909 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.047885    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"]
Jul 28 17:41:16.149629 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.149603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.149767 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.149633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.149767 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.149658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.149767 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.149718    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.149927 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.149769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.149927 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.149792    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mgm6\" (UniqueName: \"kubernetes.io/projected/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-kube-api-access-6mgm6\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.149927 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.149819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.149927 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.149847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.150148 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.149951    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250255 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250368 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250368 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mgm6\" (UniqueName: \"kubernetes.io/projected/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-kube-api-access-6mgm6\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250368 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250368 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250568 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250568 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250568 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250723 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250658    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250723 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.250823 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.250786    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.251042 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.251024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.251167 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.251121    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.251167 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.251139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.252466 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.252446    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.253131 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.253111    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.262264 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.262238    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.262342 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.262299    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mgm6\" (UniqueName: \"kubernetes.io/projected/725b8dbe-d66c-4ff7-841d-b9ee89319cf2-kube-api-access-6mgm6\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cf8frj\" (UID: \"725b8dbe-d66c-4ff7-841d-b9ee89319cf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.352236 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.352182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:16.483121 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.483074    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"]
Jul 28 17:41:16.486064 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:41:16.486034    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725b8dbe_d66c_4ff7_841d_b9ee89319cf2.slice/crio-41a736c5747c735e228cd0e80c6b6e2ac4f99ef8cc23076e357c01113fefed8c WatchSource:0}: Error finding container 41a736c5747c735e228cd0e80c6b6e2ac4f99ef8cc23076e357c01113fefed8c: Status 404 returned error can't find the container with id 41a736c5747c735e228cd0e80c6b6e2ac4f99ef8cc23076e357c01113fefed8c
Jul 28 17:41:16.770788 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:16.770761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj" event={"ID":"725b8dbe-d66c-4ff7-841d-b9ee89319cf2","Type":"ContainerStarted","Data":"41a736c5747c735e228cd0e80c6b6e2ac4f99ef8cc23076e357c01113fefed8c"}
Jul 28 17:41:19.148797 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:19.148751    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 17:41:19.149070 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:19.148856    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 17:41:19.149070 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:19.148890    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 17:41:19.786722 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:19.786687    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj" event={"ID":"725b8dbe-d66c-4ff7-841d-b9ee89319cf2","Type":"ContainerStarted","Data":"e86229c156889cec8f60fbf54e97fe1b08862e5e111b00fc0841879ef934f766"}
Jul 28 17:41:19.810978 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:19.810927    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj" podStartSLOduration=1.150396444 podStartE2EDuration="3.810913684s" totalImagesPullingTime="2.66051724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:41:19.810042098 +0000 UTC m=+420.410638933" watchObservedRunningTime="2026-07-28 17:41:19.810913684 +0000 UTC m=+420.411510516"
Jul 28 17:41:20.353196 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:20.353165    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:20.357392 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:20.357370    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:20.791681 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:20.791648    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:20.792678 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:20.792655    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf8frj"
Jul 28 17:41:57.981993 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:57.981917    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpq69"]
Jul 28 17:41:57.991313 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:57.991288    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zpq69"
Jul 28 17:41:57.994227 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:57.994196    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpq69"]
Jul 28 17:41:57.995164 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:57.995143    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 17:41:57.995314 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:57.995290    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-lwx2w\""
Jul 28 17:41:57.995523 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:57.995501    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 17:41:58.141520 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.141487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppfrk\" (UniqueName: \"kubernetes.io/projected/e37b5634-3172-49b0-a0c1-05e6adb1b34c-kube-api-access-ppfrk\") pod \"kuadrant-operator-catalog-zpq69\" (UID: \"e37b5634-3172-49b0-a0c1-05e6adb1b34c\") " pod="kuadrant-system/kuadrant-operator-catalog-zpq69"
Jul 28 17:41:58.242724 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.242661    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppfrk\" (UniqueName: \"kubernetes.io/projected/e37b5634-3172-49b0-a0c1-05e6adb1b34c-kube-api-access-ppfrk\") pod \"kuadrant-operator-catalog-zpq69\" (UID: \"e37b5634-3172-49b0-a0c1-05e6adb1b34c\") " pod="kuadrant-system/kuadrant-operator-catalog-zpq69"
Jul 28 17:41:58.253034 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.253010    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppfrk\" (UniqueName: \"kubernetes.io/projected/e37b5634-3172-49b0-a0c1-05e6adb1b34c-kube-api-access-ppfrk\") pod \"kuadrant-operator-catalog-zpq69\" (UID: \"e37b5634-3172-49b0-a0c1-05e6adb1b34c\") " pod="kuadrant-system/kuadrant-operator-catalog-zpq69"
Jul 28 17:41:58.302054 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.302029    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zpq69"
Jul 28 17:41:58.338687 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.338659    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpq69"]
Jul 28 17:41:58.437625 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.437599    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpq69"]
Jul 28 17:41:58.440263 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:41:58.440237    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37b5634_3172_49b0_a0c1_05e6adb1b34c.slice/crio-bb999df07b3bca244992e0684f07ef255816bac3946c7ad3694c1094b9015d6a WatchSource:0}: Error finding container bb999df07b3bca244992e0684f07ef255816bac3946c7ad3694c1094b9015d6a: Status 404 returned error can't find the container with id bb999df07b3bca244992e0684f07ef255816bac3946c7ad3694c1094b9015d6a
Jul 28 17:41:58.551142 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.551081    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fvps8"]
Jul 28 17:41:58.555584 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.555569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fvps8"
Jul 28 17:41:58.563777 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.563756    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fvps8"]
Jul 28 17:41:58.645731 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.645707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fsbq\" (UniqueName: \"kubernetes.io/projected/6d5196e9-e886-469a-8b34-d0605c4bc947-kube-api-access-9fsbq\") pod \"kuadrant-operator-catalog-fvps8\" (UID: \"6d5196e9-e886-469a-8b34-d0605c4bc947\") " pod="kuadrant-system/kuadrant-operator-catalog-fvps8"
Jul 28 17:41:58.746426 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.746391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fsbq\" (UniqueName: \"kubernetes.io/projected/6d5196e9-e886-469a-8b34-d0605c4bc947-kube-api-access-9fsbq\") pod \"kuadrant-operator-catalog-fvps8\" (UID: \"6d5196e9-e886-469a-8b34-d0605c4bc947\") " pod="kuadrant-system/kuadrant-operator-catalog-fvps8"
Jul 28 17:41:58.756147 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.756117    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fsbq\" (UniqueName: \"kubernetes.io/projected/6d5196e9-e886-469a-8b34-d0605c4bc947-kube-api-access-9fsbq\") pod \"kuadrant-operator-catalog-fvps8\" (UID: \"6d5196e9-e886-469a-8b34-d0605c4bc947\") " pod="kuadrant-system/kuadrant-operator-catalog-fvps8"
Jul 28 17:41:58.865210 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.865156    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fvps8"
Jul 28 17:41:58.957399 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.957365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zpq69" event={"ID":"e37b5634-3172-49b0-a0c1-05e6adb1b34c","Type":"ContainerStarted","Data":"bb999df07b3bca244992e0684f07ef255816bac3946c7ad3694c1094b9015d6a"}
Jul 28 17:41:58.991973 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:58.991931    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fvps8"]
Jul 28 17:41:58.993962 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:41:58.993938    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5196e9_e886_469a_8b34_d0605c4bc947.slice/crio-c95b782b28298e660013fcaf2b70ee308114b0205c864a7b97e22c92915ace50 WatchSource:0}: Error finding container c95b782b28298e660013fcaf2b70ee308114b0205c864a7b97e22c92915ace50: Status 404 returned error can't find the container with id c95b782b28298e660013fcaf2b70ee308114b0205c864a7b97e22c92915ace50
Jul 28 17:41:59.969925 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:41:59.969876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fvps8" event={"ID":"6d5196e9-e886-469a-8b34-d0605c4bc947","Type":"ContainerStarted","Data":"c95b782b28298e660013fcaf2b70ee308114b0205c864a7b97e22c92915ace50"}
Jul 28 17:42:00.976513 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:00.976467    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fvps8" event={"ID":"6d5196e9-e886-469a-8b34-d0605c4bc947","Type":"ContainerStarted","Data":"767cea426c20200c8f04053e1fd27979e60d02dcec206ed7f13bddc1fc666f34"}
Jul 28 17:42:00.978240 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:00.978198    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zpq69" event={"ID":"e37b5634-3172-49b0-a0c1-05e6adb1b34c","Type":"ContainerStarted","Data":"ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac"}
Jul 28 17:42:00.978396 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:00.978265    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zpq69" podUID="e37b5634-3172-49b0-a0c1-05e6adb1b34c" containerName="registry-server" containerID="cri-o://ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac" gracePeriod=2
Jul 28 17:42:00.999765 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:00.999707    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fvps8" podStartSLOduration=1.209601747 podStartE2EDuration="2.999688969s" totalImagesPullingTime="1.790087222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:42:00.998582226 +0000 UTC m=+461.599179084" watchObservedRunningTime="2026-07-28 17:42:00.999688969 +0000 UTC m=+461.600285826"
Jul 28 17:42:01.018533 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.018466    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zpq69" podStartSLOduration=1.6756475960000001 podStartE2EDuration="4.018441195s" totalImagesPullingTime="2.342793599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:42:01.016229362 +0000 UTC m=+461.616826196" watchObservedRunningTime="2026-07-28 17:42:01.018441195 +0000 UTC m=+461.619038029"
Jul 28 17:42:01.226776 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.226740    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zpq69"
Jul 28 17:42:01.369123 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.369006    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppfrk\" (UniqueName: \"kubernetes.io/projected/e37b5634-3172-49b0-a0c1-05e6adb1b34c-kube-api-access-ppfrk\") pod \"e37b5634-3172-49b0-a0c1-05e6adb1b34c\" (UID: \"e37b5634-3172-49b0-a0c1-05e6adb1b34c\") "
Jul 28 17:42:01.371472 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.371439    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37b5634-3172-49b0-a0c1-05e6adb1b34c-kube-api-access-ppfrk" (OuterVolumeSpecName: "kube-api-access-ppfrk") pod "e37b5634-3172-49b0-a0c1-05e6adb1b34c" (UID: "e37b5634-3172-49b0-a0c1-05e6adb1b34c"). InnerVolumeSpecName "kube-api-access-ppfrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:42:01.470301 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.470264    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppfrk\" (UniqueName: \"kubernetes.io/projected/e37b5634-3172-49b0-a0c1-05e6adb1b34c-kube-api-access-ppfrk\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:42:01.983781 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.983738    2561 generic.go:356] "Generic (PLEG): container finished" podID="e37b5634-3172-49b0-a0c1-05e6adb1b34c" containerID="ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac" exitCode=0
Jul 28 17:42:01.984271 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.983789    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zpq69"
Jul 28 17:42:01.984271 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.983825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zpq69" event={"ID":"e37b5634-3172-49b0-a0c1-05e6adb1b34c","Type":"ContainerDied","Data":"ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac"}
Jul 28 17:42:01.984271 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.983883    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zpq69" event={"ID":"e37b5634-3172-49b0-a0c1-05e6adb1b34c","Type":"ContainerDied","Data":"bb999df07b3bca244992e0684f07ef255816bac3946c7ad3694c1094b9015d6a"}
Jul 28 17:42:01.984271 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.983903    2561 scope.go:117] "RemoveContainer" containerID="ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac"
Jul 28 17:42:01.993071 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.993004    2561 scope.go:117] "RemoveContainer" containerID="ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac"
Jul 28 17:42:01.993458 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:42:01.993435    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac\": container with ID starting with ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac not found: ID does not exist" containerID="ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac"
Jul 28 17:42:01.993561 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:01.993469    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac"} err="failed to get container status \"ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac\": rpc error: code = NotFound desc = could not find container \"ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac\": container with ID starting with ba6d00c21405a98c6f9d1c4564ebbf427a5f14f5a618fe1f7dc5cbc9461749ac not found: ID does not exist"
Jul 28 17:42:02.009004 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:02.008971    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpq69"]
Jul 28 17:42:02.014834 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:02.014803    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpq69"]
Jul 28 17:42:03.920917 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:03.920828    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e37b5634-3172-49b0-a0c1-05e6adb1b34c" path="/var/lib/kubelet/pods/e37b5634-3172-49b0-a0c1-05e6adb1b34c/volumes"
Jul 28 17:42:08.865592 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:08.865550    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fvps8"
Jul 28 17:42:08.866033 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:08.865656    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fvps8"
Jul 28 17:42:08.887797 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:08.887771    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fvps8"
Jul 28 17:42:09.035550 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:09.035523    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fvps8"
Jul 28 17:42:23.902349 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:23.902307    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"]
Jul 28 17:42:23.902763 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:23.902623    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37b5634-3172-49b0-a0c1-05e6adb1b34c" containerName="registry-server"
Jul 28 17:42:23.902763 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:23.902635    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37b5634-3172-49b0-a0c1-05e6adb1b34c" containerName="registry-server"
Jul 28 17:42:23.902763 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:23.902694    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37b5634-3172-49b0-a0c1-05e6adb1b34c" containerName="registry-server"
Jul 28 17:42:23.906694 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:23.906666    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:23.909495 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:23.909468    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-npwpf\""
Jul 28 17:42:23.920984 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:23.920953    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"]
Jul 28 17:42:24.044496 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:24.044446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q7tr\" (UniqueName: \"kubernetes.io/projected/6d27eab3-9927-41a3-8a90-0b0c23cce778-kube-api-access-5q7tr\") pod \"limitador-operator-controller-manager-859d7b78bd-8qz7k\" (UID: \"6d27eab3-9927-41a3-8a90-0b0c23cce778\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:24.145229 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:24.145183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q7tr\" (UniqueName: \"kubernetes.io/projected/6d27eab3-9927-41a3-8a90-0b0c23cce778-kube-api-access-5q7tr\") pod \"limitador-operator-controller-manager-859d7b78bd-8qz7k\" (UID: \"6d27eab3-9927-41a3-8a90-0b0c23cce778\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:24.160376 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:24.160290    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q7tr\" (UniqueName: \"kubernetes.io/projected/6d27eab3-9927-41a3-8a90-0b0c23cce778-kube-api-access-5q7tr\") pod \"limitador-operator-controller-manager-859d7b78bd-8qz7k\" (UID: \"6d27eab3-9927-41a3-8a90-0b0c23cce778\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:24.218442 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:24.218402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:24.367332 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:24.367214    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"]
Jul 28 17:42:24.370168 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:42:24.370129    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d27eab3_9927_41a3_8a90_0b0c23cce778.slice/crio-d288db90ede7087e7e56104583370ee76529bcf5711bbb71867ff07ea636db31 WatchSource:0}: Error finding container d288db90ede7087e7e56104583370ee76529bcf5711bbb71867ff07ea636db31: Status 404 returned error can't find the container with id d288db90ede7087e7e56104583370ee76529bcf5711bbb71867ff07ea636db31
Jul 28 17:42:25.082358 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:25.082312    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k" event={"ID":"6d27eab3-9927-41a3-8a90-0b0c23cce778","Type":"ContainerStarted","Data":"d288db90ede7087e7e56104583370ee76529bcf5711bbb71867ff07ea636db31"}
Jul 28 17:42:26.089028 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:26.088988    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k" event={"ID":"6d27eab3-9927-41a3-8a90-0b0c23cce778","Type":"ContainerStarted","Data":"2ffe43d8485d1f686102c693285f9d57e7b53dae927ddb00e1e94adb89d67aeb"}
Jul 28 17:42:26.089570 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:26.089078    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:26.109301 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:26.109244    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k" podStartSLOduration=1.59323762 podStartE2EDuration="3.109224593s" totalImagesPullingTime="1.515986973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:42:26.107801362 +0000 UTC m=+486.708398195" watchObservedRunningTime="2026-07-28 17:42:26.109224593 +0000 UTC m=+486.709821425"
Jul 28 17:42:31.294014 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:31.293973    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-88brq"]
Jul 28 17:42:31.298494 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:31.298470    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-88brq"
Jul 28 17:42:31.301298 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:31.301272    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wx887\""
Jul 28 17:42:31.303864 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:31.303820    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssh97\" (UniqueName: \"kubernetes.io/projected/2b51f0a9-c131-463f-a860-f4bb81948f22-kube-api-access-ssh97\") pod \"authorino-operator-75cc8d5cb7-88brq\" (UID: \"2b51f0a9-c131-463f-a860-f4bb81948f22\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-88brq"
Jul 28 17:42:31.311269 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:31.311239    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-88brq"]
Jul 28 17:42:31.404815 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:31.404773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssh97\" (UniqueName: \"kubernetes.io/projected/2b51f0a9-c131-463f-a860-f4bb81948f22-kube-api-access-ssh97\") pod \"authorino-operator-75cc8d5cb7-88brq\" (UID: \"2b51f0a9-c131-463f-a860-f4bb81948f22\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-88brq"
Jul 28 17:42:31.418566 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:31.418535    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssh97\" (UniqueName: \"kubernetes.io/projected/2b51f0a9-c131-463f-a860-f4bb81948f22-kube-api-access-ssh97\") pod \"authorino-operator-75cc8d5cb7-88brq\" (UID: \"2b51f0a9-c131-463f-a860-f4bb81948f22\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-88brq"
Jul 28 17:42:31.609135 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:31.608995    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-88brq"
Jul 28 17:42:31.761617 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:31.761522    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-88brq"]
Jul 28 17:42:31.764655 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:42:31.764629    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b51f0a9_c131_463f_a860_f4bb81948f22.slice/crio-e19951eb9272ce6cd518ace5033452bc60044f318641b59d50d6a3025b1c1c04 WatchSource:0}: Error finding container e19951eb9272ce6cd518ace5033452bc60044f318641b59d50d6a3025b1c1c04: Status 404 returned error can't find the container with id e19951eb9272ce6cd518ace5033452bc60044f318641b59d50d6a3025b1c1c04
Jul 28 17:42:32.117702 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:32.117655    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-88brq" event={"ID":"2b51f0a9-c131-463f-a860-f4bb81948f22","Type":"ContainerStarted","Data":"e19951eb9272ce6cd518ace5033452bc60044f318641b59d50d6a3025b1c1c04"}
Jul 28 17:42:34.128291 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:34.128253    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-88brq" event={"ID":"2b51f0a9-c131-463f-a860-f4bb81948f22","Type":"ContainerStarted","Data":"6a4a7c1d1c4033a70b8d6ceb902e9cbcbd26dc03be02fa4264f3dc8d14c03cd4"}
Jul 28 17:42:34.128707 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:34.128379    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-88brq"
Jul 28 17:42:34.146906 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:34.146852    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-88brq" podStartSLOduration=0.943893776 podStartE2EDuration="3.146833989s" totalImagesPullingTime="2.202940213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:42:34.145928921 +0000 UTC m=+494.746525755" watchObservedRunningTime="2026-07-28 17:42:34.146833989 +0000 UTC m=+494.747430821"
Jul 28 17:42:37.095901 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:37.095867    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:45.134795 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:45.134761    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-88brq"
Jul 28 17:42:55.994373 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:55.994334    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"]
Jul 28 17:42:55.994981 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:55.994613    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k" podUID="6d27eab3-9927-41a3-8a90-0b0c23cce778" containerName="manager" containerID="cri-o://2ffe43d8485d1f686102c693285f9d57e7b53dae927ddb00e1e94adb89d67aeb" gracePeriod=2
Jul 28 17:42:56.012698 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:56.012666    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"]
Jul 28 17:42:56.021283 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:42:56.021221    2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6d27eab3-9927-41a3-8a90-0b0c23cce778\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-8qz7k\": pods \"limitador-operator-controller-manager-859d7b78bd-8qz7k\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:56.230128 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:56.230076    2561 generic.go:356] "Generic (PLEG): container finished" podID="6d27eab3-9927-41a3-8a90-0b0c23cce778" containerID="2ffe43d8485d1f686102c693285f9d57e7b53dae927ddb00e1e94adb89d67aeb" exitCode=0
Jul 28 17:42:56.230289 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:56.230156    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d288db90ede7087e7e56104583370ee76529bcf5711bbb71867ff07ea636db31"
Jul 28 17:42:56.237853 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:56.237818    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:56.240552 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:42:56.240516    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qz7k\" is forbidden: User \"system:node:ip-10-0-142-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-195.ec2.internal' and this object" podUID="6d27eab3-9927-41a3-8a90-0b0c23cce778" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:56.301996 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:56.301895    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q7tr\" (UniqueName: \"kubernetes.io/projected/6d27eab3-9927-41a3-8a90-0b0c23cce778-kube-api-access-5q7tr\") pod \"6d27eab3-9927-41a3-8a90-0b0c23cce778\" (UID: \"6d27eab3-9927-41a3-8a90-0b0c23cce778\") "
Jul 28 17:42:56.304025 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:56.303992    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d27eab3-9927-41a3-8a90-0b0c23cce778-kube-api-access-5q7tr" (OuterVolumeSpecName: "kube-api-access-5q7tr") pod "6d27eab3-9927-41a3-8a90-0b0c23cce778" (UID: "6d27eab3-9927-41a3-8a90-0b0c23cce778"). InnerVolumeSpecName "kube-api-access-5q7tr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:42:56.402441 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:56.402397    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q7tr\" (UniqueName: \"kubernetes.io/projected/6d27eab3-9927-41a3-8a90-0b0c23cce778-kube-api-access-5q7tr\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:42:57.234017 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:57.233972    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:57.237544 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:42:57.237502    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qz7k\" is forbidden: User \"system:node:ip-10-0-142-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-195.ec2.internal' and this object" podUID="6d27eab3-9927-41a3-8a90-0b0c23cce778" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:57.249148 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:42:57.249105    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qz7k\" is forbidden: User \"system:node:ip-10-0-142-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-195.ec2.internal' and this object" podUID="6d27eab3-9927-41a3-8a90-0b0c23cce778" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qz7k"
Jul 28 17:42:57.920067 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:42:57.920028    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d27eab3-9927-41a3-8a90-0b0c23cce778" path="/var/lib/kubelet/pods/6d27eab3-9927-41a3-8a90-0b0c23cce778/volumes"
Jul 28 17:43:24.588874 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.588839    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"]
Jul 28 17:43:24.589411 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.589231    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d27eab3-9927-41a3-8a90-0b0c23cce778" containerName="manager"
Jul 28 17:43:24.589411 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.589247    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d27eab3-9927-41a3-8a90-0b0c23cce778" containerName="manager"
Jul 28 17:43:24.589411 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.589316    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d27eab3-9927-41a3-8a90-0b0c23cce778" containerName="manager"
Jul 28 17:43:24.592396 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.592371    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.595348 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.595318    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cbt9g\""
Jul 28 17:43:24.604307 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.604269    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"]
Jul 28 17:43:24.744458 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.744391    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.744458 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.744456    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.744699 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.744547    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.744699 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.744604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.744699 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.744650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktfbk\" (UniqueName: \"kubernetes.io/projected/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-kube-api-access-ktfbk\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.744699 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.744672    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.744857 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.744706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.744857 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.744769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.744857 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.744799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.845863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.845755    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.845863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.845804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.845863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.845841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846191 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.845958    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846191 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.846010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846191 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.846054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846191 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.846078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktfbk\" (UniqueName: \"kubernetes.io/projected/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-kube-api-access-ktfbk\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846384 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.846281    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846384 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.846301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846487 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.846132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846548 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.846488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846548 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.846495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846833 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.846807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.846928 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.846905    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.848534 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.848501    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.848679 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.848659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.859903 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.859866    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktfbk\" (UniqueName: \"kubernetes.io/projected/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-kube-api-access-ktfbk\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.860827 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.860803    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7gcxx\" (UID: \"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:24.903708 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:24.903658    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:25.056749 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:25.056711    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"]
Jul 28 17:43:25.060443 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:43:25.060410    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc11ce8e_7b9c_4eda_9d1a_c4051ca3644f.slice/crio-9dc15bff17e9a08314ab7d03cab24f8bc73f0990395d2d643c74fe04041c7d18 WatchSource:0}: Error finding container 9dc15bff17e9a08314ab7d03cab24f8bc73f0990395d2d643c74fe04041c7d18: Status 404 returned error can't find the container with id 9dc15bff17e9a08314ab7d03cab24f8bc73f0990395d2d643c74fe04041c7d18
Jul 28 17:43:25.062771 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:25.062727    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 17:43:25.062900 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:25.062825    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 17:43:25.062900 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:25.062872    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 17:43:25.367498 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:25.367389    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx" event={"ID":"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f","Type":"ContainerStarted","Data":"d04e8d58fe7aaf356578348d703887fae6c3cb8e2b23979fd47b329344cf3f15"}
Jul 28 17:43:25.367498 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:25.367490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx" event={"ID":"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f","Type":"ContainerStarted","Data":"9dc15bff17e9a08314ab7d03cab24f8bc73f0990395d2d643c74fe04041c7d18"}
Jul 28 17:43:25.392875 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:25.392810    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx" podStartSLOduration=1.39279199 podStartE2EDuration="1.39279199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:43:25.390389244 +0000 UTC m=+545.990986090" watchObservedRunningTime="2026-07-28 17:43:25.39279199 +0000 UTC m=+545.993388822"
Jul 28 17:43:25.904118 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:25.904028    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:26.910016 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:26.909982    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:27.376691 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:27.376660    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:27.377676 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:27.377650    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:43:41.287123 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.287069    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"]
Jul 28 17:43:41.290647 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.290615    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:41.293293 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.293264    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x977p\""
Jul 28 17:43:41.293450 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.293267    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 17:43:41.302602 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.302570    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"]
Jul 28 17:43:41.377926 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.377875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f78k\" (UniqueName: \"kubernetes.io/projected/9d20d400-c5b2-42e3-8a63-643a9769f0e6-kube-api-access-4f78k\") pod \"limitador-limitador-64c94fd64f-zqtvp\" (UID: \"9d20d400-c5b2-42e3-8a63-643a9769f0e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:41.378130 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.378039    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d20d400-c5b2-42e3-8a63-643a9769f0e6-config-file\") pod \"limitador-limitador-64c94fd64f-zqtvp\" (UID: \"9d20d400-c5b2-42e3-8a63-643a9769f0e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:41.381991 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.381958    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"]
Jul 28 17:43:41.478642 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.478596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d20d400-c5b2-42e3-8a63-643a9769f0e6-config-file\") pod \"limitador-limitador-64c94fd64f-zqtvp\" (UID: \"9d20d400-c5b2-42e3-8a63-643a9769f0e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:41.478812 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.478656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f78k\" (UniqueName: \"kubernetes.io/projected/9d20d400-c5b2-42e3-8a63-643a9769f0e6-kube-api-access-4f78k\") pod \"limitador-limitador-64c94fd64f-zqtvp\" (UID: \"9d20d400-c5b2-42e3-8a63-643a9769f0e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:41.479353 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.479330    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d20d400-c5b2-42e3-8a63-643a9769f0e6-config-file\") pod \"limitador-limitador-64c94fd64f-zqtvp\" (UID: \"9d20d400-c5b2-42e3-8a63-643a9769f0e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:41.490398 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.490348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f78k\" (UniqueName: \"kubernetes.io/projected/9d20d400-c5b2-42e3-8a63-643a9769f0e6-kube-api-access-4f78k\") pod \"limitador-limitador-64c94fd64f-zqtvp\" (UID: \"9d20d400-c5b2-42e3-8a63-643a9769f0e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:41.602448 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.602332    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:41.747639 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:41.747572    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"]
Jul 28 17:43:41.750579 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:43:41.750539    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d20d400_c5b2_42e3_8a63_643a9769f0e6.slice/crio-83d562ff5168db014951f674e9b46195cdf9395f94fe00132294f49ad64a8df4 WatchSource:0}: Error finding container 83d562ff5168db014951f674e9b46195cdf9395f94fe00132294f49ad64a8df4: Status 404 returned error can't find the container with id 83d562ff5168db014951f674e9b46195cdf9395f94fe00132294f49ad64a8df4
Jul 28 17:43:42.176688 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:42.176645    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-fv9qr"]
Jul 28 17:43:42.181163 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:42.181135    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fv9qr"
Jul 28 17:43:42.183958 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:42.183930    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bp9pv\""
Jul 28 17:43:42.183958 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:42.183941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-786rd\" (UniqueName: \"kubernetes.io/projected/9005198c-855d-45f2-a033-6fecff4a2127-kube-api-access-786rd\") pod \"authorino-58cd955675-fv9qr\" (UID: \"9005198c-855d-45f2-a033-6fecff4a2127\") " pod="kuadrant-system/authorino-58cd955675-fv9qr"
Jul 28 17:43:42.188938 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:42.188870    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fv9qr"]
Jul 28 17:43:42.284670 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:42.284623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-786rd\" (UniqueName: \"kubernetes.io/projected/9005198c-855d-45f2-a033-6fecff4a2127-kube-api-access-786rd\") pod \"authorino-58cd955675-fv9qr\" (UID: \"9005198c-855d-45f2-a033-6fecff4a2127\") " pod="kuadrant-system/authorino-58cd955675-fv9qr"
Jul 28 17:43:42.295151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:42.295120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-786rd\" (UniqueName: \"kubernetes.io/projected/9005198c-855d-45f2-a033-6fecff4a2127-kube-api-access-786rd\") pod \"authorino-58cd955675-fv9qr\" (UID: \"9005198c-855d-45f2-a033-6fecff4a2127\") " pod="kuadrant-system/authorino-58cd955675-fv9qr"
Jul 28 17:43:42.452212 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:42.452037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp" event={"ID":"9d20d400-c5b2-42e3-8a63-643a9769f0e6","Type":"ContainerStarted","Data":"83d562ff5168db014951f674e9b46195cdf9395f94fe00132294f49ad64a8df4"}
Jul 28 17:43:42.492631 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:42.492589    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fv9qr"
Jul 28 17:43:42.639863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:42.639812    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fv9qr"]
Jul 28 17:43:42.644068 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:43:42.644035    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9005198c_855d_45f2_a033_6fecff4a2127.slice/crio-dbd01d2c3f8fff46fa2dd26a1a62a69366e7b3e7726e99d12c66d17a6e93e8ca WatchSource:0}: Error finding container dbd01d2c3f8fff46fa2dd26a1a62a69366e7b3e7726e99d12c66d17a6e93e8ca: Status 404 returned error can't find the container with id dbd01d2c3f8fff46fa2dd26a1a62a69366e7b3e7726e99d12c66d17a6e93e8ca
Jul 28 17:43:43.459520 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:43.459483    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fv9qr" event={"ID":"9005198c-855d-45f2-a033-6fecff4a2127","Type":"ContainerStarted","Data":"dbd01d2c3f8fff46fa2dd26a1a62a69366e7b3e7726e99d12c66d17a6e93e8ca"}
Jul 28 17:43:47.206736 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:47.206700    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fv9qr"]
Jul 28 17:43:47.483715 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:47.483671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp" event={"ID":"9d20d400-c5b2-42e3-8a63-643a9769f0e6","Type":"ContainerStarted","Data":"b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91"}
Jul 28 17:43:47.483933 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:47.483788    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:47.485183 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:47.485151    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fv9qr" event={"ID":"9005198c-855d-45f2-a033-6fecff4a2127","Type":"ContainerStarted","Data":"18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8"}
Jul 28 17:43:47.503113 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:47.503032    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp" podStartSLOduration=1.549529902 podStartE2EDuration="6.503013489s" totalImagesPullingTime="4.953483587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:43:47.501525517 +0000 UTC m=+568.102122351" watchObservedRunningTime="2026-07-28 17:43:47.503013489 +0000 UTC m=+568.103610322"
Jul 28 17:43:47.518054 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:47.517995    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-fv9qr" podStartSLOduration=1.4502155079999999 podStartE2EDuration="5.517978965s" totalImagesPullingTime="4.067763457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:43:47.51646745 +0000 UTC m=+568.117064283" watchObservedRunningTime="2026-07-28 17:43:47.517978965 +0000 UTC m=+568.118575797"
Jul 28 17:43:48.490263 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:48.490213    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-fv9qr" podUID="9005198c-855d-45f2-a033-6fecff4a2127" containerName="authorino" containerID="cri-o://18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8" gracePeriod=30
Jul 28 17:43:48.748651 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:48.748575    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fv9qr"
Jul 28 17:43:48.846366 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:48.846329    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-786rd\" (UniqueName: \"kubernetes.io/projected/9005198c-855d-45f2-a033-6fecff4a2127-kube-api-access-786rd\") pod \"9005198c-855d-45f2-a033-6fecff4a2127\" (UID: \"9005198c-855d-45f2-a033-6fecff4a2127\") "
Jul 28 17:43:48.848466 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:48.848432    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9005198c-855d-45f2-a033-6fecff4a2127-kube-api-access-786rd" (OuterVolumeSpecName: "kube-api-access-786rd") pod "9005198c-855d-45f2-a033-6fecff4a2127" (UID: "9005198c-855d-45f2-a033-6fecff4a2127"). InnerVolumeSpecName "kube-api-access-786rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:43:48.947351 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:48.947308    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-786rd\" (UniqueName: \"kubernetes.io/projected/9005198c-855d-45f2-a033-6fecff4a2127-kube-api-access-786rd\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:43:49.496555 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:49.496516    2561 generic.go:356] "Generic (PLEG): container finished" podID="9005198c-855d-45f2-a033-6fecff4a2127" containerID="18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8" exitCode=0
Jul 28 17:43:49.496555 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:49.496558    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fv9qr"
Jul 28 17:43:49.497011 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:49.496606    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fv9qr" event={"ID":"9005198c-855d-45f2-a033-6fecff4a2127","Type":"ContainerDied","Data":"18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8"}
Jul 28 17:43:49.497011 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:49.496647    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fv9qr" event={"ID":"9005198c-855d-45f2-a033-6fecff4a2127","Type":"ContainerDied","Data":"dbd01d2c3f8fff46fa2dd26a1a62a69366e7b3e7726e99d12c66d17a6e93e8ca"}
Jul 28 17:43:49.497011 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:49.496665    2561 scope.go:117] "RemoveContainer" containerID="18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8"
Jul 28 17:43:49.506005 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:49.505983    2561 scope.go:117] "RemoveContainer" containerID="18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8"
Jul 28 17:43:49.506326 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:43:49.506305    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8\": container with ID starting with 18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8 not found: ID does not exist" containerID="18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8"
Jul 28 17:43:49.506390 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:49.506335    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8"} err="failed to get container status \"18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8\": rpc error: code = NotFound desc = could not find container \"18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8\": container with ID starting with 18c788a65ec14b621e4cf3b517e8072981c135e6d875fdb05a208f39459080f8 not found: ID does not exist"
Jul 28 17:43:49.524523 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:49.524492    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fv9qr"]
Jul 28 17:43:49.526841 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:49.526814    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-fv9qr"]
Jul 28 17:43:49.920871 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:49.920779    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9005198c-855d-45f2-a033-6fecff4a2127" path="/var/lib/kubelet/pods/9005198c-855d-45f2-a033-6fecff4a2127/volumes"
Jul 28 17:43:58.233506 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:58.233465    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"]
Jul 28 17:43:58.234059 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:58.233683    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp" podUID="9d20d400-c5b2-42e3-8a63-643a9769f0e6" containerName="limitador" containerID="cri-o://b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91" gracePeriod=30
Jul 28 17:43:58.234443 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:58.234333    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:58.785618 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:58.785589    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:58.829918 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:58.829813    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f78k\" (UniqueName: \"kubernetes.io/projected/9d20d400-c5b2-42e3-8a63-643a9769f0e6-kube-api-access-4f78k\") pod \"9d20d400-c5b2-42e3-8a63-643a9769f0e6\" (UID: \"9d20d400-c5b2-42e3-8a63-643a9769f0e6\") "
Jul 28 17:43:58.830078 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:58.829928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d20d400-c5b2-42e3-8a63-643a9769f0e6-config-file\") pod \"9d20d400-c5b2-42e3-8a63-643a9769f0e6\" (UID: \"9d20d400-c5b2-42e3-8a63-643a9769f0e6\") "
Jul 28 17:43:58.830316 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:58.830292    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d20d400-c5b2-42e3-8a63-643a9769f0e6-config-file" (OuterVolumeSpecName: "config-file") pod "9d20d400-c5b2-42e3-8a63-643a9769f0e6" (UID: "9d20d400-c5b2-42e3-8a63-643a9769f0e6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:43:58.831993 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:58.831969    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d20d400-c5b2-42e3-8a63-643a9769f0e6-kube-api-access-4f78k" (OuterVolumeSpecName: "kube-api-access-4f78k") pod "9d20d400-c5b2-42e3-8a63-643a9769f0e6" (UID: "9d20d400-c5b2-42e3-8a63-643a9769f0e6"). InnerVolumeSpecName "kube-api-access-4f78k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:43:58.931394 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:58.931353    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f78k\" (UniqueName: \"kubernetes.io/projected/9d20d400-c5b2-42e3-8a63-643a9769f0e6-kube-api-access-4f78k\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:43:58.931394 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:58.931387    2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d20d400-c5b2-42e3-8a63-643a9769f0e6-config-file\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:43:59.544696 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:59.544662    2561 generic.go:356] "Generic (PLEG): container finished" podID="9d20d400-c5b2-42e3-8a63-643a9769f0e6" containerID="b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91" exitCode=0
Jul 28 17:43:59.545138 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:59.544715    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"
Jul 28 17:43:59.545138 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:59.544742    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp" event={"ID":"9d20d400-c5b2-42e3-8a63-643a9769f0e6","Type":"ContainerDied","Data":"b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91"}
Jul 28 17:43:59.545138 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:59.544785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zqtvp" event={"ID":"9d20d400-c5b2-42e3-8a63-643a9769f0e6","Type":"ContainerDied","Data":"83d562ff5168db014951f674e9b46195cdf9395f94fe00132294f49ad64a8df4"}
Jul 28 17:43:59.545138 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:59.544806    2561 scope.go:117] "RemoveContainer" containerID="b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91"
Jul 28 17:43:59.553764 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:59.553743    2561 scope.go:117] "RemoveContainer" containerID="b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91"
Jul 28 17:43:59.554084 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:43:59.554065    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91\": container with ID starting with b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91 not found: ID does not exist" containerID="b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91"
Jul 28 17:43:59.554157 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:59.554114    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91"} err="failed to get container status \"b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91\": rpc error: code = NotFound desc = could not find container \"b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91\": container with ID starting with b859493b02ac27eb1f9b0f66c1c4af30bd848a0fddd1d3d6b0645bfb3990bb91 not found: ID does not exist"
Jul 28 17:43:59.570985 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:59.570942    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"]
Jul 28 17:43:59.579650 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:59.579597    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zqtvp"]
Jul 28 17:43:59.919892 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:43:59.919806    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d20d400-c5b2-42e3-8a63-643a9769f0e6" path="/var/lib/kubelet/pods/9d20d400-c5b2-42e3-8a63-643a9769f0e6/volumes"
Jul 28 17:44:03.686347 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.686311    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"]
Jul 28 17:44:03.686821 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.686735    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9005198c-855d-45f2-a033-6fecff4a2127" containerName="authorino"
Jul 28 17:44:03.686821 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.686753    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9005198c-855d-45f2-a033-6fecff4a2127" containerName="authorino"
Jul 28 17:44:03.686821 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.686770    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d20d400-c5b2-42e3-8a63-643a9769f0e6" containerName="limitador"
Jul 28 17:44:03.686821 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.686777    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d20d400-c5b2-42e3-8a63-643a9769f0e6" containerName="limitador"
Jul 28 17:44:03.686961 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.686888    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d20d400-c5b2-42e3-8a63-643a9769f0e6" containerName="limitador"
Jul 28 17:44:03.686961 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.686904    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9005198c-855d-45f2-a033-6fecff4a2127" containerName="authorino"
Jul 28 17:44:03.691428 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.691401    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"
Jul 28 17:44:03.694405 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.694372    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 17:44:03.694580 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.694372    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zqjgp\""
Jul 28 17:44:03.694580 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.694416    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 17:44:03.695578 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.695493    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 17:44:03.698040 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.698014    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"]
Jul 28 17:44:03.774412 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.774369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pznc7\" (UniqueName: \"kubernetes.io/projected/5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b-kube-api-access-pznc7\") pod \"postgres-69fb4594cf-ccld6\" (UID: \"5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"
Jul 28 17:44:03.774601 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.774427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b-data\") pod \"postgres-69fb4594cf-ccld6\" (UID: \"5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"
Jul 28 17:44:03.875175 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.875060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pznc7\" (UniqueName: \"kubernetes.io/projected/5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b-kube-api-access-pznc7\") pod \"postgres-69fb4594cf-ccld6\" (UID: \"5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"
Jul 28 17:44:03.875344 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.875210    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b-data\") pod \"postgres-69fb4594cf-ccld6\" (UID: \"5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"
Jul 28 17:44:03.875639 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.875612    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b-data\") pod \"postgres-69fb4594cf-ccld6\" (UID: \"5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"
Jul 28 17:44:03.884829 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:03.884789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pznc7\" (UniqueName: \"kubernetes.io/projected/5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b-kube-api-access-pznc7\") pod \"postgres-69fb4594cf-ccld6\" (UID: \"5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"
Jul 28 17:44:04.004322 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:04.004281    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"
Jul 28 17:44:04.152285 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:04.152179    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"]
Jul 28 17:44:04.156447 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:44:04.156416    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0f01cc_7e11_473d_a9d9_c3ed28e22e1b.slice/crio-731a1f0a85a1a57803e304d954840c5fa73ed0ef24db41871b75b06b926ad797 WatchSource:0}: Error finding container 731a1f0a85a1a57803e304d954840c5fa73ed0ef24db41871b75b06b926ad797: Status 404 returned error can't find the container with id 731a1f0a85a1a57803e304d954840c5fa73ed0ef24db41871b75b06b926ad797
Jul 28 17:44:04.569832 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:04.569785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6" event={"ID":"5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b","Type":"ContainerStarted","Data":"731a1f0a85a1a57803e304d954840c5fa73ed0ef24db41871b75b06b926ad797"}
Jul 28 17:44:10.605496 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:10.605450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6" event={"ID":"5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b","Type":"ContainerStarted","Data":"804e0babd20cbdc0a5d509408c6322d226dfe9bd011957fead8f5f63b1232133"}
Jul 28 17:44:10.605896 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:10.605587    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"
Jul 28 17:44:10.628930 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:10.628864    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6" podStartSLOduration=2.140123825 podStartE2EDuration="7.628844531s" totalImagesPullingTime="5.488720706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:44:10.626747161 +0000 UTC m=+591.227343994" watchObservedRunningTime="2026-07-28 17:44:10.628844531 +0000 UTC m=+591.229441365"
Jul 28 17:44:16.641075 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:16.641038    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ccld6"
Jul 28 17:44:17.237656 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.237609    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bv6wl"]
Jul 28 17:44:17.241033 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.241006    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bv6wl"
Jul 28 17:44:17.243658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.243631    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bp9pv\""
Jul 28 17:44:17.253607 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.253574    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bv6wl"]
Jul 28 17:44:17.401489 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.401445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhgvl\" (UniqueName: \"kubernetes.io/projected/a85b9268-1b60-4dc2-a6dd-0a041b5a57ff-kube-api-access-rhgvl\") pod \"authorino-5d4b67c446-bv6wl\" (UID: \"a85b9268-1b60-4dc2-a6dd-0a041b5a57ff\") " pod="kuadrant-system/authorino-5d4b67c446-bv6wl"
Jul 28 17:44:17.499831 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.499741    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bv6wl"]
Jul 28 17:44:17.500027 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:44:17.500005    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rhgvl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-bv6wl" podUID="a85b9268-1b60-4dc2-a6dd-0a041b5a57ff"
Jul 28 17:44:17.502029 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.501989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhgvl\" (UniqueName: \"kubernetes.io/projected/a85b9268-1b60-4dc2-a6dd-0a041b5a57ff-kube-api-access-rhgvl\") pod \"authorino-5d4b67c446-bv6wl\" (UID: \"a85b9268-1b60-4dc2-a6dd-0a041b5a57ff\") " pod="kuadrant-system/authorino-5d4b67c446-bv6wl"
Jul 28 17:44:17.516937 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.516905    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhgvl\" (UniqueName: \"kubernetes.io/projected/a85b9268-1b60-4dc2-a6dd-0a041b5a57ff-kube-api-access-rhgvl\") pod \"authorino-5d4b67c446-bv6wl\" (UID: \"a85b9268-1b60-4dc2-a6dd-0a041b5a57ff\") " pod="kuadrant-system/authorino-5d4b67c446-bv6wl"
Jul 28 17:44:17.533378 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.533341    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-99d5464b6-vf6cl"]
Jul 28 17:44:17.536691 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.536665    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-99d5464b6-vf6cl"
Jul 28 17:44:17.544578 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.544408    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-99d5464b6-vf6cl"]
Jul 28 17:44:17.637734 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.637694    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bv6wl"
Jul 28 17:44:17.644731 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.644697    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bv6wl"
Jul 28 17:44:17.704275 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.704236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8cd\" (UniqueName: \"kubernetes.io/projected/160c5e73-e23b-4177-b727-decd85cab5f8-kube-api-access-5n8cd\") pod \"authorino-99d5464b6-vf6cl\" (UID: \"160c5e73-e23b-4177-b727-decd85cab5f8\") " pod="kuadrant-system/authorino-99d5464b6-vf6cl"
Jul 28 17:44:17.712135 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.712080    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-99d5464b6-vf6cl"]
Jul 28 17:44:17.712387 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:44:17.712363    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5n8cd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-99d5464b6-vf6cl" podUID="160c5e73-e23b-4177-b727-decd85cab5f8"
Jul 28 17:44:17.740218 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.740177    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59f7cdc74-78chs"]
Jul 28 17:44:17.743390 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.743358    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f7cdc74-78chs"
Jul 28 17:44:17.746208 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.746184    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 17:44:17.752232 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.752200    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59f7cdc74-78chs"]
Jul 28 17:44:17.804914 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.804868    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhgvl\" (UniqueName: \"kubernetes.io/projected/a85b9268-1b60-4dc2-a6dd-0a041b5a57ff-kube-api-access-rhgvl\") pod \"a85b9268-1b60-4dc2-a6dd-0a041b5a57ff\" (UID: \"a85b9268-1b60-4dc2-a6dd-0a041b5a57ff\") "
Jul 28 17:44:17.805180 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.804996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8cd\" (UniqueName: \"kubernetes.io/projected/160c5e73-e23b-4177-b727-decd85cab5f8-kube-api-access-5n8cd\") pod \"authorino-99d5464b6-vf6cl\" (UID: \"160c5e73-e23b-4177-b727-decd85cab5f8\") " pod="kuadrant-system/authorino-99d5464b6-vf6cl"
Jul 28 17:44:17.807429 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.807394    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a85b9268-1b60-4dc2-a6dd-0a041b5a57ff-kube-api-access-rhgvl" (OuterVolumeSpecName: "kube-api-access-rhgvl") pod "a85b9268-1b60-4dc2-a6dd-0a041b5a57ff" (UID: "a85b9268-1b60-4dc2-a6dd-0a041b5a57ff"). InnerVolumeSpecName "kube-api-access-rhgvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:44:17.815511 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.815481    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8cd\" (UniqueName: \"kubernetes.io/projected/160c5e73-e23b-4177-b727-decd85cab5f8-kube-api-access-5n8cd\") pod \"authorino-99d5464b6-vf6cl\" (UID: \"160c5e73-e23b-4177-b727-decd85cab5f8\") " pod="kuadrant-system/authorino-99d5464b6-vf6cl"
Jul 28 17:44:17.905842 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.905798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzfwt\" (UniqueName: \"kubernetes.io/projected/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-kube-api-access-xzfwt\") pod \"authorino-59f7cdc74-78chs\" (UID: \"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f\") " pod="kuadrant-system/authorino-59f7cdc74-78chs"
Jul 28 17:44:17.906024 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.905855    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-tls-cert\") pod \"authorino-59f7cdc74-78chs\" (UID: \"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f\") " pod="kuadrant-system/authorino-59f7cdc74-78chs"
Jul 28 17:44:17.906024 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:17.905901    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhgvl\" (UniqueName: \"kubernetes.io/projected/a85b9268-1b60-4dc2-a6dd-0a041b5a57ff-kube-api-access-rhgvl\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:44:18.007273 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.007164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfwt\" (UniqueName: \"kubernetes.io/projected/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-kube-api-access-xzfwt\") pod \"authorino-59f7cdc74-78chs\" (UID: \"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f\") " pod="kuadrant-system/authorino-59f7cdc74-78chs"
Jul 28 17:44:18.007273 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.007241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-tls-cert\") pod \"authorino-59f7cdc74-78chs\" (UID: \"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f\") " pod="kuadrant-system/authorino-59f7cdc74-78chs"
Jul 28 17:44:18.009836 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.009807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-tls-cert\") pod \"authorino-59f7cdc74-78chs\" (UID: \"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f\") " pod="kuadrant-system/authorino-59f7cdc74-78chs"
Jul 28 17:44:18.018384 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.018351    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzfwt\" (UniqueName: \"kubernetes.io/projected/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-kube-api-access-xzfwt\") pod \"authorino-59f7cdc74-78chs\" (UID: \"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f\") " pod="kuadrant-system/authorino-59f7cdc74-78chs"
Jul 28 17:44:18.054341 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.054285    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f7cdc74-78chs"
Jul 28 17:44:18.198657 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.198619    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59f7cdc74-78chs"]
Jul 28 17:44:18.201445 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:44:18.201414    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ff3fb94_2939_45b9_a144_cf2d3caf0c5f.slice/crio-218d618e6c4b0106041294057a93693f331679529e95735c70e256b217ff6c67 WatchSource:0}: Error finding container 218d618e6c4b0106041294057a93693f331679529e95735c70e256b217ff6c67: Status 404 returned error can't find the container with id 218d618e6c4b0106041294057a93693f331679529e95735c70e256b217ff6c67
Jul 28 17:44:18.645060 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.645014    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f7cdc74-78chs" event={"ID":"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f","Type":"ContainerStarted","Data":"218d618e6c4b0106041294057a93693f331679529e95735c70e256b217ff6c67"}
Jul 28 17:44:18.645060 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.645068    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-99d5464b6-vf6cl"
Jul 28 17:44:18.645529 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.645079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bv6wl"
Jul 28 17:44:18.656221 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.656186    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-99d5464b6-vf6cl"
Jul 28 17:44:18.688686 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.688644    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bv6wl"]
Jul 28 17:44:18.693004 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.692966    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bv6wl"]
Jul 28 17:44:18.814698 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.814654    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n8cd\" (UniqueName: \"kubernetes.io/projected/160c5e73-e23b-4177-b727-decd85cab5f8-kube-api-access-5n8cd\") pod \"160c5e73-e23b-4177-b727-decd85cab5f8\" (UID: \"160c5e73-e23b-4177-b727-decd85cab5f8\") "
Jul 28 17:44:18.816858 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.816819    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160c5e73-e23b-4177-b727-decd85cab5f8-kube-api-access-5n8cd" (OuterVolumeSpecName: "kube-api-access-5n8cd") pod "160c5e73-e23b-4177-b727-decd85cab5f8" (UID: "160c5e73-e23b-4177-b727-decd85cab5f8"). InnerVolumeSpecName "kube-api-access-5n8cd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:44:18.916124 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:18.916070    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n8cd\" (UniqueName: \"kubernetes.io/projected/160c5e73-e23b-4177-b727-decd85cab5f8-kube-api-access-5n8cd\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:44:19.657902 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:19.657860    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f7cdc74-78chs" event={"ID":"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f","Type":"ContainerStarted","Data":"8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531"}
Jul 28 17:44:19.658434 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:19.657941    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-99d5464b6-vf6cl"
Jul 28 17:44:19.675904 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:19.675846    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59f7cdc74-78chs" podStartSLOduration=2.041800401 podStartE2EDuration="2.675829384s" totalImagesPullingTime="634.028983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:44:19.67496094 +0000 UTC m=+600.275557774" watchObservedRunningTime="2026-07-28 17:44:19.675829384 +0000 UTC m=+600.276426216"
Jul 28 17:44:19.702942 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:19.702899    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-99d5464b6-vf6cl"]
Jul 28 17:44:19.713318 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:19.713271    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-99d5464b6-vf6cl"]
Jul 28 17:44:19.793872 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:19.793833    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:44:19.799643 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:19.799613    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:44:19.921175 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:19.921081    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="160c5e73-e23b-4177-b727-decd85cab5f8" path="/var/lib/kubelet/pods/160c5e73-e23b-4177-b727-decd85cab5f8/volumes"
Jul 28 17:44:19.921350 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:19.921335    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a85b9268-1b60-4dc2-a6dd-0a041b5a57ff" path="/var/lib/kubelet/pods/a85b9268-1b60-4dc2-a6dd-0a041b5a57ff/volumes"
Jul 28 17:44:24.984852 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:24.984806    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fdf77d766-7kmpm"]
Jul 28 17:44:25.005622 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.005592    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:44:25.005846 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.005587    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-7kmpm"]
Jul 28 17:44:25.009922 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.009891    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 17:44:25.010101 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.009890    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hrp6b\""
Jul 28 17:44:25.010101 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.009906    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 17:44:25.070466 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.070430    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-webhook-cert\") pod \"maas-controller-5fdf77d766-7kmpm\" (UID: \"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0\") " pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:44:25.070681 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.070476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc44k\" (UniqueName: \"kubernetes.io/projected/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-kube-api-access-mc44k\") pod \"maas-controller-5fdf77d766-7kmpm\" (UID: \"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0\") " pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:44:25.171104 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.171053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-webhook-cert\") pod \"maas-controller-5fdf77d766-7kmpm\" (UID: \"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0\") " pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:44:25.171320 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.171173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc44k\" (UniqueName: \"kubernetes.io/projected/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-kube-api-access-mc44k\") pod \"maas-controller-5fdf77d766-7kmpm\" (UID: \"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0\") " pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:44:25.173754 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.173720    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-webhook-cert\") pod \"maas-controller-5fdf77d766-7kmpm\" (UID: \"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0\") " pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:44:25.182161 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.182124    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc44k\" (UniqueName: \"kubernetes.io/projected/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-kube-api-access-mc44k\") pod \"maas-controller-5fdf77d766-7kmpm\" (UID: \"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0\") " pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:44:25.316814 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.316707    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:44:25.467724 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.467572    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-7kmpm"]
Jul 28 17:44:25.470593 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:44:25.470560    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95efefdf_d20e_46e2_8c3e_cc4be5fd0bb0.slice/crio-b4209ad6d698b98a7eed1bb7a0fa4ac933870ca339d91ba6775a6aabeb9825f7 WatchSource:0}: Error finding container b4209ad6d698b98a7eed1bb7a0fa4ac933870ca339d91ba6775a6aabeb9825f7: Status 404 returned error can't find the container with id b4209ad6d698b98a7eed1bb7a0fa4ac933870ca339d91ba6775a6aabeb9825f7
Jul 28 17:44:25.688212 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:25.688119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf77d766-7kmpm" event={"ID":"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0","Type":"ContainerStarted","Data":"b4209ad6d698b98a7eed1bb7a0fa4ac933870ca339d91ba6775a6aabeb9825f7"}
Jul 28 17:44:28.707045 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:28.707010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf77d766-7kmpm" event={"ID":"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0","Type":"ContainerStarted","Data":"3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b"}
Jul 28 17:44:28.707475 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:28.707132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:44:28.769658 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:28.769548    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fdf77d766-7kmpm" podStartSLOduration=2.43322658 podStartE2EDuration="4.769520387s" totalImagesPullingTime="2.336293807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:44:28.76639685 +0000 UTC m=+609.366993684" watchObservedRunningTime="2026-07-28 17:44:28.769520387 +0000 UTC m=+609.370117222"
Jul 28 17:44:39.714367 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:44:39.714332    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:45:02.553677 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.553636    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-265dr"]
Jul 28 17:45:02.559652 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.559618    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-265dr"
Jul 28 17:45:02.562323 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.562297    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 17:45:02.571793 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.571762    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-265dr"]
Jul 28 17:45:02.622747 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.622710    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"]
Jul 28 17:45:02.625061 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.625041    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"
Jul 28 17:45:02.628002 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.627980    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zph97\""
Jul 28 17:45:02.635222 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.635192    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"]
Jul 28 17:45:02.704418 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.704374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm6jx\" (UniqueName: \"kubernetes.io/projected/f09fd716-542d-4aa0-93e3-688e2617c874-kube-api-access-hm6jx\") pod \"payload-processing-5cc6cd444b-265dr\" (UID: \"f09fd716-542d-4aa0-93e3-688e2617c874\") " pod="openshift-ingress/payload-processing-5cc6cd444b-265dr"
Jul 28 17:45:02.704603 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.704552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f09fd716-542d-4aa0-93e3-688e2617c874-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-265dr\" (UID: \"f09fd716-542d-4aa0-93e3-688e2617c874\") " pod="openshift-ingress/payload-processing-5cc6cd444b-265dr"
Jul 28 17:45:02.805731 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.805623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2229acb-e2b4-4af4-b01f-a9537c2a7776-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tgh68\" (UID: \"e2229acb-e2b4-4af4-b01f-a9537c2a7776\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"
Jul 28 17:45:02.805731 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.805673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpkwf\" (UniqueName: \"kubernetes.io/projected/e2229acb-e2b4-4af4-b01f-a9537c2a7776-kube-api-access-wpkwf\") pod \"payload-pre-processing-687dbb6cf6-tgh68\" (UID: \"e2229acb-e2b4-4af4-b01f-a9537c2a7776\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"
Jul 28 17:45:02.805939 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.805764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f09fd716-542d-4aa0-93e3-688e2617c874-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-265dr\" (UID: \"f09fd716-542d-4aa0-93e3-688e2617c874\") " pod="openshift-ingress/payload-processing-5cc6cd444b-265dr"
Jul 28 17:45:02.805939 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.805812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm6jx\" (UniqueName: \"kubernetes.io/projected/f09fd716-542d-4aa0-93e3-688e2617c874-kube-api-access-hm6jx\") pod \"payload-processing-5cc6cd444b-265dr\" (UID: \"f09fd716-542d-4aa0-93e3-688e2617c874\") " pod="openshift-ingress/payload-processing-5cc6cd444b-265dr"
Jul 28 17:45:02.806543 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.806523    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f09fd716-542d-4aa0-93e3-688e2617c874-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-265dr\" (UID: \"f09fd716-542d-4aa0-93e3-688e2617c874\") " pod="openshift-ingress/payload-processing-5cc6cd444b-265dr"
Jul 28 17:45:02.816497 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.816460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm6jx\" (UniqueName: \"kubernetes.io/projected/f09fd716-542d-4aa0-93e3-688e2617c874-kube-api-access-hm6jx\") pod \"payload-processing-5cc6cd444b-265dr\" (UID: \"f09fd716-542d-4aa0-93e3-688e2617c874\") " pod="openshift-ingress/payload-processing-5cc6cd444b-265dr"
Jul 28 17:45:02.870560 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.870511    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-265dr"
Jul 28 17:45:02.906898 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.906860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2229acb-e2b4-4af4-b01f-a9537c2a7776-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tgh68\" (UID: \"e2229acb-e2b4-4af4-b01f-a9537c2a7776\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"
Jul 28 17:45:02.906898 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.906895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpkwf\" (UniqueName: \"kubernetes.io/projected/e2229acb-e2b4-4af4-b01f-a9537c2a7776-kube-api-access-wpkwf\") pod \"payload-pre-processing-687dbb6cf6-tgh68\" (UID: \"e2229acb-e2b4-4af4-b01f-a9537c2a7776\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"
Jul 28 17:45:02.907863 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.907835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2229acb-e2b4-4af4-b01f-a9537c2a7776-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tgh68\" (UID: \"e2229acb-e2b4-4af4-b01f-a9537c2a7776\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"
Jul 28 17:45:02.928866 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.928835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpkwf\" (UniqueName: \"kubernetes.io/projected/e2229acb-e2b4-4af4-b01f-a9537c2a7776-kube-api-access-wpkwf\") pod \"payload-pre-processing-687dbb6cf6-tgh68\" (UID: \"e2229acb-e2b4-4af4-b01f-a9537c2a7776\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"
Jul 28 17:45:02.937047 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:02.936697    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"
Jul 28 17:45:03.037122 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:03.037044    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-265dr"]
Jul 28 17:45:03.041948 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:45:03.041832    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09fd716_542d_4aa0_93e3_688e2617c874.slice/crio-559943edc9ca6e7d2f6c24726dc9317e8b99db845010c4800df74346f133ae7d WatchSource:0}: Error finding container 559943edc9ca6e7d2f6c24726dc9317e8b99db845010c4800df74346f133ae7d: Status 404 returned error can't find the container with id 559943edc9ca6e7d2f6c24726dc9317e8b99db845010c4800df74346f133ae7d
Jul 28 17:45:03.103920 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:03.103827    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"]
Jul 28 17:45:03.109206 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:45:03.109172    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2229acb_e2b4_4af4_b01f_a9537c2a7776.slice/crio-b62654a13a3fa0a6316ea5d94103e7c282e665945186fede78c71dfba92b3eb0 WatchSource:0}: Error finding container b62654a13a3fa0a6316ea5d94103e7c282e665945186fede78c71dfba92b3eb0: Status 404 returned error can't find the container with id b62654a13a3fa0a6316ea5d94103e7c282e665945186fede78c71dfba92b3eb0
Jul 28 17:45:03.887699 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:03.887526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68" event={"ID":"e2229acb-e2b4-4af4-b01f-a9537c2a7776","Type":"ContainerStarted","Data":"b62654a13a3fa0a6316ea5d94103e7c282e665945186fede78c71dfba92b3eb0"}
Jul 28 17:45:03.890962 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:03.890922    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-265dr" event={"ID":"f09fd716-542d-4aa0-93e3-688e2617c874","Type":"ContainerStarted","Data":"559943edc9ca6e7d2f6c24726dc9317e8b99db845010c4800df74346f133ae7d"}
Jul 28 17:45:06.912279 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:06.912191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-265dr" event={"ID":"f09fd716-542d-4aa0-93e3-688e2617c874","Type":"ContainerStarted","Data":"12d3eef84d1cfb46bbdd38f6f30328299aafbaae4c8b9e1f59fc918d966baf85"}
Jul 28 17:45:06.912776 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:06.912328    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-265dr"
Jul 28 17:45:06.913832 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:06.913803    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68" event={"ID":"e2229acb-e2b4-4af4-b01f-a9537c2a7776","Type":"ContainerStarted","Data":"820c7de5d6f3626ec70de03cc142c85f0e1183a2fd67b2a9fd7181433d493453"}
Jul 28 17:45:06.913968 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:06.913951    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"
Jul 28 17:45:06.930310 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:06.930257    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-265dr" podStartSLOduration=1.6233808 podStartE2EDuration="4.93023731s" totalImagesPullingTime="3.30685651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:45:06.929395961 +0000 UTC m=+647.529992796" watchObservedRunningTime="2026-07-28 17:45:06.93023731 +0000 UTC m=+647.530834140"
Jul 28 17:45:06.949124 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:06.949052    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68" podStartSLOduration=1.681150932 podStartE2EDuration="4.949034034s" totalImagesPullingTime="3.267883102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:45:06.947432039 +0000 UTC m=+647.548028911" watchObservedRunningTime="2026-07-28 17:45:06.949034034 +0000 UTC m=+647.549630866"
Jul 28 17:45:10.936220 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:10.936185    2561 generic.go:356] "Generic (PLEG): container finished" podID="bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f" containerID="d04e8d58fe7aaf356578348d703887fae6c3cb8e2b23979fd47b329344cf3f15" exitCode=0
Jul 28 17:45:10.936905 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:10.936240    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx" event={"ID":"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f","Type":"ContainerDied","Data":"d04e8d58fe7aaf356578348d703887fae6c3cb8e2b23979fd47b329344cf3f15"}
Jul 28 17:45:10.936905 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:10.936626    2561 scope.go:117] "RemoveContainer" containerID="d04e8d58fe7aaf356578348d703887fae6c3cb8e2b23979fd47b329344cf3f15"
Jul 28 17:45:10.937679 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:10.937649    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 17:45:10.937737 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:10.937722    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 17:45:10.937784 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:10.937776    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 17:45:11.943346 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:11.943307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx" event={"ID":"bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f","Type":"ContainerStarted","Data":"4c06fb96ea383b7845b4ea562429056444fb475585d4500dcbf174f1356e7e9b"}
Jul 28 17:45:12.376936 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:12.376879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:45:12.904960 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:12.904912    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:45:12.906238 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:12.906199    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7gcxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 28 17:45:12.906370 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:12.906271    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx" podUID="bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 28 17:45:13.904150 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:13.904109    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7gcxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 28 17:45:13.904561 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:13.904168    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx" podUID="bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 28 17:45:14.904509 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:14.904468    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7gcxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 28 17:45:14.904929 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:14.904532    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx" podUID="bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 28 17:45:15.904277 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:15.904231    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7gcxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 28 17:45:15.904510 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:15.904297    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx" podUID="bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 28 17:45:16.908463 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:16.908431    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:45:16.909478 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:16.909459    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7gcxx"
Jul 28 17:45:17.921685 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:17.921657    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-265dr"
Jul 28 17:45:17.922119 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:17.921783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tgh68"
Jul 28 17:45:36.303310 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.300687    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"]
Jul 28 17:45:36.305930 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.304977    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.309510 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.309471    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dc42l\""
Jul 28 17:45:36.309685 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.309548    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 17:45:36.309685 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.309565    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 28 17:45:36.309685 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.309475    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 17:45:36.315946 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.315917    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"]
Jul 28 17:45:36.408151 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.408077    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4zl9\" (UniqueName: \"kubernetes.io/projected/23409785-2647-4616-9591-a91b72dc98d9-kube-api-access-k4zl9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.408322 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.408197    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23409785-2647-4616-9591-a91b72dc98d9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.408322 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.408223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.408395 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.408320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.408395 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.408348    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.408395 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.408377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.509310 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.509257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23409785-2647-4616-9591-a91b72dc98d9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.509310 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.509306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.509580 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.509448    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.509580 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.509484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.509681 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.509639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.509757 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.509728    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.509807 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.509794    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.509857 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.509824    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.509979 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.509958    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4zl9\" (UniqueName: \"kubernetes.io/projected/23409785-2647-4616-9591-a91b72dc98d9-kube-api-access-k4zl9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.512188 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.512152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23409785-2647-4616-9591-a91b72dc98d9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.512353 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.512257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23409785-2647-4616-9591-a91b72dc98d9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.522058 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.522023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4zl9\" (UniqueName: \"kubernetes.io/projected/23409785-2647-4616-9591-a91b72dc98d9-kube-api-access-k4zl9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9l2z7\" (UID: \"23409785-2647-4616-9591-a91b72dc98d9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.618792 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.618672    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:36.764244 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.764215    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"]
Jul 28 17:45:36.766680 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:45:36.766648    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23409785_2647_4616_9591_a91b72dc98d9.slice/crio-a0a4b36993e4ce32c7e109425b9eedebb7c279aba298566a93c423f04d9dc756 WatchSource:0}: Error finding container a0a4b36993e4ce32c7e109425b9eedebb7c279aba298566a93c423f04d9dc756: Status 404 returned error can't find the container with id a0a4b36993e4ce32c7e109425b9eedebb7c279aba298566a93c423f04d9dc756
Jul 28 17:45:36.768233 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:36.768214    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:45:37.063976 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:37.063926    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7" event={"ID":"23409785-2647-4616-9591-a91b72dc98d9","Type":"ContainerStarted","Data":"a0a4b36993e4ce32c7e109425b9eedebb7c279aba298566a93c423f04d9dc756"}
Jul 28 17:45:38.070012 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:38.069969    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7" event={"ID":"23409785-2647-4616-9591-a91b72dc98d9","Type":"ContainerStarted","Data":"bdd56c4d5c06d0e2f8028919118cb92aecdf5a53db51f0b055120c17f033c7de"}
Jul 28 17:45:38.093164 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:38.093050    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7" podStartSLOduration=1.039487839 podStartE2EDuration="2.093027771s" totalImagesPullingTime="1.053539932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:45:38.09127687 +0000 UTC m=+678.691873704" watchObservedRunningTime="2026-07-28 17:45:38.093027771 +0000 UTC m=+678.693624603"
Jul 28 17:45:46.623141 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:46.621257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:46.623141 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:46.621348    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:46.640087 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:46.640040    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:47.126949 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:47.126915    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9l2z7"
Jul 28 17:45:52.194897 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.194852    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"]
Jul 28 17:45:52.197889 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.197858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.200595 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.200567    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 28 17:45:52.211488 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.211452    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"]
Jul 28 17:45:52.251104 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.251043    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4czc\" (UniqueName: \"kubernetes.io/projected/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-kube-api-access-n4czc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.251313 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.251129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.251313 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.251159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.251313 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.251178    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.251313 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.251204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.251469 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.251322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.352434 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.352387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.352434 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.352444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.352697 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.352473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.352697 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.352493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.352697 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.352573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.352697 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.352617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4czc\" (UniqueName: \"kubernetes.io/projected/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-kube-api-access-n4czc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.352886 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.352812    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.353158 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.353081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.353158 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.353133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.354962 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.354933    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.355146 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.355123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.363488 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.363456    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4czc\" (UniqueName: \"kubernetes.io/projected/d36d5480-c71c-4bdd-b7ec-10f0e0e12213-kube-api-access-n4czc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l\" (UID: \"d36d5480-c71c-4bdd-b7ec-10f0e0e12213\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.509295 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.509250    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:45:52.654840 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:52.654802    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"]
Jul 28 17:45:52.658405 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:45:52.658372    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36d5480_c71c_4bdd_b7ec_10f0e0e12213.slice/crio-d00d287d9dea04924dd8e105c526634dd02e66182017f2e8d004647dd8a95ef9 WatchSource:0}: Error finding container d00d287d9dea04924dd8e105c526634dd02e66182017f2e8d004647dd8a95ef9: Status 404 returned error can't find the container with id d00d287d9dea04924dd8e105c526634dd02e66182017f2e8d004647dd8a95ef9
Jul 28 17:45:53.146457 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:53.146420    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l" event={"ID":"d36d5480-c71c-4bdd-b7ec-10f0e0e12213","Type":"ContainerStarted","Data":"661d8a15c42c2806d3abaac2534ad7f397103bfe992830888d41c2bc36bb8aa4"}
Jul 28 17:45:53.146661 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:53.146472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l" event={"ID":"d36d5480-c71c-4bdd-b7ec-10f0e0e12213","Type":"ContainerStarted","Data":"d00d287d9dea04924dd8e105c526634dd02e66182017f2e8d004647dd8a95ef9"}
Jul 28 17:45:53.179762 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:45:53.179700    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l" podStartSLOduration=0.864085065 podStartE2EDuration="1.179677941s" totalImagesPullingTime="315.592876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:45:53.178310597 +0000 UTC m=+693.778907443" watchObservedRunningTime="2026-07-28 17:45:53.179677941 +0000 UTC m=+693.780274801"
Jul 28 17:46:02.510179 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:46:02.510138    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:46:02.510634 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:46:02.510239    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:46:02.523159 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:46:02.523129    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:46:03.211363 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:46:03.211323    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l"
Jul 28 17:47:04.147142 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.147073    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f7cdc74-78chs"]
Jul 28 17:47:04.147655 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.147314    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59f7cdc74-78chs" podUID="9ff3fb94-2939-45b9-a144-cf2d3caf0c5f" containerName="authorino" containerID="cri-o://8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531" gracePeriod=30
Jul 28 17:47:04.405757 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.405684    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f7cdc74-78chs"
Jul 28 17:47:04.498472 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.498433    2561 generic.go:356] "Generic (PLEG): container finished" podID="9ff3fb94-2939-45b9-a144-cf2d3caf0c5f" containerID="8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531" exitCode=0
Jul 28 17:47:04.498650 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.498480    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f7cdc74-78chs"
Jul 28 17:47:04.498650 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.498495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f7cdc74-78chs" event={"ID":"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f","Type":"ContainerDied","Data":"8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531"}
Jul 28 17:47:04.498650 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.498528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f7cdc74-78chs" event={"ID":"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f","Type":"ContainerDied","Data":"218d618e6c4b0106041294057a93693f331679529e95735c70e256b217ff6c67"}
Jul 28 17:47:04.498650 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.498545    2561 scope.go:117] "RemoveContainer" containerID="8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531"
Jul 28 17:47:04.507501 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.507476    2561 scope.go:117] "RemoveContainer" containerID="8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531"
Jul 28 17:47:04.507870 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:47:04.507850    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531\": container with ID starting with 8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531 not found: ID does not exist" containerID="8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531"
Jul 28 17:47:04.507918 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.507883    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531"} err="failed to get container status \"8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531\": rpc error: code = NotFound desc = could not find container \"8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531\": container with ID starting with 8a1d6ff984fa3a1551cd6b31e0281e682617ea4235fe3821d42f5723635e1531 not found: ID does not exist"
Jul 28 17:47:04.512322 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.512241    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzfwt\" (UniqueName: \"kubernetes.io/projected/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-kube-api-access-xzfwt\") pod \"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f\" (UID: \"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f\") "
Jul 28 17:47:04.512322 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.512289    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-tls-cert\") pod \"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f\" (UID: \"9ff3fb94-2939-45b9-a144-cf2d3caf0c5f\") "
Jul 28 17:47:04.514552 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.514516    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-kube-api-access-xzfwt" (OuterVolumeSpecName: "kube-api-access-xzfwt") pod "9ff3fb94-2939-45b9-a144-cf2d3caf0c5f" (UID: "9ff3fb94-2939-45b9-a144-cf2d3caf0c5f"). InnerVolumeSpecName "kube-api-access-xzfwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:47:04.523489 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.523451    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9ff3fb94-2939-45b9-a144-cf2d3caf0c5f" (UID: "9ff3fb94-2939-45b9-a144-cf2d3caf0c5f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:47:04.613607 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.613569    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzfwt\" (UniqueName: \"kubernetes.io/projected/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-kube-api-access-xzfwt\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:47:04.613607 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.613601    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f-tls-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:47:04.822555 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.822507    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f7cdc74-78chs"]
Jul 28 17:47:04.828508 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:04.828474    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59f7cdc74-78chs"]
Jul 28 17:47:05.920585 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:05.920546    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff3fb94-2939-45b9-a144-cf2d3caf0c5f" path="/var/lib/kubelet/pods/9ff3fb94-2939-45b9-a144-cf2d3caf0c5f/volumes"
Jul 28 17:47:51.921344 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:51.921255    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-7kmpm"]
Jul 28 17:47:51.921841 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:51.921507    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5fdf77d766-7kmpm" podUID="95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0" containerName="manager" containerID="cri-o://3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b" gracePeriod=30
Jul 28 17:47:52.177199 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.177123    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:47:52.264291 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.264248    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-webhook-cert\") pod \"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0\" (UID: \"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0\") "
Jul 28 17:47:52.264500 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.264405    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc44k\" (UniqueName: \"kubernetes.io/projected/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-kube-api-access-mc44k\") pod \"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0\" (UID: \"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0\") "
Jul 28 17:47:52.266588 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.266556    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-kube-api-access-mc44k" (OuterVolumeSpecName: "kube-api-access-mc44k") pod "95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0" (UID: "95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0"). InnerVolumeSpecName "kube-api-access-mc44k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:47:52.266712 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.266656    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0" (UID: "95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:47:52.365525 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.365484    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-webhook-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:47:52.365525 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.365522    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc44k\" (UniqueName: \"kubernetes.io/projected/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0-kube-api-access-mc44k\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:47:52.728678 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.728639    2561 generic.go:356] "Generic (PLEG): container finished" podID="95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0" containerID="3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b" exitCode=0
Jul 28 17:47:52.728864 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.728692    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf77d766-7kmpm"
Jul 28 17:47:52.728864 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.728728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf77d766-7kmpm" event={"ID":"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0","Type":"ContainerDied","Data":"3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b"}
Jul 28 17:47:52.728864 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.728789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf77d766-7kmpm" event={"ID":"95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0","Type":"ContainerDied","Data":"b4209ad6d698b98a7eed1bb7a0fa4ac933870ca339d91ba6775a6aabeb9825f7"}
Jul 28 17:47:52.728864 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.728815    2561 scope.go:117] "RemoveContainer" containerID="3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b"
Jul 28 17:47:52.740813 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.740788    2561 scope.go:117] "RemoveContainer" containerID="3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b"
Jul 28 17:47:52.741138 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:47:52.741113    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b\": container with ID starting with 3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b not found: ID does not exist" containerID="3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b"
Jul 28 17:47:52.741196 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.741150    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b"} err="failed to get container status \"3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b\": rpc error: code = NotFound desc = could not find container \"3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b\": container with ID starting with 3be225f4b231b1df839f9df0d176083480a2c242f857d354c68c21649601728b not found: ID does not exist"
Jul 28 17:47:52.754247 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.754209    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-7kmpm"]
Jul 28 17:47:52.758569 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:52.758537    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-7kmpm"]
Jul 28 17:47:53.921821 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:47:53.921777    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0" path="/var/lib/kubelet/pods/95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0/volumes"
Jul 28 17:48:53.687667 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.687629    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fdf77d766-6lwnw"]
Jul 28 17:48:53.688209 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.687967    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0" containerName="manager"
Jul 28 17:48:53.688209 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.687978    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0" containerName="manager"
Jul 28 17:48:53.688209 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.687990    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff3fb94-2939-45b9-a144-cf2d3caf0c5f" containerName="authorino"
Jul 28 17:48:53.688209 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.687995    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff3fb94-2939-45b9-a144-cf2d3caf0c5f" containerName="authorino"
Jul 28 17:48:53.688209 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.688078    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff3fb94-2939-45b9-a144-cf2d3caf0c5f" containerName="authorino"
Jul 28 17:48:53.688209 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.688088    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="95efefdf-d20e-46e2-8c3e-cc4be5fd0bb0" containerName="manager"
Jul 28 17:48:53.690141 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.690122    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:48:53.695910 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:48:53.695867    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-controller-5fdf77d766-6lwnw\" is forbidden: User \"system:node:ip-10-0-142-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-195.ec2.internal' and this object" podUID="03c5d8d3-9f89-46f7-b2be-600e91bdc9d0" pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:48:53.696151 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:48:53.695906    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-142-195.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-195.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" type="*v1.Secret"
Jul 28 17:48:53.696151 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:48:53.695911    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-controller-dockercfg-hrp6b\" is forbidden: User \"system:node:ip-10-0-142-195.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-195.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hrp6b\"" type="*v1.Secret"
Jul 28 17:48:53.696259 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:48:53.696183    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"maas-parameters\" is forbidden: User \"system:node:ip-10-0-142-195.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-195.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-parameters\"" type="*v1.ConfigMap"
Jul 28 17:48:53.716599 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.716563    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-6lwnw"]
Jul 28 17:48:53.818034 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.817988    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-webhook-cert\") pod \"maas-controller-5fdf77d766-6lwnw\" (UID: \"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0\") " pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:48:53.818236 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.818177    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw8ph\" (UniqueName: \"kubernetes.io/projected/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-kube-api-access-jw8ph\") pod \"maas-controller-5fdf77d766-6lwnw\" (UID: \"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0\") " pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:48:53.918622 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.918591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw8ph\" (UniqueName: \"kubernetes.io/projected/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-kube-api-access-jw8ph\") pod \"maas-controller-5fdf77d766-6lwnw\" (UID: \"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0\") " pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:48:53.918814 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.918645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-webhook-cert\") pod \"maas-controller-5fdf77d766-6lwnw\" (UID: \"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0\") " pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:48:53.929368 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:53.929333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw8ph\" (UniqueName: \"kubernetes.io/projected/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-kube-api-access-jw8ph\") pod \"maas-controller-5fdf77d766-6lwnw\" (UID: \"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0\") " pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:48:54.911070 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:54.911035    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 17:48:54.921600 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:54.921570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-webhook-cert\") pod \"maas-controller-5fdf77d766-6lwnw\" (UID: \"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0\") " pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:48:55.041918 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:55.041888    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hrp6b\""
Jul 28 17:48:55.201057 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:55.200949    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:48:55.233053 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:55.233025    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 17:48:55.343802 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:55.343761    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-6lwnw"]
Jul 28 17:48:55.346431 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:48:55.346401    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c5d8d3_9f89_46f7_b2be_600e91bdc9d0.slice/crio-fa9e2cbdc8bb1a5ca631571b74fa78c0fc36a97184442e7f168d498f20e7dc39 WatchSource:0}: Error finding container fa9e2cbdc8bb1a5ca631571b74fa78c0fc36a97184442e7f168d498f20e7dc39: Status 404 returned error can't find the container with id fa9e2cbdc8bb1a5ca631571b74fa78c0fc36a97184442e7f168d498f20e7dc39
Jul 28 17:48:56.050142 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:56.050070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf77d766-6lwnw" event={"ID":"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0","Type":"ContainerStarted","Data":"aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70"}
Jul 28 17:48:56.050556 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:56.050167    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf77d766-6lwnw" event={"ID":"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0","Type":"ContainerStarted","Data":"fa9e2cbdc8bb1a5ca631571b74fa78c0fc36a97184442e7f168d498f20e7dc39"}
Jul 28 17:48:56.050556 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:56.050307    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:48:56.069077 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:48:56.069021    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fdf77d766-6lwnw" podStartSLOduration=2.48729349 podStartE2EDuration="3.069005297s" totalImagesPullingTime="581.711807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:48:56.067839988 +0000 UTC m=+876.668436834" watchObservedRunningTime="2026-07-28 17:48:56.069005297 +0000 UTC m=+876.669602130"
Jul 28 17:49:07.057271 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:07.057234    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:49:11.774554 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:11.774463    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-6lwnw"]
Jul 28 17:49:11.774961 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:11.774707    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5fdf77d766-6lwnw" podUID="03c5d8d3-9f89-46f7-b2be-600e91bdc9d0" containerName="manager" containerID="cri-o://aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70" gracePeriod=30
Jul 28 17:49:12.028618 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.028541    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:49:12.060683 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.060654    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-webhook-cert\") pod \"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0\" (UID: \"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0\") "
Jul 28 17:49:12.062813 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.062780    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "03c5d8d3-9f89-46f7-b2be-600e91bdc9d0" (UID: "03c5d8d3-9f89-46f7-b2be-600e91bdc9d0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:49:12.131967 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.131928    2561 generic.go:356] "Generic (PLEG): container finished" podID="03c5d8d3-9f89-46f7-b2be-600e91bdc9d0" containerID="aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70" exitCode=0
Jul 28 17:49:12.132170 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.131975    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf77d766-6lwnw"
Jul 28 17:49:12.132170 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.131978    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf77d766-6lwnw" event={"ID":"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0","Type":"ContainerDied","Data":"aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70"}
Jul 28 17:49:12.132170 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.132126    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf77d766-6lwnw" event={"ID":"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0","Type":"ContainerDied","Data":"fa9e2cbdc8bb1a5ca631571b74fa78c0fc36a97184442e7f168d498f20e7dc39"}
Jul 28 17:49:12.132170 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.132160    2561 scope.go:117] "RemoveContainer" containerID="aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70"
Jul 28 17:49:12.140652 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.140630    2561 scope.go:117] "RemoveContainer" containerID="aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70"
Jul 28 17:49:12.140959 ip-10-0-142-195 kubenswrapper[2561]: E0728 17:49:12.140934    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70\": container with ID starting with aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70 not found: ID does not exist" containerID="aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70"
Jul 28 17:49:12.141031 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.140969    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70"} err="failed to get container status \"aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70\": rpc error: code = NotFound desc = could not find container \"aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70\": container with ID starting with aa6ed44b14267e2f1880f4d10502730a1344f8f3305061a6a4a66509b7763d70 not found: ID does not exist"
Jul 28 17:49:12.161335 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.161300    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw8ph\" (UniqueName: \"kubernetes.io/projected/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-kube-api-access-jw8ph\") pod \"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0\" (UID: \"03c5d8d3-9f89-46f7-b2be-600e91bdc9d0\") "
Jul 28 17:49:12.161531 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.161519    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-webhook-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:49:12.163371 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.163336    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-kube-api-access-jw8ph" (OuterVolumeSpecName: "kube-api-access-jw8ph") pod "03c5d8d3-9f89-46f7-b2be-600e91bdc9d0" (UID: "03c5d8d3-9f89-46f7-b2be-600e91bdc9d0"). InnerVolumeSpecName "kube-api-access-jw8ph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:49:12.262003 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.261967    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw8ph\" (UniqueName: \"kubernetes.io/projected/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0-kube-api-access-jw8ph\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 17:49:12.458177 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.458140    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-6lwnw"]
Jul 28 17:49:12.463555 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:12.463524    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-6lwnw"]
Jul 28 17:49:13.322309 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.322267    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fdf77d766-tsrc7"]
Jul 28 17:49:13.322724 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.322644    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c5d8d3-9f89-46f7-b2be-600e91bdc9d0" containerName="manager"
Jul 28 17:49:13.322724 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.322656    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c5d8d3-9f89-46f7-b2be-600e91bdc9d0" containerName="manager"
Jul 28 17:49:13.322724 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.322706    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="03c5d8d3-9f89-46f7-b2be-600e91bdc9d0" containerName="manager"
Jul 28 17:49:13.325685 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.325660    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf77d766-tsrc7"
Jul 28 17:49:13.329624 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.329587    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 17:49:13.329805 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.329639    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hrp6b\""
Jul 28 17:49:13.329805 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.329645    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 17:49:13.337990 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.337959    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-tsrc7"]
Jul 28 17:49:13.370364 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.370314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080af2ac-3e19-4afb-afbd-a0e77b4e9c42-webhook-cert\") pod \"maas-controller-5fdf77d766-tsrc7\" (UID: \"080af2ac-3e19-4afb-afbd-a0e77b4e9c42\") " pod="opendatahub/maas-controller-5fdf77d766-tsrc7"
Jul 28 17:49:13.370364 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.370368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz7dg\" (UniqueName: \"kubernetes.io/projected/080af2ac-3e19-4afb-afbd-a0e77b4e9c42-kube-api-access-gz7dg\") pod \"maas-controller-5fdf77d766-tsrc7\" (UID: \"080af2ac-3e19-4afb-afbd-a0e77b4e9c42\") " pod="opendatahub/maas-controller-5fdf77d766-tsrc7"
Jul 28 17:49:13.470952 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.470915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz7dg\" (UniqueName: \"kubernetes.io/projected/080af2ac-3e19-4afb-afbd-a0e77b4e9c42-kube-api-access-gz7dg\") pod \"maas-controller-5fdf77d766-tsrc7\" (UID: \"080af2ac-3e19-4afb-afbd-a0e77b4e9c42\") " pod="opendatahub/maas-controller-5fdf77d766-tsrc7"
Jul 28 17:49:13.471170 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.471031    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080af2ac-3e19-4afb-afbd-a0e77b4e9c42-webhook-cert\") pod \"maas-controller-5fdf77d766-tsrc7\" (UID: \"080af2ac-3e19-4afb-afbd-a0e77b4e9c42\") " pod="opendatahub/maas-controller-5fdf77d766-tsrc7"
Jul 28 17:49:13.473694 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.473655    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080af2ac-3e19-4afb-afbd-a0e77b4e9c42-webhook-cert\") pod \"maas-controller-5fdf77d766-tsrc7\" (UID: \"080af2ac-3e19-4afb-afbd-a0e77b4e9c42\") " pod="opendatahub/maas-controller-5fdf77d766-tsrc7"
Jul 28 17:49:13.481654 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.481621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz7dg\" (UniqueName: \"kubernetes.io/projected/080af2ac-3e19-4afb-afbd-a0e77b4e9c42-kube-api-access-gz7dg\") pod \"maas-controller-5fdf77d766-tsrc7\" (UID: \"080af2ac-3e19-4afb-afbd-a0e77b4e9c42\") " pod="opendatahub/maas-controller-5fdf77d766-tsrc7"
Jul 28 17:49:13.637921 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.637822    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf77d766-tsrc7"
Jul 28 17:49:13.781233 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.781205    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fdf77d766-tsrc7"]
Jul 28 17:49:13.783673 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:49:13.783644    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080af2ac_3e19_4afb_afbd_a0e77b4e9c42.slice/crio-85d31cf4d4cf87ba049634dbebe3ab98c710af72f7d8335dd5be80dba66256b2 WatchSource:0}: Error finding container 85d31cf4d4cf87ba049634dbebe3ab98c710af72f7d8335dd5be80dba66256b2: Status 404 returned error can't find the container with id 85d31cf4d4cf87ba049634dbebe3ab98c710af72f7d8335dd5be80dba66256b2
Jul 28 17:49:13.921014 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:13.920929    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03c5d8d3-9f89-46f7-b2be-600e91bdc9d0" path="/var/lib/kubelet/pods/03c5d8d3-9f89-46f7-b2be-600e91bdc9d0/volumes"
Jul 28 17:49:14.144482 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:14.144451    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf77d766-tsrc7" event={"ID":"080af2ac-3e19-4afb-afbd-a0e77b4e9c42","Type":"ContainerStarted","Data":"85d31cf4d4cf87ba049634dbebe3ab98c710af72f7d8335dd5be80dba66256b2"}
Jul 28 17:49:15.150668 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:15.150634    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf77d766-tsrc7" event={"ID":"080af2ac-3e19-4afb-afbd-a0e77b4e9c42","Type":"ContainerStarted","Data":"0ce61315256166cff46397a4963c73cdfb82e5b49e05c72a7641717b38926edd"}
Jul 28 17:49:15.151121 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:15.150720    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fdf77d766-tsrc7"
Jul 28 17:49:15.172558 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:15.172502    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fdf77d766-tsrc7" podStartSLOduration=1.8176430799999999 podStartE2EDuration="2.172479852s" totalImagesPullingTime="354.836772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:49:15.170516045 +0000 UTC m=+895.771112880" watchObservedRunningTime="2026-07-28 17:49:15.172479852 +0000 UTC m=+895.773076725"
Jul 28 17:49:19.825881 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:19.825848    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:49:19.829407 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:19.829376    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:49:19.866239 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:19.866206    2561 scope.go:117] "RemoveContainer" containerID="2ffe43d8485d1f686102c693285f9d57e7b53dae927ddb00e1e94adb89d67aeb"
Jul 28 17:49:26.158312 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:49:26.158273    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fdf77d766-tsrc7"
Jul 28 17:54:19.860287 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:54:19.860259    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:54:19.860841 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:54:19.860259    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:58:23.026992 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.026952    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"]
Jul 28 17:58:23.030251 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.030228    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.033712 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.033685    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-4822c567-kserve-self-signed-certs\""
Jul 28 17:58:23.060702 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.060669    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"]
Jul 28 17:58:23.116993 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.116954    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-dshm\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.116993 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.117004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-model-cache\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.117289 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.117078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-home\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.117289 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.117162    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tls-certs\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.117371 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.117293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmz62\" (UniqueName: \"kubernetes.io/projected/74412461-5702-4cf0-b5d6-9a3e5bd81f30-kube-api-access-pmz62\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.117371 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.117323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tmp-dir\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.217931 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.217887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-home\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.217931 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.217928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tls-certs\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.218241 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.217977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmz62\" (UniqueName: \"kubernetes.io/projected/74412461-5702-4cf0-b5d6-9a3e5bd81f30-kube-api-access-pmz62\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.218241 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.217995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tmp-dir\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.218241 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.218045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-dshm\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.218241 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.218071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-model-cache\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.218443 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.218410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-home\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.218484 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.218434    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tmp-dir\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.218484 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.218474    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-model-cache\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.220410 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.220384    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-dshm\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.220681 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.220664    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tls-certs\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.229436 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.229407    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmz62\" (UniqueName: \"kubernetes.io/projected/74412461-5702-4cf0-b5d6-9a3e5bd81f30-kube-api-access-pmz62\") pod \"e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") " pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.339610 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.339516    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:23.492745 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.492713    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"]
Jul 28 17:58:23.494614 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:58:23.494591    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74412461_5702_4cf0_b5d6_9a3e5bd81f30.slice/crio-9c29fee561bd845767ea2dfb6ba3ae1773ac0d8663efa5f9b5d0bde00f6debf1 WatchSource:0}: Error finding container 9c29fee561bd845767ea2dfb6ba3ae1773ac0d8663efa5f9b5d0bde00f6debf1: Status 404 returned error can't find the container with id 9c29fee561bd845767ea2dfb6ba3ae1773ac0d8663efa5f9b5d0bde00f6debf1
Jul 28 17:58:23.753833 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.753796    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt" event={"ID":"74412461-5702-4cf0-b5d6-9a3e5bd81f30","Type":"ContainerStarted","Data":"3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70"}
Jul 28 17:58:23.753833 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.753841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt" event={"ID":"74412461-5702-4cf0-b5d6-9a3e5bd81f30","Type":"ContainerStarted","Data":"9c29fee561bd845767ea2dfb6ba3ae1773ac0d8663efa5f9b5d0bde00f6debf1"}
Jul 28 17:58:23.776704 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:23.776639    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt" podStartSLOduration=0.776617647 podStartE2EDuration="776.617647ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:58:23.775694678 +0000 UTC m=+1444.376291526" watchObservedRunningTime="2026-07-28 17:58:23.776617647 +0000 UTC m=+1444.377214544"
Jul 28 17:58:33.340139 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:33.340010    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:33.340566 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:33.340296    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:33.352849 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:33.352820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:33.816271 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:33.816233    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 17:58:48.282348 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.282303    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"]
Jul 28 17:58:48.286015 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.285991    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.288969 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.288938    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-4822c567-kserve-self-signed-certs\""
Jul 28 17:58:48.296896 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.296868    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"]
Jul 28 17:58:48.452787 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.452750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-home\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.452787 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.452791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-model-cache\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.453013 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.452856    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-tmp-dir\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.453013 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.452871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d2f18e4-bf9a-4cac-987f-532328664c09-tls-certs\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.453013 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.452913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-dshm\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.453013 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.452929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdtgx\" (UniqueName: \"kubernetes.io/projected/5d2f18e4-bf9a-4cac-987f-532328664c09-kube-api-access-sdtgx\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.554297 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.554212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-tmp-dir\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.554297 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.554252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d2f18e4-bf9a-4cac-987f-532328664c09-tls-certs\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.554297 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.554295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-dshm\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.554520 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.554311    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdtgx\" (UniqueName: \"kubernetes.io/projected/5d2f18e4-bf9a-4cac-987f-532328664c09-kube-api-access-sdtgx\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.554520 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.554345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-home\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.554520 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.554364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-model-cache\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.554724 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.554694    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-tmp-dir\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.554782 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.554738    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-model-cache\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.554858 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.554835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-home\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.556740 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.556713    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-dshm\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.556865 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.556847    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d2f18e4-bf9a-4cac-987f-532328664c09-tls-certs\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.564911 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.564875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdtgx\" (UniqueName: \"kubernetes.io/projected/5d2f18e4-bf9a-4cac-987f-532328664c09-kube-api-access-sdtgx\") pod \"e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") " pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.598548 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.598510    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:48.744127 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.744077    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"]
Jul 28 17:58:48.747231 ip-10-0-142-195 kubenswrapper[2561]: W0728 17:58:48.747194    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d2f18e4_bf9a_4cac_987f_532328664c09.slice/crio-5a9f172896bed225b6470c1d3eeede839b0e626a6bb4a0c0c522bd083ed0bbe6 WatchSource:0}: Error finding container 5a9f172896bed225b6470c1d3eeede839b0e626a6bb4a0c0c522bd083ed0bbe6: Status 404 returned error can't find the container with id 5a9f172896bed225b6470c1d3eeede839b0e626a6bb4a0c0c522bd083ed0bbe6
Jul 28 17:58:48.876634 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.876598    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7" event={"ID":"5d2f18e4-bf9a-4cac-987f-532328664c09","Type":"ContainerStarted","Data":"0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0"}
Jul 28 17:58:48.876847 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.876656    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7" event={"ID":"5d2f18e4-bf9a-4cac-987f-532328664c09","Type":"ContainerStarted","Data":"5a9f172896bed225b6470c1d3eeede839b0e626a6bb4a0c0c522bd083ed0bbe6"}
Jul 28 17:58:48.898734 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:48.898682    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7" podStartSLOduration=0.898665218 podStartE2EDuration="898.665218ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:58:48.897246465 +0000 UTC m=+1469.497843298" watchObservedRunningTime="2026-07-28 17:58:48.898665218 +0000 UTC m=+1469.499262052"
Jul 28 17:58:58.598785 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:58.598750    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:58.599302 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:58.598813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:58.611551 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:58.611518    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:58:58.941883 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:58:58.941789    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 17:59:19.892408 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:59:19.892376    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:59:19.894256 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:59:19.894234    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 17:59:49.911353 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:59:49.911266    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"]
Jul 28 17:59:50.575563 ip-10-0-142-195 kubenswrapper[2561]: I0728 17:59:50.575525    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"]
Jul 28 18:00:04.933234 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:04.933186    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt" podUID="74412461-5702-4cf0-b5d6-9a3e5bd81f30" containerName="main" containerID="cri-o://3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70" gracePeriod=45
Jul 28 18:00:05.194065 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.193990    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 18:00:05.247842 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.247802    2561 generic.go:356] "Generic (PLEG): container finished" podID="74412461-5702-4cf0-b5d6-9a3e5bd81f30" containerID="3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70" exitCode=0
Jul 28 18:00:05.248023 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.247862    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"
Jul 28 18:00:05.248023 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.247895    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt" event={"ID":"74412461-5702-4cf0-b5d6-9a3e5bd81f30","Type":"ContainerDied","Data":"3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70"}
Jul 28 18:00:05.248023 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.247942    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt" event={"ID":"74412461-5702-4cf0-b5d6-9a3e5bd81f30","Type":"ContainerDied","Data":"9c29fee561bd845767ea2dfb6ba3ae1773ac0d8663efa5f9b5d0bde00f6debf1"}
Jul 28 18:00:05.248023 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.247959    2561 scope.go:117] "RemoveContainer" containerID="3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70"
Jul 28 18:00:05.254553 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.254525    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-model-cache\") pod \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") "
Jul 28 18:00:05.254700 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.254561    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-home\") pod \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") "
Jul 28 18:00:05.254700 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.254587    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tls-certs\") pod \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") "
Jul 28 18:00:05.254700 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.254625    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmz62\" (UniqueName: \"kubernetes.io/projected/74412461-5702-4cf0-b5d6-9a3e5bd81f30-kube-api-access-pmz62\") pod \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") "
Jul 28 18:00:05.254700 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.254691    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-dshm\") pod \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") "
Jul 28 18:00:05.254906 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.254714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tmp-dir\") pod \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\" (UID: \"74412461-5702-4cf0-b5d6-9a3e5bd81f30\") "
Jul 28 18:00:05.254906 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.254841    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-model-cache" (OuterVolumeSpecName: "model-cache") pod "74412461-5702-4cf0-b5d6-9a3e5bd81f30" (UID: "74412461-5702-4cf0-b5d6-9a3e5bd81f30"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:00:05.254906 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.254859    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-home" (OuterVolumeSpecName: "home") pod "74412461-5702-4cf0-b5d6-9a3e5bd81f30" (UID: "74412461-5702-4cf0-b5d6-9a3e5bd81f30"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:00:05.255106 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.255066    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "74412461-5702-4cf0-b5d6-9a3e5bd81f30" (UID: "74412461-5702-4cf0-b5d6-9a3e5bd81f30"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:00:05.255167 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.255107    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-model-cache\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:05.255167 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.255129    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-home\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:05.257032 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.256999    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-dshm" (OuterVolumeSpecName: "dshm") pod "74412461-5702-4cf0-b5d6-9a3e5bd81f30" (UID: "74412461-5702-4cf0-b5d6-9a3e5bd81f30"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:00:05.257275 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.257247    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74412461-5702-4cf0-b5d6-9a3e5bd81f30-kube-api-access-pmz62" (OuterVolumeSpecName: "kube-api-access-pmz62") pod "74412461-5702-4cf0-b5d6-9a3e5bd81f30" (UID: "74412461-5702-4cf0-b5d6-9a3e5bd81f30"). InnerVolumeSpecName "kube-api-access-pmz62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:00:05.257345 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.257281    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "74412461-5702-4cf0-b5d6-9a3e5bd81f30" (UID: "74412461-5702-4cf0-b5d6-9a3e5bd81f30"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:00:05.257547 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.257530    2561 scope.go:117] "RemoveContainer" containerID="3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70"
Jul 28 18:00:05.257879 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:00:05.257857    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70\": container with ID starting with 3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70 not found: ID does not exist" containerID="3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70"
Jul 28 18:00:05.257969 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.257894    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70"} err="failed to get container status \"3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70\": rpc error: code = NotFound desc = could not find container \"3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70\": container with ID starting with 3c7051499bc4d35fd3e6c623e5a946ff74ab0ba28db9acd9986d782c0785ae70 not found: ID does not exist"
Jul 28 18:00:05.356224 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.356186    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tls-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:05.356224 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.356222    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmz62\" (UniqueName: \"kubernetes.io/projected/74412461-5702-4cf0-b5d6-9a3e5bd81f30-kube-api-access-pmz62\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:05.356224 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.356236    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-dshm\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:05.356476 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.356250    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74412461-5702-4cf0-b5d6-9a3e5bd81f30-tmp-dir\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:05.572335 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.572299    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"]
Jul 28 18:00:05.577048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.577015    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-4822c567-kserve-766b675c59-q5gmt"]
Jul 28 18:00:05.594942 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.594895    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7" podUID="5d2f18e4-bf9a-4cac-987f-532328664c09" containerName="main" containerID="cri-o://0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0" gracePeriod=45
Jul 28 18:00:05.842505 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.842476    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 18:00:05.921015 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.920980    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74412461-5702-4cf0-b5d6-9a3e5bd81f30" path="/var/lib/kubelet/pods/74412461-5702-4cf0-b5d6-9a3e5bd81f30/volumes"
Jul 28 18:00:05.961211 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961176    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-home\") pod \"5d2f18e4-bf9a-4cac-987f-532328664c09\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") "
Jul 28 18:00:05.961211 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961219    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-model-cache\") pod \"5d2f18e4-bf9a-4cac-987f-532328664c09\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") "
Jul 28 18:00:05.961747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961243    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdtgx\" (UniqueName: \"kubernetes.io/projected/5d2f18e4-bf9a-4cac-987f-532328664c09-kube-api-access-sdtgx\") pod \"5d2f18e4-bf9a-4cac-987f-532328664c09\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") "
Jul 28 18:00:05.961747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961312    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-dshm\") pod \"5d2f18e4-bf9a-4cac-987f-532328664c09\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") "
Jul 28 18:00:05.961747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961332    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-tmp-dir\") pod \"5d2f18e4-bf9a-4cac-987f-532328664c09\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") "
Jul 28 18:00:05.961747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961376    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d2f18e4-bf9a-4cac-987f-532328664c09-tls-certs\") pod \"5d2f18e4-bf9a-4cac-987f-532328664c09\" (UID: \"5d2f18e4-bf9a-4cac-987f-532328664c09\") "
Jul 28 18:00:05.961747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961512    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d2f18e4-bf9a-4cac-987f-532328664c09" (UID: "5d2f18e4-bf9a-4cac-987f-532328664c09"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:00:05.961747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961542    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-home" (OuterVolumeSpecName: "home") pod "5d2f18e4-bf9a-4cac-987f-532328664c09" (UID: "5d2f18e4-bf9a-4cac-987f-532328664c09"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:00:05.961747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961657    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5d2f18e4-bf9a-4cac-987f-532328664c09" (UID: "5d2f18e4-bf9a-4cac-987f-532328664c09"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:00:05.961747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961675    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-home\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:05.961747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.961696    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-model-cache\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:05.963569 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.963546    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d2f18e4-bf9a-4cac-987f-532328664c09-kube-api-access-sdtgx" (OuterVolumeSpecName: "kube-api-access-sdtgx") pod "5d2f18e4-bf9a-4cac-987f-532328664c09" (UID: "5d2f18e4-bf9a-4cac-987f-532328664c09"). InnerVolumeSpecName "kube-api-access-sdtgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:00:05.963667 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.963589    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-dshm" (OuterVolumeSpecName: "dshm") pod "5d2f18e4-bf9a-4cac-987f-532328664c09" (UID: "5d2f18e4-bf9a-4cac-987f-532328664c09"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:00:05.963667 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:05.963605    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d2f18e4-bf9a-4cac-987f-532328664c09-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5d2f18e4-bf9a-4cac-987f-532328664c09" (UID: "5d2f18e4-bf9a-4cac-987f-532328664c09"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:00:06.063419 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.063381    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-dshm\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:06.063419 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.063417    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d2f18e4-bf9a-4cac-987f-532328664c09-tmp-dir\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:06.063419 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.063433    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d2f18e4-bf9a-4cac-987f-532328664c09-tls-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:06.063701 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.063459    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdtgx\" (UniqueName: \"kubernetes.io/projected/5d2f18e4-bf9a-4cac-987f-532328664c09-kube-api-access-sdtgx\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:00:06.255117 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.255053    2561 generic.go:356] "Generic (PLEG): container finished" podID="5d2f18e4-bf9a-4cac-987f-532328664c09" containerID="0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0" exitCode=0
Jul 28 18:00:06.255117 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.255118    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"
Jul 28 18:00:06.255357 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.255142    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7" event={"ID":"5d2f18e4-bf9a-4cac-987f-532328664c09","Type":"ContainerDied","Data":"0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0"}
Jul 28 18:00:06.255357 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.255194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7" event={"ID":"5d2f18e4-bf9a-4cac-987f-532328664c09","Type":"ContainerDied","Data":"5a9f172896bed225b6470c1d3eeede839b0e626a6bb4a0c0c522bd083ed0bbe6"}
Jul 28 18:00:06.255357 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.255214    2561 scope.go:117] "RemoveContainer" containerID="0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0"
Jul 28 18:00:06.265033 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.265012    2561 scope.go:117] "RemoveContainer" containerID="0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0"
Jul 28 18:00:06.265383 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:00:06.265361    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0\": container with ID starting with 0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0 not found: ID does not exist" containerID="0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0"
Jul 28 18:00:06.265483 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.265390    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0"} err="failed to get container status \"0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0\": rpc error: code = NotFound desc = could not find container \"0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0\": container with ID starting with 0f875ade5e64ecbf7811dd7a7576c1aba65e0645ebfbda75745b28578cd9e4d0 not found: ID does not exist"
Jul 28 18:00:06.281848 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.281815    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"]
Jul 28 18:00:06.290351 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:06.290313    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-4822c567-kserve-75d9757dc9-jwvz7"]
Jul 28 18:00:07.920356 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:00:07.920314    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d2f18e4-bf9a-4cac-987f-532328664c09" path="/var/lib/kubelet/pods/5d2f18e4-bf9a-4cac-987f-532328664c09/volumes"
Jul 28 18:03:50.039956 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.039909    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"]
Jul 28 18:03:50.042430 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.040345    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74412461-5702-4cf0-b5d6-9a3e5bd81f30" containerName="main"
Jul 28 18:03:50.042430 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.040359    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="74412461-5702-4cf0-b5d6-9a3e5bd81f30" containerName="main"
Jul 28 18:03:50.042430 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.040368    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d2f18e4-bf9a-4cac-987f-532328664c09" containerName="main"
Jul 28 18:03:50.042430 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.040374    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d2f18e4-bf9a-4cac-987f-532328664c09" containerName="main"
Jul 28 18:03:50.042430 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.040442    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="74412461-5702-4cf0-b5d6-9a3e5bd81f30" containerName="main"
Jul 28 18:03:50.042430 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.040452    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d2f18e4-bf9a-4cac-987f-532328664c09" containerName="main"
Jul 28 18:03:50.043342 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.043324    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.046401 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.046377    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3fe65036-openshift-default-dockercfg-q64pm\""
Jul 28 18:03:50.067167 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.067123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-socket\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.067349 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.067181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-podinfo\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.067349 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.067231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-token\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.067349 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.067298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istiod-ca-cert\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.067349 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.067330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-envoy\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.067517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.067417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-certs\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.067517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.067439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-data\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.067517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.067455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7zmd\" (UniqueName: \"kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-kube-api-access-r7zmd\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.067517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.067479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-credential-socket\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.071923 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.071888    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"]
Jul 28 18:03:50.167934 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.167898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-podinfo\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.167934 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.167934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-token\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.168233 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.167954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istiod-ca-cert\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.168233 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-envoy\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.168353 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-certs\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.168353 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-data\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.168353 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168346    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7zmd\" (UniqueName: \"kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-kube-api-access-r7zmd\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.168503 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168381    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-credential-socket\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.168503 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-socket\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.168698 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-certs\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.168883 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-data\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.168970 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168895    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istiod-ca-cert\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.169039 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168985    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-socket\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.169039 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.168999    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-credential-socket\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.170696 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.170668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-envoy\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.170847 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.170828    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-podinfo\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.180566 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.180529    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-token\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.180705 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.180677    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7zmd\" (UniqueName: \"kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-kube-api-access-r7zmd\") pod \"e2e-ait-3fe65036-openshift-default-6875486f96-brr9j\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") " pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.357260 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.357157    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:50.508142 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.508112    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"]
Jul 28 18:03:50.511321 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:03:50.511291    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655cd6b1_c31c_4ed0_8947_a74f88d4fbf3.slice/crio-1fa39c83a8b3dfb3dbf57e978b645cf216a17673fff45c9ff793d15ccfb9e1f6 WatchSource:0}: Error finding container 1fa39c83a8b3dfb3dbf57e978b645cf216a17673fff45c9ff793d15ccfb9e1f6: Status 404 returned error can't find the container with id 1fa39c83a8b3dfb3dbf57e978b645cf216a17673fff45c9ff793d15ccfb9e1f6
Jul 28 18:03:50.513515 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.513474    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:03:50.513609 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.513544    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:03:50.513609 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:50.513572    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:03:51.331042 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:51.331005    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" event={"ID":"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3","Type":"ContainerStarted","Data":"3e904c04cb90a35d09209f677c9dbe333dcea1f81b558c1ed2dc4bec0f8082c9"}
Jul 28 18:03:51.331515 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:51.331082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" event={"ID":"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3","Type":"ContainerStarted","Data":"1fa39c83a8b3dfb3dbf57e978b645cf216a17673fff45c9ff793d15ccfb9e1f6"}
Jul 28 18:03:51.355655 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:51.355598    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" podStartSLOduration=1.355579852 podStartE2EDuration="1.355579852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:03:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:03:51.353793061 +0000 UTC m=+1771.954389895" watchObservedRunningTime="2026-07-28 18:03:51.355579852 +0000 UTC m=+1771.956176681"
Jul 28 18:03:51.357985 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:51.357957    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:51.363868 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:51.363838    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:52.336406 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:52.336375    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:52.337472 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:52.337449    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:03:53.898383 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:53.898344    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"]
Jul 28 18:03:53.901825 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:53.901802    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:03:53.905022 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:53.904994    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3fe65036-dockercfg-dw86s\""
Jul 28 18:03:53.905181 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:53.905047    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3fe65036\""
Jul 28 18:03:53.911412 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:53.911377    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"]
Jul 28 18:03:53.924811 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:53.924776    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"]
Jul 28 18:03:53.928439 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:53.928408    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:03:53.940661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:53.940629    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"]
Jul 28 18:03:54.001507 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.001465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhwzn\" (UniqueName: \"kubernetes.io/projected/77f918f8-64ad-425b-9953-fc208e11affb-kube-api-access-jhwzn\") pod \"payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb\" (UID: \"77f918f8-64ad-425b-9953-fc208e11affb\") " pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:03:54.001698 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.001531    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a49ea476-a2ed-4378-bb11-484e10ca18b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh\" (UID: \"a49ea476-a2ed-4378-bb11-484e10ca18b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:03:54.001698 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.001583    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f918f8-64ad-425b-9953-fc208e11affb-plugins-config-volume\") pod \"payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb\" (UID: \"77f918f8-64ad-425b-9953-fc208e11affb\") " pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:03:54.001698 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.001608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld6wv\" (UniqueName: \"kubernetes.io/projected/a49ea476-a2ed-4378-bb11-484e10ca18b8-kube-api-access-ld6wv\") pod \"payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh\" (UID: \"a49ea476-a2ed-4378-bb11-484e10ca18b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:03:54.102507 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.102472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f918f8-64ad-425b-9953-fc208e11affb-plugins-config-volume\") pod \"payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb\" (UID: \"77f918f8-64ad-425b-9953-fc208e11affb\") " pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:03:54.102507 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.102512    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld6wv\" (UniqueName: \"kubernetes.io/projected/a49ea476-a2ed-4378-bb11-484e10ca18b8-kube-api-access-ld6wv\") pod \"payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh\" (UID: \"a49ea476-a2ed-4378-bb11-484e10ca18b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:03:54.102902 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.102569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwzn\" (UniqueName: \"kubernetes.io/projected/77f918f8-64ad-425b-9953-fc208e11affb-kube-api-access-jhwzn\") pod \"payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb\" (UID: \"77f918f8-64ad-425b-9953-fc208e11affb\") " pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:03:54.102902 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.102633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a49ea476-a2ed-4378-bb11-484e10ca18b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh\" (UID: \"a49ea476-a2ed-4378-bb11-484e10ca18b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:03:54.103553 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.103526    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f918f8-64ad-425b-9953-fc208e11affb-plugins-config-volume\") pod \"payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb\" (UID: \"77f918f8-64ad-425b-9953-fc208e11affb\") " pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:03:54.103606 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.103553    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a49ea476-a2ed-4378-bb11-484e10ca18b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh\" (UID: \"a49ea476-a2ed-4378-bb11-484e10ca18b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:03:54.112314 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.112285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhwzn\" (UniqueName: \"kubernetes.io/projected/77f918f8-64ad-425b-9953-fc208e11affb-kube-api-access-jhwzn\") pod \"payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb\" (UID: \"77f918f8-64ad-425b-9953-fc208e11affb\") " pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:03:54.112478 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.112346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld6wv\" (UniqueName: \"kubernetes.io/projected/a49ea476-a2ed-4378-bb11-484e10ca18b8-kube-api-access-ld6wv\") pod \"payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh\" (UID: \"a49ea476-a2ed-4378-bb11-484e10ca18b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:03:54.214496 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.214400    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:03:54.240280 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.240241    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:03:54.386290 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.386255    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"]
Jul 28 18:03:54.390225 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:03:54.390192    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49ea476_a2ed_4378_bb11_484e10ca18b8.slice/crio-d796ffbb3541fc9a03db906f63808a7e36e39ced493a6d77bd31cd38cbecd600 WatchSource:0}: Error finding container d796ffbb3541fc9a03db906f63808a7e36e39ced493a6d77bd31cd38cbecd600: Status 404 returned error can't find the container with id d796ffbb3541fc9a03db906f63808a7e36e39ced493a6d77bd31cd38cbecd600
Jul 28 18:03:54.410490 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:54.410463    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"]
Jul 28 18:03:54.413690 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:03:54.413660    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f918f8_64ad_425b_9953_fc208e11affb.slice/crio-cdd2b1cdd39405e54b57a0a67ea3c28bf775024f6db1e1b744960f7b221337cb WatchSource:0}: Error finding container cdd2b1cdd39405e54b57a0a67ea3c28bf775024f6db1e1b744960f7b221337cb: Status 404 returned error can't find the container with id cdd2b1cdd39405e54b57a0a67ea3c28bf775024f6db1e1b744960f7b221337cb
Jul 28 18:03:55.358687 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:55.357768    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh" event={"ID":"a49ea476-a2ed-4378-bb11-484e10ca18b8","Type":"ContainerStarted","Data":"39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83"}
Jul 28 18:03:55.358687 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:55.357875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh" event={"ID":"a49ea476-a2ed-4378-bb11-484e10ca18b8","Type":"ContainerStarted","Data":"d796ffbb3541fc9a03db906f63808a7e36e39ced493a6d77bd31cd38cbecd600"}
Jul 28 18:03:55.358687 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:55.358679    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:03:55.360155 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:55.360122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb" event={"ID":"77f918f8-64ad-425b-9953-fc208e11affb","Type":"ContainerStarted","Data":"635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d"}
Jul 28 18:03:55.360321 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:55.360181    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb" event={"ID":"77f918f8-64ad-425b-9953-fc208e11affb","Type":"ContainerStarted","Data":"cdd2b1cdd39405e54b57a0a67ea3c28bf775024f6db1e1b744960f7b221337cb"}
Jul 28 18:03:55.360321 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:55.360271    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:03:55.379529 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:55.379468    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh" podStartSLOduration=2.3794499350000002 podStartE2EDuration="2.379449935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:03:55.377818384 +0000 UTC m=+1775.978415217" watchObservedRunningTime="2026-07-28 18:03:55.379449935 +0000 UTC m=+1775.980046806"
Jul 28 18:03:55.397423 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:03:55.397359    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb" podStartSLOduration=2.3973397370000002 podStartE2EDuration="2.397339737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:03:55.39708562 +0000 UTC m=+1775.997682453" watchObservedRunningTime="2026-07-28 18:03:55.397339737 +0000 UTC m=+1775.997936571"
Jul 28 18:04:06.368483 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:06.368443    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:04:07.338377 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:07.338336    2561 patch_prober.go:28] interesting pod/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 28 18:04:07.338612 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:07.338406    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 28 18:04:07.372654 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:07.372622    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:04:07.425241 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:07.425206    2561 generic.go:356] "Generic (PLEG): container finished" podID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerID="3e904c04cb90a35d09209f677c9dbe333dcea1f81b558c1ed2dc4bec0f8082c9" exitCode=0
Jul 28 18:04:07.425419 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:07.425274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" event={"ID":"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3","Type":"ContainerDied","Data":"3e904c04cb90a35d09209f677c9dbe333dcea1f81b558c1ed2dc4bec0f8082c9"}
Jul 28 18:04:07.425818 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:07.425797    2561 scope.go:117] "RemoveContainer" containerID="3e904c04cb90a35d09209f677c9dbe333dcea1f81b558c1ed2dc4bec0f8082c9"
Jul 28 18:04:07.427004 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:07.426973    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:07.427127 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:07.427045    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:07.427127 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:07.427079    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:08.432124 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:08.432059    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" event={"ID":"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3","Type":"ContainerStarted","Data":"cf9e0069779a7fba238f728028160f6122e3a0f2f4759c01e8b567d605089a94"}
Jul 28 18:04:09.358332 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:09.358232    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:04:09.358613 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:09.358579    2561 patch_prober.go:28] interesting pod/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 28 18:04:09.358850 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:09.358812    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 28 18:04:10.368632 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:10.368591    2561 patch_prober.go:28] interesting pod/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 28 18:04:10.369296 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:10.369259    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 28 18:04:11.358832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:11.358771    2561 patch_prober.go:28] interesting pod/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 28 18:04:11.359064 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:11.358862    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 28 18:04:12.357834 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:12.357727    2561 patch_prober.go:28] interesting pod/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 28 18:04:12.358375 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:12.357828    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 28 18:04:13.362814 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:13.362750    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:04:13.363262 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:13.363218    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:04:13.363991 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:13.363971    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:04:19.924233 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:19.924199    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:04:19.926992 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:19.926966    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:04:23.855238 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:23.855189    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"]
Jul 28 18:04:23.855774 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:23.855475    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb" podUID="77f918f8-64ad-425b-9953-fc208e11affb" containerName="payload-processing" containerID="cri-o://635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d" gracePeriod=30
Jul 28 18:04:23.864823 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:23.864777    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"]
Jul 28 18:04:23.865412 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:23.865059    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh" podUID="a49ea476-a2ed-4378-bb11-484e10ca18b8" containerName="payload-pre-processing" containerID="cri-o://39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83" gracePeriod=30
Jul 28 18:04:24.142787 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.142756    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:04:24.156482 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.156453    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:04:24.235754 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.235703    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"]
Jul 28 18:04:24.235983 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.235922    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy" containerID="cri-o://cf9e0069779a7fba238f728028160f6122e3a0f2f4759c01e8b567d605089a94" gracePeriod=30
Jul 28 18:04:24.302389 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.302346    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld6wv\" (UniqueName: \"kubernetes.io/projected/a49ea476-a2ed-4378-bb11-484e10ca18b8-kube-api-access-ld6wv\") pod \"a49ea476-a2ed-4378-bb11-484e10ca18b8\" (UID: \"a49ea476-a2ed-4378-bb11-484e10ca18b8\") "
Jul 28 18:04:24.302613 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.302438    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a49ea476-a2ed-4378-bb11-484e10ca18b8-plugins-config-volume\") pod \"a49ea476-a2ed-4378-bb11-484e10ca18b8\" (UID: \"a49ea476-a2ed-4378-bb11-484e10ca18b8\") "
Jul 28 18:04:24.302613 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.302484    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f918f8-64ad-425b-9953-fc208e11affb-plugins-config-volume\") pod \"77f918f8-64ad-425b-9953-fc208e11affb\" (UID: \"77f918f8-64ad-425b-9953-fc208e11affb\") "
Jul 28 18:04:24.302613 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.302577    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhwzn\" (UniqueName: \"kubernetes.io/projected/77f918f8-64ad-425b-9953-fc208e11affb-kube-api-access-jhwzn\") pod \"77f918f8-64ad-425b-9953-fc208e11affb\" (UID: \"77f918f8-64ad-425b-9953-fc208e11affb\") "
Jul 28 18:04:24.302927 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.302898    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a49ea476-a2ed-4378-bb11-484e10ca18b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a49ea476-a2ed-4378-bb11-484e10ca18b8" (UID: "a49ea476-a2ed-4378-bb11-484e10ca18b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:04:24.302991 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.302973    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f918f8-64ad-425b-9953-fc208e11affb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "77f918f8-64ad-425b-9953-fc208e11affb" (UID: "77f918f8-64ad-425b-9953-fc208e11affb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:04:24.304854 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.304825    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49ea476-a2ed-4378-bb11-484e10ca18b8-kube-api-access-ld6wv" (OuterVolumeSpecName: "kube-api-access-ld6wv") pod "a49ea476-a2ed-4378-bb11-484e10ca18b8" (UID: "a49ea476-a2ed-4378-bb11-484e10ca18b8"). InnerVolumeSpecName "kube-api-access-ld6wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:04:24.304854 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.304841    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f918f8-64ad-425b-9953-fc208e11affb-kube-api-access-jhwzn" (OuterVolumeSpecName: "kube-api-access-jhwzn") pod "77f918f8-64ad-425b-9953-fc208e11affb" (UID: "77f918f8-64ad-425b-9953-fc208e11affb"). InnerVolumeSpecName "kube-api-access-jhwzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:04:24.403630 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.403523    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f918f8-64ad-425b-9953-fc208e11affb-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:24.403630 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.403572    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhwzn\" (UniqueName: \"kubernetes.io/projected/77f918f8-64ad-425b-9953-fc208e11affb-kube-api-access-jhwzn\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:24.403630 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.403583    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld6wv\" (UniqueName: \"kubernetes.io/projected/a49ea476-a2ed-4378-bb11-484e10ca18b8-kube-api-access-ld6wv\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:24.403630 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.403592    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a49ea476-a2ed-4378-bb11-484e10ca18b8-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:24.514565 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.514529    2561 generic.go:356] "Generic (PLEG): container finished" podID="a49ea476-a2ed-4378-bb11-484e10ca18b8" containerID="39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83" exitCode=0
Jul 28 18:04:24.514747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.514579    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"
Jul 28 18:04:24.514747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.514611    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh" event={"ID":"a49ea476-a2ed-4378-bb11-484e10ca18b8","Type":"ContainerDied","Data":"39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83"}
Jul 28 18:04:24.514747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.514661    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh" event={"ID":"a49ea476-a2ed-4378-bb11-484e10ca18b8","Type":"ContainerDied","Data":"d796ffbb3541fc9a03db906f63808a7e36e39ced493a6d77bd31cd38cbecd600"}
Jul 28 18:04:24.514747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.514688    2561 scope.go:117] "RemoveContainer" containerID="39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83"
Jul 28 18:04:24.516048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.516020    2561 generic.go:356] "Generic (PLEG): container finished" podID="77f918f8-64ad-425b-9953-fc208e11affb" containerID="635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d" exitCode=0
Jul 28 18:04:24.516181 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.516071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb" event={"ID":"77f918f8-64ad-425b-9953-fc208e11affb","Type":"ContainerDied","Data":"635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d"}
Jul 28 18:04:24.516181 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.516078    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"
Jul 28 18:04:24.516181 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.516149    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb" event={"ID":"77f918f8-64ad-425b-9953-fc208e11affb","Type":"ContainerDied","Data":"cdd2b1cdd39405e54b57a0a67ea3c28bf775024f6db1e1b744960f7b221337cb"}
Jul 28 18:04:24.524029 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.524004    2561 scope.go:117] "RemoveContainer" containerID="39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83"
Jul 28 18:04:24.524482 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:04:24.524398    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83\": container with ID starting with 39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83 not found: ID does not exist" containerID="39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83"
Jul 28 18:04:24.524482 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.524436    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83"} err="failed to get container status \"39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83\": rpc error: code = NotFound desc = could not find container \"39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83\": container with ID starting with 39846a949553324de310d3c5f2e6a915daca6cb035a6d13fdd6ebdff662abc83 not found: ID does not exist"
Jul 28 18:04:24.524482 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.524468    2561 scope.go:117] "RemoveContainer" containerID="635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d"
Jul 28 18:04:24.534723 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.534699    2561 scope.go:117] "RemoveContainer" containerID="635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d"
Jul 28 18:04:24.535082 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:04:24.535061    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d\": container with ID starting with 635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d not found: ID does not exist" containerID="635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d"
Jul 28 18:04:24.535175 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.535115    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d"} err="failed to get container status \"635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d\": rpc error: code = NotFound desc = could not find container \"635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d\": container with ID starting with 635cd10bb783cc9abc02b64780fc4473b0cc502b6ad86060a4d167899349287d not found: ID does not exist"
Jul 28 18:04:24.546215 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.546171    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"]
Jul 28 18:04:24.548084 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.548049    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3fe65036-5f748f47bd-jjmwh"]
Jul 28 18:04:24.561574 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.561538    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"]
Jul 28 18:04:24.566533 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:24.566502    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3fe65036-74bf89f5d8-49vjb"]
Jul 28 18:04:25.312466 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.312426    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"]
Jul 28 18:04:25.312994 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.312978    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f918f8-64ad-425b-9953-fc208e11affb" containerName="payload-processing"
Jul 28 18:04:25.313038 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.312996    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f918f8-64ad-425b-9953-fc208e11affb" containerName="payload-processing"
Jul 28 18:04:25.313038 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.313032    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49ea476-a2ed-4378-bb11-484e10ca18b8" containerName="payload-pre-processing"
Jul 28 18:04:25.313219 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.313040    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49ea476-a2ed-4378-bb11-484e10ca18b8" containerName="payload-pre-processing"
Jul 28 18:04:25.313219 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.313143    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a49ea476-a2ed-4378-bb11-484e10ca18b8" containerName="payload-pre-processing"
Jul 28 18:04:25.313219 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.313160    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f918f8-64ad-425b-9953-fc208e11affb" containerName="payload-processing"
Jul 28 18:04:25.317624 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.317596    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.321991 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.321955    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-6ad02c46-gw-openshift-default-dockercfg-2xdcn\""
Jul 28 18:04:25.330042 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.330007    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"]
Jul 28 18:04:25.512822 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.512772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-certs\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.512822 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.512829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-podinfo\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.513075 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.512857    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-socket\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.513075 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.512883    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zkw9\" (UniqueName: \"kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-kube-api-access-4zkw9\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.513075 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.512937    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-credential-socket\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.513075 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.512968    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-data\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.513075 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.512992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-token\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.513257 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.513069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-envoy\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.513257 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.513164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istiod-ca-cert\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.614559 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.614456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-certs\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.614559 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.614497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-podinfo\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.614559 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.614515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-socket\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.614836 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.614635    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zkw9\" (UniqueName: \"kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-kube-api-access-4zkw9\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.614836 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.614690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-credential-socket\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.615031 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.615004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-credential-socket\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.615130 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.615062    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-socket\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.615130 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.615024    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-data\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.615267 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.615157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-token\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.615267 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.615199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-envoy\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.615382 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.615357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-data\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.615438 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.615388    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istiod-ca-cert\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.615535 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.614970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-certs\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.616142 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.616121    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istiod-ca-cert\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.617404 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.617373    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-podinfo\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.617518 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.617428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-envoy\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.625035 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.624992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-token\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.625240 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.625179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zkw9\" (UniqueName: \"kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-kube-api-access-4zkw9\") pod \"e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") " pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.630832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.630792    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:25.792179 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.792144    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"]
Jul 28 18:04:25.794638 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:04:25.794602    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae18d9e2_f5c2_43f4_89c0_ba82f48c977f.slice/crio-b722190be33263af7badc5a1750d65df56466fd2404b1dcebd5e9fed7d695ec5 WatchSource:0}: Error finding container b722190be33263af7badc5a1750d65df56466fd2404b1dcebd5e9fed7d695ec5: Status 404 returned error can't find the container with id b722190be33263af7badc5a1750d65df56466fd2404b1dcebd5e9fed7d695ec5
Jul 28 18:04:25.797281 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.797239    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:25.797385 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.797334    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:25.797453 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.797381    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:25.924656 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.924607    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77f918f8-64ad-425b-9953-fc208e11affb" path="/var/lib/kubelet/pods/77f918f8-64ad-425b-9953-fc208e11affb/volumes"
Jul 28 18:04:25.925182 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:25.925159    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a49ea476-a2ed-4378-bb11-484e10ca18b8" path="/var/lib/kubelet/pods/a49ea476-a2ed-4378-bb11-484e10ca18b8/volumes"
Jul 28 18:04:26.535628 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:26.535584    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" event={"ID":"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f","Type":"ContainerStarted","Data":"462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a"}
Jul 28 18:04:26.536069 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:26.535681    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" event={"ID":"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f","Type":"ContainerStarted","Data":"b722190be33263af7badc5a1750d65df56466fd2404b1dcebd5e9fed7d695ec5"}
Jul 28 18:04:26.559799 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:26.559735    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" podStartSLOduration=1.559713834 podStartE2EDuration="1.559713834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:04:26.557749195 +0000 UTC m=+1807.158346030" watchObservedRunningTime="2026-07-28 18:04:26.559713834 +0000 UTC m=+1807.160310667"
Jul 28 18:04:26.631018 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:26.630984    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:26.636639 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:26.636602    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:27.540548 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:27.540511    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:27.541675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:27.541651    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:28.365332 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:28.365285    2561 patch_prober.go:28] interesting pod/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 28 18:04:28.365594 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:28.365409    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 18:04:29.020178 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.020130    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"]
Jul 28 18:04:29.024915 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.024885    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:29.027914 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.027889    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-6ad02c46\""
Jul 28 18:04:29.036762 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.036684    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"]
Jul 28 18:04:29.039567 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.039528    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"]
Jul 28 18:04:29.043195 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.043165    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:29.046254 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.046217    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-6ad02c46-dockercfg-kx2jc\""
Jul 28 18:04:29.049544 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.049078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llpr6\" (UniqueName: \"kubernetes.io/projected/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-kube-api-access-llpr6\") pod \"payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn\" (UID: \"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b\") " pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:29.049544 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.049208    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn\" (UID: \"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b\") " pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:29.049544 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.049374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc1c421-f430-4618-b312-e84a1cc042b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t\" (UID: \"efc1c421-f430-4618-b312-e84a1cc042b6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:29.049544 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.049404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv4cw\" (UniqueName: \"kubernetes.io/projected/efc1c421-f430-4618-b312-e84a1cc042b6-kube-api-access-gv4cw\") pod \"payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t\" (UID: \"efc1c421-f430-4618-b312-e84a1cc042b6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:29.050168 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.050035    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"]
Jul 28 18:04:29.150887 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.150368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llpr6\" (UniqueName: \"kubernetes.io/projected/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-kube-api-access-llpr6\") pod \"payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn\" (UID: \"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b\") " pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:29.150887 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.150443    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn\" (UID: \"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b\") " pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:29.150887 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.150571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc1c421-f430-4618-b312-e84a1cc042b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t\" (UID: \"efc1c421-f430-4618-b312-e84a1cc042b6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:29.150887 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.150600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv4cw\" (UniqueName: \"kubernetes.io/projected/efc1c421-f430-4618-b312-e84a1cc042b6-kube-api-access-gv4cw\") pod \"payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t\" (UID: \"efc1c421-f430-4618-b312-e84a1cc042b6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:29.151672 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.151640    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc1c421-f430-4618-b312-e84a1cc042b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t\" (UID: \"efc1c421-f430-4618-b312-e84a1cc042b6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:29.152114 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.152065    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn\" (UID: \"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b\") " pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:29.164952 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.164814    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llpr6\" (UniqueName: \"kubernetes.io/projected/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-kube-api-access-llpr6\") pod \"payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn\" (UID: \"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b\") " pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:29.166053 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.166020    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv4cw\" (UniqueName: \"kubernetes.io/projected/efc1c421-f430-4618-b312-e84a1cc042b6-kube-api-access-gv4cw\") pod \"payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t\" (UID: \"efc1c421-f430-4618-b312-e84a1cc042b6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:29.338837 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.338728    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:29.357963 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.357935    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:29.532869 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.530749    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"]
Jul 28 18:04:29.551031 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:04:29.550991    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc1c421_f430_4618_b312_e84a1cc042b6.slice/crio-52eacf98d9c9a5903a0217c8995d4f4b8536dd6a7ad04a764f8dcfb44882411e WatchSource:0}: Error finding container 52eacf98d9c9a5903a0217c8995d4f4b8536dd6a7ad04a764f8dcfb44882411e: Status 404 returned error can't find the container with id 52eacf98d9c9a5903a0217c8995d4f4b8536dd6a7ad04a764f8dcfb44882411e
Jul 28 18:04:29.558563 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.558529    2561 generic.go:356] "Generic (PLEG): container finished" podID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerID="cf9e0069779a7fba238f728028160f6122e3a0f2f4759c01e8b567d605089a94" exitCode=0
Jul 28 18:04:29.558742 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.558582    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" event={"ID":"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3","Type":"ContainerDied","Data":"cf9e0069779a7fba238f728028160f6122e3a0f2f4759c01e8b567d605089a94"}
Jul 28 18:04:29.558742 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.558652    2561 scope.go:117] "RemoveContainer" containerID="3e904c04cb90a35d09209f677c9dbe333dcea1f81b558c1ed2dc4bec0f8082c9"
Jul 28 18:04:29.564334 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.564302    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:04:29.581028 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.580997    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"]
Jul 28 18:04:29.584414 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:04:29.584387    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9391c8_06a6_4e12_9ccd_37f8699a8d7b.slice/crio-1f48c1b79b1e7762c02219c7e6c75cacd12e27df55f211f2badf9e136e3b33c5 WatchSource:0}: Error finding container 1f48c1b79b1e7762c02219c7e6c75cacd12e27df55f211f2badf9e136e3b33c5: Status 404 returned error can't find the container with id 1f48c1b79b1e7762c02219c7e6c75cacd12e27df55f211f2badf9e136e3b33c5
Jul 28 18:04:29.656435 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.656400    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-data\") pod \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") "
Jul 28 18:04:29.656435 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.656444    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-token\") pod \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") "
Jul 28 18:04:29.656709 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.656519    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-envoy\") pod \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") "
Jul 28 18:04:29.656709 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.656545    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7zmd\" (UniqueName: \"kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-kube-api-access-r7zmd\") pod \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") "
Jul 28 18:04:29.656709 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.656576    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-certs\") pod \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") "
Jul 28 18:04:29.656709 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.656594    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-credential-socket\") pod \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") "
Jul 28 18:04:29.656709 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.656615    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-socket\") pod \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") "
Jul 28 18:04:29.656709 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.656673    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istiod-ca-cert\") pod \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") "
Jul 28 18:04:29.656709 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.656700    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-podinfo\") pod \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\" (UID: \"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3\") "
Jul 28 18:04:29.657040 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.656950    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" (UID: "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:04:29.657141 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.657064    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:29.657141 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.657087    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" (UID: "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:04:29.657609 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.657363    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" (UID: "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:04:29.657609 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.657419    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-data" (OuterVolumeSpecName: "istio-data") pod "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" (UID: "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:04:29.657780 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.657611    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" (UID: "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:04:29.659564 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.659499    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-kube-api-access-r7zmd" (OuterVolumeSpecName: "kube-api-access-r7zmd") pod "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" (UID: "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3"). InnerVolumeSpecName "kube-api-access-r7zmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:04:29.659709 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.659625    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" (UID: "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:04:29.659855 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.659827    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-token" (OuterVolumeSpecName: "istio-token") pod "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" (UID: "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:04:29.659977 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.659953    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" (UID: "655cd6b1-c31c-4ed0-8947-a74f88d4fbf3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:04:29.757966 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.757915    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:29.757966 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.757963    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:29.757966 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.757976    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:29.758282 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.757990    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7zmd\" (UniqueName: \"kubernetes.io/projected/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-kube-api-access-r7zmd\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:29.758282 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.758006    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:29.758282 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.758020    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:29.758282 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.758036    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:29.758282 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:29.758050    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:30.565867 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.565830    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"
Jul 28 18:04:30.565867 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.565841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j" event={"ID":"655cd6b1-c31c-4ed0-8947-a74f88d4fbf3","Type":"ContainerDied","Data":"1fa39c83a8b3dfb3dbf57e978b645cf216a17673fff45c9ff793d15ccfb9e1f6"}
Jul 28 18:04:30.566441 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.565912    2561 scope.go:117] "RemoveContainer" containerID="cf9e0069779a7fba238f728028160f6122e3a0f2f4759c01e8b567d605089a94"
Jul 28 18:04:30.571323 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.571292    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t" event={"ID":"efc1c421-f430-4618-b312-e84a1cc042b6","Type":"ContainerStarted","Data":"e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9"}
Jul 28 18:04:30.571588 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.571568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t" event={"ID":"efc1c421-f430-4618-b312-e84a1cc042b6","Type":"ContainerStarted","Data":"52eacf98d9c9a5903a0217c8995d4f4b8536dd6a7ad04a764f8dcfb44882411e"}
Jul 28 18:04:30.571674 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.571655    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:30.575163 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.575129    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn" event={"ID":"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b","Type":"ContainerStarted","Data":"9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c"}
Jul 28 18:04:30.575305 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.575191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn" event={"ID":"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b","Type":"ContainerStarted","Data":"1f48c1b79b1e7762c02219c7e6c75cacd12e27df55f211f2badf9e136e3b33c5"}
Jul 28 18:04:30.575305 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.575241    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:30.621197 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.621131    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t" podStartSLOduration=1.621110583 podStartE2EDuration="1.621110583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:04:30.607461794 +0000 UTC m=+1811.208058637" watchObservedRunningTime="2026-07-28 18:04:30.621110583 +0000 UTC m=+1811.221707409"
Jul 28 18:04:30.622913 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.622888    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"]
Jul 28 18:04:30.627773 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.627736    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3fe65036-openshift-default-6875486f96-brr9j"]
Jul 28 18:04:30.644223 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:30.644155    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn" podStartSLOduration=1.644134457 podStartE2EDuration="1.644134457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:04:30.643728284 +0000 UTC m=+1811.244325112" watchObservedRunningTime="2026-07-28 18:04:30.644134457 +0000 UTC m=+1811.244731290"
Jul 28 18:04:31.921304 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:31.921267    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" path="/var/lib/kubelet/pods/655cd6b1-c31c-4ed0-8947-a74f88d4fbf3/volumes"
Jul 28 18:04:41.583078 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:41.583032    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:41.583608 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:41.583146    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:42.542670 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:42.542622    2561 patch_prober.go:28] interesting pod/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 28 18:04:42.542904 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:42.542705    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 28 18:04:42.642842 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:42.642800    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerID="462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a" exitCode=0
Jul 28 18:04:42.643240 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:42.642870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" event={"ID":"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f","Type":"ContainerDied","Data":"462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a"}
Jul 28 18:04:42.643386 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:42.643370    2561 scope.go:117] "RemoveContainer" containerID="462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a"
Jul 28 18:04:42.644440 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:42.644407    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:42.644509 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:42.644489    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:42.644565 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:42.644551    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:43.651144 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:43.651086    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" event={"ID":"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f","Type":"ContainerStarted","Data":"3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43"}
Jul 28 18:04:44.631926 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:44.631882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:44.632200 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:44.632171    2561 patch_prober.go:28] interesting pod/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 28 18:04:44.632259 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:44.632233    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 28 18:04:45.631262 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:45.631225    2561 patch_prober.go:28] interesting pod/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 28 18:04:45.631672 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:45.631284    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 28 18:04:46.631220 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:46.631183    2561 patch_prober.go:28] interesting pod/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 28 18:04:46.631395 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:46.631250    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 28 18:04:47.635892 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:47.635856    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:47.636412 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:47.636285    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:47.637083 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:47.637062    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:04:57.932654 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:57.932618    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"]
Jul 28 18:04:57.933277 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:57.932883    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn" podUID="9e9391c8-06a6-4e12-9ccd-37f8699a8d7b" containerName="payload-processing" containerID="cri-o://9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c" gracePeriod=30
Jul 28 18:04:57.939992 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:57.939957    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"]
Jul 28 18:04:57.940756 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:57.940230    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t" podUID="efc1c421-f430-4618-b312-e84a1cc042b6" containerName="payload-pre-processing" containerID="cri-o://e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9" gracePeriod=30
Jul 28 18:04:58.211535 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.211503    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:58.238578 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.238535    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:58.322035 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.321990    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"]
Jul 28 18:04:58.322293 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.322264    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy" containerID="cri-o://3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43" gracePeriod=30
Jul 28 18:04:58.334987 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.334950    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llpr6\" (UniqueName: \"kubernetes.io/projected/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-kube-api-access-llpr6\") pod \"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b\" (UID: \"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b\") "
Jul 28 18:04:58.335243 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.335025    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv4cw\" (UniqueName: \"kubernetes.io/projected/efc1c421-f430-4618-b312-e84a1cc042b6-kube-api-access-gv4cw\") pod \"efc1c421-f430-4618-b312-e84a1cc042b6\" (UID: \"efc1c421-f430-4618-b312-e84a1cc042b6\") "
Jul 28 18:04:58.335243 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.335191    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc1c421-f430-4618-b312-e84a1cc042b6-plugins-config-volume\") pod \"efc1c421-f430-4618-b312-e84a1cc042b6\" (UID: \"efc1c421-f430-4618-b312-e84a1cc042b6\") "
Jul 28 18:04:58.335243 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.335237    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-plugins-config-volume\") pod \"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b\" (UID: \"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b\") "
Jul 28 18:04:58.335633 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.335604    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc1c421-f430-4618-b312-e84a1cc042b6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "efc1c421-f430-4618-b312-e84a1cc042b6" (UID: "efc1c421-f430-4618-b312-e84a1cc042b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:04:58.335721 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.335675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9e9391c8-06a6-4e12-9ccd-37f8699a8d7b" (UID: "9e9391c8-06a6-4e12-9ccd-37f8699a8d7b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:04:58.337465 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.337432    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-kube-api-access-llpr6" (OuterVolumeSpecName: "kube-api-access-llpr6") pod "9e9391c8-06a6-4e12-9ccd-37f8699a8d7b" (UID: "9e9391c8-06a6-4e12-9ccd-37f8699a8d7b"). InnerVolumeSpecName "kube-api-access-llpr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:04:58.337569 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.337500    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc1c421-f430-4618-b312-e84a1cc042b6-kube-api-access-gv4cw" (OuterVolumeSpecName: "kube-api-access-gv4cw") pod "efc1c421-f430-4618-b312-e84a1cc042b6" (UID: "efc1c421-f430-4618-b312-e84a1cc042b6"). InnerVolumeSpecName "kube-api-access-gv4cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:04:58.436472 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.436370    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc1c421-f430-4618-b312-e84a1cc042b6-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:58.436472 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.436406    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:58.436472 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.436416    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llpr6\" (UniqueName: \"kubernetes.io/projected/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b-kube-api-access-llpr6\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:58.436472 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.436424    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv4cw\" (UniqueName: \"kubernetes.io/projected/efc1c421-f430-4618-b312-e84a1cc042b6-kube-api-access-gv4cw\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:04:58.740150 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.740111    2561 generic.go:356] "Generic (PLEG): container finished" podID="efc1c421-f430-4618-b312-e84a1cc042b6" containerID="e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9" exitCode=0
Jul 28 18:04:58.740362 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.740172    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"
Jul 28 18:04:58.740362 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.740194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t" event={"ID":"efc1c421-f430-4618-b312-e84a1cc042b6","Type":"ContainerDied","Data":"e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9"}
Jul 28 18:04:58.740362 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.740274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t" event={"ID":"efc1c421-f430-4618-b312-e84a1cc042b6","Type":"ContainerDied","Data":"52eacf98d9c9a5903a0217c8995d4f4b8536dd6a7ad04a764f8dcfb44882411e"}
Jul 28 18:04:58.740362 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.740297    2561 scope.go:117] "RemoveContainer" containerID="e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9"
Jul 28 18:04:58.741647 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.741613    2561 generic.go:356] "Generic (PLEG): container finished" podID="9e9391c8-06a6-4e12-9ccd-37f8699a8d7b" containerID="9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c" exitCode=0
Jul 28 18:04:58.741755 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.741683    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"
Jul 28 18:04:58.741755 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.741688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn" event={"ID":"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b","Type":"ContainerDied","Data":"9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c"}
Jul 28 18:04:58.741755 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.741747    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn" event={"ID":"9e9391c8-06a6-4e12-9ccd-37f8699a8d7b","Type":"ContainerDied","Data":"1f48c1b79b1e7762c02219c7e6c75cacd12e27df55f211f2badf9e136e3b33c5"}
Jul 28 18:04:58.751299 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.751246    2561 scope.go:117] "RemoveContainer" containerID="e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9"
Jul 28 18:04:58.751666 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:04:58.751636    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9\": container with ID starting with e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9 not found: ID does not exist" containerID="e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9"
Jul 28 18:04:58.751743 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.751679    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9"} err="failed to get container status \"e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9\": rpc error: code = NotFound desc = could not find container \"e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9\": container with ID starting with e46dad65fe20d95b429e1a5b114578c72cccf37871b8bd2a6d18a5f40a96d4f9 not found: ID does not exist"
Jul 28 18:04:58.751743 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.751700    2561 scope.go:117] "RemoveContainer" containerID="9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c"
Jul 28 18:04:58.760636 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.760613    2561 scope.go:117] "RemoveContainer" containerID="9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c"
Jul 28 18:04:58.760964 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:04:58.760943    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c\": container with ID starting with 9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c not found: ID does not exist" containerID="9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c"
Jul 28 18:04:58.761010 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.760973    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c"} err="failed to get container status \"9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c\": rpc error: code = NotFound desc = could not find container \"9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c\": container with ID starting with 9d03cb2ff564fdd4207671f8aadce32b59509192a98d395a5c2c415ec5ae670c not found: ID does not exist"
Jul 28 18:04:58.776710 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.776669    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"]
Jul 28 18:04:58.782957 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.782925    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6ad02c46-74c56cc968-z8g8t"]
Jul 28 18:04:58.817160 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.817119    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"]
Jul 28 18:04:58.827036 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:58.826998    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6ad02c46-b6b66755c-j6bxn"]
Jul 28 18:04:59.230258 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.230161    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"]
Jul 28 18:04:59.230745 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.230679    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy"
Jul 28 18:04:59.230745 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.230699    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy"
Jul 28 18:04:59.230745 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.230711    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e9391c8-06a6-4e12-9ccd-37f8699a8d7b" containerName="payload-processing"
Jul 28 18:04:59.230745 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.230721    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e9391c8-06a6-4e12-9ccd-37f8699a8d7b" containerName="payload-processing"
Jul 28 18:04:59.230973 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.230756    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc1c421-f430-4618-b312-e84a1cc042b6" containerName="payload-pre-processing"
Jul 28 18:04:59.230973 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.230766    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc1c421-f430-4618-b312-e84a1cc042b6" containerName="payload-pre-processing"
Jul 28 18:04:59.230973 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.230876    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy"
Jul 28 18:04:59.230973 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.230890    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc1c421-f430-4618-b312-e84a1cc042b6" containerName="payload-pre-processing"
Jul 28 18:04:59.230973 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.230902    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e9391c8-06a6-4e12-9ccd-37f8699a8d7b" containerName="payload-processing"
Jul 28 18:04:59.235513 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.235482    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.239262 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.239233    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-21c55cfa-openshift-default-dockercfg-jq6jt\""
Jul 28 18:04:59.252241 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.252205    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"]
Jul 28 18:04:59.344437 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.344398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-socket\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.344437 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.344445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87153902-5d9f-4be5-96ab-71793adf6228-istiod-ca-cert\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.344675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.344488    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-certs\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.344675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.344537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-data\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.344675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.344565    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-istio-token\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.344675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.344659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-credential-socket\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.344812 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.344706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjf9d\" (UniqueName: \"kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-kube-api-access-vjf9d\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.344812 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.344771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-envoy\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.344812 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.344798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87153902-5d9f-4be5-96ab-71793adf6228-istio-podinfo\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.445668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.445623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjf9d\" (UniqueName: \"kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-kube-api-access-vjf9d\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.445862 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.445691    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-envoy\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.445862 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.445717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87153902-5d9f-4be5-96ab-71793adf6228-istio-podinfo\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.445862 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.445771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-socket\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.445862 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.445808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87153902-5d9f-4be5-96ab-71793adf6228-istiod-ca-cert\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.445862 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.445855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-certs\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.446155 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.445884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-data\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.446155 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.445909    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-istio-token\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.446155 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.445955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-credential-socket\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.446332 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.446262    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-socket\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.446332 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.446307    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-certs\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.446593 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.446567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-credential-socket\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.446593 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.446587    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-data\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.446760 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.446693    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87153902-5d9f-4be5-96ab-71793adf6228-istiod-ca-cert\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.448551 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.448523    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-envoy\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.448650 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.448532    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87153902-5d9f-4be5-96ab-71793adf6228-istio-podinfo\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.457448 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.457413    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-istio-token\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.458025 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.457999    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjf9d\" (UniqueName: \"kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-kube-api-access-vjf9d\") pod \"e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") " pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.547079 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.547038    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:04:59.706796 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.706766    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"]
Jul 28 18:04:59.709619 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:04:59.709590    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87153902_5d9f_4be5_96ab_71793adf6228.slice/crio-62bb26c089c4092b42187430bcb725259b421b978c0009ff17ec3ba51a808df8 WatchSource:0}: Error finding container 62bb26c089c4092b42187430bcb725259b421b978c0009ff17ec3ba51a808df8: Status 404 returned error can't find the container with id 62bb26c089c4092b42187430bcb725259b421b978c0009ff17ec3ba51a808df8
Jul 28 18:04:59.711828 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.711793    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:59.711914 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.711862    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:59.711914 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.711897    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:04:59.748888 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.748855    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" event={"ID":"87153902-5d9f-4be5-96ab-71793adf6228","Type":"ContainerStarted","Data":"62bb26c089c4092b42187430bcb725259b421b978c0009ff17ec3ba51a808df8"}
Jul 28 18:04:59.923529 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.923435    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e9391c8-06a6-4e12-9ccd-37f8699a8d7b" path="/var/lib/kubelet/pods/9e9391c8-06a6-4e12-9ccd-37f8699a8d7b/volumes"
Jul 28 18:04:59.924020 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:04:59.923995    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc1c421-f430-4618-b312-e84a1cc042b6" path="/var/lib/kubelet/pods/efc1c421-f430-4618-b312-e84a1cc042b6/volumes"
Jul 28 18:05:00.757768 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:00.757725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" event={"ID":"87153902-5d9f-4be5-96ab-71793adf6228","Type":"ContainerStarted","Data":"0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc"}
Jul 28 18:05:00.790596 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:00.790530    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" podStartSLOduration=1.790511349 podStartE2EDuration="1.790511349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:05:00.788604003 +0000 UTC m=+1841.389200861" watchObservedRunningTime="2026-07-28 18:05:00.790511349 +0000 UTC m=+1841.391108182"
Jul 28 18:05:01.547507 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:01.547462    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:05:01.554222 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:01.554188    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:05:01.763357 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:01.763323    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:05:01.764451 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:01.764421    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:05:02.638564 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:02.638520    2561 patch_prober.go:28] interesting pod/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 18:05:02.638752 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:02.638608    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 18:05:03.318462 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.318419    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"]
Jul 28 18:05:03.318867 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.318794    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy"
Jul 28 18:05:03.318867 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.318805    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy"
Jul 28 18:05:03.318962 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.318891    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="655cd6b1-c31c-4ed0-8947-a74f88d4fbf3" containerName="istio-proxy"
Jul 28 18:05:03.323250 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.323221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:03.325746 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.325716    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-21c55cfa\""
Jul 28 18:05:03.325918 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.325782    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-21c55cfa-dockercfg-wzdn5\""
Jul 28 18:05:03.335254 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.335047    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"]
Jul 28 18:05:03.364934 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.364896    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"]
Jul 28 18:05:03.368353 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.368331    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:03.379074 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.379040    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"]
Jul 28 18:05:03.488678 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.488628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cv8m\" (UniqueName: \"kubernetes.io/projected/e1f8caf6-c17a-4912-92b0-e3bc025550a3-kube-api-access-7cv8m\") pod \"payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55\" (UID: \"e1f8caf6-c17a-4912-92b0-e3bc025550a3\") " pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:03.488866 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.488773    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33e5e943-818b-45a3-83a9-40dd8359422c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr\" (UID: \"33e5e943-818b-45a3-83a9-40dd8359422c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:03.488955 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.488862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1f8caf6-c17a-4912-92b0-e3bc025550a3-plugins-config-volume\") pod \"payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55\" (UID: \"e1f8caf6-c17a-4912-92b0-e3bc025550a3\") " pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:03.488955 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.488916    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kdvc\" (UniqueName: \"kubernetes.io/projected/33e5e943-818b-45a3-83a9-40dd8359422c-kube-api-access-7kdvc\") pod \"payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr\" (UID: \"33e5e943-818b-45a3-83a9-40dd8359422c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:03.575495 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.575413    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:05:03.590066 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.590021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1f8caf6-c17a-4912-92b0-e3bc025550a3-plugins-config-volume\") pod \"payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55\" (UID: \"e1f8caf6-c17a-4912-92b0-e3bc025550a3\") " pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:03.590066 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.590066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kdvc\" (UniqueName: \"kubernetes.io/projected/33e5e943-818b-45a3-83a9-40dd8359422c-kube-api-access-7kdvc\") pod \"payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr\" (UID: \"33e5e943-818b-45a3-83a9-40dd8359422c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:03.590347 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.590150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cv8m\" (UniqueName: \"kubernetes.io/projected/e1f8caf6-c17a-4912-92b0-e3bc025550a3-kube-api-access-7cv8m\") pod \"payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55\" (UID: \"e1f8caf6-c17a-4912-92b0-e3bc025550a3\") " pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:03.590347 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.590199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33e5e943-818b-45a3-83a9-40dd8359422c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr\" (UID: \"33e5e943-818b-45a3-83a9-40dd8359422c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:03.590977 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.590949    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33e5e943-818b-45a3-83a9-40dd8359422c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr\" (UID: \"33e5e943-818b-45a3-83a9-40dd8359422c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:03.591076 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.590949    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1f8caf6-c17a-4912-92b0-e3bc025550a3-plugins-config-volume\") pod \"payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55\" (UID: \"e1f8caf6-c17a-4912-92b0-e3bc025550a3\") " pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:03.605880 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.605841    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kdvc\" (UniqueName: \"kubernetes.io/projected/33e5e943-818b-45a3-83a9-40dd8359422c-kube-api-access-7kdvc\") pod \"payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr\" (UID: \"33e5e943-818b-45a3-83a9-40dd8359422c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:03.606025 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.605999    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cv8m\" (UniqueName: \"kubernetes.io/projected/e1f8caf6-c17a-4912-92b0-e3bc025550a3-kube-api-access-7cv8m\") pod \"payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55\" (UID: \"e1f8caf6-c17a-4912-92b0-e3bc025550a3\") " pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:03.635657 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.635612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:03.691198 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691165    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istiod-ca-cert\") pod \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") "
Jul 28 18:05:03.691414 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691214    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zkw9\" (UniqueName: \"kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-kube-api-access-4zkw9\") pod \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") "
Jul 28 18:05:03.691414 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691242    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-envoy\") pod \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") "
Jul 28 18:05:03.691414 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691290    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-socket\") pod \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") "
Jul 28 18:05:03.691414 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691314    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-token\") pod \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") "
Jul 28 18:05:03.691414 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691349    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-data\") pod \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") "
Jul 28 18:05:03.691414 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691413    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-certs\") pod \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") "
Jul 28 18:05:03.691756 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691470    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-credential-socket\") pod \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") "
Jul 28 18:05:03.691756 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691499    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-podinfo\") pod \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\" (UID: \"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f\") "
Jul 28 18:05:03.691756 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691682    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" (UID: "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:05:03.691911 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691890    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" (UID: "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:05:03.692284 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.691992    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:03.692284 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.692019    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:03.692284 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.692071    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" (UID: "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:05:03.692532 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.692318    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" (UID: "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:05:03.692532 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.692424    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" (UID: "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:05:03.694601 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.694565    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" (UID: "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:05:03.696550 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.695392    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-kube-api-access-4zkw9" (OuterVolumeSpecName: "kube-api-access-4zkw9") pod "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" (UID: "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f"). InnerVolumeSpecName "kube-api-access-4zkw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:05:03.696550 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.695490    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" (UID: "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:05:03.696550 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.696003    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" (UID: "ae18d9e2-f5c2-43f4-89c0-ba82f48c977f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:05:03.718520 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.718483    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:03.776841 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.776802    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerID="3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43" exitCode=0
Jul 28 18:05:03.777017 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.776877    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"
Jul 28 18:05:03.777017 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.776891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" event={"ID":"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f","Type":"ContainerDied","Data":"3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43"}
Jul 28 18:05:03.777017 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.776972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w" event={"ID":"ae18d9e2-f5c2-43f4-89c0-ba82f48c977f","Type":"ContainerDied","Data":"b722190be33263af7badc5a1750d65df56466fd2404b1dcebd5e9fed7d695ec5"}
Jul 28 18:05:03.777017 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.777006    2561 scope.go:117] "RemoveContainer" containerID="3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43"
Jul 28 18:05:03.791621 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.791579    2561 scope.go:117] "RemoveContainer" containerID="462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a"
Jul 28 18:05:03.792572 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.792545    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:03.792701 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.792576    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:03.792701 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.792589    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:03.792701 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.792600    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:03.792701 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.792609    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:03.792701 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.792620    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zkw9\" (UniqueName: \"kubernetes.io/projected/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-kube-api-access-4zkw9\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:03.792701 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.792633    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:03.800776 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.800732    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"]
Jul 28 18:05:03.808002 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.807974    2561 scope.go:117] "RemoveContainer" containerID="3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43"
Jul 28 18:05:03.808409 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:05:03.808385    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43\": container with ID starting with 3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43 not found: ID does not exist" containerID="3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43"
Jul 28 18:05:03.808518 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.808418    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43"} err="failed to get container status \"3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43\": rpc error: code = NotFound desc = could not find container \"3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43\": container with ID starting with 3719524d90522903a2cdb1b472d3a9cfe72efb73d978e6db8f7e39505f590a43 not found: ID does not exist"
Jul 28 18:05:03.808518 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.808437    2561 scope.go:117] "RemoveContainer" containerID="462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a"
Jul 28 18:05:03.808776 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:05:03.808753    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a\": container with ID starting with 462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a not found: ID does not exist" containerID="462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a"
Jul 28 18:05:03.808863 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.808781    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a"} err="failed to get container status \"462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a\": rpc error: code = NotFound desc = could not find container \"462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a\": container with ID starting with 462de3fe4fc30b2b0ac5813ef0e1ee1b46992a3cc5b7e6a53b87f77d5769f10a not found: ID does not exist"
Jul 28 18:05:03.809021 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:05:03.809000    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f8caf6_c17a_4912_92b0_e3bc025550a3.slice/crio-5918734aafc43acb65ba1509015c0ddb48dc6480d54f71b3f8896ae31b190911 WatchSource:0}: Error finding container 5918734aafc43acb65ba1509015c0ddb48dc6480d54f71b3f8896ae31b190911: Status 404 returned error can't find the container with id 5918734aafc43acb65ba1509015c0ddb48dc6480d54f71b3f8896ae31b190911
Jul 28 18:05:03.813192 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.813168    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"]
Jul 28 18:05:03.817902 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.817874    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-6ad02c46-gw-openshift-default-75f77d4468-tnh4w"]
Jul 28 18:05:03.890971 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.890943    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"]
Jul 28 18:05:03.893620 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:05:03.893585    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e5e943_818b_45a3_83a9_40dd8359422c.slice/crio-d909df9234db4ea62fdc3f63987c63c9b9bf68863979b20b7befe80f088b3f47 WatchSource:0}: Error finding container d909df9234db4ea62fdc3f63987c63c9b9bf68863979b20b7befe80f088b3f47: Status 404 returned error can't find the container with id d909df9234db4ea62fdc3f63987c63c9b9bf68863979b20b7befe80f088b3f47
Jul 28 18:05:03.921490 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:03.921445    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" path="/var/lib/kubelet/pods/ae18d9e2-f5c2-43f4-89c0-ba82f48c977f/volumes"
Jul 28 18:05:04.783976 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:04.783929    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55" event={"ID":"e1f8caf6-c17a-4912-92b0-e3bc025550a3","Type":"ContainerStarted","Data":"78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63"}
Jul 28 18:05:04.784483 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:04.783999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55" event={"ID":"e1f8caf6-c17a-4912-92b0-e3bc025550a3","Type":"ContainerStarted","Data":"5918734aafc43acb65ba1509015c0ddb48dc6480d54f71b3f8896ae31b190911"}
Jul 28 18:05:04.784483 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:04.784126    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:04.785685 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:04.785657    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr" event={"ID":"33e5e943-818b-45a3-83a9-40dd8359422c","Type":"ContainerStarted","Data":"8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e"}
Jul 28 18:05:04.785868 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:04.785707    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr" event={"ID":"33e5e943-818b-45a3-83a9-40dd8359422c","Type":"ContainerStarted","Data":"d909df9234db4ea62fdc3f63987c63c9b9bf68863979b20b7befe80f088b3f47"}
Jul 28 18:05:04.785868 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:04.785735    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:04.806237 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:04.806176    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55" podStartSLOduration=1.806157679 podStartE2EDuration="1.806157679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:05:04.804627245 +0000 UTC m=+1845.405224077" watchObservedRunningTime="2026-07-28 18:05:04.806157679 +0000 UTC m=+1845.406754512"
Jul 28 18:05:04.825477 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:04.825416    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr" podStartSLOduration=1.825390004 podStartE2EDuration="1.825390004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:05:04.824863477 +0000 UTC m=+1845.425460336" watchObservedRunningTime="2026-07-28 18:05:04.825390004 +0000 UTC m=+1845.425986836"
Jul 28 18:05:15.794334 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:15.794291    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:15.794793 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:15.794388    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:16.765685 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:16.765649    2561 patch_prober.go:28] interesting pod/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 28 18:05:16.765902 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:16.765723    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 28 18:05:16.860486 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:16.860450    2561 generic.go:356] "Generic (PLEG): container finished" podID="87153902-5d9f-4be5-96ab-71793adf6228" containerID="0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc" exitCode=0
Jul 28 18:05:16.860894 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:16.860495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" event={"ID":"87153902-5d9f-4be5-96ab-71793adf6228","Type":"ContainerDied","Data":"0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc"}
Jul 28 18:05:16.860894 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:16.860890    2561 scope.go:117] "RemoveContainer" containerID="0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc"
Jul 28 18:05:16.861970 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:16.861937    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:05:16.862028 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:16.862015    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:05:16.862064 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:16.862049    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:05:17.871682 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:17.871636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" event={"ID":"87153902-5d9f-4be5-96ab-71793adf6228","Type":"ContainerStarted","Data":"fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b"}
Jul 28 18:05:18.547454 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:18.547402    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:05:18.547660 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:18.547634    2561 patch_prober.go:28] interesting pod/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 28 18:05:18.547711 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:18.547685    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 28 18:05:19.547706 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:19.547665    2561 patch_prober.go:28] interesting pod/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 28 18:05:19.548195 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:19.547731    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 28 18:05:20.547840 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:20.547800    2561 patch_prober.go:28] interesting pod/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 28 18:05:20.548303 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:20.547859    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 28 18:05:21.548390 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:21.548352    2561 patch_prober.go:28] interesting pod/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 28 18:05:21.548817 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:21.548414    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 28 18:05:22.551703 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:22.551670    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:05:22.552159 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:22.551939    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:05:22.552818 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:22.552796    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:05:32.586236 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.586180    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"]
Jul 28 18:05:32.587313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.587268    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55" podUID="e1f8caf6-c17a-4912-92b0-e3bc025550a3" containerName="payload-processing" containerID="cri-o://78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63" gracePeriod=30
Jul 28 18:05:32.595791 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.595754    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"]
Jul 28 18:05:32.596042 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.595983    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr" podUID="33e5e943-818b-45a3-83a9-40dd8359422c" containerName="payload-pre-processing" containerID="cri-o://8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e" gracePeriod=30
Jul 28 18:05:32.858899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.858869    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:32.888310 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.888277    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:32.953831 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.953798    2561 generic.go:356] "Generic (PLEG): container finished" podID="e1f8caf6-c17a-4912-92b0-e3bc025550a3" containerID="78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63" exitCode=0
Jul 28 18:05:32.953831 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.953841    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"
Jul 28 18:05:32.954119 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.953874    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55" event={"ID":"e1f8caf6-c17a-4912-92b0-e3bc025550a3","Type":"ContainerDied","Data":"78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63"}
Jul 28 18:05:32.954119 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.953926    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55" event={"ID":"e1f8caf6-c17a-4912-92b0-e3bc025550a3","Type":"ContainerDied","Data":"5918734aafc43acb65ba1509015c0ddb48dc6480d54f71b3f8896ae31b190911"}
Jul 28 18:05:32.954119 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.953959    2561 scope.go:117] "RemoveContainer" containerID="78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63"
Jul 28 18:05:32.955324 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.955300    2561 generic.go:356] "Generic (PLEG): container finished" podID="33e5e943-818b-45a3-83a9-40dd8359422c" containerID="8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e" exitCode=0
Jul 28 18:05:32.955445 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.955344    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"
Jul 28 18:05:32.955445 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.955351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr" event={"ID":"33e5e943-818b-45a3-83a9-40dd8359422c","Type":"ContainerDied","Data":"8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e"}
Jul 28 18:05:32.955445 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.955386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr" event={"ID":"33e5e943-818b-45a3-83a9-40dd8359422c","Type":"ContainerDied","Data":"d909df9234db4ea62fdc3f63987c63c9b9bf68863979b20b7befe80f088b3f47"}
Jul 28 18:05:32.963170 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.963145    2561 scope.go:117] "RemoveContainer" containerID="78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63"
Jul 28 18:05:32.963518 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:05:32.963499    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63\": container with ID starting with 78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63 not found: ID does not exist" containerID="78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63"
Jul 28 18:05:32.963582 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.963531    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63"} err="failed to get container status \"78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63\": rpc error: code = NotFound desc = could not find container \"78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63\": container with ID starting with 78f2d4641302a7b54f3e1327f12a10351b31427dd6fb4f0f770a2878cd568e63 not found: ID does not exist"
Jul 28 18:05:32.963582 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.963550    2561 scope.go:117] "RemoveContainer" containerID="8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e"
Jul 28 18:05:32.972150 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.972127    2561 scope.go:117] "RemoveContainer" containerID="8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e"
Jul 28 18:05:32.972486 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:05:32.972459    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e\": container with ID starting with 8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e not found: ID does not exist" containerID="8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e"
Jul 28 18:05:32.972558 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.972499    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e"} err="failed to get container status \"8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e\": rpc error: code = NotFound desc = could not find container \"8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e\": container with ID starting with 8779dcd9f12b3ae40efa1133773314e54cd20116204b468384e1a2c233a3771e not found: ID does not exist"
Jul 28 18:05:32.994888 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.994852    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1f8caf6-c17a-4912-92b0-e3bc025550a3-plugins-config-volume\") pod \"e1f8caf6-c17a-4912-92b0-e3bc025550a3\" (UID: \"e1f8caf6-c17a-4912-92b0-e3bc025550a3\") "
Jul 28 18:05:32.995056 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.994918    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33e5e943-818b-45a3-83a9-40dd8359422c-plugins-config-volume\") pod \"33e5e943-818b-45a3-83a9-40dd8359422c\" (UID: \"33e5e943-818b-45a3-83a9-40dd8359422c\") "
Jul 28 18:05:32.995056 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.994953    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cv8m\" (UniqueName: \"kubernetes.io/projected/e1f8caf6-c17a-4912-92b0-e3bc025550a3-kube-api-access-7cv8m\") pod \"e1f8caf6-c17a-4912-92b0-e3bc025550a3\" (UID: \"e1f8caf6-c17a-4912-92b0-e3bc025550a3\") "
Jul 28 18:05:32.995056 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.994999    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kdvc\" (UniqueName: \"kubernetes.io/projected/33e5e943-818b-45a3-83a9-40dd8359422c-kube-api-access-7kdvc\") pod \"33e5e943-818b-45a3-83a9-40dd8359422c\" (UID: \"33e5e943-818b-45a3-83a9-40dd8359422c\") "
Jul 28 18:05:32.995378 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.995349    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1f8caf6-c17a-4912-92b0-e3bc025550a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e1f8caf6-c17a-4912-92b0-e3bc025550a3" (UID: "e1f8caf6-c17a-4912-92b0-e3bc025550a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:05:32.995449 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.995356    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e5e943-818b-45a3-83a9-40dd8359422c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "33e5e943-818b-45a3-83a9-40dd8359422c" (UID: "33e5e943-818b-45a3-83a9-40dd8359422c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:05:32.997189 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.997162    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e5e943-818b-45a3-83a9-40dd8359422c-kube-api-access-7kdvc" (OuterVolumeSpecName: "kube-api-access-7kdvc") pod "33e5e943-818b-45a3-83a9-40dd8359422c" (UID: "33e5e943-818b-45a3-83a9-40dd8359422c"). InnerVolumeSpecName "kube-api-access-7kdvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:05:32.997269 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:32.997206    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1f8caf6-c17a-4912-92b0-e3bc025550a3-kube-api-access-7cv8m" (OuterVolumeSpecName: "kube-api-access-7cv8m") pod "e1f8caf6-c17a-4912-92b0-e3bc025550a3" (UID: "e1f8caf6-c17a-4912-92b0-e3bc025550a3"). InnerVolumeSpecName "kube-api-access-7cv8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:05:33.096206 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:33.096075    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33e5e943-818b-45a3-83a9-40dd8359422c-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:33.096206 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:33.096138    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cv8m\" (UniqueName: \"kubernetes.io/projected/e1f8caf6-c17a-4912-92b0-e3bc025550a3-kube-api-access-7cv8m\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:33.096206 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:33.096150    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kdvc\" (UniqueName: \"kubernetes.io/projected/33e5e943-818b-45a3-83a9-40dd8359422c-kube-api-access-7kdvc\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:33.096206 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:33.096161    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1f8caf6-c17a-4912-92b0-e3bc025550a3-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:33.284693 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:33.284659    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"]
Jul 28 18:05:33.286463 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:33.286435    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-21c55cfa-67484df6bd-z9v55"]
Jul 28 18:05:33.302078 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:33.302031    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"]
Jul 28 18:05:33.311649 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:33.311612    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-21c55cfa-65dd89b95b-nsvzr"]
Jul 28 18:05:33.922356 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:33.922259    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33e5e943-818b-45a3-83a9-40dd8359422c" path="/var/lib/kubelet/pods/33e5e943-818b-45a3-83a9-40dd8359422c/volumes"
Jul 28 18:05:33.922816 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:33.922630    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1f8caf6-c17a-4912-92b0-e3bc025550a3" path="/var/lib/kubelet/pods/e1f8caf6-c17a-4912-92b0-e3bc025550a3/volumes"
Jul 28 18:05:34.113030 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:34.112989    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"]
Jul 28 18:05:34.113260 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:34.113225    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy" containerID="cri-o://fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b" gracePeriod=30
Jul 28 18:05:35.168207 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168169    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"]
Jul 28 18:05:35.168680 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168605    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e5e943-818b-45a3-83a9-40dd8359422c" containerName="payload-pre-processing"
Jul 28 18:05:35.168680 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168620    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e5e943-818b-45a3-83a9-40dd8359422c" containerName="payload-pre-processing"
Jul 28 18:05:35.168680 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168638    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy"
Jul 28 18:05:35.168680 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168643    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy"
Jul 28 18:05:35.168680 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168662    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1f8caf6-c17a-4912-92b0-e3bc025550a3" containerName="payload-processing"
Jul 28 18:05:35.168868 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168690    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1f8caf6-c17a-4912-92b0-e3bc025550a3" containerName="payload-processing"
Jul 28 18:05:35.168868 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168749    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy"
Jul 28 18:05:35.168868 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168758    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e5e943-818b-45a3-83a9-40dd8359422c" containerName="payload-pre-processing"
Jul 28 18:05:35.168868 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168766    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1f8caf6-c17a-4912-92b0-e3bc025550a3" containerName="payload-processing"
Jul 28 18:05:35.168868 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.168774    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy"
Jul 28 18:05:35.173400 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.173363    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.185033 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.185001    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-55c1dce5-openshift-default-dockercfg-lckwd\""
Jul 28 18:05:35.210900 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.210864    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"]
Jul 28 18:05:35.318043 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.317999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-certs\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.318043 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.318045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx7zm\" (UniqueName: \"kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-kube-api-access-mx7zm\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.318299 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.318129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-envoy\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.318299 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.318224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-socket\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.318299 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.318288    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-data\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.318420 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.318309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-token\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.318420 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.318357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-credential-socket\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.318420 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.318383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-podinfo\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.318420 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.318407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istiod-ca-cert\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.419669 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.419555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-data\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.419669 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.419607    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-token\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.419669 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.419661    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-credential-socket\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.419983 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.419687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-podinfo\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.419983 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.419808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istiod-ca-cert\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.419983 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.419888    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-certs\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.419983 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.419919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx7zm\" (UniqueName: \"kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-kube-api-access-mx7zm\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.419983 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.419963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-envoy\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.420257 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.420004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-socket\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.420257 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.420008    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-data\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.420257 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.420067    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-credential-socket\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.420257 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.420234    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-certs\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.420465 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.420366    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-socket\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.420560 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.420535    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istiod-ca-cert\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.422298 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.422264    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-envoy\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.422501 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.422476    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-podinfo\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.433282 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.433250    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx7zm\" (UniqueName: \"kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-kube-api-access-mx7zm\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.433840 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.433813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-token\") pod \"e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") " pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.484901 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.484857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:35.672768 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.672660    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"]
Jul 28 18:05:35.676017 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:05:35.675986    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a03f3d2_8285_4d09_8f24_4f5241da46dd.slice/crio-fe056b2740dae4139a1cd00a372e0d4e8c125470bd81368a8a604bdd1887ffae WatchSource:0}: Error finding container fe056b2740dae4139a1cd00a372e0d4e8c125470bd81368a8a604bdd1887ffae: Status 404 returned error can't find the container with id fe056b2740dae4139a1cd00a372e0d4e8c125470bd81368a8a604bdd1887ffae
Jul 28 18:05:35.678378 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.678340    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:05:35.678478 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.678425    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:05:35.678478 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.678457    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:05:35.975225 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.975111    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" event={"ID":"6a03f3d2-8285-4d09-8f24-4f5241da46dd","Type":"ContainerStarted","Data":"3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8"}
Jul 28 18:05:35.975225 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:35.975187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" event={"ID":"6a03f3d2-8285-4d09-8f24-4f5241da46dd","Type":"ContainerStarted","Data":"fe056b2740dae4139a1cd00a372e0d4e8c125470bd81368a8a604bdd1887ffae"}
Jul 28 18:05:36.011057 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:36.010996    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" podStartSLOduration=1.010979415 podStartE2EDuration="1.010979415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:05:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:05:36.01000854 +0000 UTC m=+1876.610605377" watchObservedRunningTime="2026-07-28 18:05:36.010979415 +0000 UTC m=+1876.611576247"
Jul 28 18:05:36.485368 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:36.485322    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:36.491354 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:36.491322    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:36.980722 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:36.980700    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:36.981731 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:36.981706    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:37.555038 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:37.554989    2561 patch_prober.go:28] interesting pod/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 18:05:37.555478 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:37.555080    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 18:05:38.799250 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.799210    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"]
Jul 28 18:05:38.799664 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.799587    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy"
Jul 28 18:05:38.799664 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.799599    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae18d9e2-f5c2-43f4-89c0-ba82f48c977f" containerName="istio-proxy"
Jul 28 18:05:38.802763 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.802739    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:05:38.806848 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.806810    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-55c1dce5-dockercfg-7nttf\""
Jul 28 18:05:38.809820 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.809788    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-55c1dce5\""
Jul 28 18:05:38.837059 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.837017    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"]
Jul 28 18:05:38.902320 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.902276    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"]
Jul 28 18:05:38.906573 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.906535    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:05:38.921254 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.921221    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"]
Jul 28 18:05:38.952046 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.952000    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nmh9\" (UniqueName: \"kubernetes.io/projected/e37e8ebf-6e19-45c6-8cff-f9bd31716918-kube-api-access-9nmh9\") pod \"payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6\" (UID: \"e37e8ebf-6e19-45c6-8cff-f9bd31716918\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:05:38.952046 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:38.952045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e37e8ebf-6e19-45c6-8cff-f9bd31716918-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6\" (UID: \"e37e8ebf-6e19-45c6-8cff-f9bd31716918\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:05:39.053204 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.053083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nmh9\" (UniqueName: \"kubernetes.io/projected/e37e8ebf-6e19-45c6-8cff-f9bd31716918-kube-api-access-9nmh9\") pod \"payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6\" (UID: \"e37e8ebf-6e19-45c6-8cff-f9bd31716918\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:05:39.053204 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.053148    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e37e8ebf-6e19-45c6-8cff-f9bd31716918-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6\" (UID: \"e37e8ebf-6e19-45c6-8cff-f9bd31716918\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:05:39.053204 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.053173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hzg9\" (UniqueName: \"kubernetes.io/projected/02e4b753-10aa-464a-898f-8df1aa5a31e7-kube-api-access-8hzg9\") pod \"payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q\" (UID: \"02e4b753-10aa-464a-898f-8df1aa5a31e7\") " pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:05:39.053462 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.053247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02e4b753-10aa-464a-898f-8df1aa5a31e7-plugins-config-volume\") pod \"payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q\" (UID: \"02e4b753-10aa-464a-898f-8df1aa5a31e7\") " pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:05:39.053896 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.053874    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e37e8ebf-6e19-45c6-8cff-f9bd31716918-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6\" (UID: \"e37e8ebf-6e19-45c6-8cff-f9bd31716918\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:05:39.074225 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.074191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nmh9\" (UniqueName: \"kubernetes.io/projected/e37e8ebf-6e19-45c6-8cff-f9bd31716918-kube-api-access-9nmh9\") pod \"payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6\" (UID: \"e37e8ebf-6e19-45c6-8cff-f9bd31716918\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:05:39.114194 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.114149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:05:39.154071 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.154026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02e4b753-10aa-464a-898f-8df1aa5a31e7-plugins-config-volume\") pod \"payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q\" (UID: \"02e4b753-10aa-464a-898f-8df1aa5a31e7\") " pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:05:39.154348 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.154307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hzg9\" (UniqueName: \"kubernetes.io/projected/02e4b753-10aa-464a-898f-8df1aa5a31e7-kube-api-access-8hzg9\") pod \"payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q\" (UID: \"02e4b753-10aa-464a-898f-8df1aa5a31e7\") " pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:05:39.154908 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.154882    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02e4b753-10aa-464a-898f-8df1aa5a31e7-plugins-config-volume\") pod \"payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q\" (UID: \"02e4b753-10aa-464a-898f-8df1aa5a31e7\") " pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:05:39.167554 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.167521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hzg9\" (UniqueName: \"kubernetes.io/projected/02e4b753-10aa-464a-898f-8df1aa5a31e7-kube-api-access-8hzg9\") pod \"payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q\" (UID: \"02e4b753-10aa-464a-898f-8df1aa5a31e7\") " pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:05:39.220808 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.220764    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:05:39.289361 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.289329    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"]
Jul 28 18:05:39.385781 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.385749    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:05:39.558514 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558429    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-credential-socket\") pod \"87153902-5d9f-4be5-96ab-71793adf6228\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") "
Jul 28 18:05:39.558514 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558471    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-istio-token\") pod \"87153902-5d9f-4be5-96ab-71793adf6228\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") "
Jul 28 18:05:39.558514 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558509    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-socket\") pod \"87153902-5d9f-4be5-96ab-71793adf6228\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") "
Jul 28 18:05:39.558768 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558536    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-data\") pod \"87153902-5d9f-4be5-96ab-71793adf6228\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") "
Jul 28 18:05:39.558768 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558660    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-envoy\") pod \"87153902-5d9f-4be5-96ab-71793adf6228\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") "
Jul 28 18:05:39.558768 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558708    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87153902-5d9f-4be5-96ab-71793adf6228-istiod-ca-cert\") pod \"87153902-5d9f-4be5-96ab-71793adf6228\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") "
Jul 28 18:05:39.558768 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558734    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjf9d\" (UniqueName: \"kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-kube-api-access-vjf9d\") pod \"87153902-5d9f-4be5-96ab-71793adf6228\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") "
Jul 28 18:05:39.558985 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558780    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87153902-5d9f-4be5-96ab-71793adf6228" (UID: "87153902-5d9f-4be5-96ab-71793adf6228"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:05:39.558985 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558818    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87153902-5d9f-4be5-96ab-71793adf6228-istio-podinfo\") pod \"87153902-5d9f-4be5-96ab-71793adf6228\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") "
Jul 28 18:05:39.558985 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558799    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87153902-5d9f-4be5-96ab-71793adf6228" (UID: "87153902-5d9f-4be5-96ab-71793adf6228"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:05:39.558985 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.558888    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-certs\") pod \"87153902-5d9f-4be5-96ab-71793adf6228\" (UID: \"87153902-5d9f-4be5-96ab-71793adf6228\") "
Jul 28 18:05:39.559242 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.559176    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87153902-5d9f-4be5-96ab-71793adf6228-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87153902-5d9f-4be5-96ab-71793adf6228" (UID: "87153902-5d9f-4be5-96ab-71793adf6228"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:05:39.559303 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.559290    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:39.559422 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.559309    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:39.559422 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.559405    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87153902-5d9f-4be5-96ab-71793adf6228-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:39.559540 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.559422    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-data" (OuterVolumeSpecName: "istio-data") pod "87153902-5d9f-4be5-96ab-71793adf6228" (UID: "87153902-5d9f-4be5-96ab-71793adf6228"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:05:39.559540 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.559454    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87153902-5d9f-4be5-96ab-71793adf6228" (UID: "87153902-5d9f-4be5-96ab-71793adf6228"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:05:39.560982 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.560947    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87153902-5d9f-4be5-96ab-71793adf6228" (UID: "87153902-5d9f-4be5-96ab-71793adf6228"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:05:39.561128 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.560999    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-kube-api-access-vjf9d" (OuterVolumeSpecName: "kube-api-access-vjf9d") pod "87153902-5d9f-4be5-96ab-71793adf6228" (UID: "87153902-5d9f-4be5-96ab-71793adf6228"). InnerVolumeSpecName "kube-api-access-vjf9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:05:39.561351 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.561332    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-istio-token" (OuterVolumeSpecName: "istio-token") pod "87153902-5d9f-4be5-96ab-71793adf6228" (UID: "87153902-5d9f-4be5-96ab-71793adf6228"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:05:39.561894 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.561864    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87153902-5d9f-4be5-96ab-71793adf6228-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87153902-5d9f-4be5-96ab-71793adf6228" (UID: "87153902-5d9f-4be5-96ab-71793adf6228"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:05:39.610907 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.610879    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"]
Jul 28 18:05:39.613138 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:05:39.613102    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e4b753_10aa_464a_898f_8df1aa5a31e7.slice/crio-7702fd901b4264090eaa9c6c803c66dfb29d3fcf606d831379ef84f499d7bd98 WatchSource:0}: Error finding container 7702fd901b4264090eaa9c6c803c66dfb29d3fcf606d831379ef84f499d7bd98: Status 404 returned error can't find the container with id 7702fd901b4264090eaa9c6c803c66dfb29d3fcf606d831379ef84f499d7bd98
Jul 28 18:05:39.660398 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.660353    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:39.660398 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.660385    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:39.660398 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.660397    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjf9d\" (UniqueName: \"kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-kube-api-access-vjf9d\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:39.660629 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.660410    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87153902-5d9f-4be5-96ab-71793adf6228-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:39.660629 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.660426    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87153902-5d9f-4be5-96ab-71793adf6228-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:39.660629 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.660436    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87153902-5d9f-4be5-96ab-71793adf6228-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:05:39.998463 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.998422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q" event={"ID":"02e4b753-10aa-464a-898f-8df1aa5a31e7","Type":"ContainerStarted","Data":"686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b"}
Jul 28 18:05:39.998921 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.998491    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:05:39.998921 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:39.998530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q" event={"ID":"02e4b753-10aa-464a-898f-8df1aa5a31e7","Type":"ContainerStarted","Data":"7702fd901b4264090eaa9c6c803c66dfb29d3fcf606d831379ef84f499d7bd98"}
Jul 28 18:05:40.000459 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.000422    2561 generic.go:356] "Generic (PLEG): container finished" podID="87153902-5d9f-4be5-96ab-71793adf6228" containerID="fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b" exitCode=0
Jul 28 18:05:40.000625 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.000470    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"
Jul 28 18:05:40.000625 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.000507    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" event={"ID":"87153902-5d9f-4be5-96ab-71793adf6228","Type":"ContainerDied","Data":"fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b"}
Jul 28 18:05:40.000625 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.000559    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc" event={"ID":"87153902-5d9f-4be5-96ab-71793adf6228","Type":"ContainerDied","Data":"62bb26c089c4092b42187430bcb725259b421b978c0009ff17ec3ba51a808df8"}
Jul 28 18:05:40.000625 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.000587    2561 scope.go:117] "RemoveContainer" containerID="fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b"
Jul 28 18:05:40.002574 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.002545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6" event={"ID":"e37e8ebf-6e19-45c6-8cff-f9bd31716918","Type":"ContainerStarted","Data":"cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5"}
Jul 28 18:05:40.002713 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.002594    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6" event={"ID":"e37e8ebf-6e19-45c6-8cff-f9bd31716918","Type":"ContainerStarted","Data":"7aab41f930a5b28c045e1ed50e0475d1ea01abd90168468ea1b984214c084d77"}
Jul 28 18:05:40.002820 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.002801    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:05:40.010767 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.010741    2561 scope.go:117] "RemoveContainer" containerID="0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc"
Jul 28 18:05:40.019966 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.019941    2561 scope.go:117] "RemoveContainer" containerID="fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b"
Jul 28 18:05:40.020344 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:05:40.020319    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b\": container with ID starting with fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b not found: ID does not exist" containerID="fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b"
Jul 28 18:05:40.020451 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.020358    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b"} err="failed to get container status \"fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b\": rpc error: code = NotFound desc = could not find container \"fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b\": container with ID starting with fec24e857a6da81336fc6c09d36f8597a22527a5bd7b43402f015d1cbd18208b not found: ID does not exist"
Jul 28 18:05:40.020451 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.020384    2561 scope.go:117] "RemoveContainer" containerID="0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc"
Jul 28 18:05:40.020766 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:05:40.020739    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc\": container with ID starting with 0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc not found: ID does not exist" containerID="0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc"
Jul 28 18:05:40.020829 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.020778    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc"} err="failed to get container status \"0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc\": rpc error: code = NotFound desc = could not find container \"0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc\": container with ID starting with 0446d69d1504343ecedcd08511e180f3db4d2332d87216352ba001b7bfb14efc not found: ID does not exist"
Jul 28 18:05:40.023578 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.023530    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q" podStartSLOduration=2.023515687 podStartE2EDuration="2.023515687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:05:40.021084679 +0000 UTC m=+1880.621681517" watchObservedRunningTime="2026-07-28 18:05:40.023515687 +0000 UTC m=+1880.624112521"
Jul 28 18:05:40.044942 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.044900    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"]
Jul 28 18:05:40.052995 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.052954    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-21c55cfa-openshift-default-5758dcb456-km8nc"]
Jul 28 18:05:40.075170 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:40.075102    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6" podStartSLOduration=2.075068765 podStartE2EDuration="2.075068765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:05:40.073370209 +0000 UTC m=+1880.673967042" watchObservedRunningTime="2026-07-28 18:05:40.075068765 +0000 UTC m=+1880.675665666"
Jul 28 18:05:41.922648 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:41.922564    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87153902-5d9f-4be5-96ab-71793adf6228" path="/var/lib/kubelet/pods/87153902-5d9f-4be5-96ab-71793adf6228/volumes"
Jul 28 18:05:51.011318 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:51.011275    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:05:51.011832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:51.011680    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:05:51.982422 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:51.982386    2561 patch_prober.go:28] interesting pod/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 28 18:05:51.982640 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:51.982455    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 28 18:05:52.065373 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:52.065337    2561 generic.go:356] "Generic (PLEG): container finished" podID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerID="3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8" exitCode=0
Jul 28 18:05:52.065818 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:52.065384    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" event={"ID":"6a03f3d2-8285-4d09-8f24-4f5241da46dd","Type":"ContainerDied","Data":"3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8"}
Jul 28 18:05:52.065818 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:52.065777    2561 scope.go:117] "RemoveContainer" containerID="3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8"
Jul 28 18:05:52.066866 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:52.066823    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:05:52.066928 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:52.066908    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:05:52.066964 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:52.066940    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:05:53.076583 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:53.076541    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" event={"ID":"6a03f3d2-8285-4d09-8f24-4f5241da46dd","Type":"ContainerStarted","Data":"23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce"}
Jul 28 18:05:53.485679 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:53.485644    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:53.485909 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:53.485885    2561 patch_prober.go:28] interesting pod/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 28 18:05:53.485965 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:53.485937    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 28 18:05:54.486122 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:54.486053    2561 patch_prober.go:28] interesting pod/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 28 18:05:54.486629 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:54.486162    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 28 18:05:55.485808 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:55.485762    2561 patch_prober.go:28] interesting pod/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 28 18:05:55.486013 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:55.485829    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 28 18:05:56.486200 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:56.486155    2561 patch_prober.go:28] interesting pod/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 28 18:05:56.486642 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:56.486235    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 28 18:05:57.489024 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:57.488989    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:57.489463 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:57.489363    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:05:57.490235 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:05:57.490215    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:06:07.375363 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.375312    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"]
Jul 28 18:06:07.375999 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.375709    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q" podUID="02e4b753-10aa-464a-898f-8df1aa5a31e7" containerName="payload-processing" containerID="cri-o://686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b" gracePeriod=30
Jul 28 18:06:07.388047 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.388003    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"]
Jul 28 18:06:07.388374 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.388298    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6" podUID="e37e8ebf-6e19-45c6-8cff-f9bd31716918" containerName="payload-pre-processing" containerID="cri-o://cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5" gracePeriod=30
Jul 28 18:06:07.648262 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.648233    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:06:07.682024 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.681994    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:06:07.720304 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.720263    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02e4b753-10aa-464a-898f-8df1aa5a31e7-plugins-config-volume\") pod \"02e4b753-10aa-464a-898f-8df1aa5a31e7\" (UID: \"02e4b753-10aa-464a-898f-8df1aa5a31e7\") "
Jul 28 18:06:07.720517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.720359    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hzg9\" (UniqueName: \"kubernetes.io/projected/02e4b753-10aa-464a-898f-8df1aa5a31e7-kube-api-access-8hzg9\") pod \"02e4b753-10aa-464a-898f-8df1aa5a31e7\" (UID: \"02e4b753-10aa-464a-898f-8df1aa5a31e7\") "
Jul 28 18:06:07.720673 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.720646    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e4b753-10aa-464a-898f-8df1aa5a31e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "02e4b753-10aa-464a-898f-8df1aa5a31e7" (UID: "02e4b753-10aa-464a-898f-8df1aa5a31e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:06:07.722532 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.722504    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e4b753-10aa-464a-898f-8df1aa5a31e7-kube-api-access-8hzg9" (OuterVolumeSpecName: "kube-api-access-8hzg9") pod "02e4b753-10aa-464a-898f-8df1aa5a31e7" (UID: "02e4b753-10aa-464a-898f-8df1aa5a31e7"). InnerVolumeSpecName "kube-api-access-8hzg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:06:07.781218 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.781182    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"]
Jul 28 18:06:07.781470 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.781444    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy" containerID="cri-o://23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce" gracePeriod=30
Jul 28 18:06:07.821224 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.821191    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nmh9\" (UniqueName: \"kubernetes.io/projected/e37e8ebf-6e19-45c6-8cff-f9bd31716918-kube-api-access-9nmh9\") pod \"e37e8ebf-6e19-45c6-8cff-f9bd31716918\" (UID: \"e37e8ebf-6e19-45c6-8cff-f9bd31716918\") "
Jul 28 18:06:07.821224 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.821232    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e37e8ebf-6e19-45c6-8cff-f9bd31716918-plugins-config-volume\") pod \"e37e8ebf-6e19-45c6-8cff-f9bd31716918\" (UID: \"e37e8ebf-6e19-45c6-8cff-f9bd31716918\") "
Jul 28 18:06:07.821465 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.821454    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02e4b753-10aa-464a-898f-8df1aa5a31e7-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:07.821505 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.821468    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hzg9\" (UniqueName: \"kubernetes.io/projected/02e4b753-10aa-464a-898f-8df1aa5a31e7-kube-api-access-8hzg9\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:07.821600 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.821579    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37e8ebf-6e19-45c6-8cff-f9bd31716918-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e37e8ebf-6e19-45c6-8cff-f9bd31716918" (UID: "e37e8ebf-6e19-45c6-8cff-f9bd31716918"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:06:07.823436 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.823400    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37e8ebf-6e19-45c6-8cff-f9bd31716918-kube-api-access-9nmh9" (OuterVolumeSpecName: "kube-api-access-9nmh9") pod "e37e8ebf-6e19-45c6-8cff-f9bd31716918" (UID: "e37e8ebf-6e19-45c6-8cff-f9bd31716918"). InnerVolumeSpecName "kube-api-access-9nmh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:06:07.921952 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.921860    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nmh9\" (UniqueName: \"kubernetes.io/projected/e37e8ebf-6e19-45c6-8cff-f9bd31716918-kube-api-access-9nmh9\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:07.921952 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:07.921888    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e37e8ebf-6e19-45c6-8cff-f9bd31716918-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:08.155795 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.155757    2561 generic.go:356] "Generic (PLEG): container finished" podID="02e4b753-10aa-464a-898f-8df1aa5a31e7" containerID="686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b" exitCode=0
Jul 28 18:06:08.155985 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.155801    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"
Jul 28 18:06:08.155985 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.155844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q" event={"ID":"02e4b753-10aa-464a-898f-8df1aa5a31e7","Type":"ContainerDied","Data":"686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b"}
Jul 28 18:06:08.155985 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.155900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q" event={"ID":"02e4b753-10aa-464a-898f-8df1aa5a31e7","Type":"ContainerDied","Data":"7702fd901b4264090eaa9c6c803c66dfb29d3fcf606d831379ef84f499d7bd98"}
Jul 28 18:06:08.155985 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.155924    2561 scope.go:117] "RemoveContainer" containerID="686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b"
Jul 28 18:06:08.157393 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.157356    2561 generic.go:356] "Generic (PLEG): container finished" podID="e37e8ebf-6e19-45c6-8cff-f9bd31716918" containerID="cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5" exitCode=0
Jul 28 18:06:08.157521 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.157411    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"
Jul 28 18:06:08.157521 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.157415    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6" event={"ID":"e37e8ebf-6e19-45c6-8cff-f9bd31716918","Type":"ContainerDied","Data":"cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5"}
Jul 28 18:06:08.157521 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.157465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6" event={"ID":"e37e8ebf-6e19-45c6-8cff-f9bd31716918","Type":"ContainerDied","Data":"7aab41f930a5b28c045e1ed50e0475d1ea01abd90168468ea1b984214c084d77"}
Jul 28 18:06:08.166062 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.166033    2561 scope.go:117] "RemoveContainer" containerID="686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b"
Jul 28 18:06:08.166459 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:06:08.166436    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b\": container with ID starting with 686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b not found: ID does not exist" containerID="686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b"
Jul 28 18:06:08.166544 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.166467    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b"} err="failed to get container status \"686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b\": rpc error: code = NotFound desc = could not find container \"686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b\": container with ID starting with 686f4dcd8567e9dcab971956ad3743af0917d5b16223ebcf5eb1c4d527cc4d0b not found: ID does not exist"
Jul 28 18:06:08.166544 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.166488    2561 scope.go:117] "RemoveContainer" containerID="cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5"
Jul 28 18:06:08.175464 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.175440    2561 scope.go:117] "RemoveContainer" containerID="cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5"
Jul 28 18:06:08.175775 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:06:08.175745    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5\": container with ID starting with cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5 not found: ID does not exist" containerID="cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5"
Jul 28 18:06:08.175881 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.175783    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5"} err="failed to get container status \"cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5\": rpc error: code = NotFound desc = could not find container \"cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5\": container with ID starting with cc6ee000ad55ae00a517cfabe0f612749482609ce73ab5385332a9a850878be5 not found: ID does not exist"
Jul 28 18:06:08.188883 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.188842    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"]
Jul 28 18:06:08.194432 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.194390    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-55c1dce5-5cc9869d7b-85kd6"]
Jul 28 18:06:08.213491 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.213419    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"]
Jul 28 18:06:08.215653 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:08.215612    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-55c1dce5-77f44c65d6-v2w9q"]
Jul 28 18:06:09.920816 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:09.920779    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e4b753-10aa-464a-898f-8df1aa5a31e7" path="/var/lib/kubelet/pods/02e4b753-10aa-464a-898f-8df1aa5a31e7/volumes"
Jul 28 18:06:09.921242 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:09.921175    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e37e8ebf-6e19-45c6-8cff-f9bd31716918" path="/var/lib/kubelet/pods/e37e8ebf-6e19-45c6-8cff-f9bd31716918/volumes"
Jul 28 18:06:12.491498 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:12.491459    2561 patch_prober.go:28] interesting pod/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 18:06:12.491898 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:12.491523    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 18:06:13.043048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.042971    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:06:13.172153 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172076    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-token\") pod \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") "
Jul 28 18:06:13.172359 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172168    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-credential-socket\") pod \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") "
Jul 28 18:06:13.172359 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172199    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istiod-ca-cert\") pod \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") "
Jul 28 18:06:13.172359 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172256    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx7zm\" (UniqueName: \"kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-kube-api-access-mx7zm\") pod \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") "
Jul 28 18:06:13.172359 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172280    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-socket\") pod \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") "
Jul 28 18:06:13.172359 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172302    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-data\") pod \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") "
Jul 28 18:06:13.172359 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172355    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-certs\") pod \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") "
Jul 28 18:06:13.172676 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172383    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-podinfo\") pod \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") "
Jul 28 18:06:13.172676 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172420    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-envoy\") pod \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\" (UID: \"6a03f3d2-8285-4d09-8f24-4f5241da46dd\") "
Jul 28 18:06:13.172676 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172497    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a03f3d2-8285-4d09-8f24-4f5241da46dd" (UID: "6a03f3d2-8285-4d09-8f24-4f5241da46dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:06:13.172837 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172725    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a03f3d2-8285-4d09-8f24-4f5241da46dd" (UID: "6a03f3d2-8285-4d09-8f24-4f5241da46dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:06:13.172837 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172731    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a03f3d2-8285-4d09-8f24-4f5241da46dd" (UID: "6a03f3d2-8285-4d09-8f24-4f5241da46dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:06:13.172837 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172741    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:13.172965 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.172916    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a03f3d2-8285-4d09-8f24-4f5241da46dd" (UID: "6a03f3d2-8285-4d09-8f24-4f5241da46dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:06:13.173399 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.173368    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a03f3d2-8285-4d09-8f24-4f5241da46dd" (UID: "6a03f3d2-8285-4d09-8f24-4f5241da46dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:06:13.174585 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.174562    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a03f3d2-8285-4d09-8f24-4f5241da46dd" (UID: "6a03f3d2-8285-4d09-8f24-4f5241da46dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:06:13.174681 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.174660    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a03f3d2-8285-4d09-8f24-4f5241da46dd" (UID: "6a03f3d2-8285-4d09-8f24-4f5241da46dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:06:13.174885 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.174857    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a03f3d2-8285-4d09-8f24-4f5241da46dd" (UID: "6a03f3d2-8285-4d09-8f24-4f5241da46dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:06:13.174984 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.174857    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-kube-api-access-mx7zm" (OuterVolumeSpecName: "kube-api-access-mx7zm") pod "6a03f3d2-8285-4d09-8f24-4f5241da46dd" (UID: "6a03f3d2-8285-4d09-8f24-4f5241da46dd"). InnerVolumeSpecName "kube-api-access-mx7zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:06:13.186538 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.186505    2561 generic.go:356] "Generic (PLEG): container finished" podID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerID="23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce" exitCode=0
Jul 28 18:06:13.186538 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.186544    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" event={"ID":"6a03f3d2-8285-4d09-8f24-4f5241da46dd","Type":"ContainerDied","Data":"23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce"}
Jul 28 18:06:13.186758 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.186556    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"
Jul 28 18:06:13.186758 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.186595    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k" event={"ID":"6a03f3d2-8285-4d09-8f24-4f5241da46dd","Type":"ContainerDied","Data":"fe056b2740dae4139a1cd00a372e0d4e8c125470bd81368a8a604bdd1887ffae"}
Jul 28 18:06:13.186758 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.186620    2561 scope.go:117] "RemoveContainer" containerID="23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce"
Jul 28 18:06:13.199478 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.199456    2561 scope.go:117] "RemoveContainer" containerID="3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8"
Jul 28 18:06:13.208826 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.208799    2561 scope.go:117] "RemoveContainer" containerID="23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce"
Jul 28 18:06:13.209173 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:06:13.209152    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce\": container with ID starting with 23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce not found: ID does not exist" containerID="23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce"
Jul 28 18:06:13.209268 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.209182    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce"} err="failed to get container status \"23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce\": rpc error: code = NotFound desc = could not find container \"23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce\": container with ID starting with 23e132eafcc889987d76ffc571fe090469c5ee9b13c8a727e83d33e5bee4c0ce not found: ID does not exist"
Jul 28 18:06:13.209268 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.209202    2561 scope.go:117] "RemoveContainer" containerID="3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8"
Jul 28 18:06:13.209490 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:06:13.209469    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8\": container with ID starting with 3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8 not found: ID does not exist" containerID="3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8"
Jul 28 18:06:13.209532 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.209497    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8"} err="failed to get container status \"3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8\": rpc error: code = NotFound desc = could not find container \"3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8\": container with ID starting with 3bf147aa5fef0f40f56b4ff2616aa7aae144551033b51f620d70fce78e82b2e8 not found: ID does not exist"
Jul 28 18:06:13.213976 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.213900    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"]
Jul 28 18:06:13.216129 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.216079    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-55c1dce5-openshift-default-7454bbd8d4-sj44k"]
Jul 28 18:06:13.273347 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.273308    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:13.273347 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.273335    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:13.273347 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.273344    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:13.273347 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.273356    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx7zm\" (UniqueName: \"kubernetes.io/projected/6a03f3d2-8285-4d09-8f24-4f5241da46dd-kube-api-access-mx7zm\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:13.273635 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.273366    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:13.273635 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.273378    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:13.273635 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.273387    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a03f3d2-8285-4d09-8f24-4f5241da46dd-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:13.273635 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.273395    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a03f3d2-8285-4d09-8f24-4f5241da46dd-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:06:13.921836 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:06:13.921799    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" path="/var/lib/kubelet/pods/6a03f3d2-8285-4d09-8f24-4f5241da46dd/volumes"
Jul 28 18:08:08.568747 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.568704    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"]
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569072    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e4b753-10aa-464a-898f-8df1aa5a31e7" containerName="payload-processing"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569084    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e4b753-10aa-464a-898f-8df1aa5a31e7" containerName="payload-processing"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569151    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569160    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569171    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37e8ebf-6e19-45c6-8cff-f9bd31716918" containerName="payload-pre-processing"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569179    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37e8ebf-6e19-45c6-8cff-f9bd31716918" containerName="payload-pre-processing"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569192    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569197    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569206    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569215    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569223    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569229    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569299    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569306    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy"
Jul 28 18:08:08.569313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569312    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e4b753-10aa-464a-898f-8df1aa5a31e7" containerName="payload-processing"
Jul 28 18:08:08.569787 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.569323    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37e8ebf-6e19-45c6-8cff-f9bd31716918" containerName="payload-pre-processing"
Jul 28 18:08:08.574270 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.572838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.576445 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.576414    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-688e4a86-openshift-default-dockercfg-fxrqs\""
Jul 28 18:08:08.611243 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.611209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-podinfo\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.611492 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.611254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb9z5\" (UniqueName: \"kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-kube-api-access-lb9z5\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.611492 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.611357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-token\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.611492 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.611379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/034cc156-87ab-466d-a5ec-b7f7231b9af8-istiod-ca-cert\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.611492 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.611465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-credential-socket\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.611730 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.611537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-certs\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.611730 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.611569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-socket\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.611730 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.611596    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-data\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.611730 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.611661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-envoy\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.612003 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.611981    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"]
Jul 28 18:08:08.712143 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-certs\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712143 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-socket\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712431 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-data\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712431 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-envoy\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712431 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-podinfo\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712431 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb9z5\" (UniqueName: \"kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-kube-api-access-lb9z5\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712647 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-token\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712647 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/034cc156-87ab-466d-a5ec-b7f7231b9af8-istiod-ca-cert\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712647 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-credential-socket\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712647 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-certs\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712647 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712615    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-data\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712876 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-socket\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.712954 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.712933    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-credential-socket\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.713410 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.713387    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/034cc156-87ab-466d-a5ec-b7f7231b9af8-istiod-ca-cert\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.714743 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.714715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-envoy\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.715028 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.715008    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-podinfo\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.723310 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.723280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb9z5\" (UniqueName: \"kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-kube-api-access-lb9z5\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.723310 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.723316    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-token\") pod \"e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") " pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:08.885807 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:08.885688    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:09.052258 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:09.052222    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"]
Jul 28 18:08:09.055333 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:08:09.055300    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034cc156_87ab_466d_a5ec_b7f7231b9af8.slice/crio-274bec74a2b42742a48a0c0e4a655f5e23ddd0918f19fd0a4d3b7e9575a93e3c WatchSource:0}: Error finding container 274bec74a2b42742a48a0c0e4a655f5e23ddd0918f19fd0a4d3b7e9575a93e3c: Status 404 returned error can't find the container with id 274bec74a2b42742a48a0c0e4a655f5e23ddd0918f19fd0a4d3b7e9575a93e3c
Jul 28 18:08:09.057451 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:09.057411    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:08:09.057553 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:09.057486    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:08:09.057553 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:09.057513    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:08:09.737437 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:09.737401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" event={"ID":"034cc156-87ab-466d-a5ec-b7f7231b9af8","Type":"ContainerStarted","Data":"189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c"}
Jul 28 18:08:09.737859 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:09.737457    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" event={"ID":"034cc156-87ab-466d-a5ec-b7f7231b9af8","Type":"ContainerStarted","Data":"274bec74a2b42742a48a0c0e4a655f5e23ddd0918f19fd0a4d3b7e9575a93e3c"}
Jul 28 18:08:09.767544 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:09.767487    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" podStartSLOduration=1.767468579 podStartE2EDuration="1.767468579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:08:09.765985245 +0000 UTC m=+2030.366582077" watchObservedRunningTime="2026-07-28 18:08:09.767468579 +0000 UTC m=+2030.368065412"
Jul 28 18:08:09.885961 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:09.885926    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:10.891598 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:10.891566    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:11.747481 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:11.747448    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:11.748529 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:11.748504    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:12.987415 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:12.987380    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"]
Jul 28 18:08:12.987840 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:12.987800    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="87153902-5d9f-4be5-96ab-71793adf6228" containerName="istio-proxy"
Jul 28 18:08:12.987840 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:12.987812    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a03f3d2-8285-4d09-8f24-4f5241da46dd" containerName="istio-proxy"
Jul 28 18:08:12.990564 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:12.990545    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:12.993969 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:12.993935    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-688e4a86\""
Jul 28 18:08:12.994138 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:12.993935    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-688e4a86-dockercfg-58ts2\""
Jul 28 18:08:13.008056 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.008021    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"]
Jul 28 18:08:13.051531 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.051482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29078d97-18e0-41c2-aefb-715f59030ec1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54\" (UID: \"29078d97-18e0-41c2-aefb-715f59030ec1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:13.051734 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.051634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ccmn\" (UniqueName: \"kubernetes.io/projected/29078d97-18e0-41c2-aefb-715f59030ec1-kube-api-access-4ccmn\") pod \"payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54\" (UID: \"29078d97-18e0-41c2-aefb-715f59030ec1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:13.085145 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.085106    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"]
Jul 28 18:08:13.088034 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.088014    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:13.110858 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.110813    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"]
Jul 28 18:08:13.152246 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.152203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29078d97-18e0-41c2-aefb-715f59030ec1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54\" (UID: \"29078d97-18e0-41c2-aefb-715f59030ec1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:13.152446 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.152279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rrd\" (UniqueName: \"kubernetes.io/projected/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-kube-api-access-98rrd\") pod \"payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w\" (UID: \"3d57619e-6d83-46c9-b60a-e017fbe7f0b0\") " pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:13.152446 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.152354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ccmn\" (UniqueName: \"kubernetes.io/projected/29078d97-18e0-41c2-aefb-715f59030ec1-kube-api-access-4ccmn\") pod \"payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54\" (UID: \"29078d97-18e0-41c2-aefb-715f59030ec1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:13.152446 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.152392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-plugins-config-volume\") pod \"payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w\" (UID: \"3d57619e-6d83-46c9-b60a-e017fbe7f0b0\") " pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:13.153165 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.153139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29078d97-18e0-41c2-aefb-715f59030ec1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54\" (UID: \"29078d97-18e0-41c2-aefb-715f59030ec1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:13.168990 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.168946    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ccmn\" (UniqueName: \"kubernetes.io/projected/29078d97-18e0-41c2-aefb-715f59030ec1-kube-api-access-4ccmn\") pod \"payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54\" (UID: \"29078d97-18e0-41c2-aefb-715f59030ec1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:13.253432 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.253329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-plugins-config-volume\") pod \"payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w\" (UID: \"3d57619e-6d83-46c9-b60a-e017fbe7f0b0\") " pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:13.253432 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.253422    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rrd\" (UniqueName: \"kubernetes.io/projected/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-kube-api-access-98rrd\") pod \"payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w\" (UID: \"3d57619e-6d83-46c9-b60a-e017fbe7f0b0\") " pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:13.254192 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.254158    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-plugins-config-volume\") pod \"payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w\" (UID: \"3d57619e-6d83-46c9-b60a-e017fbe7f0b0\") " pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:13.279350 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.279311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rrd\" (UniqueName: \"kubernetes.io/projected/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-kube-api-access-98rrd\") pod \"payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w\" (UID: \"3d57619e-6d83-46c9-b60a-e017fbe7f0b0\") " pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:13.308157 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.308114    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:13.398766 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.398714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:13.478027 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.477996    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"]
Jul 28 18:08:13.479490 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:08:13.479456    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29078d97_18e0_41c2_aefb_715f59030ec1.slice/crio-70266dfcacc7574a0c35b8cee77c65e8f19bdb574576605498fb0db2adea92ea WatchSource:0}: Error finding container 70266dfcacc7574a0c35b8cee77c65e8f19bdb574576605498fb0db2adea92ea: Status 404 returned error can't find the container with id 70266dfcacc7574a0c35b8cee77c65e8f19bdb574576605498fb0db2adea92ea
Jul 28 18:08:13.572947 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.572920    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"]
Jul 28 18:08:13.575086 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:08:13.575045    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d57619e_6d83_46c9_b60a_e017fbe7f0b0.slice/crio-c1b58204782c5e992ba004506411bcd6b2f3265874572342564621685130660b WatchSource:0}: Error finding container c1b58204782c5e992ba004506411bcd6b2f3265874572342564621685130660b: Status 404 returned error can't find the container with id c1b58204782c5e992ba004506411bcd6b2f3265874572342564621685130660b
Jul 28 18:08:13.760570 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.760513    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w" event={"ID":"3d57619e-6d83-46c9-b60a-e017fbe7f0b0","Type":"ContainerStarted","Data":"49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2"}
Jul 28 18:08:13.760761 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.760587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w" event={"ID":"3d57619e-6d83-46c9-b60a-e017fbe7f0b0","Type":"ContainerStarted","Data":"c1b58204782c5e992ba004506411bcd6b2f3265874572342564621685130660b"}
Jul 28 18:08:13.760761 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.760640    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:13.762605 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.762506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54" event={"ID":"29078d97-18e0-41c2-aefb-715f59030ec1","Type":"ContainerStarted","Data":"88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314"}
Jul 28 18:08:13.762605 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.762569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54" event={"ID":"29078d97-18e0-41c2-aefb-715f59030ec1","Type":"ContainerStarted","Data":"70266dfcacc7574a0c35b8cee77c65e8f19bdb574576605498fb0db2adea92ea"}
Jul 28 18:08:13.762838 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.762732    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:13.782438 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.782374    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w" podStartSLOduration=0.782354373 podStartE2EDuration="782.354373ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:08:13.781639353 +0000 UTC m=+2034.382236187" watchObservedRunningTime="2026-07-28 18:08:13.782354373 +0000 UTC m=+2034.382951228"
Jul 28 18:08:13.801715 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:13.801654    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54" podStartSLOduration=1.801635959 podStartE2EDuration="1.801635959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:08:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:08:13.799969973 +0000 UTC m=+2034.400566803" watchObservedRunningTime="2026-07-28 18:08:13.801635959 +0000 UTC m=+2034.402232792"
Jul 28 18:08:24.771065 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:24.771026    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:24.771504 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:24.771210    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:24.822447 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:24.822409    2561 generic.go:356] "Generic (PLEG): container finished" podID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerID="189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c" exitCode=0
Jul 28 18:08:24.822641 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:24.822479    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" event={"ID":"034cc156-87ab-466d-a5ec-b7f7231b9af8","Type":"ContainerDied","Data":"189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c"}
Jul 28 18:08:24.822963 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:24.822936    2561 scope.go:117] "RemoveContainer" containerID="189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c"
Jul 28 18:08:24.824246 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:24.824207    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:08:24.824369 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:24.824306    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:08:24.824369 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:24.824349    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:08:25.830458 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:25.830423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" event={"ID":"034cc156-87ab-466d-a5ec-b7f7231b9af8","Type":"ContainerStarted","Data":"472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173"}
Jul 28 18:08:25.886644 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:25.886604    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:25.887620 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:25.887592    2561 patch_prober.go:28] interesting pod/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 28 18:08:25.887742 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:25.887645    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 28 18:08:26.747695 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:26.747652    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:26.887036 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:26.886997    2561 patch_prober.go:28] interesting pod/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 28 18:08:26.887476 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:26.887057    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 28 18:08:27.886589 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:27.886551    2561 patch_prober.go:28] interesting pod/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 28 18:08:27.886792 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:27.886616    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 28 18:08:28.886881 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:28.886837    2561 patch_prober.go:28] interesting pod/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 28 18:08:28.887329 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:28.886925    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 28 18:08:29.887061 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:29.887014    2561 patch_prober.go:28] interesting pod/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 28 18:08:29.887478 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:29.887111    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 28 18:08:30.890817 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:30.890778    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:30.892081 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:30.892057    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:08:49.067375 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.067284    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"]
Jul 28 18:08:49.067983 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.067587    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w" podUID="3d57619e-6d83-46c9-b60a-e017fbe7f0b0" containerName="payload-processing" containerID="cri-o://49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2" gracePeriod=30
Jul 28 18:08:49.076538 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.076507    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"]
Jul 28 18:08:49.076739 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.076717    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54" podUID="29078d97-18e0-41c2-aefb-715f59030ec1" containerName="payload-pre-processing" containerID="cri-o://88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314" gracePeriod=30
Jul 28 18:08:49.333124 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.333073    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:49.362339 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.362311    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:49.393121 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.393073    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ccmn\" (UniqueName: \"kubernetes.io/projected/29078d97-18e0-41c2-aefb-715f59030ec1-kube-api-access-4ccmn\") pod \"29078d97-18e0-41c2-aefb-715f59030ec1\" (UID: \"29078d97-18e0-41c2-aefb-715f59030ec1\") "
Jul 28 18:08:49.393121 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.393127    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29078d97-18e0-41c2-aefb-715f59030ec1-plugins-config-volume\") pod \"29078d97-18e0-41c2-aefb-715f59030ec1\" (UID: \"29078d97-18e0-41c2-aefb-715f59030ec1\") "
Jul 28 18:08:49.393355 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.393170    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98rrd\" (UniqueName: \"kubernetes.io/projected/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-kube-api-access-98rrd\") pod \"3d57619e-6d83-46c9-b60a-e017fbe7f0b0\" (UID: \"3d57619e-6d83-46c9-b60a-e017fbe7f0b0\") "
Jul 28 18:08:49.393355 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.393238    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-plugins-config-volume\") pod \"3d57619e-6d83-46c9-b60a-e017fbe7f0b0\" (UID: \"3d57619e-6d83-46c9-b60a-e017fbe7f0b0\") "
Jul 28 18:08:49.393593 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.393559    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29078d97-18e0-41c2-aefb-715f59030ec1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29078d97-18e0-41c2-aefb-715f59030ec1" (UID: "29078d97-18e0-41c2-aefb-715f59030ec1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:08:49.393706 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.393613    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3d57619e-6d83-46c9-b60a-e017fbe7f0b0" (UID: "3d57619e-6d83-46c9-b60a-e017fbe7f0b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:08:49.395398 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.395365    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-kube-api-access-98rrd" (OuterVolumeSpecName: "kube-api-access-98rrd") pod "3d57619e-6d83-46c9-b60a-e017fbe7f0b0" (UID: "3d57619e-6d83-46c9-b60a-e017fbe7f0b0"). InnerVolumeSpecName "kube-api-access-98rrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:08:49.395508 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.395482    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29078d97-18e0-41c2-aefb-715f59030ec1-kube-api-access-4ccmn" (OuterVolumeSpecName: "kube-api-access-4ccmn") pod "29078d97-18e0-41c2-aefb-715f59030ec1" (UID: "29078d97-18e0-41c2-aefb-715f59030ec1"). InnerVolumeSpecName "kube-api-access-4ccmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:08:49.494437 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.494395    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ccmn\" (UniqueName: \"kubernetes.io/projected/29078d97-18e0-41c2-aefb-715f59030ec1-kube-api-access-4ccmn\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:08:49.494437 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.494428    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29078d97-18e0-41c2-aefb-715f59030ec1-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:08:49.494437 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.494439    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98rrd\" (UniqueName: \"kubernetes.io/projected/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-kube-api-access-98rrd\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:08:49.494437 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.494449    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d57619e-6d83-46c9-b60a-e017fbe7f0b0-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:08:49.952565 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.952526    2561 generic.go:356] "Generic (PLEG): container finished" podID="3d57619e-6d83-46c9-b60a-e017fbe7f0b0" containerID="49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2" exitCode=0
Jul 28 18:08:49.952758 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.952579    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"
Jul 28 18:08:49.952758 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.952602    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w" event={"ID":"3d57619e-6d83-46c9-b60a-e017fbe7f0b0","Type":"ContainerDied","Data":"49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2"}
Jul 28 18:08:49.952758 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.952654    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w" event={"ID":"3d57619e-6d83-46c9-b60a-e017fbe7f0b0","Type":"ContainerDied","Data":"c1b58204782c5e992ba004506411bcd6b2f3265874572342564621685130660b"}
Jul 28 18:08:49.952758 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.952698    2561 scope.go:117] "RemoveContainer" containerID="49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2"
Jul 28 18:08:49.954042 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.954018    2561 generic.go:356] "Generic (PLEG): container finished" podID="29078d97-18e0-41c2-aefb-715f59030ec1" containerID="88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314" exitCode=0
Jul 28 18:08:49.954180 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.954068    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"
Jul 28 18:08:49.954180 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.954108    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54" event={"ID":"29078d97-18e0-41c2-aefb-715f59030ec1","Type":"ContainerDied","Data":"88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314"}
Jul 28 18:08:49.954267 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.954219    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54" event={"ID":"29078d97-18e0-41c2-aefb-715f59030ec1","Type":"ContainerDied","Data":"70266dfcacc7574a0c35b8cee77c65e8f19bdb574576605498fb0db2adea92ea"}
Jul 28 18:08:49.961872 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.961852    2561 scope.go:117] "RemoveContainer" containerID="49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2"
Jul 28 18:08:49.962234 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:08:49.962206    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2\": container with ID starting with 49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2 not found: ID does not exist" containerID="49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2"
Jul 28 18:08:49.962314 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.962240    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2"} err="failed to get container status \"49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2\": rpc error: code = NotFound desc = could not find container \"49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2\": container with ID starting with 49c671fec91d7444babc9b572856c477880bd52da4350f27c1dd94e866029cb2 not found: ID does not exist"
Jul 28 18:08:49.962314 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.962258    2561 scope.go:117] "RemoveContainer" containerID="88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314"
Jul 28 18:08:49.970699 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.970674    2561 scope.go:117] "RemoveContainer" containerID="88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314"
Jul 28 18:08:49.971050 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:08:49.971028    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314\": container with ID starting with 88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314 not found: ID does not exist" containerID="88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314"
Jul 28 18:08:49.971232 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.971060    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314"} err="failed to get container status \"88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314\": rpc error: code = NotFound desc = could not find container \"88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314\": container with ID starting with 88aa3f8f1acc81c9f0c4531686ec1c3fd30c880e8e9cb36e2edc13f6aa67d314 not found: ID does not exist"
Jul 28 18:08:49.972019 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.972000    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"]
Jul 28 18:08:49.976310 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.976283    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-688e4a86-6f8454fb6b-hfw6w"]
Jul 28 18:08:49.992576 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.992537    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"]
Jul 28 18:08:49.997631 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:49.997599    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-688e4a86-59768f4d64-m9d54"]
Jul 28 18:08:51.920575 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:51.920541    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29078d97-18e0-41c2-aefb-715f59030ec1" path="/var/lib/kubelet/pods/29078d97-18e0-41c2-aefb-715f59030ec1/volumes"
Jul 28 18:08:51.920970 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:51.920893    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d57619e-6d83-46c9-b60a-e017fbe7f0b0" path="/var/lib/kubelet/pods/3d57619e-6d83-46c9-b60a-e017fbe7f0b0/volumes"
Jul 28 18:08:56.293991 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:56.293954    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"]
Jul 28 18:08:56.294523 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:08:56.294271    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy" containerID="cri-o://472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173" gracePeriod=30
Jul 28 18:09:00.894342 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:00.894306    2561 patch_prober.go:28] interesting pod/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 18:09:00.894844 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:00.894360    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 18:09:01.557555 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.557481    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:09:01.609446 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609404    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-credential-socket\") pod \"034cc156-87ab-466d-a5ec-b7f7231b9af8\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") "
Jul 28 18:09:01.609446 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609450    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-socket\") pod \"034cc156-87ab-466d-a5ec-b7f7231b9af8\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") "
Jul 28 18:09:01.609713 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609511    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-data\") pod \"034cc156-87ab-466d-a5ec-b7f7231b9af8\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") "
Jul 28 18:09:01.609713 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609541    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-podinfo\") pod \"034cc156-87ab-466d-a5ec-b7f7231b9af8\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") "
Jul 28 18:09:01.609713 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609602    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-certs\") pod \"034cc156-87ab-466d-a5ec-b7f7231b9af8\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") "
Jul 28 18:09:01.609713 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609631    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-token\") pod \"034cc156-87ab-466d-a5ec-b7f7231b9af8\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") "
Jul 28 18:09:01.609713 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609654    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-envoy\") pod \"034cc156-87ab-466d-a5ec-b7f7231b9af8\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") "
Jul 28 18:09:01.609713 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609709    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/034cc156-87ab-466d-a5ec-b7f7231b9af8-istiod-ca-cert\") pod \"034cc156-87ab-466d-a5ec-b7f7231b9af8\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") "
Jul 28 18:09:01.610005 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609740    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb9z5\" (UniqueName: \"kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-kube-api-access-lb9z5\") pod \"034cc156-87ab-466d-a5ec-b7f7231b9af8\" (UID: \"034cc156-87ab-466d-a5ec-b7f7231b9af8\") "
Jul 28 18:09:01.610005 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609773    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "034cc156-87ab-466d-a5ec-b7f7231b9af8" (UID: "034cc156-87ab-466d-a5ec-b7f7231b9af8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:09:01.610005 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609801    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "034cc156-87ab-466d-a5ec-b7f7231b9af8" (UID: "034cc156-87ab-466d-a5ec-b7f7231b9af8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:09:01.610005 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.609957    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "034cc156-87ab-466d-a5ec-b7f7231b9af8" (UID: "034cc156-87ab-466d-a5ec-b7f7231b9af8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:09:01.610244 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.610023    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:09:01.610244 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.610043    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:09:01.610244 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.610057    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:09:01.610244 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.610076    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/034cc156-87ab-466d-a5ec-b7f7231b9af8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "034cc156-87ab-466d-a5ec-b7f7231b9af8" (UID: "034cc156-87ab-466d-a5ec-b7f7231b9af8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:09:01.610438 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.610310    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-data" (OuterVolumeSpecName: "istio-data") pod "034cc156-87ab-466d-a5ec-b7f7231b9af8" (UID: "034cc156-87ab-466d-a5ec-b7f7231b9af8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:09:01.612443 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.612407    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "034cc156-87ab-466d-a5ec-b7f7231b9af8" (UID: "034cc156-87ab-466d-a5ec-b7f7231b9af8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:09:01.612610 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.612422    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-token" (OuterVolumeSpecName: "istio-token") pod "034cc156-87ab-466d-a5ec-b7f7231b9af8" (UID: "034cc156-87ab-466d-a5ec-b7f7231b9af8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:09:01.612610 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.612461    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-kube-api-access-lb9z5" (OuterVolumeSpecName: "kube-api-access-lb9z5") pod "034cc156-87ab-466d-a5ec-b7f7231b9af8" (UID: "034cc156-87ab-466d-a5ec-b7f7231b9af8"). InnerVolumeSpecName "kube-api-access-lb9z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:09:01.612610 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.612567    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "034cc156-87ab-466d-a5ec-b7f7231b9af8" (UID: "034cc156-87ab-466d-a5ec-b7f7231b9af8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:09:01.711248 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.711208    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/034cc156-87ab-466d-a5ec-b7f7231b9af8-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:09:01.711248 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.711243    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb9z5\" (UniqueName: \"kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-kube-api-access-lb9z5\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:09:01.711248 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.711253    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:09:01.711497 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.711263    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:09:01.711497 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.711272    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:09:01.711497 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:01.711283    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/034cc156-87ab-466d-a5ec-b7f7231b9af8-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:09:02.018500 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.018469    2561 generic.go:356] "Generic (PLEG): container finished" podID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerID="472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173" exitCode=0
Jul 28 18:09:02.018925 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.018518    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"
Jul 28 18:09:02.018925 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.018553    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" event={"ID":"034cc156-87ab-466d-a5ec-b7f7231b9af8","Type":"ContainerDied","Data":"472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173"}
Jul 28 18:09:02.018925 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.018619    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz" event={"ID":"034cc156-87ab-466d-a5ec-b7f7231b9af8","Type":"ContainerDied","Data":"274bec74a2b42742a48a0c0e4a655f5e23ddd0918f19fd0a4d3b7e9575a93e3c"}
Jul 28 18:09:02.018925 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.018645    2561 scope.go:117] "RemoveContainer" containerID="472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173"
Jul 28 18:09:02.028342 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.028320    2561 scope.go:117] "RemoveContainer" containerID="189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c"
Jul 28 18:09:02.037159 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.037140    2561 scope.go:117] "RemoveContainer" containerID="472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173"
Jul 28 18:09:02.037495 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:09:02.037472    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173\": container with ID starting with 472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173 not found: ID does not exist" containerID="472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173"
Jul 28 18:09:02.037589 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.037507    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173"} err="failed to get container status \"472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173\": rpc error: code = NotFound desc = could not find container \"472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173\": container with ID starting with 472cbdfd23289336ac026d9f8376384e4e1a8b9a741f136899b010cbdddf2173 not found: ID does not exist"
Jul 28 18:09:02.037589 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.037535    2561 scope.go:117] "RemoveContainer" containerID="189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c"
Jul 28 18:09:02.037825 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:09:02.037807    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c\": container with ID starting with 189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c not found: ID does not exist" containerID="189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c"
Jul 28 18:09:02.037865 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.037833    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c"} err="failed to get container status \"189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c\": rpc error: code = NotFound desc = could not find container \"189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c\": container with ID starting with 189de6df9f2176babcee0b1fb90d6d06c23f7e79a1d4883a99c5bd8af97c1b4c not found: ID does not exist"
Jul 28 18:09:02.048598 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.048555    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"]
Jul 28 18:09:02.061418 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:02.061386    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-688e4a86-openshift-default-556696fb84-m8pmz"]
Jul 28 18:09:03.921968 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:03.921932    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" path="/var/lib/kubelet/pods/034cc156-87ab-466d-a5ec-b7f7231b9af8/volumes"
Jul 28 18:09:19.289483 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.289441    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"]
Jul 28 18:09:19.289975 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.289944    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d57619e-6d83-46c9-b60a-e017fbe7f0b0" containerName="payload-processing"
Jul 28 18:09:19.289975 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.289960    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d57619e-6d83-46c9-b60a-e017fbe7f0b0" containerName="payload-processing"
Jul 28 18:09:19.290058 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.289984    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy"
Jul 28 18:09:19.290058 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.289994    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy"
Jul 28 18:09:19.290058 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.290013    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29078d97-18e0-41c2-aefb-715f59030ec1" containerName="payload-pre-processing"
Jul 28 18:09:19.290058 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.290022    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="29078d97-18e0-41c2-aefb-715f59030ec1" containerName="payload-pre-processing"
Jul 28 18:09:19.290058 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.290042    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy"
Jul 28 18:09:19.290058 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.290052    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy"
Jul 28 18:09:19.290283 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.290168    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy"
Jul 28 18:09:19.290283 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.290182    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="034cc156-87ab-466d-a5ec-b7f7231b9af8" containerName="istio-proxy"
Jul 28 18:09:19.290283 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.290193    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d57619e-6d83-46c9-b60a-e017fbe7f0b0" containerName="payload-processing"
Jul 28 18:09:19.290283 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.290203    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="29078d97-18e0-41c2-aefb-715f59030ec1" containerName="payload-pre-processing"
Jul 28 18:09:19.301561 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.301532    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.306657 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.306630    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a6b37785-openshift-default-dockercfg-h77ll\""
Jul 28 18:09:19.309127 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.309079    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"]
Jul 28 18:09:19.375420 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.375384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-envoy\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.375420 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.375432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-data\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.375707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.375479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf6kx\" (UniqueName: \"kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-kube-api-access-rf6kx\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.375707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.375548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c154c476-ff17-465e-8fd6-4923621a9f8c-istiod-ca-cert\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.375707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.375609    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-podinfo\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.375707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.375659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-credential-socket\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.375707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.375683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-certs\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.375707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.375705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-token\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.376036 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.375786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-socket\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.476894 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.476843    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-podinfo\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477153 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.476917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-credential-socket\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477153 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.476944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-certs\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477153 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.476970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-token\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477153 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.477035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-socket\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477153 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.477071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-envoy\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477153 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.477145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-data\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477508 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.477203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf6kx\" (UniqueName: \"kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-kube-api-access-rf6kx\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477508 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.477231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c154c476-ff17-465e-8fd6-4923621a9f8c-istiod-ca-cert\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477615 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.477516    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-credential-socket\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477667 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.477635    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-data\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477781 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.477764    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-certs\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477882 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.477863    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-socket\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.477952 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.477934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c154c476-ff17-465e-8fd6-4923621a9f8c-istiod-ca-cert\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.479571 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.479541    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-envoy\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.479706 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.479649    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-podinfo\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.489241 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.489205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf6kx\" (UniqueName: \"kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-kube-api-access-rf6kx\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.490568 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.490520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-token\") pod \"e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") " pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.614647 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.614549    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:19.773871 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.773840    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"]
Jul 28 18:09:19.775724 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:09:19.775697    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc154c476_ff17_465e_8fd6_4923621a9f8c.slice/crio-83ab169544cac358d81719f03c7df1d8124ec14e50a7d3b4705e1f527fdc6896 WatchSource:0}: Error finding container 83ab169544cac358d81719f03c7df1d8124ec14e50a7d3b4705e1f527fdc6896: Status 404 returned error can't find the container with id 83ab169544cac358d81719f03c7df1d8124ec14e50a7d3b4705e1f527fdc6896
Jul 28 18:09:19.777676 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.777640    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:09:19.777781 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.777722    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:09:19.777781 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.777767    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:09:19.954187 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.954073    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:09:19.959963 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:19.959927    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:09:20.108372 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:20.108337    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" event={"ID":"c154c476-ff17-465e-8fd6-4923621a9f8c","Type":"ContainerStarted","Data":"4014c04ca48e1162b06823bca861118866affa6c5ce50bd8e94016af5868aa20"}
Jul 28 18:09:20.108535 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:20.108394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" event={"ID":"c154c476-ff17-465e-8fd6-4923621a9f8c","Type":"ContainerStarted","Data":"83ab169544cac358d81719f03c7df1d8124ec14e50a7d3b4705e1f527fdc6896"}
Jul 28 18:09:20.132359 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:20.132301    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" podStartSLOduration=1.132276146 podStartE2EDuration="1.132276146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:09:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:09:20.13090014 +0000 UTC m=+2100.731496975" watchObservedRunningTime="2026-07-28 18:09:20.132276146 +0000 UTC m=+2100.732872981"
Jul 28 18:09:20.615210 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:20.615170    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:20.620416 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:20.620386    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:21.113142 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:21.113106    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:21.114135 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:21.114083    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:23.393849 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.393808    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"]
Jul 28 18:09:23.398791 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.398764    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:09:23.401835 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.401804    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a6b37785-dockercfg-gs9bl\""
Jul 28 18:09:23.402913 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.402889    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a6b37785\""
Jul 28 18:09:23.412355 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.412325    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"]
Jul 28 18:09:23.497822 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.497782    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"]
Jul 28 18:09:23.501344 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.501320    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:09:23.514173 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.514143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh\" (UID: \"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:09:23.514337 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.514313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phx97\" (UniqueName: \"kubernetes.io/projected/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-kube-api-access-phx97\") pod \"payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh\" (UID: \"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:09:23.517810 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.517778    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"]
Jul 28 18:09:23.615404 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.615359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh\" (UID: \"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:09:23.615627 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.615411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmz2m\" (UniqueName: \"kubernetes.io/projected/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-kube-api-access-vmz2m\") pod \"payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h\" (UID: \"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c\") " pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:09:23.615627 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.615446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-plugins-config-volume\") pod \"payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h\" (UID: \"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c\") " pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:09:23.615741 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.615623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phx97\" (UniqueName: \"kubernetes.io/projected/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-kube-api-access-phx97\") pod \"payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh\" (UID: \"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:09:23.616215 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.616198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh\" (UID: \"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:09:23.625829 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.625796    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phx97\" (UniqueName: \"kubernetes.io/projected/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-kube-api-access-phx97\") pod \"payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh\" (UID: \"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:09:23.711075 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.710970    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:09:23.716561 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.716533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmz2m\" (UniqueName: \"kubernetes.io/projected/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-kube-api-access-vmz2m\") pod \"payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h\" (UID: \"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c\") " pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:09:23.716658 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.716573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-plugins-config-volume\") pod \"payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h\" (UID: \"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c\") " pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:09:23.717593 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.717565    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-plugins-config-volume\") pod \"payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h\" (UID: \"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c\") " pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:09:23.729688 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.729651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmz2m\" (UniqueName: \"kubernetes.io/projected/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-kube-api-access-vmz2m\") pod \"payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h\" (UID: \"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c\") " pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:09:23.812665 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.812631    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:09:23.894713 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.894680    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"]
Jul 28 18:09:23.897420 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:09:23.897385    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea2e367_0b7b_46ab_bc24_c3ae6c5ab252.slice/crio-022eb45bc6ad73d760d776ef448bc918a31caabb3d6f824f60db876a8f4c64ef WatchSource:0}: Error finding container 022eb45bc6ad73d760d776ef448bc918a31caabb3d6f824f60db876a8f4c64ef: Status 404 returned error can't find the container with id 022eb45bc6ad73d760d776ef448bc918a31caabb3d6f824f60db876a8f4c64ef
Jul 28 18:09:23.973606 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:23.973402    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"]
Jul 28 18:09:23.973702 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:09:23.973673    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21b3c9d_f1cf_4fa1_bb22_22d1e71fa68c.slice/crio-dad3395ab14872fe267823f912e52b4b0bc0fb8d376ac3a51e02721611ac0946 WatchSource:0}: Error finding container dad3395ab14872fe267823f912e52b4b0bc0fb8d376ac3a51e02721611ac0946: Status 404 returned error can't find the container with id dad3395ab14872fe267823f912e52b4b0bc0fb8d376ac3a51e02721611ac0946
Jul 28 18:09:24.129597 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:24.129561    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh" event={"ID":"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252","Type":"ContainerStarted","Data":"f398397a2efd9cfee9cda4c2cae615fa5125f0248c265733b9ca8f7cc1238d73"}
Jul 28 18:09:24.129778 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:24.129620    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh" event={"ID":"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252","Type":"ContainerStarted","Data":"022eb45bc6ad73d760d776ef448bc918a31caabb3d6f824f60db876a8f4c64ef"}
Jul 28 18:09:24.129778 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:24.129650    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:09:24.131073 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:24.131048    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h" event={"ID":"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c","Type":"ContainerStarted","Data":"de398cc319ace7d5bdc15df3a3821a45c01c353fefdf039cc85f055b708d6696"}
Jul 28 18:09:24.131221 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:24.131119    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:09:24.131221 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:24.131144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h" event={"ID":"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c","Type":"ContainerStarted","Data":"dad3395ab14872fe267823f912e52b4b0bc0fb8d376ac3a51e02721611ac0946"}
Jul 28 18:09:24.150507 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:24.150443    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh" podStartSLOduration=1.150424753 podStartE2EDuration="1.150424753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:09:24.148545493 +0000 UTC m=+2104.749142327" watchObservedRunningTime="2026-07-28 18:09:24.150424753 +0000 UTC m=+2104.751021586"
Jul 28 18:09:24.171257 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:24.171205    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h" podStartSLOduration=1.171186984 podStartE2EDuration="1.171186984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:09:24.170701269 +0000 UTC m=+2104.771298103" watchObservedRunningTime="2026-07-28 18:09:24.171186984 +0000 UTC m=+2104.771783816"
Jul 28 18:09:35.138554 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:35.138517    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:09:35.139043 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:35.138640    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:09:37.155305 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:37.155257    2561 patch_prober.go:28] interesting pod/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 18:09:37.155707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:37.155332    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 18:09:38.212192 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:38.212157    2561 generic.go:356] "Generic (PLEG): container finished" podID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerID="4014c04ca48e1162b06823bca861118866affa6c5ce50bd8e94016af5868aa20" exitCode=0
Jul 28 18:09:38.212661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:38.212209    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" event={"ID":"c154c476-ff17-465e-8fd6-4923621a9f8c","Type":"ContainerDied","Data":"4014c04ca48e1162b06823bca861118866affa6c5ce50bd8e94016af5868aa20"}
Jul 28 18:09:38.212661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:38.212593    2561 scope.go:117] "RemoveContainer" containerID="4014c04ca48e1162b06823bca861118866affa6c5ce50bd8e94016af5868aa20"
Jul 28 18:09:38.213705 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:38.213671    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:09:38.213826 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:38.213763    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:09:38.213895 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:38.213825    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:09:39.223972 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:39.223927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" event={"ID":"c154c476-ff17-465e-8fd6-4923621a9f8c","Type":"ContainerStarted","Data":"d340d73ea8473c051f98d20e5a8f62b943d154db848a319b0448dcd54cdc1551"}
Jul 28 18:09:39.614808 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:39.614762    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:39.615038 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:39.615018    2561 patch_prober.go:28] interesting pod/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 28 18:09:39.615118 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:39.615064    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 28 18:09:40.615428 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:40.615384    2561 patch_prober.go:28] interesting pod/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 28 18:09:40.615843 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:40.615447    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 28 18:09:41.615726 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:41.615684    2561 patch_prober.go:28] interesting pod/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 28 18:09:41.616131 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:41.615761    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 28 18:09:42.615360 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:42.615319    2561 patch_prober.go:28] interesting pod/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 28 18:09:42.615565 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:42.615385    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 28 18:09:43.618989 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:43.618950    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:43.619506 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:43.619364    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:43.620129 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:43.620080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:09:51.394515 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.394482    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"]
Jul 28 18:09:51.396935 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.396917    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.400980 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.400956    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a6b37785\"/\"kube-root-ca.crt\""
Jul 28 18:09:51.401163 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.400956    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a6b37785\"/\"default-dockercfg-4xtkj\""
Jul 28 18:09:51.401163 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.400995    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a6b37785\"/\"e2e-lifecycle-model-a6b37785-kserve-self-signed-certs\""
Jul 28 18:09:51.401163 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.401008    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a6b37785\"/\"openshift-service-ca.crt\""
Jul 28 18:09:51.409022 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.408998    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"]
Jul 28 18:09:51.487139 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.487061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-tmp-dir\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.487336 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.487190    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-model-cache\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.487336 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.487271    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-home\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.487336 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.487292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-dshm\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.487336 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.487315    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50581338-76f3-4de1-a5c6-6951e0bce8eb-tls-certs\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.487336 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.487333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hb2k\" (UniqueName: \"kubernetes.io/projected/50581338-76f3-4de1-a5c6-6951e0bce8eb-kube-api-access-5hb2k\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.588445 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.588406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-model-cache\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.588658 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.588471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-home\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.588658 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.588487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-dshm\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.588658 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.588515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50581338-76f3-4de1-a5c6-6951e0bce8eb-tls-certs\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.588658 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.588533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hb2k\" (UniqueName: \"kubernetes.io/projected/50581338-76f3-4de1-a5c6-6951e0bce8eb-kube-api-access-5hb2k\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.588900 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.588749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-tmp-dir\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.588900 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.588854    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-home\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.589011 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.588895    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-model-cache\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.589121 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.589064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-tmp-dir\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.590861 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.590839    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-dshm\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.591062 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.591045    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50581338-76f3-4de1-a5c6-6951e0bce8eb-tls-certs\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.598234 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.598210    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hb2k\" (UniqueName: \"kubernetes.io/projected/50581338-76f3-4de1-a5c6-6951e0bce8eb-kube-api-access-5hb2k\") pod \"e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") " pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.707018 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.706911    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:09:51.853642 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:51.853598    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"]
Jul 28 18:09:51.860243 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:09:51.860216    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50581338_76f3_4de1_a5c6_6951e0bce8eb.slice/crio-e755154bb1d2ac95f72df5a3bd8d6275ed7611796c9308c75fdbd403de4fb5e7 WatchSource:0}: Error finding container e755154bb1d2ac95f72df5a3bd8d6275ed7611796c9308c75fdbd403de4fb5e7: Status 404 returned error can't find the container with id e755154bb1d2ac95f72df5a3bd8d6275ed7611796c9308c75fdbd403de4fb5e7
Jul 28 18:09:52.286861 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:52.286810    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg" event={"ID":"50581338-76f3-4de1-a5c6-6951e0bce8eb","Type":"ContainerStarted","Data":"a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938"}
Jul 28 18:09:52.286861 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:52.286867    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg" event={"ID":"50581338-76f3-4de1-a5c6-6951e0bce8eb","Type":"ContainerStarted","Data":"e755154bb1d2ac95f72df5a3bd8d6275ed7611796c9308c75fdbd403de4fb5e7"}
Jul 28 18:09:52.308933 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:09:52.308879    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg" podStartSLOduration=1.30886059 podStartE2EDuration="1.30886059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:09:52.306828118 +0000 UTC m=+2132.907424942" watchObservedRunningTime="2026-07-28 18:09:52.30886059 +0000 UTC m=+2132.909457423"
Jul 28 18:10:01.707528 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:01.707477    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:10:01.707528 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:01.707532    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:10:01.720246 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:01.720213    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:10:02.347287 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:02.347254    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:10:38.285175 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.285139    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"]
Jul 28 18:10:38.285819 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.285422    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h" podUID="a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c" containerName="payload-processing" containerID="cri-o://de398cc319ace7d5bdc15df3a3821a45c01c353fefdf039cc85f055b708d6696" gracePeriod=30
Jul 28 18:10:38.295000 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.294885    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"]
Jul 28 18:10:38.295269 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.295217    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh" podUID="eea2e367-0b7b-46ab-bc24-c3ae6c5ab252" containerName="payload-pre-processing" containerID="cri-o://f398397a2efd9cfee9cda4c2cae615fa5125f0248c265733b9ca8f7cc1238d73" gracePeriod=30
Jul 28 18:10:38.520020 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.519988    2561 generic.go:356] "Generic (PLEG): container finished" podID="eea2e367-0b7b-46ab-bc24-c3ae6c5ab252" containerID="f398397a2efd9cfee9cda4c2cae615fa5125f0248c265733b9ca8f7cc1238d73" exitCode=0
Jul 28 18:10:38.520220 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.520059    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh" event={"ID":"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252","Type":"ContainerDied","Data":"f398397a2efd9cfee9cda4c2cae615fa5125f0248c265733b9ca8f7cc1238d73"}
Jul 28 18:10:38.521966 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.521924    2561 generic.go:356] "Generic (PLEG): container finished" podID="a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c" containerID="de398cc319ace7d5bdc15df3a3821a45c01c353fefdf039cc85f055b708d6696" exitCode=0
Jul 28 18:10:38.522111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.521983    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h" event={"ID":"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c","Type":"ContainerDied","Data":"de398cc319ace7d5bdc15df3a3821a45c01c353fefdf039cc85f055b708d6696"}
Jul 28 18:10:38.556011 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.555974    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:10:38.589203 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.589175    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:10:38.637970 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.637929    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmz2m\" (UniqueName: \"kubernetes.io/projected/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-kube-api-access-vmz2m\") pod \"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c\" (UID: \"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c\") "
Jul 28 18:10:38.638194 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.637999    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-plugins-config-volume\") pod \"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c\" (UID: \"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c\") "
Jul 28 18:10:38.638445 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.638421    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c" (UID: "a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:10:38.640469 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.640442    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-kube-api-access-vmz2m" (OuterVolumeSpecName: "kube-api-access-vmz2m") pod "a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c" (UID: "a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c"). InnerVolumeSpecName "kube-api-access-vmz2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:10:38.739176 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.739133    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phx97\" (UniqueName: \"kubernetes.io/projected/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-kube-api-access-phx97\") pod \"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252\" (UID: \"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252\") "
Jul 28 18:10:38.739373 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.739232    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-plugins-config-volume\") pod \"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252\" (UID: \"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252\") "
Jul 28 18:10:38.739499 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.739481    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmz2m\" (UniqueName: \"kubernetes.io/projected/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-kube-api-access-vmz2m\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:10:38.739541 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.739507    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:10:38.739649 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.739631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eea2e367-0b7b-46ab-bc24-c3ae6c5ab252" (UID: "eea2e367-0b7b-46ab-bc24-c3ae6c5ab252"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:10:38.741298 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.741274    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-kube-api-access-phx97" (OuterVolumeSpecName: "kube-api-access-phx97") pod "eea2e367-0b7b-46ab-bc24-c3ae6c5ab252" (UID: "eea2e367-0b7b-46ab-bc24-c3ae6c5ab252"). InnerVolumeSpecName "kube-api-access-phx97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:10:38.840670 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.840578    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phx97\" (UniqueName: \"kubernetes.io/projected/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-kube-api-access-phx97\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:10:38.840670 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:38.840616    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:10:39.528996 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.528961    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"
Jul 28 18:10:39.529484 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.528964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh" event={"ID":"eea2e367-0b7b-46ab-bc24-c3ae6c5ab252","Type":"ContainerDied","Data":"022eb45bc6ad73d760d776ef448bc918a31caabb3d6f824f60db876a8f4c64ef"}
Jul 28 18:10:39.529484 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.529140    2561 scope.go:117] "RemoveContainer" containerID="f398397a2efd9cfee9cda4c2cae615fa5125f0248c265733b9ca8f7cc1238d73"
Jul 28 18:10:39.530535 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.530504    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h" event={"ID":"a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c","Type":"ContainerDied","Data":"dad3395ab14872fe267823f912e52b4b0bc0fb8d376ac3a51e02721611ac0946"}
Jul 28 18:10:39.530587 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.530558    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"
Jul 28 18:10:39.540984 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.540929    2561 scope.go:117] "RemoveContainer" containerID="de398cc319ace7d5bdc15df3a3821a45c01c353fefdf039cc85f055b708d6696"
Jul 28 18:10:39.561622 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.561529    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"]
Jul 28 18:10:39.566315 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.566283    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a6b37785-6598799756-phgrh"]
Jul 28 18:10:39.586622 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.586582    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"]
Jul 28 18:10:39.593635 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.593602    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a6b37785-5cfcff4486-gbp5h"]
Jul 28 18:10:39.921132 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.921024    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c" path="/var/lib/kubelet/pods/a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c/volumes"
Jul 28 18:10:39.921414 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:39.921399    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea2e367-0b7b-46ab-bc24-c3ae6c5ab252" path="/var/lib/kubelet/pods/eea2e367-0b7b-46ab-bc24-c3ae6c5ab252/volumes"
Jul 28 18:10:47.124545 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:10:47.124492    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"]
Jul 28 18:11:02.144147 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.144057    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg" podUID="50581338-76f3-4de1-a5c6-6951e0bce8eb" containerName="main" containerID="cri-o://a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938" gracePeriod=45
Jul 28 18:11:02.402159 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.402071    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:11:02.440263 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440230    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-tmp-dir\") pod \"50581338-76f3-4de1-a5c6-6951e0bce8eb\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") "
Jul 28 18:11:02.440467 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440275    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-model-cache\") pod \"50581338-76f3-4de1-a5c6-6951e0bce8eb\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") "
Jul 28 18:11:02.440467 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440331    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-dshm\") pod \"50581338-76f3-4de1-a5c6-6951e0bce8eb\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") "
Jul 28 18:11:02.440467 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440348    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50581338-76f3-4de1-a5c6-6951e0bce8eb-tls-certs\") pod \"50581338-76f3-4de1-a5c6-6951e0bce8eb\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") "
Jul 28 18:11:02.440467 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440398    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-home\") pod \"50581338-76f3-4de1-a5c6-6951e0bce8eb\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") "
Jul 28 18:11:02.440718 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440519    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hb2k\" (UniqueName: \"kubernetes.io/projected/50581338-76f3-4de1-a5c6-6951e0bce8eb-kube-api-access-5hb2k\") pod \"50581338-76f3-4de1-a5c6-6951e0bce8eb\" (UID: \"50581338-76f3-4de1-a5c6-6951e0bce8eb\") "
Jul 28 18:11:02.440718 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440574    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "50581338-76f3-4de1-a5c6-6951e0bce8eb" (UID: "50581338-76f3-4de1-a5c6-6951e0bce8eb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:11:02.440718 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440641    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-model-cache" (OuterVolumeSpecName: "model-cache") pod "50581338-76f3-4de1-a5c6-6951e0bce8eb" (UID: "50581338-76f3-4de1-a5c6-6951e0bce8eb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:11:02.440718 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440653    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-home" (OuterVolumeSpecName: "home") pod "50581338-76f3-4de1-a5c6-6951e0bce8eb" (UID: "50581338-76f3-4de1-a5c6-6951e0bce8eb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:11:02.440880 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440848    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-home\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:11:02.440880 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440866    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-tmp-dir\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:11:02.440945 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.440881    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-model-cache\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:11:02.442857 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.442812    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50581338-76f3-4de1-a5c6-6951e0bce8eb-kube-api-access-5hb2k" (OuterVolumeSpecName: "kube-api-access-5hb2k") pod "50581338-76f3-4de1-a5c6-6951e0bce8eb" (UID: "50581338-76f3-4de1-a5c6-6951e0bce8eb"). InnerVolumeSpecName "kube-api-access-5hb2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:11:02.443017 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.442996    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50581338-76f3-4de1-a5c6-6951e0bce8eb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "50581338-76f3-4de1-a5c6-6951e0bce8eb" (UID: "50581338-76f3-4de1-a5c6-6951e0bce8eb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:11:02.443087 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.443006    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-dshm" (OuterVolumeSpecName: "dshm") pod "50581338-76f3-4de1-a5c6-6951e0bce8eb" (UID: "50581338-76f3-4de1-a5c6-6951e0bce8eb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:11:02.541559 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.541516    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50581338-76f3-4de1-a5c6-6951e0bce8eb-dshm\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:11:02.541559 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.541553    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50581338-76f3-4de1-a5c6-6951e0bce8eb-tls-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:11:02.541559 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.541565    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hb2k\" (UniqueName: \"kubernetes.io/projected/50581338-76f3-4de1-a5c6-6951e0bce8eb-kube-api-access-5hb2k\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:11:02.645477 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.645439    2561 generic.go:356] "Generic (PLEG): container finished" podID="50581338-76f3-4de1-a5c6-6951e0bce8eb" containerID="a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938" exitCode=0
Jul 28 18:11:02.645667 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.645501    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"
Jul 28 18:11:02.645667 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.645520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg" event={"ID":"50581338-76f3-4de1-a5c6-6951e0bce8eb","Type":"ContainerDied","Data":"a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938"}
Jul 28 18:11:02.645667 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.645572    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg" event={"ID":"50581338-76f3-4de1-a5c6-6951e0bce8eb","Type":"ContainerDied","Data":"e755154bb1d2ac95f72df5a3bd8d6275ed7611796c9308c75fdbd403de4fb5e7"}
Jul 28 18:11:02.645667 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.645597    2561 scope.go:117] "RemoveContainer" containerID="a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938"
Jul 28 18:11:02.657562 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.657542    2561 scope.go:117] "RemoveContainer" containerID="a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938"
Jul 28 18:11:02.657908 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:11:02.657886    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938\": container with ID starting with a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938 not found: ID does not exist" containerID="a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938"
Jul 28 18:11:02.657965 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.657919    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938"} err="failed to get container status \"a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938\": rpc error: code = NotFound desc = could not find container \"a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938\": container with ID starting with a017256fb0d6d628e068072e2c62ebd400dbb1de2770f138e05ab3749c2ba938 not found: ID does not exist"
Jul 28 18:11:02.675232 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.675187    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"]
Jul 28 18:11:02.680377 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:02.680346    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg"]
Jul 28 18:11:03.920895 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:03.920849    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50581338-76f3-4de1-a5c6-6951e0bce8eb" path="/var/lib/kubelet/pods/50581338-76f3-4de1-a5c6-6951e0bce8eb/volumes"
Jul 28 18:11:07.337321 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:07.337257    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-a6b37785/e2e-lifecycle-model-a6b37785-kserve-794956c7cf-mc9fg" podUID="50581338-76f3-4de1-a5c6-6951e0bce8eb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": context deadline exceeded"
Jul 28 18:11:58.799755 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:58.799666    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"]
Jul 28 18:11:58.800351 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:11:58.799919    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy" containerID="cri-o://d340d73ea8473c051f98d20e5a8f62b943d154db848a319b0448dcd54cdc1551" gracePeriod=30
Jul 28 18:12:03.946288 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:03.946248    2561 generic.go:356] "Generic (PLEG): container finished" podID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerID="d340d73ea8473c051f98d20e5a8f62b943d154db848a319b0448dcd54cdc1551" exitCode=0
Jul 28 18:12:03.946745 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:03.946323    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" event={"ID":"c154c476-ff17-465e-8fd6-4923621a9f8c","Type":"ContainerDied","Data":"d340d73ea8473c051f98d20e5a8f62b943d154db848a319b0448dcd54cdc1551"}
Jul 28 18:12:03.946745 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:03.946398    2561 scope.go:117] "RemoveContainer" containerID="4014c04ca48e1162b06823bca861118866affa6c5ce50bd8e94016af5868aa20"
Jul 28 18:12:04.060301 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.060271    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:12:04.209611 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.209501    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-data\") pod \"c154c476-ff17-465e-8fd6-4923621a9f8c\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") "
Jul 28 18:12:04.209611 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.209544    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-podinfo\") pod \"c154c476-ff17-465e-8fd6-4923621a9f8c\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") "
Jul 28 18:12:04.209611 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.209586    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-envoy\") pod \"c154c476-ff17-465e-8fd6-4923621a9f8c\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") "
Jul 28 18:12:04.209611 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.209617    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-socket\") pod \"c154c476-ff17-465e-8fd6-4923621a9f8c\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") "
Jul 28 18:12:04.209978 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.209652    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf6kx\" (UniqueName: \"kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-kube-api-access-rf6kx\") pod \"c154c476-ff17-465e-8fd6-4923621a9f8c\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") "
Jul 28 18:12:04.209978 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.209675    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c154c476-ff17-465e-8fd6-4923621a9f8c-istiod-ca-cert\") pod \"c154c476-ff17-465e-8fd6-4923621a9f8c\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") "
Jul 28 18:12:04.209978 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.209699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-credential-socket\") pod \"c154c476-ff17-465e-8fd6-4923621a9f8c\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") "
Jul 28 18:12:04.209978 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.209764    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-certs\") pod \"c154c476-ff17-465e-8fd6-4923621a9f8c\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") "
Jul 28 18:12:04.209978 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.209851    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-token\") pod \"c154c476-ff17-465e-8fd6-4923621a9f8c\" (UID: \"c154c476-ff17-465e-8fd6-4923621a9f8c\") "
Jul 28 18:12:04.210275 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.210011    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c154c476-ff17-465e-8fd6-4923621a9f8c" (UID: "c154c476-ff17-465e-8fd6-4923621a9f8c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:12:04.210275 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.210143    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c154c476-ff17-465e-8fd6-4923621a9f8c" (UID: "c154c476-ff17-465e-8fd6-4923621a9f8c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:12:04.210275 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.210182    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c154c476-ff17-465e-8fd6-4923621a9f8c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c154c476-ff17-465e-8fd6-4923621a9f8c" (UID: "c154c476-ff17-465e-8fd6-4923621a9f8c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:12:04.210429 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.210265    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c154c476-ff17-465e-8fd6-4923621a9f8c" (UID: "c154c476-ff17-465e-8fd6-4923621a9f8c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:12:04.210567 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.210544    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c154c476-ff17-465e-8fd6-4923621a9f8c" (UID: "c154c476-ff17-465e-8fd6-4923621a9f8c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:12:04.210696 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.210681    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:12:04.210761 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.210702    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:12:04.210761 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.210718    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c154c476-ff17-465e-8fd6-4923621a9f8c-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:12:04.210761 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.210733    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:12:04.210761 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.210747    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:12:04.212020 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.211989    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-kube-api-access-rf6kx" (OuterVolumeSpecName: "kube-api-access-rf6kx") pod "c154c476-ff17-465e-8fd6-4923621a9f8c" (UID: "c154c476-ff17-465e-8fd6-4923621a9f8c"). InnerVolumeSpecName "kube-api-access-rf6kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:12:04.212020 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.212006    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c154c476-ff17-465e-8fd6-4923621a9f8c" (UID: "c154c476-ff17-465e-8fd6-4923621a9f8c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:12:04.212275 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.212254    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c154c476-ff17-465e-8fd6-4923621a9f8c" (UID: "c154c476-ff17-465e-8fd6-4923621a9f8c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:12:04.212351 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.212331    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c154c476-ff17-465e-8fd6-4923621a9f8c" (UID: "c154c476-ff17-465e-8fd6-4923621a9f8c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:12:04.311226 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.311191    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:12:04.311226 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.311221    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf6kx\" (UniqueName: \"kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-kube-api-access-rf6kx\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:12:04.311226 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.311232    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:12:04.311536 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.311244    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c154c476-ff17-465e-8fd6-4923621a9f8c-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:12:04.958824 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.958773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl" event={"ID":"c154c476-ff17-465e-8fd6-4923621a9f8c","Type":"ContainerDied","Data":"83ab169544cac358d81719f03c7df1d8124ec14e50a7d3b4705e1f527fdc6896"}
Jul 28 18:12:04.958824 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.958819    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"
Jul 28 18:12:04.959398 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.958889    2561 scope.go:117] "RemoveContainer" containerID="d340d73ea8473c051f98d20e5a8f62b943d154db848a319b0448dcd54cdc1551"
Jul 28 18:12:04.988142 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.988083    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"]
Jul 28 18:12:04.999987 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:04.999957    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a6b37785-openshift-default-68bf888684-pb5bl"]
Jul 28 18:12:05.919790 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:12:05.919756    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" path="/var/lib/kubelet/pods/c154c476-ff17-465e-8fd6-4923621a9f8c/volumes"
Jul 28 18:13:06.922347 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922310    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"]
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922696    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea2e367-0b7b-46ab-bc24-c3ae6c5ab252" containerName="payload-pre-processing"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922709    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea2e367-0b7b-46ab-bc24-c3ae6c5ab252" containerName="payload-pre-processing"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922718    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c" containerName="payload-processing"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922724    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c" containerName="payload-processing"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922731    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922737    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922764    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50581338-76f3-4de1-a5c6-6951e0bce8eb" containerName="main"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922772    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="50581338-76f3-4de1-a5c6-6951e0bce8eb" containerName="main"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922840    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922850    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea2e367-0b7b-46ab-bc24-c3ae6c5ab252" containerName="payload-pre-processing"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922858    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="50581338-76f3-4de1-a5c6-6951e0bce8eb" containerName="main"
Jul 28 18:13:06.922986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.922863    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a21b3c9d-f1cf-4fa1-bb22-22d1e71fa68c" containerName="payload-processing"
Jul 28 18:13:06.925751 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.925732    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:06.930462 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.930437    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1cce3e-openshift-default-dockercfg-49chm\""
Jul 28 18:13:06.950561 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:06.950523    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"]
Jul 28 18:13:07.077590 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.077550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-data\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.077590 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.077595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-socket\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.077832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.077692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w727d\" (UniqueName: \"kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-kube-api-access-w727d\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.077832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.077734    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istiod-ca-cert\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.077832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.077777    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-certs\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.077832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.077794    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-envoy\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.077832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.077811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-podinfo\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.078187 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.077867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-credential-socket\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.078187 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.077895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-token\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179046 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.178935    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-data\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179046 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.178988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-socket\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179046 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179037    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w727d\" (UniqueName: \"kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-kube-api-access-w727d\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179365 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istiod-ca-cert\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179365 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-certs\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179365 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-envoy\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179365 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-podinfo\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179595 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-credential-socket\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179595 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-token\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179595 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179442    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-data\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179595 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-socket\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179817 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179649    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-credential-socket\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179901 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istiod-ca-cert\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.179965 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.179913    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-certs\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.181470 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.181452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-envoy\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.181695 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.181675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-podinfo\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.190428 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.190396    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w727d\" (UniqueName: \"kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-kube-api-access-w727d\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.195297 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.195260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-token\") pod \"e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") " pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.236165 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.236121    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:07.391064 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.391033    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"]
Jul 28 18:13:07.394055 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:13:07.394022    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1eb1a8_27c7_47f3_9682_dd8de5d3d5c6.slice/crio-715b7d98b5ff92f435b1bbb9f1a8591dcf9f78190df5cc0445fd6286e6641a9d WatchSource:0}: Error finding container 715b7d98b5ff92f435b1bbb9f1a8591dcf9f78190df5cc0445fd6286e6641a9d: Status 404 returned error can't find the container with id 715b7d98b5ff92f435b1bbb9f1a8591dcf9f78190df5cc0445fd6286e6641a9d
Jul 28 18:13:07.396212 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.396178    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:07.396312 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.396250    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:07.396312 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:07.396281    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:08.255859 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:08.255806    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" event={"ID":"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6","Type":"ContainerStarted","Data":"3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7"}
Jul 28 18:13:08.256332 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:08.255888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" event={"ID":"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6","Type":"ContainerStarted","Data":"715b7d98b5ff92f435b1bbb9f1a8591dcf9f78190df5cc0445fd6286e6641a9d"}
Jul 28 18:13:08.304870 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:08.304813    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" podStartSLOduration=2.304581049 podStartE2EDuration="2.304581049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:13:08.298264359 +0000 UTC m=+2328.898861184" watchObservedRunningTime="2026-07-28 18:13:08.304581049 +0000 UTC m=+2328.905177884"
Jul 28 18:13:09.237179 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:09.237140    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:09.242416 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:09.242386    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:09.261160 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:09.261129    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:09.262126 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:09.262081    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:11.768144 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.768044    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"]
Jul 28 18:13:11.768537 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.768413    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy"
Jul 28 18:13:11.768537 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.768426    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy"
Jul 28 18:13:11.768537 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.768495    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c154c476-ff17-465e-8fd6-4923621a9f8c" containerName="istio-proxy"
Jul 28 18:13:11.771534 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.771517    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:13:11.774796 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.774776    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-1cce3e-dockercfg-mx28d\""
Jul 28 18:13:11.775340 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.775322    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-1cce3e\""
Jul 28 18:13:11.795391 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.795358    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"]
Jul 28 18:13:11.822374 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.822338    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"]
Jul 28 18:13:11.825619 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.825600    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:13:11.844436 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.844409    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"]
Jul 28 18:13:11.925566 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.925530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66761e71-aac7-45e3-847f-da3c08d5a111-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k\" (UID: \"66761e71-aac7-45e3-847f-da3c08d5a111\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:13:11.925731 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.925580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvdx\" (UniqueName: \"kubernetes.io/projected/776e4115-d3d0-4203-b776-b294d793e8cb-kube-api-access-zmvdx\") pod \"payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc\" (UID: \"776e4115-d3d0-4203-b776-b294d793e8cb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:13:11.925731 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.925616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776e4115-d3d0-4203-b776-b294d793e8cb-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc\" (UID: \"776e4115-d3d0-4203-b776-b294d793e8cb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:13:11.925731 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:11.925699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zccr\" (UniqueName: \"kubernetes.io/projected/66761e71-aac7-45e3-847f-da3c08d5a111-kube-api-access-4zccr\") pod \"payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k\" (UID: \"66761e71-aac7-45e3-847f-da3c08d5a111\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:13:12.027151 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.026968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66761e71-aac7-45e3-847f-da3c08d5a111-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k\" (UID: \"66761e71-aac7-45e3-847f-da3c08d5a111\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:13:12.027151 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.027034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvdx\" (UniqueName: \"kubernetes.io/projected/776e4115-d3d0-4203-b776-b294d793e8cb-kube-api-access-zmvdx\") pod \"payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc\" (UID: \"776e4115-d3d0-4203-b776-b294d793e8cb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:13:12.027151 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.027081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776e4115-d3d0-4203-b776-b294d793e8cb-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc\" (UID: \"776e4115-d3d0-4203-b776-b294d793e8cb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:13:12.027488 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.027166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zccr\" (UniqueName: \"kubernetes.io/projected/66761e71-aac7-45e3-847f-da3c08d5a111-kube-api-access-4zccr\") pod \"payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k\" (UID: \"66761e71-aac7-45e3-847f-da3c08d5a111\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:13:12.027953 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.027924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776e4115-d3d0-4203-b776-b294d793e8cb-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc\" (UID: \"776e4115-d3d0-4203-b776-b294d793e8cb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:13:12.028058 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.028040    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66761e71-aac7-45e3-847f-da3c08d5a111-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k\" (UID: \"66761e71-aac7-45e3-847f-da3c08d5a111\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:13:12.040350 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.040291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvdx\" (UniqueName: \"kubernetes.io/projected/776e4115-d3d0-4203-b776-b294d793e8cb-kube-api-access-zmvdx\") pod \"payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc\" (UID: \"776e4115-d3d0-4203-b776-b294d793e8cb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:13:12.040548 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.040426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zccr\" (UniqueName: \"kubernetes.io/projected/66761e71-aac7-45e3-847f-da3c08d5a111-kube-api-access-4zccr\") pod \"payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k\" (UID: \"66761e71-aac7-45e3-847f-da3c08d5a111\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:13:12.082172 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.082134    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:13:12.136316 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.136275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:13:12.238506 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.238474    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"]
Jul 28 18:13:12.242062 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:13:12.242031    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66761e71_aac7_45e3_847f_da3c08d5a111.slice/crio-5364c484e90fc61ca7e9bcfd44f2ecefb480bfc317cce0bea71e82695f46560a WatchSource:0}: Error finding container 5364c484e90fc61ca7e9bcfd44f2ecefb480bfc317cce0bea71e82695f46560a: Status 404 returned error can't find the container with id 5364c484e90fc61ca7e9bcfd44f2ecefb480bfc317cce0bea71e82695f46560a
Jul 28 18:13:12.279813 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.279736    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k" event={"ID":"66761e71-aac7-45e3-847f-da3c08d5a111","Type":"ContainerStarted","Data":"5364c484e90fc61ca7e9bcfd44f2ecefb480bfc317cce0bea71e82695f46560a"}
Jul 28 18:13:12.300671 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:12.300644    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"]
Jul 28 18:13:12.303476 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:13:12.303440    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776e4115_d3d0_4203_b776_b294d793e8cb.slice/crio-6f64fb134fee4ceab6a1e4b4dbbb08ea61fffd16ea668e13fd19e86fad523289 WatchSource:0}: Error finding container 6f64fb134fee4ceab6a1e4b4dbbb08ea61fffd16ea668e13fd19e86fad523289: Status 404 returned error can't find the container with id 6f64fb134fee4ceab6a1e4b4dbbb08ea61fffd16ea668e13fd19e86fad523289
Jul 28 18:13:13.286949 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:13.286903    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc" event={"ID":"776e4115-d3d0-4203-b776-b294d793e8cb","Type":"ContainerStarted","Data":"782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8"}
Jul 28 18:13:13.287467 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:13.287015    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:13:13.287467 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:13.287043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc" event={"ID":"776e4115-d3d0-4203-b776-b294d793e8cb","Type":"ContainerStarted","Data":"6f64fb134fee4ceab6a1e4b4dbbb08ea61fffd16ea668e13fd19e86fad523289"}
Jul 28 18:13:13.288501 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:13.288474    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k" event={"ID":"66761e71-aac7-45e3-847f-da3c08d5a111","Type":"ContainerStarted","Data":"f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd"}
Jul 28 18:13:13.288647 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:13.288596    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:13:13.328315 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:13.328262    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc" podStartSLOduration=2.328243857 podStartE2EDuration="2.328243857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:13:13.326223423 +0000 UTC m=+2333.926820256" watchObservedRunningTime="2026-07-28 18:13:13.328243857 +0000 UTC m=+2333.928840690"
Jul 28 18:13:13.365285 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:13.365228    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k" podStartSLOduration=2.3652097100000002 podStartE2EDuration="2.36520971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:13:13.363701108 +0000 UTC m=+2333.964297941" watchObservedRunningTime="2026-07-28 18:13:13.36520971 +0000 UTC m=+2333.965806542"
Jul 28 18:13:24.295633 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:24.295597    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:13:24.296118 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:24.295779    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:13:25.303274 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:25.303218    2561 patch_prober.go:28] interesting pod/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 18:13:25.303911 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:25.303297    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 18:13:26.353711 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:26.353674    2561 generic.go:356] "Generic (PLEG): container finished" podID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerID="3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7" exitCode=0
Jul 28 18:13:26.354251 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:26.353747    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" event={"ID":"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6","Type":"ContainerDied","Data":"3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7"}
Jul 28 18:13:26.354251 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:26.354180    2561 scope.go:117] "RemoveContainer" containerID="3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7"
Jul 28 18:13:26.355220 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:26.355191    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:26.355293 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:26.355276    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:26.355343 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:26.355328    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:27.365566 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:27.365518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" event={"ID":"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6","Type":"ContainerStarted","Data":"60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec"}
Jul 28 18:13:28.236478 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:28.236438    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:28.236696 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:28.236671    2561 patch_prober.go:28] interesting pod/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 18:13:28.236751 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:28.236730    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 18:13:29.237476 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:29.237434    2561 patch_prober.go:28] interesting pod/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 18:13:29.237905 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:29.237492    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 18:13:30.236683 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:30.236641    2561 patch_prober.go:28] interesting pod/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 18:13:30.236884 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:30.236703    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 18:13:31.240410 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:31.240377    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:31.240919 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:31.240866    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:31.241710 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:31.241690    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:13:36.350666 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.350633    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"]
Jul 28 18:13:36.354364 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.354332    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.357428 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.357402    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-95c506-openshift-default-dockercfg-fp44h\""
Jul 28 18:13:36.371257 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.371223    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"]
Jul 28 18:13:36.440937 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.440892    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-socket\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.441156 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.440954    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-token\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.441156 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.441048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d600968-f6a7-4d2a-a388-8ef37ef65824-istiod-ca-cert\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.441156 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.441142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-certs\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.441369 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.441177    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-data\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.441369 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.441286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r27lv\" (UniqueName: \"kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-kube-api-access-r27lv\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.441484 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.441396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-envoy\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.441484 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.441424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-podinfo\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.441484 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.441455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-credential-socket\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.542803 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.542763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-envoy\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.542803 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.542802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-podinfo\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543083 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.542835    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-credential-socket\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543083 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.542872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-socket\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543083 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.542896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-token\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543083 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.542917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d600968-f6a7-4d2a-a388-8ef37ef65824-istiod-ca-cert\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543083 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.542952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-certs\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543083 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.542980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-data\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543083 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.543037    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r27lv\" (UniqueName: \"kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-kube-api-access-r27lv\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543447 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.543384    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-socket\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543447 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.543417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-credential-socket\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543690 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.543649    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-data\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543690 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.543663    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-certs\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.543964 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.543946    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d600968-f6a7-4d2a-a388-8ef37ef65824-istiod-ca-cert\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.545675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.545652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-podinfo\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.545790 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.545722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-envoy\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.553757 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.553726    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-token\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.553967 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.553943    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r27lv\" (UniqueName: \"kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-kube-api-access-r27lv\") pod \"e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") " pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.665565 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.665462    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:36.830724 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.830697    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"]
Jul 28 18:13:36.833498 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:13:36.833469    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d600968_f6a7_4d2a_a388_8ef37ef65824.slice/crio-bf729bc194da081b41b8ff184d80c998dcf879cc8216e8b7c4025fd2e3ebde33 WatchSource:0}: Error finding container bf729bc194da081b41b8ff184d80c998dcf879cc8216e8b7c4025fd2e3ebde33: Status 404 returned error can't find the container with id bf729bc194da081b41b8ff184d80c998dcf879cc8216e8b7c4025fd2e3ebde33
Jul 28 18:13:36.836117 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.836063    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:36.836189 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.836159    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:36.836227 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:36.836193    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:37.422713 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:37.422672    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" event={"ID":"9d600968-f6a7-4d2a-a388-8ef37ef65824","Type":"ContainerStarted","Data":"20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de"}
Jul 28 18:13:37.423217 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:37.422767    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" event={"ID":"9d600968-f6a7-4d2a-a388-8ef37ef65824","Type":"ContainerStarted","Data":"bf729bc194da081b41b8ff184d80c998dcf879cc8216e8b7c4025fd2e3ebde33"}
Jul 28 18:13:37.454450 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:37.454394    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" podStartSLOduration=1.4543769069999999 podStartE2EDuration="1.454376907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:13:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:13:37.453032069 +0000 UTC m=+2358.053628915" watchObservedRunningTime="2026-07-28 18:13:37.454376907 +0000 UTC m=+2358.054973739"
Jul 28 18:13:37.665909 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:37.665874    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:37.671215 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:37.671183    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:38.429354 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:38.429312    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:38.430256 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:38.430232    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:54.471330 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:54.471276    2561 patch_prober.go:28] interesting pod/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 18:13:54.471844 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:54.471357    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 18:13:56.520745 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:56.520707    2561 generic.go:356] "Generic (PLEG): container finished" podID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerID="20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de" exitCode=0
Jul 28 18:13:56.521322 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:56.520784    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" event={"ID":"9d600968-f6a7-4d2a-a388-8ef37ef65824","Type":"ContainerDied","Data":"20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de"}
Jul 28 18:13:56.521406 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:56.521339    2561 scope.go:117] "RemoveContainer" containerID="20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de"
Jul 28 18:13:56.522438 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:56.522406    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:56.522545 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:56.522477    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:56.522545 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:56.522508    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:13:57.528033 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:57.527998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" event={"ID":"9d600968-f6a7-4d2a-a388-8ef37ef65824","Type":"ContainerStarted","Data":"8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb"}
Jul 28 18:13:57.666409 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:57.666359    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:13:57.666865 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:57.666831    2561 patch_prober.go:28] interesting pod/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 28 18:13:57.666976 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:57.666894    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 28 18:13:58.667457 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:58.666953    2561 patch_prober.go:28] interesting pod/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 28 18:13:58.667457 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:58.667021    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 28 18:13:59.666320 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:59.666269    2561 patch_prober.go:28] interesting pod/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 28 18:13:59.667147 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:13:59.666637    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 28 18:14:00.666935 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:00.666889    2561 patch_prober.go:28] interesting pod/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 28 18:14:00.667645 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:00.667607    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 28 18:14:01.667389 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:01.666875    2561 patch_prober.go:28] interesting pod/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 28 18:14:01.667389 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:01.666949    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 28 18:14:02.669909 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:02.669870    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:14:02.670345 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:02.670201    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:14:02.671039 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:02.671016    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:14:16.648930 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.648891    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"]
Jul 28 18:14:16.652597 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.652574    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.663111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.663075    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1cce3e\"/\"openshift-service-ca.crt\""
Jul 28 18:14:16.663269 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.663075    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1cce3e\"/\"kube-root-ca.crt\""
Jul 28 18:14:16.666617 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.666598    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1cce3e\"/\"default-dockercfg-qph9d\""
Jul 28 18:14:16.666678 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.666644    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1cce3e\"/\"test-model-1cce3e-kserve-self-signed-certs\""
Jul 28 18:14:16.700518 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.700474    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"]
Jul 28 18:14:16.755562 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.755515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tmp-dir\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.755757 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.755572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-model-cache\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.755757 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.755656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-home\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.755757 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.755716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-dshm\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.755898 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.755769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd8tl\" (UniqueName: \"kubernetes.io/projected/14f7d023-d394-4c90-97be-d7e7d40c7f4e-kube-api-access-vd8tl\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.755898 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.755794    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tls-certs\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.856694 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.856654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-model-cache\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.856899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.856702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-home\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.856899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.856742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-dshm\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.856899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.856779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd8tl\" (UniqueName: \"kubernetes.io/projected/14f7d023-d394-4c90-97be-d7e7d40c7f4e-kube-api-access-vd8tl\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.856899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.856806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tls-certs\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.856899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.856880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tmp-dir\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.857241 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.857143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-model-cache\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.857241 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.857190    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-home\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.857318 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.857279    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tmp-dir\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.859277 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.859254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-dshm\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.859443 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.859424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tls-certs\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.867997 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.867971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd8tl\" (UniqueName: \"kubernetes.io/projected/14f7d023-d394-4c90-97be-d7e7d40c7f4e-kube-api-access-vd8tl\") pod \"test-model-1cce3e-kserve-76dc46bd9-xhksn\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") " pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:16.962158 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:16.962055    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:17.138815 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:17.138787    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"]
Jul 28 18:14:17.141458 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:14:17.141422    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14f7d023_d394_4c90_97be_d7e7d40c7f4e.slice/crio-9aba8a8b4533334876e9a86351cec6d6ffaaaad542200e94834fbb275137fe91 WatchSource:0}: Error finding container 9aba8a8b4533334876e9a86351cec6d6ffaaaad542200e94834fbb275137fe91: Status 404 returned error can't find the container with id 9aba8a8b4533334876e9a86351cec6d6ffaaaad542200e94834fbb275137fe91
Jul 28 18:14:17.633691 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:17.633648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn" event={"ID":"14f7d023-d394-4c90-97be-d7e7d40c7f4e","Type":"ContainerStarted","Data":"7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183"}
Jul 28 18:14:17.633920 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:17.633702    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn" event={"ID":"14f7d023-d394-4c90-97be-d7e7d40c7f4e","Type":"ContainerStarted","Data":"9aba8a8b4533334876e9a86351cec6d6ffaaaad542200e94834fbb275137fe91"}
Jul 28 18:14:17.678342 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:17.678286    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn" podStartSLOduration=1.678266271 podStartE2EDuration="1.678266271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:14:17.676977701 +0000 UTC m=+2398.277574548" watchObservedRunningTime="2026-07-28 18:14:17.678266271 +0000 UTC m=+2398.278863104"
Jul 28 18:14:19.988369 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:19.988335    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:14:19.996740 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:19.996712    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:14:26.962425 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:26.962377    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:26.962957 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:26.962458    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:26.975024 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:26.974994    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:14:27.694823 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:14:27.694787    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:15:55.801498 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:15:55.801459    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"]
Jul 28 18:16:07.864838 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:07.864800    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"]
Jul 28 18:16:07.865339 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:07.865048    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc" podUID="776e4115-d3d0-4203-b776-b294d793e8cb" containerName="payload-processing" containerID="cri-o://782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8" gracePeriod=30
Jul 28 18:16:07.873978 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:07.873945    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"]
Jul 28 18:16:07.874221 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:07.874171    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k" podUID="66761e71-aac7-45e3-847f-da3c08d5a111" containerName="payload-pre-processing" containerID="cri-o://f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd" gracePeriod=30
Jul 28 18:16:08.145056 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.145023    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:16:08.176068 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.176036    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:16:08.209126 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.209068    2561 generic.go:356] "Generic (PLEG): container finished" podID="776e4115-d3d0-4203-b776-b294d793e8cb" containerID="782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8" exitCode=0
Jul 28 18:16:08.209348 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.209154    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc" event={"ID":"776e4115-d3d0-4203-b776-b294d793e8cb","Type":"ContainerDied","Data":"782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8"}
Jul 28 18:16:08.209348 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.209176    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"
Jul 28 18:16:08.209348 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.209257    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc" event={"ID":"776e4115-d3d0-4203-b776-b294d793e8cb","Type":"ContainerDied","Data":"6f64fb134fee4ceab6a1e4b4dbbb08ea61fffd16ea668e13fd19e86fad523289"}
Jul 28 18:16:08.209348 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.209290    2561 scope.go:117] "RemoveContainer" containerID="782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8"
Jul 28 18:16:08.211051 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.211007    2561 generic.go:356] "Generic (PLEG): container finished" podID="66761e71-aac7-45e3-847f-da3c08d5a111" containerID="f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd" exitCode=0
Jul 28 18:16:08.211218 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.211072    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"
Jul 28 18:16:08.211218 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.211112    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k" event={"ID":"66761e71-aac7-45e3-847f-da3c08d5a111","Type":"ContainerDied","Data":"f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd"}
Jul 28 18:16:08.211218 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.211179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k" event={"ID":"66761e71-aac7-45e3-847f-da3c08d5a111","Type":"ContainerDied","Data":"5364c484e90fc61ca7e9bcfd44f2ecefb480bfc317cce0bea71e82695f46560a"}
Jul 28 18:16:08.219194 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.219152    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66761e71-aac7-45e3-847f-da3c08d5a111-plugins-config-volume\") pod \"66761e71-aac7-45e3-847f-da3c08d5a111\" (UID: \"66761e71-aac7-45e3-847f-da3c08d5a111\") "
Jul 28 18:16:08.219410 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.219229    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmvdx\" (UniqueName: \"kubernetes.io/projected/776e4115-d3d0-4203-b776-b294d793e8cb-kube-api-access-zmvdx\") pod \"776e4115-d3d0-4203-b776-b294d793e8cb\" (UID: \"776e4115-d3d0-4203-b776-b294d793e8cb\") "
Jul 28 18:16:08.219410 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.219278    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zccr\" (UniqueName: \"kubernetes.io/projected/66761e71-aac7-45e3-847f-da3c08d5a111-kube-api-access-4zccr\") pod \"66761e71-aac7-45e3-847f-da3c08d5a111\" (UID: \"66761e71-aac7-45e3-847f-da3c08d5a111\") "
Jul 28 18:16:08.219410 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.219390    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776e4115-d3d0-4203-b776-b294d793e8cb-plugins-config-volume\") pod \"776e4115-d3d0-4203-b776-b294d793e8cb\" (UID: \"776e4115-d3d0-4203-b776-b294d793e8cb\") "
Jul 28 18:16:08.219753 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.219706    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66761e71-aac7-45e3-847f-da3c08d5a111-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "66761e71-aac7-45e3-847f-da3c08d5a111" (UID: "66761e71-aac7-45e3-847f-da3c08d5a111"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:16:08.219915 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.219769    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/776e4115-d3d0-4203-b776-b294d793e8cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "776e4115-d3d0-4203-b776-b294d793e8cb" (UID: "776e4115-d3d0-4203-b776-b294d793e8cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:16:08.221327 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.221274    2561 scope.go:117] "RemoveContainer" containerID="782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8"
Jul 28 18:16:08.221704 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.221670    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66761e71-aac7-45e3-847f-da3c08d5a111-kube-api-access-4zccr" (OuterVolumeSpecName: "kube-api-access-4zccr") pod "66761e71-aac7-45e3-847f-da3c08d5a111" (UID: "66761e71-aac7-45e3-847f-da3c08d5a111"). InnerVolumeSpecName "kube-api-access-4zccr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:16:08.221833 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:16:08.221808    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8\": container with ID starting with 782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8 not found: ID does not exist" containerID="782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8"
Jul 28 18:16:08.221908 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.221842    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8"} err="failed to get container status \"782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8\": rpc error: code = NotFound desc = could not find container \"782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8\": container with ID starting with 782b544d14dc9cf85485b60ade815063479af95b1df3a219bcf7074d981060a8 not found: ID does not exist"
Jul 28 18:16:08.221908 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.221861    2561 scope.go:117] "RemoveContainer" containerID="f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd"
Jul 28 18:16:08.221908 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.221882    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/776e4115-d3d0-4203-b776-b294d793e8cb-kube-api-access-zmvdx" (OuterVolumeSpecName: "kube-api-access-zmvdx") pod "776e4115-d3d0-4203-b776-b294d793e8cb" (UID: "776e4115-d3d0-4203-b776-b294d793e8cb"). InnerVolumeSpecName "kube-api-access-zmvdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:16:08.230386 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.230364    2561 scope.go:117] "RemoveContainer" containerID="f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd"
Jul 28 18:16:08.230687 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:16:08.230669    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd\": container with ID starting with f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd not found: ID does not exist" containerID="f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd"
Jul 28 18:16:08.230739 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.230694    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd"} err="failed to get container status \"f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd\": rpc error: code = NotFound desc = could not find container \"f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd\": container with ID starting with f46a94df3648154d526309fb4d5f40bad278bd06f7aadbe5607cdcb8fe4364fd not found: ID does not exist"
Jul 28 18:16:08.320381 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.320331    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmvdx\" (UniqueName: \"kubernetes.io/projected/776e4115-d3d0-4203-b776-b294d793e8cb-kube-api-access-zmvdx\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:08.320381 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.320372    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zccr\" (UniqueName: \"kubernetes.io/projected/66761e71-aac7-45e3-847f-da3c08d5a111-kube-api-access-4zccr\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:08.320381 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.320385    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776e4115-d3d0-4203-b776-b294d793e8cb-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:08.320638 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.320398    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66761e71-aac7-45e3-847f-da3c08d5a111-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:08.536254 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.536216    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"]
Jul 28 18:16:08.541273 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.541240    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1cce3e-65bf6bd46-9xcqc"]
Jul 28 18:16:08.554976 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.554934    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"]
Jul 28 18:16:08.560018 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:08.559985    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cce3e-77dbd55d7b-8t84k"]
Jul 28 18:16:09.921386 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:09.921345    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66761e71-aac7-45e3-847f-da3c08d5a111" path="/var/lib/kubelet/pods/66761e71-aac7-45e3-847f-da3c08d5a111/volumes"
Jul 28 18:16:09.921799 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:09.921736    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="776e4115-d3d0-4203-b776-b294d793e8cb" path="/var/lib/kubelet/pods/776e4115-d3d0-4203-b776-b294d793e8cb/volumes"
Jul 28 18:16:10.821253 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:10.821207    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn" podUID="14f7d023-d394-4c90-97be-d7e7d40c7f4e" containerName="main" containerID="cri-o://7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183" gracePeriod=45
Jul 28 18:16:11.081418 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.081315    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:16:11.145705 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.145663    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-dshm\") pod \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") "
Jul 28 18:16:11.145899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.145755    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tmp-dir\") pod \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") "
Jul 28 18:16:11.145899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.145781    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-model-cache\") pod \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") "
Jul 28 18:16:11.145899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.145820    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-home\") pod \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") "
Jul 28 18:16:11.145899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.145847    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd8tl\" (UniqueName: \"kubernetes.io/projected/14f7d023-d394-4c90-97be-d7e7d40c7f4e-kube-api-access-vd8tl\") pod \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") "
Jul 28 18:16:11.145899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.145897    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tls-certs\") pod \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\" (UID: \"14f7d023-d394-4c90-97be-d7e7d40c7f4e\") "
Jul 28 18:16:11.146187 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.146074    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-model-cache" (OuterVolumeSpecName: "model-cache") pod "14f7d023-d394-4c90-97be-d7e7d40c7f4e" (UID: "14f7d023-d394-4c90-97be-d7e7d40c7f4e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:11.146187 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.146136    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "14f7d023-d394-4c90-97be-d7e7d40c7f4e" (UID: "14f7d023-d394-4c90-97be-d7e7d40c7f4e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:11.146187 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.146151    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-home" (OuterVolumeSpecName: "home") pod "14f7d023-d394-4c90-97be-d7e7d40c7f4e" (UID: "14f7d023-d394-4c90-97be-d7e7d40c7f4e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:11.146359 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.146344    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-home\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:11.146398 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.146362    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tmp-dir\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:11.146398 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.146373    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-model-cache\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:11.148246 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.148211    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "14f7d023-d394-4c90-97be-d7e7d40c7f4e" (UID: "14f7d023-d394-4c90-97be-d7e7d40c7f4e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:16:11.148399 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.148384    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-dshm" (OuterVolumeSpecName: "dshm") pod "14f7d023-d394-4c90-97be-d7e7d40c7f4e" (UID: "14f7d023-d394-4c90-97be-d7e7d40c7f4e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:11.148593 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.148566    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f7d023-d394-4c90-97be-d7e7d40c7f4e-kube-api-access-vd8tl" (OuterVolumeSpecName: "kube-api-access-vd8tl") pod "14f7d023-d394-4c90-97be-d7e7d40c7f4e" (UID: "14f7d023-d394-4c90-97be-d7e7d40c7f4e"). InnerVolumeSpecName "kube-api-access-vd8tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:16:11.229403 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.229360    2561 generic.go:356] "Generic (PLEG): container finished" podID="14f7d023-d394-4c90-97be-d7e7d40c7f4e" containerID="7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183" exitCode=0
Jul 28 18:16:11.229403 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.229408    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"
Jul 28 18:16:11.229626 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.229453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn" event={"ID":"14f7d023-d394-4c90-97be-d7e7d40c7f4e","Type":"ContainerDied","Data":"7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183"}
Jul 28 18:16:11.229626 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.229502    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn" event={"ID":"14f7d023-d394-4c90-97be-d7e7d40c7f4e","Type":"ContainerDied","Data":"9aba8a8b4533334876e9a86351cec6d6ffaaaad542200e94834fbb275137fe91"}
Jul 28 18:16:11.229626 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.229522    2561 scope.go:117] "RemoveContainer" containerID="7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183"
Jul 28 18:16:11.239191 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.239169    2561 scope.go:117] "RemoveContainer" containerID="7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183"
Jul 28 18:16:11.239490 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:16:11.239465    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183\": container with ID starting with 7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183 not found: ID does not exist" containerID="7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183"
Jul 28 18:16:11.239565 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.239501    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183"} err="failed to get container status \"7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183\": rpc error: code = NotFound desc = could not find container \"7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183\": container with ID starting with 7e7443b867519589739cab3c2165856267d38747121f53a33a54f1efb5b30183 not found: ID does not exist"
Jul 28 18:16:11.247328 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.247295    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14f7d023-d394-4c90-97be-d7e7d40c7f4e-dshm\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:11.247328 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.247326    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd8tl\" (UniqueName: \"kubernetes.io/projected/14f7d023-d394-4c90-97be-d7e7d40c7f4e-kube-api-access-vd8tl\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:11.247504 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.247338    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14f7d023-d394-4c90-97be-d7e7d40c7f4e-tls-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:11.255862 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.255830    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"]
Jul 28 18:16:11.261664 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.261634    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-1cce3e/test-model-1cce3e-kserve-76dc46bd9-xhksn"]
Jul 28 18:16:11.921037 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:11.920959    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14f7d023-d394-4c90-97be-d7e7d40c7f4e" path="/var/lib/kubelet/pods/14f7d023-d394-4c90-97be-d7e7d40c7f4e/volumes"
Jul 28 18:16:16.190035 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:16.190000    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"]
Jul 28 18:16:16.190494 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:16.190238    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy" containerID="cri-o://60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec" gracePeriod=30
Jul 28 18:16:16.243380 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:16.243336    2561 patch_prober.go:28] interesting pod/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 18:16:16.243544 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:16.243423    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 18:16:21.456807 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.456730    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:16:21.547871 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.547827    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-socket\") pod \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") "
Jul 28 18:16:21.548052 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.547891    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-podinfo\") pod \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") "
Jul 28 18:16:21.548052 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.547952    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w727d\" (UniqueName: \"kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-kube-api-access-w727d\") pod \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") "
Jul 28 18:16:21.548052 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548004    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-certs\") pod \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") "
Jul 28 18:16:21.548052 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548042    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istiod-ca-cert\") pod \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") "
Jul 28 18:16:21.548296 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548067    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-envoy\") pod \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") "
Jul 28 18:16:21.548296 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548108    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-token\") pod \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") "
Jul 28 18:16:21.548296 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548144    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-credential-socket\") pod \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") "
Jul 28 18:16:21.548296 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548193    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-data\") pod \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\" (UID: \"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6\") "
Jul 28 18:16:21.548296 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548197    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" (UID: "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:21.548571 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548365    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" (UID: "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:21.548571 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548425    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" (UID: "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:21.548571 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548519    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:21.548571 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548536    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:21.548778 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548577    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:21.548778 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.548699    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" (UID: "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:16:21.549048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.549027    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" (UID: "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:21.550243 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.550216    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" (UID: "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:16:21.550362 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.550293    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-kube-api-access-w727d" (OuterVolumeSpecName: "kube-api-access-w727d") pod "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" (UID: "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6"). InnerVolumeSpecName "kube-api-access-w727d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:16:21.550630 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.550607    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" (UID: "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:16:21.550702 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.550609    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" (UID: "3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:21.650062 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.650029    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:21.650062 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.650058    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w727d\" (UniqueName: \"kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-kube-api-access-w727d\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:21.650062 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.650068    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:21.650370 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.650077    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:21.650370 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.650085    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:21.650370 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:21.650111    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:22.286177 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.286135    2561 generic.go:356] "Generic (PLEG): container finished" podID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerID="60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec" exitCode=0
Jul 28 18:16:22.286367 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.286219    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" event={"ID":"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6","Type":"ContainerDied","Data":"60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec"}
Jul 28 18:16:22.286367 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.286235    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"
Jul 28 18:16:22.286367 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.286263    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj" event={"ID":"3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6","Type":"ContainerDied","Data":"715b7d98b5ff92f435b1bbb9f1a8591dcf9f78190df5cc0445fd6286e6641a9d"}
Jul 28 18:16:22.286367 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.286284    2561 scope.go:117] "RemoveContainer" containerID="60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec"
Jul 28 18:16:22.295266 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.295243    2561 scope.go:117] "RemoveContainer" containerID="3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7"
Jul 28 18:16:22.303879 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.303702    2561 scope.go:117] "RemoveContainer" containerID="60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec"
Jul 28 18:16:22.304062 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:16:22.304043    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec\": container with ID starting with 60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec not found: ID does not exist" containerID="60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec"
Jul 28 18:16:22.304125 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.304070    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec"} err="failed to get container status \"60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec\": rpc error: code = NotFound desc = could not find container \"60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec\": container with ID starting with 60280cfeb36abda219e4927e77416aa673b262203f723fdfb387967771367fec not found: ID does not exist"
Jul 28 18:16:22.304125 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.304105    2561 scope.go:117] "RemoveContainer" containerID="3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7"
Jul 28 18:16:22.304365 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:16:22.304345    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7\": container with ID starting with 3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7 not found: ID does not exist" containerID="3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7"
Jul 28 18:16:22.304402 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.304374    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7"} err="failed to get container status \"3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7\": rpc error: code = NotFound desc = could not find container \"3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7\": container with ID starting with 3edf30c998ccd6440b37b16b2a1aa3d0989c9860d865ca97faf23cb91c008bc7 not found: ID does not exist"
Jul 28 18:16:22.309067 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.309036    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"]
Jul 28 18:16:22.313597 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:22.313571    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1cce3e-openshift-default-5b7f6f578-f77wj"]
Jul 28 18:16:23.926544 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:23.926509    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" path="/var/lib/kubelet/pods/3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6/volumes"
Jul 28 18:16:29.609624 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:29.609586    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"]
Jul 28 18:16:29.610161 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:29.609796    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy" containerID="cri-o://8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb" gracePeriod=30
Jul 28 18:16:30.527984 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.527942    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"]
Jul 28 18:16:30.528336 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528321    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy"
Jul 28 18:16:30.528413 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528337    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy"
Jul 28 18:16:30.528413 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528347    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66761e71-aac7-45e3-847f-da3c08d5a111" containerName="payload-pre-processing"
Jul 28 18:16:30.528413 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528353    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="66761e71-aac7-45e3-847f-da3c08d5a111" containerName="payload-pre-processing"
Jul 28 18:16:30.528413 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528362    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy"
Jul 28 18:16:30.528413 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528369    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy"
Jul 28 18:16:30.528413 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528395    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14f7d023-d394-4c90-97be-d7e7d40c7f4e" containerName="main"
Jul 28 18:16:30.528413 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528405    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="14f7d023-d394-4c90-97be-d7e7d40c7f4e" containerName="main"
Jul 28 18:16:30.528413 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528415    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="776e4115-d3d0-4203-b776-b294d793e8cb" containerName="payload-processing"
Jul 28 18:16:30.528830 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528421    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="776e4115-d3d0-4203-b776-b294d793e8cb" containerName="payload-processing"
Jul 28 18:16:30.528830 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528474    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="14f7d023-d394-4c90-97be-d7e7d40c7f4e" containerName="main"
Jul 28 18:16:30.528830 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528483    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="776e4115-d3d0-4203-b776-b294d793e8cb" containerName="payload-processing"
Jul 28 18:16:30.528830 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528489    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy"
Jul 28 18:16:30.528830 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528496    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1eb1a8-27c7-47f3-9682-dd8de5d3d5c6" containerName="istio-proxy"
Jul 28 18:16:30.528830 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.528502    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="66761e71-aac7-45e3-847f-da3c08d5a111" containerName="payload-pre-processing"
Jul 28 18:16:30.531526 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.531504    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.534435 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.534415    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-7a2e6c-openshift-default-dockercfg-sgbqs\""
Jul 28 18:16:30.548988 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.548953    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"]
Jul 28 18:16:30.637321 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.637283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-envoy\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.637321 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.637327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-credential-socket\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.637901 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.637349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602a4dd4-c76c-4efc-ac67-c67a007612df-istiod-ca-cert\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.637901 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.637469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-certs\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.637901 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.637519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwbpc\" (UniqueName: \"kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-kube-api-access-fwbpc\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.637901 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.637557    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-data\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.637901 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.637633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-podinfo\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.637901 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.637658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-socket\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.637901 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.637682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-token\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.738612 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.738562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-envoy\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.738612 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.738619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-credential-socket\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.738853 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.738733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602a4dd4-c76c-4efc-ac67-c67a007612df-istiod-ca-cert\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.738853 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.738828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-certs\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.738947 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.738862    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwbpc\" (UniqueName: \"kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-kube-api-access-fwbpc\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.738947 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.738899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-data\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.739289 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.739114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-credential-socket\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.739289 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.738984    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-podinfo\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.739289 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.739173    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-certs\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.739289 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.739208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-socket\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.739289 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.739236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-token\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.739638 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.739374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-data\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.739638 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.739521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602a4dd4-c76c-4efc-ac67-c67a007612df-istiod-ca-cert\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.739638 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.739551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-socket\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.741321 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.741297    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-envoy\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.741681 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.741658    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-podinfo\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.748999 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.748962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-token\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.749258 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.749237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwbpc\" (UniqueName: \"kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-kube-api-access-fwbpc\") pod \"e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") " pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.842202 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.842051    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:30.998053 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:30.998009    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"]
Jul 28 18:16:31.004787 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:16:31.004757    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602a4dd4_c76c_4efc_ac67_c67a007612df.slice/crio-e2aab78366c6062f4ddb5988cbc82ee3d3f916a740aa2f32e8900b16c6484377 WatchSource:0}: Error finding container e2aab78366c6062f4ddb5988cbc82ee3d3f916a740aa2f32e8900b16c6484377: Status 404 returned error can't find the container with id e2aab78366c6062f4ddb5988cbc82ee3d3f916a740aa2f32e8900b16c6484377
Jul 28 18:16:31.007279 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:31.007243    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:16:31.007350 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:31.007318    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:16:31.007350 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:31.007345    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:16:31.333517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:31.333478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" event={"ID":"602a4dd4-c76c-4efc-ac67-c67a007612df","Type":"ContainerStarted","Data":"c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e"}
Jul 28 18:16:31.333731 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:31.333538    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" event={"ID":"602a4dd4-c76c-4efc-ac67-c67a007612df","Type":"ContainerStarted","Data":"e2aab78366c6062f4ddb5988cbc82ee3d3f916a740aa2f32e8900b16c6484377"}
Jul 28 18:16:31.359668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:31.359616    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" podStartSLOduration=1.359600538 podStartE2EDuration="1.359600538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:16:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:16:31.357445634 +0000 UTC m=+2531.958042466" watchObservedRunningTime="2026-07-28 18:16:31.359600538 +0000 UTC m=+2531.960197370"
Jul 28 18:16:31.842218 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:31.842177    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:32.673178 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:32.673138    2561 patch_prober.go:28] interesting pod/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 18:16:32.673363 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:32.673199    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 18:16:32.847144 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:32.847113    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:33.342476 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:33.342449    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:33.343387 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:33.343364    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:34.871224 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.871145    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:16:34.981517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981479    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-podinfo\") pod \"9d600968-f6a7-4d2a-a388-8ef37ef65824\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") "
Jul 28 18:16:34.981517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981531    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-certs\") pod \"9d600968-f6a7-4d2a-a388-8ef37ef65824\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") "
Jul 28 18:16:34.981823 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981575    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-socket\") pod \"9d600968-f6a7-4d2a-a388-8ef37ef65824\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") "
Jul 28 18:16:34.981823 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981598    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-token\") pod \"9d600968-f6a7-4d2a-a388-8ef37ef65824\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") "
Jul 28 18:16:34.981823 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981628    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-credential-socket\") pod \"9d600968-f6a7-4d2a-a388-8ef37ef65824\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") "
Jul 28 18:16:34.981823 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r27lv\" (UniqueName: \"kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-kube-api-access-r27lv\") pod \"9d600968-f6a7-4d2a-a388-8ef37ef65824\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") "
Jul 28 18:16:34.981823 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-envoy\") pod \"9d600968-f6a7-4d2a-a388-8ef37ef65824\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") "
Jul 28 18:16:34.982079 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981877    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d600968-f6a7-4d2a-a388-8ef37ef65824-istiod-ca-cert\") pod \"9d600968-f6a7-4d2a-a388-8ef37ef65824\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") "
Jul 28 18:16:34.982079 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981938    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d600968-f6a7-4d2a-a388-8ef37ef65824" (UID: "9d600968-f6a7-4d2a-a388-8ef37ef65824"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:34.982079 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981950    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d600968-f6a7-4d2a-a388-8ef37ef65824" (UID: "9d600968-f6a7-4d2a-a388-8ef37ef65824"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:34.982079 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.981945    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-data\") pod \"9d600968-f6a7-4d2a-a388-8ef37ef65824\" (UID: \"9d600968-f6a7-4d2a-a388-8ef37ef65824\") "
Jul 28 18:16:34.982330 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.982115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d600968-f6a7-4d2a-a388-8ef37ef65824" (UID: "9d600968-f6a7-4d2a-a388-8ef37ef65824"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:34.982330 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.982310    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d600968-f6a7-4d2a-a388-8ef37ef65824-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d600968-f6a7-4d2a-a388-8ef37ef65824" (UID: "9d600968-f6a7-4d2a-a388-8ef37ef65824"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:16:34.982451 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.982363    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:34.982451 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.982382    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:34.982451 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.982396    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:34.983164 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.983140    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d600968-f6a7-4d2a-a388-8ef37ef65824" (UID: "9d600968-f6a7-4d2a-a388-8ef37ef65824"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:34.984424 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.984396    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d600968-f6a7-4d2a-a388-8ef37ef65824" (UID: "9d600968-f6a7-4d2a-a388-8ef37ef65824"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:16:34.984424 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.984409    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-kube-api-access-r27lv" (OuterVolumeSpecName: "kube-api-access-r27lv") pod "9d600968-f6a7-4d2a-a388-8ef37ef65824" (UID: "9d600968-f6a7-4d2a-a388-8ef37ef65824"). InnerVolumeSpecName "kube-api-access-r27lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:16:34.984578 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.984566    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d600968-f6a7-4d2a-a388-8ef37ef65824" (UID: "9d600968-f6a7-4d2a-a388-8ef37ef65824"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:16:34.984623 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:34.984582    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d600968-f6a7-4d2a-a388-8ef37ef65824" (UID: "9d600968-f6a7-4d2a-a388-8ef37ef65824"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:16:35.083504 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.083460    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r27lv\" (UniqueName: \"kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-kube-api-access-r27lv\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:35.083504 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.083491    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:35.083504 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.083501    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d600968-f6a7-4d2a-a388-8ef37ef65824-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:35.083504 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.083509    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:35.083504 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.083517    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:35.083816 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.083525    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d600968-f6a7-4d2a-a388-8ef37ef65824-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:16:35.353629 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.353599    2561 generic.go:356] "Generic (PLEG): container finished" podID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerID="8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb" exitCode=0
Jul 28 18:16:35.353819 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.353646    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"
Jul 28 18:16:35.353819 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.353681    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" event={"ID":"9d600968-f6a7-4d2a-a388-8ef37ef65824","Type":"ContainerDied","Data":"8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb"}
Jul 28 18:16:35.353819 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.353732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7" event={"ID":"9d600968-f6a7-4d2a-a388-8ef37ef65824","Type":"ContainerDied","Data":"bf729bc194da081b41b8ff184d80c998dcf879cc8216e8b7c4025fd2e3ebde33"}
Jul 28 18:16:35.353819 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.353755    2561 scope.go:117] "RemoveContainer" containerID="8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb"
Jul 28 18:16:35.362679 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.362663    2561 scope.go:117] "RemoveContainer" containerID="20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de"
Jul 28 18:16:35.370817 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.370789    2561 scope.go:117] "RemoveContainer" containerID="8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb"
Jul 28 18:16:35.371081 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:16:35.371062    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb\": container with ID starting with 8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb not found: ID does not exist" containerID="8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb"
Jul 28 18:16:35.371168 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.371115    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb"} err="failed to get container status \"8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb\": rpc error: code = NotFound desc = could not find container \"8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb\": container with ID starting with 8aaabb0c3ac75e2be8fbfe9f16cf456d14ae359234ce2e956a86c992557910eb not found: ID does not exist"
Jul 28 18:16:35.371168 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.371142    2561 scope.go:117] "RemoveContainer" containerID="20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de"
Jul 28 18:16:35.371404 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:16:35.371385    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de\": container with ID starting with 20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de not found: ID does not exist" containerID="20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de"
Jul 28 18:16:35.371442 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.371410    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de"} err="failed to get container status \"20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de\": rpc error: code = NotFound desc = could not find container \"20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de\": container with ID starting with 20cf435089e8a1ed5fd4f0e80a6f8547aef120a931a475c18495c827e22fe4de not found: ID does not exist"
Jul 28 18:16:35.377572 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.377551    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"]
Jul 28 18:16:35.385967 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.385947    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-95c506-openshift-default-8457c947f6-84ll7"]
Jul 28 18:16:35.920750 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:35.920717    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" path="/var/lib/kubelet/pods/9d600968-f6a7-4d2a-a388-8ef37ef65824/volumes"
Jul 28 18:16:48.846737 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:48.845994    2561 patch_prober.go:28] interesting pod/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": read tcp 10.132.0.2:41528->10.132.0.67:15021: read: connection reset by peer" start-of-body=
Jul 28 18:16:48.846737 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:48.846128    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": read tcp 10.132.0.2:41528->10.132.0.67:15021: read: connection reset by peer"
Jul 28 18:16:49.425654 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:49.425619    2561 generic.go:356] "Generic (PLEG): container finished" podID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerID="c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e" exitCode=0
Jul 28 18:16:49.425847 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:49.425699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" event={"ID":"602a4dd4-c76c-4efc-ac67-c67a007612df","Type":"ContainerDied","Data":"c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e"}
Jul 28 18:16:49.426134 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:49.426120    2561 scope.go:117] "RemoveContainer" containerID="c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e"
Jul 28 18:16:49.427251 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:49.427223    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:16:49.427315 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:49.427291    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:16:49.427356 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:49.427323    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:16:50.432441 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:50.432398    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" event={"ID":"602a4dd4-c76c-4efc-ac67-c67a007612df","Type":"ContainerStarted","Data":"584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad"}
Jul 28 18:16:50.842357 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:50.842310    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:50.842674 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:50.842652    2561 patch_prober.go:28] interesting pod/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 28 18:16:50.842724 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:50.842703    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 28 18:16:51.842828 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:51.842780    2561 patch_prober.go:28] interesting pod/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 28 18:16:51.843317 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:51.842855    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 28 18:16:52.843372 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:52.843329    2561 patch_prober.go:28] interesting pod/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 28 18:16:52.843876 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:52.843395    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 28 18:16:53.843222 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:53.843179    2561 patch_prober.go:28] interesting pod/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 28 18:16:53.843418 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:53.843242    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 28 18:16:54.846421 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:54.846387    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:54.846857 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:54.846783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:54.847684 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:54.847667    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:16:59.312943 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.312901    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"]
Jul 28 18:16:59.313417 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.313353    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy"
Jul 28 18:16:59.313417 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.313368    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy"
Jul 28 18:16:59.313417 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.313378    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy"
Jul 28 18:16:59.313417 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.313387    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy"
Jul 28 18:16:59.313556 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.313449    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy"
Jul 28 18:16:59.313556 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.313458    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d600968-f6a7-4d2a-a388-8ef37ef65824" containerName="istio-proxy"
Jul 28 18:16:59.316492 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.316471    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.319360 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.319333    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1ff6f1-openshift-default-dockercfg-nglp2\""
Jul 28 18:16:59.330436 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.330404    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"]
Jul 28 18:16:59.415123 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.415054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-credential-socket\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.415338 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.415154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-envoy\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.415338 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.415229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-certs\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.415338 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.415258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4890a941-860c-4ccc-9392-576130156fc6-istio-podinfo\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.415523 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.415372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4890a941-860c-4ccc-9392-576130156fc6-istiod-ca-cert\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.415523 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.415450    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-istio-token\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.415523 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.415512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-data\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.415688 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.415551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-socket\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.415688 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.415580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmgbx\" (UniqueName: \"kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-kube-api-access-xmgbx\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.516531 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.516475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4890a941-860c-4ccc-9392-576130156fc6-istiod-ca-cert\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.516531 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.516534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-istio-token\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.516876 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.516582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-data\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.516876 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.516618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-socket\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.516876 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.516647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmgbx\" (UniqueName: \"kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-kube-api-access-xmgbx\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.516876 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.516685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-credential-socket\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.516876 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.516713    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-envoy\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.516876 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.516792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-certs\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.517237 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.517060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-socket\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.517237 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.517118    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-data\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.517237 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.517184    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-credential-socket\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.517237 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.516884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4890a941-860c-4ccc-9392-576130156fc6-istio-podinfo\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.517438 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.517367    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-certs\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.517633 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.517611    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4890a941-860c-4ccc-9392-576130156fc6-istiod-ca-cert\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.519230 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.519202    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-envoy\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.519430 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.519413    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4890a941-860c-4ccc-9392-576130156fc6-istio-podinfo\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.527021 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.526986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-istio-token\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.527278 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.527248    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmgbx\" (UniqueName: \"kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-kube-api-access-xmgbx\") pod \"e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") " pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.627983 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.627880    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:16:59.786441 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.786407    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"]
Jul 28 18:16:59.793002 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.792956    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:16:59.793138 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.793054    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:16:59.793138 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:16:59.793124    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:17:00.480784 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:00.480742    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" event={"ID":"4890a941-860c-4ccc-9392-576130156fc6","Type":"ContainerStarted","Data":"abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df"}
Jul 28 18:17:00.481280 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:00.480801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" event={"ID":"4890a941-860c-4ccc-9392-576130156fc6","Type":"ContainerStarted","Data":"90d0499fde5dca12b05c83573c37200289f05a2a57b9e759d811387d7d858368"}
Jul 28 18:17:00.506211 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:00.506144    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" podStartSLOduration=1.506124977 podStartE2EDuration="1.506124977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:16:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:17:00.505920145 +0000 UTC m=+2561.106517019" watchObservedRunningTime="2026-07-28 18:17:00.506124977 +0000 UTC m=+2561.106721810"
Jul 28 18:17:00.628531 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:00.628496    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:17:00.633724 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:00.633694    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:17:01.485551 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:01.485518    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:17:01.486701 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:01.486677    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:17:03.499447 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.499410    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"]
Jul 28 18:17:03.503703 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.503676    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:17:03.506882 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.506849    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-1ff6f1\""
Jul 28 18:17:03.507051 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.506967    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-1ff6f1-dockercfg-x5w5h\""
Jul 28 18:17:03.515228 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.515191    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"]
Jul 28 18:17:03.658229 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.658181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49wx\" (UniqueName: \"kubernetes.io/projected/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-kube-api-access-k49wx\") pod \"payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz\" (UID: \"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d\") " pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:17:03.658449 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.658288    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz\" (UID: \"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d\") " pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:17:03.759563 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.759465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49wx\" (UniqueName: \"kubernetes.io/projected/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-kube-api-access-k49wx\") pod \"payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz\" (UID: \"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d\") " pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:17:03.759563 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.759535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz\" (UID: \"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d\") " pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:17:03.760330 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.760310    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz\" (UID: \"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d\") " pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:17:03.769748 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.769715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49wx\" (UniqueName: \"kubernetes.io/projected/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-kube-api-access-k49wx\") pod \"payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz\" (UID: \"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d\") " pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:17:03.817744 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.817707    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:17:03.967382 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:03.967354    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"]
Jul 28 18:17:03.969771 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:17:03.969743    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b95800e_5a97_4ebb_bcfc_df9a2aa2739d.slice/crio-12329161c0fe1addb4adf0594d33f73b4876081bada7e66da7b9cff68ac45369 WatchSource:0}: Error finding container 12329161c0fe1addb4adf0594d33f73b4876081bada7e66da7b9cff68ac45369: Status 404 returned error can't find the container with id 12329161c0fe1addb4adf0594d33f73b4876081bada7e66da7b9cff68ac45369
Jul 28 18:17:04.502563 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:04.502523    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz" event={"ID":"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d","Type":"ContainerStarted","Data":"a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1"}
Jul 28 18:17:04.503075 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:04.502588    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz" event={"ID":"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d","Type":"ContainerStarted","Data":"12329161c0fe1addb4adf0594d33f73b4876081bada7e66da7b9cff68ac45369"}
Jul 28 18:17:04.503075 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:04.502701    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:17:04.522778 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:04.522722    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz" podStartSLOduration=1.5227068990000001 podStartE2EDuration="1.522706899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:17:04.52144953 +0000 UTC m=+2565.122046364" watchObservedRunningTime="2026-07-28 18:17:04.522706899 +0000 UTC m=+2565.123303741"
Jul 28 18:17:15.510369 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:15.510333    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:17:17.527314 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:17.527267    2561 patch_prober.go:28] interesting pod/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 18:17:17.527728 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:17.527338    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 18:17:18.575396 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:18.575305    2561 generic.go:356] "Generic (PLEG): container finished" podID="4890a941-860c-4ccc-9392-576130156fc6" containerID="abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df" exitCode=0
Jul 28 18:17:18.575396 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:18.575354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" event={"ID":"4890a941-860c-4ccc-9392-576130156fc6","Type":"ContainerDied","Data":"abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df"}
Jul 28 18:17:18.575983 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:18.575887    2561 scope.go:117] "RemoveContainer" containerID="abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df"
Jul 28 18:17:18.576997 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:18.576966    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:17:18.577061 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:18.577039    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:17:18.577111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:18.577074    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:17:19.582123 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:19.582064    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" event={"ID":"4890a941-860c-4ccc-9392-576130156fc6","Type":"ContainerStarted","Data":"c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4"}
Jul 28 18:17:19.628724 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:19.628681    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:17:19.628963 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:19.628940    2561 patch_prober.go:28] interesting pod/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 18:17:19.629020 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:19.628989    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 18:17:20.628508 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:20.628471    2561 patch_prober.go:28] interesting pod/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 18:17:20.628922 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:20.628528    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 18:17:21.628768 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:21.628724    2561 patch_prober.go:28] interesting pod/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 18:17:21.629192 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:21.628814    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 18:17:22.629343 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:22.629298    2561 patch_prober.go:28] interesting pod/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 18:17:22.629760 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:22.629373    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 18:17:23.628713 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:23.628680    2561 patch_prober.go:28] interesting pod/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 18:17:23.628897 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:23.628739    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 18:17:24.633765 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:24.633730    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:17:24.634203 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:24.634108    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:17:24.635113 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:17:24.635068    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:18:00.177563 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:00.177478    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"]
Jul 28 18:18:00.178129 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:00.177722    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy" containerID="cri-o://584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad" gracePeriod=30
Jul 28 18:18:05.448009 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.447943    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:18:05.528202 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528169    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602a4dd4-c76c-4efc-ac67-c67a007612df-istiod-ca-cert\") pod \"602a4dd4-c76c-4efc-ac67-c67a007612df\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") "
Jul 28 18:18:05.528202 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528203    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-data\") pod \"602a4dd4-c76c-4efc-ac67-c67a007612df\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") "
Jul 28 18:18:05.528538 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528239    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-envoy\") pod \"602a4dd4-c76c-4efc-ac67-c67a007612df\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") "
Jul 28 18:18:05.528538 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528254    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-credential-socket\") pod \"602a4dd4-c76c-4efc-ac67-c67a007612df\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") "
Jul 28 18:18:05.528538 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528385    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-token\") pod \"602a4dd4-c76c-4efc-ac67-c67a007612df\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") "
Jul 28 18:18:05.528538 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528460    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwbpc\" (UniqueName: \"kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-kube-api-access-fwbpc\") pod \"602a4dd4-c76c-4efc-ac67-c67a007612df\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") "
Jul 28 18:18:05.528538 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528494    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-socket\") pod \"602a4dd4-c76c-4efc-ac67-c67a007612df\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") "
Jul 28 18:18:05.528538 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528519    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "602a4dd4-c76c-4efc-ac67-c67a007612df" (UID: "602a4dd4-c76c-4efc-ac67-c67a007612df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:18:05.528843 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528540    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-podinfo\") pod \"602a4dd4-c76c-4efc-ac67-c67a007612df\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") "
Jul 28 18:18:05.528843 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528606    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-certs\") pod \"602a4dd4-c76c-4efc-ac67-c67a007612df\" (UID: \"602a4dd4-c76c-4efc-ac67-c67a007612df\") "
Jul 28 18:18:05.528843 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528647    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602a4dd4-c76c-4efc-ac67-c67a007612df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "602a4dd4-c76c-4efc-ac67-c67a007612df" (UID: "602a4dd4-c76c-4efc-ac67-c67a007612df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:18:05.528998 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528905    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602a4dd4-c76c-4efc-ac67-c67a007612df-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:05.528998 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528923    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:05.528998 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.528927    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "602a4dd4-c76c-4efc-ac67-c67a007612df" (UID: "602a4dd4-c76c-4efc-ac67-c67a007612df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:18:05.529192 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.529142    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "602a4dd4-c76c-4efc-ac67-c67a007612df" (UID: "602a4dd4-c76c-4efc-ac67-c67a007612df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:18:05.529383 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.529351    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-data" (OuterVolumeSpecName: "istio-data") pod "602a4dd4-c76c-4efc-ac67-c67a007612df" (UID: "602a4dd4-c76c-4efc-ac67-c67a007612df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:18:05.531049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.531018    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "602a4dd4-c76c-4efc-ac67-c67a007612df" (UID: "602a4dd4-c76c-4efc-ac67-c67a007612df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:18:05.531186 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.531142    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-token" (OuterVolumeSpecName: "istio-token") pod "602a4dd4-c76c-4efc-ac67-c67a007612df" (UID: "602a4dd4-c76c-4efc-ac67-c67a007612df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:18:05.531239 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.531181    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "602a4dd4-c76c-4efc-ac67-c67a007612df" (UID: "602a4dd4-c76c-4efc-ac67-c67a007612df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:18:05.531277 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.531249    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-kube-api-access-fwbpc" (OuterVolumeSpecName: "kube-api-access-fwbpc") pod "602a4dd4-c76c-4efc-ac67-c67a007612df" (UID: "602a4dd4-c76c-4efc-ac67-c67a007612df"). InnerVolumeSpecName "kube-api-access-fwbpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:18:05.629945 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.629914    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:05.629945 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.629940    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:05.629945 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.629948    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:05.629945 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.629957    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:05.630241 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.629966    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwbpc\" (UniqueName: \"kubernetes.io/projected/602a4dd4-c76c-4efc-ac67-c67a007612df-kube-api-access-fwbpc\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:05.630241 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.629974    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602a4dd4-c76c-4efc-ac67-c67a007612df-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:05.630241 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.629982    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602a4dd4-c76c-4efc-ac67-c67a007612df-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:05.806435 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.806399    2561 generic.go:356] "Generic (PLEG): container finished" podID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerID="584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad" exitCode=0
Jul 28 18:18:05.806618 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.806452    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"
Jul 28 18:18:05.806618 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.806489    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" event={"ID":"602a4dd4-c76c-4efc-ac67-c67a007612df","Type":"ContainerDied","Data":"584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad"}
Jul 28 18:18:05.806618 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.806545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv" event={"ID":"602a4dd4-c76c-4efc-ac67-c67a007612df","Type":"ContainerDied","Data":"e2aab78366c6062f4ddb5988cbc82ee3d3f916a740aa2f32e8900b16c6484377"}
Jul 28 18:18:05.806618 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.806568    2561 scope.go:117] "RemoveContainer" containerID="584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad"
Jul 28 18:18:05.816361 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.816341    2561 scope.go:117] "RemoveContainer" containerID="c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e"
Jul 28 18:18:05.825329 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.825307    2561 scope.go:117] "RemoveContainer" containerID="584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad"
Jul 28 18:18:05.825598 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:18:05.825576    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad\": container with ID starting with 584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad not found: ID does not exist" containerID="584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad"
Jul 28 18:18:05.825651 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.825606    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad"} err="failed to get container status \"584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad\": rpc error: code = NotFound desc = could not find container \"584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad\": container with ID starting with 584d9a507f0eced599c87ea0d202a7a23839ba002e22d5b43bc9d03e1d94a4ad not found: ID does not exist"
Jul 28 18:18:05.825651 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.825624    2561 scope.go:117] "RemoveContainer" containerID="c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e"
Jul 28 18:18:05.825834 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:18:05.825817    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e\": container with ID starting with c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e not found: ID does not exist" containerID="c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e"
Jul 28 18:18:05.825872 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.825839    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e"} err="failed to get container status \"c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e\": rpc error: code = NotFound desc = could not find container \"c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e\": container with ID starting with c6a40d069a2cadc2554b8ed72b5ed466615c1ff9da05774976166bffab6d9e7e not found: ID does not exist"
Jul 28 18:18:05.832246 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.832216    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"]
Jul 28 18:18:05.834315 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.834289    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-7a2e6c-openshift-default-6d4546457b-4prrv"]
Jul 28 18:18:05.920175 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:05.920142    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" path="/var/lib/kubelet/pods/602a4dd4-c76c-4efc-ac67-c67a007612df/volumes"
Jul 28 18:18:11.321125 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.321065    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"]
Jul 28 18:18:11.321547 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.321310    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz" podUID="0b95800e-5a97-4ebb-bcfc-df9a2aa2739d" containerName="payload-processing" containerID="cri-o://a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1" gracePeriod=30
Jul 28 18:18:11.579965 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.579886    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:18:11.682578 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.682537    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k49wx\" (UniqueName: \"kubernetes.io/projected/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-kube-api-access-k49wx\") pod \"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d\" (UID: \"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d\") "
Jul 28 18:18:11.682807 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.682597    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-plugins-config-volume\") pod \"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d\" (UID: \"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d\") "
Jul 28 18:18:11.683015 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.682986    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b95800e-5a97-4ebb-bcfc-df9a2aa2739d" (UID: "0b95800e-5a97-4ebb-bcfc-df9a2aa2739d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:18:11.684687 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.684663    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-kube-api-access-k49wx" (OuterVolumeSpecName: "kube-api-access-k49wx") pod "0b95800e-5a97-4ebb-bcfc-df9a2aa2739d" (UID: "0b95800e-5a97-4ebb-bcfc-df9a2aa2739d"). InnerVolumeSpecName "kube-api-access-k49wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:18:11.783686 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.783631    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k49wx\" (UniqueName: \"kubernetes.io/projected/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-kube-api-access-k49wx\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:11.783686 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.783677    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:11.836970 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.836858    2561 generic.go:356] "Generic (PLEG): container finished" podID="0b95800e-5a97-4ebb-bcfc-df9a2aa2739d" containerID="a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1" exitCode=0
Jul 28 18:18:11.836970 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.836918    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"
Jul 28 18:18:11.836970 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.836927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz" event={"ID":"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d","Type":"ContainerDied","Data":"a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1"}
Jul 28 18:18:11.836970 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.836969    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz" event={"ID":"0b95800e-5a97-4ebb-bcfc-df9a2aa2739d","Type":"ContainerDied","Data":"12329161c0fe1addb4adf0594d33f73b4876081bada7e66da7b9cff68ac45369"}
Jul 28 18:18:11.837358 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.836993    2561 scope.go:117] "RemoveContainer" containerID="a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1"
Jul 28 18:18:11.846617 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.846594    2561 scope.go:117] "RemoveContainer" containerID="a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1"
Jul 28 18:18:11.846961 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:18:11.846939    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1\": container with ID starting with a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1 not found: ID does not exist" containerID="a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1"
Jul 28 18:18:11.847015 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.846971    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1"} err="failed to get container status \"a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1\": rpc error: code = NotFound desc = could not find container \"a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1\": container with ID starting with a0e4b5b431d700dc9d1bb0c61170e7b7c48751178c03cad6625e17b651eaa8d1 not found: ID does not exist"
Jul 28 18:18:11.861866 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.861833    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"]
Jul 28 18:18:11.870868 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.870828    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1ff6f1-67b5d9bf4b-hp4hz"]
Jul 28 18:18:11.921221 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:11.921186    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b95800e-5a97-4ebb-bcfc-df9a2aa2739d" path="/var/lib/kubelet/pods/0b95800e-5a97-4ebb-bcfc-df9a2aa2739d/volumes"
Jul 28 18:18:20.060404 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:20.060360    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"]
Jul 28 18:18:20.060854 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:20.060633    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy" containerID="cri-o://c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4" gracePeriod=30
Jul 28 18:18:21.151640 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.151602    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"]
Jul 28 18:18:21.152273 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.151961    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b95800e-5a97-4ebb-bcfc-df9a2aa2739d" containerName="payload-processing"
Jul 28 18:18:21.152273 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.151973    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b95800e-5a97-4ebb-bcfc-df9a2aa2739d" containerName="payload-processing"
Jul 28 18:18:21.152273 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.151988    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy"
Jul 28 18:18:21.152273 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.151993    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy"
Jul 28 18:18:21.152273 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.152055    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy"
Jul 28 18:18:21.152273 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.152064    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b95800e-5a97-4ebb-bcfc-df9a2aa2739d" containerName="payload-processing"
Jul 28 18:18:21.156638 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.156615    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.159819 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.159791    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9b5b66-openshift-default-dockercfg-f7zvq\""
Jul 28 18:18:21.177483 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.177438    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"]
Jul 28 18:18:21.274588 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.274536    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-token\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.275048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.274610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-data\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.275048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.274637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c760866f-27dd-4ccf-9816-d5dc0fa21161-istiod-ca-cert\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.275048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.274855    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-podinfo\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.275048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.274899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-certs\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.275048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.274927    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr68c\" (UniqueName: \"kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-kube-api-access-nr68c\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.275048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.274956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-socket\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.275515 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.275160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-credential-socket\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.275515 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.275214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-envoy\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376009 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.375960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-data\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376009 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c760866f-27dd-4ccf-9816-d5dc0fa21161-istiod-ca-cert\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376325 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-podinfo\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376325 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-certs\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376325 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr68c\" (UniqueName: \"kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-kube-api-access-nr68c\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376325 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-socket\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376325 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-credential-socket\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376325 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-envoy\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376325 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-token\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376715 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376625    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-socket\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376715 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-credential-socket\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-data\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-certs\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.376832 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.376814    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c760866f-27dd-4ccf-9816-d5dc0fa21161-istiod-ca-cert\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.378637 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.378611    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-envoy\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.378894 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.378875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-podinfo\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.389756 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.389722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-token\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.390047 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.390026    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr68c\" (UniqueName: \"kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-kube-api-access-nr68c\") pod \"e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") " pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.472986 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.472893    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:21.629345 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.629311    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"]
Jul 28 18:18:21.631236 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:18:21.631202    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc760866f_27dd_4ccf_9816_d5dc0fa21161.slice/crio-a0b46a96f717e3683f3cd4fe434b85a40fd163c115f6b7bac0c4ce93a404f5df WatchSource:0}: Error finding container a0b46a96f717e3683f3cd4fe434b85a40fd163c115f6b7bac0c4ce93a404f5df: Status 404 returned error can't find the container with id a0b46a96f717e3683f3cd4fe434b85a40fd163c115f6b7bac0c4ce93a404f5df
Jul 28 18:18:21.633523 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.633479    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:21.633623 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.633559    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:21.633623 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.633592    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:21.887434 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.887396    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" event={"ID":"c760866f-27dd-4ccf-9816-d5dc0fa21161","Type":"ContainerStarted","Data":"97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d"}
Jul 28 18:18:21.887644 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.887455    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" event={"ID":"c760866f-27dd-4ccf-9816-d5dc0fa21161","Type":"ContainerStarted","Data":"a0b46a96f717e3683f3cd4fe434b85a40fd163c115f6b7bac0c4ce93a404f5df"}
Jul 28 18:18:21.924572 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:21.924508    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" podStartSLOduration=0.924489526 podStartE2EDuration="924.489526ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:18:21.921674632 +0000 UTC m=+2642.522271466" watchObservedRunningTime="2026-07-28 18:18:21.924489526 +0000 UTC m=+2642.525086360"
Jul 28 18:18:22.473683 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:22.473649    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:22.478687 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:22.478659    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:22.892188 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:22.892154    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:22.893301 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:22.893278    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:24.636692 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:24.636649    2561 patch_prober.go:28] interesting pod/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 18:18:24.637174 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:24.636713    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 18:18:25.347567 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.347531    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:18:25.411945 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.411896    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-credential-socket\") pod \"4890a941-860c-4ccc-9392-576130156fc6\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") "
Jul 28 18:18:25.411945 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.411934    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-istio-token\") pod \"4890a941-860c-4ccc-9392-576130156fc6\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") "
Jul 28 18:18:25.412802 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.411992    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4890a941-860c-4ccc-9392-576130156fc6-istiod-ca-cert\") pod \"4890a941-860c-4ccc-9392-576130156fc6\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") "
Jul 28 18:18:25.412802 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.412018    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmgbx\" (UniqueName: \"kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-kube-api-access-xmgbx\") pod \"4890a941-860c-4ccc-9392-576130156fc6\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") "
Jul 28 18:18:25.412802 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.412047    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-certs\") pod \"4890a941-860c-4ccc-9392-576130156fc6\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") "
Jul 28 18:18:25.412802 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.412340    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4890a941-860c-4ccc-9392-576130156fc6-istio-podinfo\") pod \"4890a941-860c-4ccc-9392-576130156fc6\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") "
Jul 28 18:18:25.412802 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.412485    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4890a941-860c-4ccc-9392-576130156fc6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4890a941-860c-4ccc-9392-576130156fc6" (UID: "4890a941-860c-4ccc-9392-576130156fc6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:18:25.412802 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.412600    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-envoy\") pod \"4890a941-860c-4ccc-9392-576130156fc6\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") "
Jul 28 18:18:25.412802 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.412700    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4890a941-860c-4ccc-9392-576130156fc6" (UID: "4890a941-860c-4ccc-9392-576130156fc6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:18:25.414540 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.412652    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-socket\") pod \"4890a941-860c-4ccc-9392-576130156fc6\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") "
Jul 28 18:18:25.414540 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.413864    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-data\") pod \"4890a941-860c-4ccc-9392-576130156fc6\" (UID: \"4890a941-860c-4ccc-9392-576130156fc6\") "
Jul 28 18:18:25.414540 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.414228    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4890a941-860c-4ccc-9392-576130156fc6-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:25.414540 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.414248    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:25.414962 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.414930    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4890a941-860c-4ccc-9392-576130156fc6" (UID: "4890a941-860c-4ccc-9392-576130156fc6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:18:25.415448 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.415386    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4890a941-860c-4ccc-9392-576130156fc6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4890a941-860c-4ccc-9392-576130156fc6" (UID: "4890a941-860c-4ccc-9392-576130156fc6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:18:25.415448 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.415390    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-kube-api-access-xmgbx" (OuterVolumeSpecName: "kube-api-access-xmgbx") pod "4890a941-860c-4ccc-9392-576130156fc6" (UID: "4890a941-860c-4ccc-9392-576130156fc6"). InnerVolumeSpecName "kube-api-access-xmgbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:18:25.415835 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.415619    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-istio-token" (OuterVolumeSpecName: "istio-token") pod "4890a941-860c-4ccc-9392-576130156fc6" (UID: "4890a941-860c-4ccc-9392-576130156fc6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:18:25.415835 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.415683    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4890a941-860c-4ccc-9392-576130156fc6" (UID: "4890a941-860c-4ccc-9392-576130156fc6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:18:25.415835 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.415758    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-data" (OuterVolumeSpecName: "istio-data") pod "4890a941-860c-4ccc-9392-576130156fc6" (UID: "4890a941-860c-4ccc-9392-576130156fc6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:18:25.416128 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.416086    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4890a941-860c-4ccc-9392-576130156fc6" (UID: "4890a941-860c-4ccc-9392-576130156fc6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:18:25.516312 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.516263    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:25.516312 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.516297    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:25.516312 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.516306    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:25.516312 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.516315    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmgbx\" (UniqueName: \"kubernetes.io/projected/4890a941-860c-4ccc-9392-576130156fc6-kube-api-access-xmgbx\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:25.516312 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.516324    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:25.516701 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.516332    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4890a941-860c-4ccc-9392-576130156fc6-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:25.516701 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.516340    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4890a941-860c-4ccc-9392-576130156fc6-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:18:25.635835 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.635745    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"]
Jul 28 18:18:25.636181 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.636167    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy"
Jul 28 18:18:25.636239 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.636184    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy"
Jul 28 18:18:25.636239 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.636197    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy"
Jul 28 18:18:25.636239 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.636205    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy"
Jul 28 18:18:25.636337 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.636301    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="602a4dd4-c76c-4efc-ac67-c67a007612df" containerName="istio-proxy"
Jul 28 18:18:25.636337 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.636311    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy"
Jul 28 18:18:25.636337 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.636319    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy"
Jul 28 18:18:25.639717 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.639680    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"]
Jul 28 18:18:25.640111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.639775    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:18:25.644467 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.644444    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-9b5b66\""
Jul 28 18:18:25.715372 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.715339    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"]
Jul 28 18:18:25.715751 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.715737    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy"
Jul 28 18:18:25.715797 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.715753    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4890a941-860c-4ccc-9392-576130156fc6" containerName="istio-proxy"
Jul 28 18:18:25.718740 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.718715    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:18:25.718903 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.718716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnctw\" (UniqueName: \"kubernetes.io/projected/99bdc937-fa93-4693-953d-0fad572e1e35-kube-api-access-gnctw\") pod \"payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq\" (UID: \"99bdc937-fa93-4693-953d-0fad572e1e35\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:18:25.718903 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.718847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99bdc937-fa93-4693-953d-0fad572e1e35-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq\" (UID: \"99bdc937-fa93-4693-953d-0fad572e1e35\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:18:25.733815 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.733785    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-9b5b66-dockercfg-tq67c\""
Jul 28 18:18:25.754270 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.754226    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"]
Jul 28 18:18:25.820051 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.819999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/053a4136-134f-48a1-bc30-ab503d2aaf81-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f\" (UID: \"053a4136-134f-48a1-bc30-ab503d2aaf81\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:18:25.820321 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.820172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnctw\" (UniqueName: \"kubernetes.io/projected/99bdc937-fa93-4693-953d-0fad572e1e35-kube-api-access-gnctw\") pod \"payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq\" (UID: \"99bdc937-fa93-4693-953d-0fad572e1e35\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:18:25.820321 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.820216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99bdc937-fa93-4693-953d-0fad572e1e35-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq\" (UID: \"99bdc937-fa93-4693-953d-0fad572e1e35\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:18:25.820321 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.820236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j5js\" (UniqueName: \"kubernetes.io/projected/053a4136-134f-48a1-bc30-ab503d2aaf81-kube-api-access-2j5js\") pod \"payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f\" (UID: \"053a4136-134f-48a1-bc30-ab503d2aaf81\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:18:25.821021 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.820998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99bdc937-fa93-4693-953d-0fad572e1e35-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq\" (UID: \"99bdc937-fa93-4693-953d-0fad572e1e35\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:18:25.835633 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.835603    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnctw\" (UniqueName: \"kubernetes.io/projected/99bdc937-fa93-4693-953d-0fad572e1e35-kube-api-access-gnctw\") pod \"payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq\" (UID: \"99bdc937-fa93-4693-953d-0fad572e1e35\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:18:25.907206 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.907083    2561 generic.go:356] "Generic (PLEG): container finished" podID="4890a941-860c-4ccc-9392-576130156fc6" containerID="c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4" exitCode=0
Jul 28 18:18:25.907206 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.907165    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"
Jul 28 18:18:25.907206 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.907175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" event={"ID":"4890a941-860c-4ccc-9392-576130156fc6","Type":"ContainerDied","Data":"c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4"}
Jul 28 18:18:25.907447 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.907263    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh" event={"ID":"4890a941-860c-4ccc-9392-576130156fc6","Type":"ContainerDied","Data":"90d0499fde5dca12b05c83573c37200289f05a2a57b9e759d811387d7d858368"}
Jul 28 18:18:25.907447 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.907289    2561 scope.go:117] "RemoveContainer" containerID="c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4"
Jul 28 18:18:25.919977 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.919951    2561 scope.go:117] "RemoveContainer" containerID="abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df"
Jul 28 18:18:25.920931 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.920887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j5js\" (UniqueName: \"kubernetes.io/projected/053a4136-134f-48a1-bc30-ab503d2aaf81-kube-api-access-2j5js\") pod \"payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f\" (UID: \"053a4136-134f-48a1-bc30-ab503d2aaf81\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:18:25.921062 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.920972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/053a4136-134f-48a1-bc30-ab503d2aaf81-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f\" (UID: \"053a4136-134f-48a1-bc30-ab503d2aaf81\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:18:25.922028 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.922003    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/053a4136-134f-48a1-bc30-ab503d2aaf81-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f\" (UID: \"053a4136-134f-48a1-bc30-ab503d2aaf81\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:18:25.930178 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.930156    2561 scope.go:117] "RemoveContainer" containerID="c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4"
Jul 28 18:18:25.930539 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:18:25.930516    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4\": container with ID starting with c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4 not found: ID does not exist" containerID="c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4"
Jul 28 18:18:25.930643 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.930547    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4"} err="failed to get container status \"c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4\": rpc error: code = NotFound desc = could not find container \"c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4\": container with ID starting with c466006cae9d807c9022e083708280163c11e9be318bf4f66517f9ec470ebba4 not found: ID does not exist"
Jul 28 18:18:25.930643 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.930566    2561 scope.go:117] "RemoveContainer" containerID="abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df"
Jul 28 18:18:25.930861 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:18:25.930840    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df\": container with ID starting with abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df not found: ID does not exist" containerID="abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df"
Jul 28 18:18:25.930907 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.930870    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df"} err="failed to get container status \"abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df\": rpc error: code = NotFound desc = could not find container \"abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df\": container with ID starting with abe83f9d1014696deda281252dd5502ca8784e7158e97fa37db89469f3f868df not found: ID does not exist"
Jul 28 18:18:25.944806 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.944769    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j5js\" (UniqueName: \"kubernetes.io/projected/053a4136-134f-48a1-bc30-ab503d2aaf81-kube-api-access-2j5js\") pod \"payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f\" (UID: \"053a4136-134f-48a1-bc30-ab503d2aaf81\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:18:25.950737 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.950707    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:18:25.958013 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.955472    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"]
Jul 28 18:18:25.967652 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:25.967620    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1ff6f1-openshift-default-64c59769fd-r8lrh"]
Jul 28 18:18:26.029413 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.029373    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:18:26.145924 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.145885    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"]
Jul 28 18:18:26.150021 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:18:26.149987    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99bdc937_fa93_4693_953d_0fad572e1e35.slice/crio-f1969952a780415931a5b61455f68112c0b15a6b522c2cd79285ed7651a08ce1 WatchSource:0}: Error finding container f1969952a780415931a5b61455f68112c0b15a6b522c2cd79285ed7651a08ce1: Status 404 returned error can't find the container with id f1969952a780415931a5b61455f68112c0b15a6b522c2cd79285ed7651a08ce1
Jul 28 18:18:26.227343 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.227260    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"]
Jul 28 18:18:26.230796 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:18:26.230765    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053a4136_134f_48a1_bc30_ab503d2aaf81.slice/crio-02ee46f05cd43844b21d21724a920a26095a0dac82c575240166940e0e479ef7 WatchSource:0}: Error finding container 02ee46f05cd43844b21d21724a920a26095a0dac82c575240166940e0e479ef7: Status 404 returned error can't find the container with id 02ee46f05cd43844b21d21724a920a26095a0dac82c575240166940e0e479ef7
Jul 28 18:18:26.913955 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.913916    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq" event={"ID":"99bdc937-fa93-4693-953d-0fad572e1e35","Type":"ContainerStarted","Data":"ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b"}
Jul 28 18:18:26.914479 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.913986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq" event={"ID":"99bdc937-fa93-4693-953d-0fad572e1e35","Type":"ContainerStarted","Data":"f1969952a780415931a5b61455f68112c0b15a6b522c2cd79285ed7651a08ce1"}
Jul 28 18:18:26.914479 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.914054    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:18:26.915575 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.915551    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f" event={"ID":"053a4136-134f-48a1-bc30-ab503d2aaf81","Type":"ContainerStarted","Data":"09c1df7d1a8e41057df0f3279d19bc8d29e1e3d92250d5cdc7c6e87f9058c778"}
Jul 28 18:18:26.915707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.915598    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f" event={"ID":"053a4136-134f-48a1-bc30-ab503d2aaf81","Type":"ContainerStarted","Data":"02ee46f05cd43844b21d21724a920a26095a0dac82c575240166940e0e479ef7"}
Jul 28 18:18:26.915707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.915628    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:18:26.938622 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.938567    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq" podStartSLOduration=1.938549494 podStartE2EDuration="1.938549494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:18:26.937122614 +0000 UTC m=+2647.537719440" watchObservedRunningTime="2026-07-28 18:18:26.938549494 +0000 UTC m=+2647.539146326"
Jul 28 18:18:26.982475 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:26.982413    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f" podStartSLOduration=1.982392661 podStartE2EDuration="1.982392661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:18:26.979497442 +0000 UTC m=+2647.580094287" watchObservedRunningTime="2026-07-28 18:18:26.982392661 +0000 UTC m=+2647.582989494"
Jul 28 18:18:27.921913 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:27.921880    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4890a941-860c-4ccc-9392-576130156fc6" path="/var/lib/kubelet/pods/4890a941-860c-4ccc-9392-576130156fc6/volumes"
Jul 28 18:18:34.497618 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.497579    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"]
Jul 28 18:18:34.502558 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.502533    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.506001 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.505950    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c73c1e-openshift-default-dockercfg-cjhd8\""
Jul 28 18:18:34.516471 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.516438    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"]
Jul 28 18:18:34.613535 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.613492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-socket\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.613757 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.613543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-credential-socket\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.613757 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.613584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-envoy\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.613757 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.613634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-certs\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.613932 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.613755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/923713c2-299e-46af-9e23-054abf3e130b-istiod-ca-cert\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.613932 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.613875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-data\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.613932 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.613905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/923713c2-299e-46af-9e23-054abf3e130b-istio-podinfo\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.614111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.613929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-istio-token\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.614111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.613981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q75jz\" (UniqueName: \"kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-kube-api-access-q75jz\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.714938 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.714900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q75jz\" (UniqueName: \"kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-kube-api-access-q75jz\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715158 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.714959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-socket\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715158 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.714976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-credential-socket\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715158 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.715008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-envoy\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715158 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.715054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-certs\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715158 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.715104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/923713c2-299e-46af-9e23-054abf3e130b-istiod-ca-cert\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715355 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.715177    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-data\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715355 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.715208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/923713c2-299e-46af-9e23-054abf3e130b-istio-podinfo\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715355 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.715240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-istio-token\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715474 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.715451    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-socket\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715593 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.715564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-certs\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715791 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.715764    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-credential-socket\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.715791 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.715785    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-data\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.716212 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.716191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/923713c2-299e-46af-9e23-054abf3e130b-istiod-ca-cert\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.718392 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.718359    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-envoy\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.718603 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.718586    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/923713c2-299e-46af-9e23-054abf3e130b-istio-podinfo\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.725660 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.725625    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-istio-token\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.725965 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.725940    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q75jz\" (UniqueName: \"kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-kube-api-access-q75jz\") pod \"e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") " pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:34.815019 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:34.814928    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:35.032798 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:35.032769    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"]
Jul 28 18:18:35.035769 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:18:35.035737    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod923713c2_299e_46af_9e23_054abf3e130b.slice/crio-e02e7edd27e36c0af0ead80e0a264dd6b950d92495ecf739d0076d00b0e205be WatchSource:0}: Error finding container e02e7edd27e36c0af0ead80e0a264dd6b950d92495ecf739d0076d00b0e205be: Status 404 returned error can't find the container with id e02e7edd27e36c0af0ead80e0a264dd6b950d92495ecf739d0076d00b0e205be
Jul 28 18:18:35.038367 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:35.038322    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:35.038466 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:35.038416    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:35.038507 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:35.038461    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:35.973906 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:35.973804    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" event={"ID":"923713c2-299e-46af-9e23-054abf3e130b","Type":"ContainerStarted","Data":"e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af"}
Jul 28 18:18:35.973906 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:35.973877    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" event={"ID":"923713c2-299e-46af-9e23-054abf3e130b","Type":"ContainerStarted","Data":"e02e7edd27e36c0af0ead80e0a264dd6b950d92495ecf739d0076d00b0e205be"}
Jul 28 18:18:35.998074 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:35.998012    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" podStartSLOduration=1.9979925029999999 podStartE2EDuration="1.997992503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:18:35.997457566 +0000 UTC m=+2656.598054424" watchObservedRunningTime="2026-07-28 18:18:35.997992503 +0000 UTC m=+2656.598589335"
Jul 28 18:18:36.815182 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:36.815136    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:36.821423 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:36.821395    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:36.979552 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:36.979521    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:36.980733 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:36.980708    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:37.924749 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:37.924711    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:18:37.924926 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:37.924803    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:18:38.462063 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:38.462025    2561 patch_prober.go:28] interesting pod/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": read tcp 10.132.0.2:54040->10.132.0.70:15021: read: connection reset by peer" start-of-body=
Jul 28 18:18:38.462508 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:38.462151    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": read tcp 10.132.0.2:54040->10.132.0.70:15021: read: connection reset by peer"
Jul 28 18:18:38.996963 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:38.996929    2561 generic.go:356] "Generic (PLEG): container finished" podID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerID="97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d" exitCode=0
Jul 28 18:18:38.997177 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:38.997006    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" event={"ID":"c760866f-27dd-4ccf-9816-d5dc0fa21161","Type":"ContainerDied","Data":"97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d"}
Jul 28 18:18:38.997573 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:38.997554    2561 scope.go:117] "RemoveContainer" containerID="97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d"
Jul 28 18:18:38.998605 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:38.998571    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:38.998660 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:38.998645    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:38.998696 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:38.998682    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:40.004601 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:40.004560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" event={"ID":"c760866f-27dd-4ccf-9816-d5dc0fa21161","Type":"ContainerStarted","Data":"4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5"}
Jul 28 18:18:40.473585 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:40.473478    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:40.473585 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:40.473539    2561 patch_prober.go:28] interesting pod/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 28 18:18:40.473841 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:40.473603    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 28 18:18:41.473628 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:41.473584    2561 patch_prober.go:28] interesting pod/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 28 18:18:41.474722 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:41.474288    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 28 18:18:42.474450 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:42.474401    2561 patch_prober.go:28] interesting pod/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 28 18:18:42.475017 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:42.474474    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 28 18:18:43.473845 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:43.473801    2561 patch_prober.go:28] interesting pod/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 28 18:18:43.474176 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:43.474144    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 28 18:18:44.474212 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:44.474168    2561 patch_prober.go:28] interesting pod/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 28 18:18:44.474855 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:44.474809    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 28 18:18:45.480382 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:45.480342    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:45.480818 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:45.480795    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:45.481611 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:45.481589    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:18:52.375364 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:52.375291    2561 patch_prober.go:28] interesting pod/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": read tcp 10.132.0.2:40196->10.132.0.73:15021: read: connection reset by peer" start-of-body=
Jul 28 18:18:52.375934 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:52.375362    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": read tcp 10.132.0.2:40196->10.132.0.73:15021: read: connection reset by peer"
Jul 28 18:18:53.073810 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:53.073773    2561 generic.go:356] "Generic (PLEG): container finished" podID="923713c2-299e-46af-9e23-054abf3e130b" containerID="e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af" exitCode=0
Jul 28 18:18:53.074004 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:53.073847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" event={"ID":"923713c2-299e-46af-9e23-054abf3e130b","Type":"ContainerDied","Data":"e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af"}
Jul 28 18:18:53.074361 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:53.074328    2561 scope.go:117] "RemoveContainer" containerID="e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af"
Jul 28 18:18:53.075473 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:53.075441    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:53.075574 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:53.075530    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:53.075574 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:53.075561    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:18:54.083661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:54.083624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" event={"ID":"923713c2-299e-46af-9e23-054abf3e130b","Type":"ContainerStarted","Data":"2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b"}
Jul 28 18:18:54.815298 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:54.815255    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:54.815557 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:54.815531    2561 patch_prober.go:28] interesting pod/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 28 18:18:54.815607 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:54.815587    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 28 18:18:55.816322 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:55.816282    2561 patch_prober.go:28] interesting pod/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 28 18:18:55.816748 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:55.816343    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 28 18:18:56.816345 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:56.816301    2561 patch_prober.go:28] interesting pod/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 28 18:18:56.816878 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:56.816377    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 28 18:18:57.815507 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:57.815471    2561 patch_prober.go:28] interesting pod/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 28 18:18:57.815694 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:57.815546    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 28 18:18:58.819189 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:58.819156    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:58.819679 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:58.819558    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:18:58.820228 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:18:58.820209    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:19:09.505919 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.505870    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"]
Jul 28 18:19:09.509604 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.509583    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.512512 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.512487    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9b5b66\"/\"kube-root-ca.crt\""
Jul 28 18:19:09.512703 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.512684    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9b5b66\"/\"openshift-service-ca.crt\""
Jul 28 18:19:09.513727 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.513701    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9b5b66\"/\"auth-test-model-9b5b66-kserve-self-signed-certs\""
Jul 28 18:19:09.513877 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.513861    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9b5b66\"/\"default-dockercfg-p45rt\""
Jul 28 18:19:09.519471 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.519446    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"]
Jul 28 18:19:09.660568 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.660502    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-dshm\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.660568 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.660570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tls-certs\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.660828 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.660609    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tmp-dir\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.660828 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.660635    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-home\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.660828 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.660671    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-model-cache\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.660828 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.660768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2lkd\" (UniqueName: \"kubernetes.io/projected/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-kube-api-access-j2lkd\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.761390 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.761285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tmp-dir\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.761390 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.761326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-home\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.761642 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.761459    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-model-cache\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.761642 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.761520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2lkd\" (UniqueName: \"kubernetes.io/projected/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-kube-api-access-j2lkd\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.761642 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.761576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-dshm\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.761642 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.761594    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tls-certs\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.761851 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.761713    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-home\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.761851 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.761776    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tmp-dir\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.761851 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.761840    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-model-cache\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.763920 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.763889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-dshm\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.764337 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.764317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tls-certs\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.771486 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.771452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2lkd\" (UniqueName: \"kubernetes.io/projected/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-kube-api-access-j2lkd\") pod \"auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") " pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.820626 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.820589    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:09.971156 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:09.971130    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"]
Jul 28 18:19:09.972632 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:19:09.972605    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f983c87_2dc7_4b3b_9a10_36da7ff6eafd.slice/crio-02c600baa4221bc39834ad72c7650444bde4ca1bd2876823eb7a7140c034fba1 WatchSource:0}: Error finding container 02c600baa4221bc39834ad72c7650444bde4ca1bd2876823eb7a7140c034fba1: Status 404 returned error can't find the container with id 02c600baa4221bc39834ad72c7650444bde4ca1bd2876823eb7a7140c034fba1
Jul 28 18:19:10.164624 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:10.164405    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg" event={"ID":"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd","Type":"ContainerStarted","Data":"3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef"}
Jul 28 18:19:10.164624 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:10.164459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg" event={"ID":"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd","Type":"ContainerStarted","Data":"02c600baa4221bc39834ad72c7650444bde4ca1bd2876823eb7a7140c034fba1"}
Jul 28 18:19:10.187142 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:10.187066    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg" podStartSLOduration=1.18704798 podStartE2EDuration="1.18704798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:19:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:19:10.18452624 +0000 UTC m=+2690.785123073" watchObservedRunningTime="2026-07-28 18:19:10.18704798 +0000 UTC m=+2690.787644812"
Jul 28 18:19:19.821371 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:19.821334    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:19.821749 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:19.821612    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:19.834341 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:19.834319    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:19:20.027529 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:20.027502    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:19:20.033242 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:20.033220    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:19:20.224469 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:19:20.224439    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:24:20.056641 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:20.056609    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:24:20.063813 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:20.063788    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:24:22.399455 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:22.399413    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"]
Jul 28 18:24:37.419066 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.418998    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg" podUID="5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" containerName="main" containerID="cri-o://3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef" gracePeriod=45
Jul 28 18:24:37.682590 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.682516    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:24:37.758146 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758073    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-home\") pod \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") "
Jul 28 18:24:37.758348 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758171    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2lkd\" (UniqueName: \"kubernetes.io/projected/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-kube-api-access-j2lkd\") pod \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") "
Jul 28 18:24:37.758348 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758212    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-dshm\") pod \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") "
Jul 28 18:24:37.758348 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tmp-dir\") pod \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") "
Jul 28 18:24:37.758539 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758364    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-model-cache\") pod \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") "
Jul 28 18:24:37.758539 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758367    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-home" (OuterVolumeSpecName: "home") pod "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" (UID: "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:24:37.758539 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758406    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tls-certs\") pod \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\" (UID: \"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd\") "
Jul 28 18:24:37.758691 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758566    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" (UID: "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:24:37.758691 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758630    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-model-cache" (OuterVolumeSpecName: "model-cache") pod "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" (UID: "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:24:37.758777 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758739    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tmp-dir\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:24:37.758777 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758760    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-model-cache\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:24:37.758777 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.758773    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-home\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:24:37.760529 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.760504    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-kube-api-access-j2lkd" (OuterVolumeSpecName: "kube-api-access-j2lkd") pod "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" (UID: "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd"). InnerVolumeSpecName "kube-api-access-j2lkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:24:37.760649 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.760526    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-dshm" (OuterVolumeSpecName: "dshm") pod "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" (UID: "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:24:37.760649 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.760528    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" (UID: "5f983c87-2dc7-4b3b-9a10-36da7ff6eafd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:24:37.770546 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.770507    2561 generic.go:356] "Generic (PLEG): container finished" podID="5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" containerID="3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef" exitCode=0
Jul 28 18:24:37.770546 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.770546    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"
Jul 28 18:24:37.770737 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.770585    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg" event={"ID":"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd","Type":"ContainerDied","Data":"3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef"}
Jul 28 18:24:37.770737 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.770627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg" event={"ID":"5f983c87-2dc7-4b3b-9a10-36da7ff6eafd","Type":"ContainerDied","Data":"02c600baa4221bc39834ad72c7650444bde4ca1bd2876823eb7a7140c034fba1"}
Jul 28 18:24:37.770737 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.770646    2561 scope.go:117] "RemoveContainer" containerID="3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef"
Jul 28 18:24:37.780707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.780691    2561 scope.go:117] "RemoveContainer" containerID="3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef"
Jul 28 18:24:37.781041 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:24:37.781022    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef\": container with ID starting with 3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef not found: ID does not exist" containerID="3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef"
Jul 28 18:24:37.781115 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.781052    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef"} err="failed to get container status \"3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef\": rpc error: code = NotFound desc = could not find container \"3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef\": container with ID starting with 3acbc34cc83140ba8960c77fba5f37855ea2dfaa488de6f5a9816a1c6632bdef not found: ID does not exist"
Jul 28 18:24:37.795738 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.795694    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"]
Jul 28 18:24:37.800739 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.800705    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9b5b66/auth-test-model-9b5b66-kserve-9f4f474f9-qpsmg"]
Jul 28 18:24:37.859668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.859622    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-dshm\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:24:37.859668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.859659    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-tls-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:24:37.859668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.859673    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2lkd\" (UniqueName: \"kubernetes.io/projected/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd-kube-api-access-j2lkd\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:24:37.922357 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:37.922319    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" path="/var/lib/kubelet/pods/5f983c87-2dc7-4b3b-9a10-36da7ff6eafd/volumes"
Jul 28 18:24:59.203476 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.203431    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"]
Jul 28 18:24:59.203931 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.203829    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" containerName="main"
Jul 28 18:24:59.203931 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.203842    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" containerName="main"
Jul 28 18:24:59.204009 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.203939    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f983c87-2dc7-4b3b-9a10-36da7ff6eafd" containerName="main"
Jul 28 18:24:59.208385 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.208357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.211408 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.211375    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c73c1e\"/\"kube-root-ca.crt\""
Jul 28 18:24:59.212346 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.212311    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c73c1e\"/\"openshift-service-ca.crt\""
Jul 28 18:24:59.212507 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.212402    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c73c1e\"/\"default-dockercfg-w24mz\""
Jul 28 18:24:59.212507 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.212444    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c73c1e\"/\"sub-test-model-c73c1e-kserve-self-signed-certs\""
Jul 28 18:24:59.217719 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.217695    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"]
Jul 28 18:24:59.258434 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.258388    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-home\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.258644 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.258450    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-dshm\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.258644 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.258529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tls-certs\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.258644 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.258566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-model-cache\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.258644 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.258600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg28g\" (UniqueName: \"kubernetes.io/projected/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-kube-api-access-rg28g\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.258796 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.258677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tmp-dir\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.359863 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.359825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tls-certs\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.360075 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.359875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-model-cache\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.360075 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.359999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg28g\" (UniqueName: \"kubernetes.io/projected/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-kube-api-access-rg28g\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.360226 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.360075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tmp-dir\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.360226 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.360146    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-home\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.360226 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.360214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-dshm\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.360378 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.360282    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-model-cache\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.360378 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.360341    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tmp-dir\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.360558 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.360538    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-home\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.362418 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.362383    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-dshm\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.362554 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.362535    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tls-certs\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.370543 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.370514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg28g\" (UniqueName: \"kubernetes.io/projected/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-kube-api-access-rg28g\") pod \"sub-test-model-c73c1e-kserve-686f88f795-9t2fq\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") " pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.519590 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.519547    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:24:59.678764 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.678669    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"]
Jul 28 18:24:59.681641 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:24:59.681606    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode292a9bb_60a2_4587_8dd7_db0fc78e6e68.slice/crio-c6d147921eb13c3de958452a2167e2e3071a56b7c69ab9b11ecdbb986bfe9778 WatchSource:0}: Error finding container c6d147921eb13c3de958452a2167e2e3071a56b7c69ab9b11ecdbb986bfe9778: Status 404 returned error can't find the container with id c6d147921eb13c3de958452a2167e2e3071a56b7c69ab9b11ecdbb986bfe9778
Jul 28 18:24:59.886059 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.885950    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq" event={"ID":"e292a9bb-60a2-4587-8dd7-db0fc78e6e68","Type":"ContainerStarted","Data":"9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab"}
Jul 28 18:24:59.886059 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.885995    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq" event={"ID":"e292a9bb-60a2-4587-8dd7-db0fc78e6e68","Type":"ContainerStarted","Data":"c6d147921eb13c3de958452a2167e2e3071a56b7c69ab9b11ecdbb986bfe9778"}
Jul 28 18:24:59.908237 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:24:59.908168    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq" podStartSLOduration=0.908150641 podStartE2EDuration="908.150641ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:24:59.906298321 +0000 UTC m=+3040.506895183" watchObservedRunningTime="2026-07-28 18:24:59.908150641 +0000 UTC m=+3040.508747473"
Jul 28 18:25:09.520050 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:25:09.520005    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:25:09.520616 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:25:09.520070    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:25:09.532884 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:25:09.532845    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:25:09.947423 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:25:09.947325    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:25:59.908455 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:25:59.908412    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"]
Jul 28 18:26:14.929828 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:14.929756    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq" podUID="e292a9bb-60a2-4587-8dd7-db0fc78e6e68" containerName="main" containerID="cri-o://9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab" gracePeriod=45
Jul 28 18:26:15.194440 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.194350    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:26:15.211850 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.211807    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tmp-dir\") pod \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") "
Jul 28 18:26:15.212067 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.211872    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tls-certs\") pod \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") "
Jul 28 18:26:15.212067 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.211893    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-model-cache\") pod \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") "
Jul 28 18:26:15.212067 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.211950    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-home\") pod \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") "
Jul 28 18:26:15.212067 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.211971    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-dshm\") pod \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") "
Jul 28 18:26:15.212067 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.212032    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg28g\" (UniqueName: \"kubernetes.io/projected/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-kube-api-access-rg28g\") pod \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\" (UID: \"e292a9bb-60a2-4587-8dd7-db0fc78e6e68\") "
Jul 28 18:26:15.212364 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.212180    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e292a9bb-60a2-4587-8dd7-db0fc78e6e68" (UID: "e292a9bb-60a2-4587-8dd7-db0fc78e6e68"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:26:15.212364 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.212199    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-model-cache" (OuterVolumeSpecName: "model-cache") pod "e292a9bb-60a2-4587-8dd7-db0fc78e6e68" (UID: "e292a9bb-60a2-4587-8dd7-db0fc78e6e68"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:26:15.212364 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.212268    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-home" (OuterVolumeSpecName: "home") pod "e292a9bb-60a2-4587-8dd7-db0fc78e6e68" (UID: "e292a9bb-60a2-4587-8dd7-db0fc78e6e68"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:26:15.212518 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.212476    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tmp-dir\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:26:15.212518 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.212497    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-model-cache\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:26:15.212518 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.212510    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-home\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:26:15.214307 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.214279    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-dshm" (OuterVolumeSpecName: "dshm") pod "e292a9bb-60a2-4587-8dd7-db0fc78e6e68" (UID: "e292a9bb-60a2-4587-8dd7-db0fc78e6e68"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:26:15.214454 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.214408    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e292a9bb-60a2-4587-8dd7-db0fc78e6e68" (UID: "e292a9bb-60a2-4587-8dd7-db0fc78e6e68"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:26:15.214517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.214463    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-kube-api-access-rg28g" (OuterVolumeSpecName: "kube-api-access-rg28g") pod "e292a9bb-60a2-4587-8dd7-db0fc78e6e68" (UID: "e292a9bb-60a2-4587-8dd7-db0fc78e6e68"). InnerVolumeSpecName "kube-api-access-rg28g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:26:15.263364 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.263322    2561 generic.go:356] "Generic (PLEG): container finished" podID="e292a9bb-60a2-4587-8dd7-db0fc78e6e68" containerID="9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab" exitCode=0
Jul 28 18:26:15.263364 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.263366    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"
Jul 28 18:26:15.263605 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.263381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq" event={"ID":"e292a9bb-60a2-4587-8dd7-db0fc78e6e68","Type":"ContainerDied","Data":"9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab"}
Jul 28 18:26:15.263605 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.263417    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq" event={"ID":"e292a9bb-60a2-4587-8dd7-db0fc78e6e68","Type":"ContainerDied","Data":"c6d147921eb13c3de958452a2167e2e3071a56b7c69ab9b11ecdbb986bfe9778"}
Jul 28 18:26:15.263605 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.263435    2561 scope.go:117] "RemoveContainer" containerID="9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab"
Jul 28 18:26:15.273439 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.273410    2561 scope.go:117] "RemoveContainer" containerID="9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab"
Jul 28 18:26:15.273777 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:26:15.273757    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab\": container with ID starting with 9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab not found: ID does not exist" containerID="9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab"
Jul 28 18:26:15.273845 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.273785    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab"} err="failed to get container status \"9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab\": rpc error: code = NotFound desc = could not find container \"9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab\": container with ID starting with 9451960681d57cce6b5af6e64e2d9a407a508ce35b6c7955bcd21f93875e7eab not found: ID does not exist"
Jul 28 18:26:15.299110 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.299059    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"]
Jul 28 18:26:15.306300 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.306263    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/sub-test-model-c73c1e-kserve-686f88f795-9t2fq"]
Jul 28 18:26:15.313753 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.313728    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-tls-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:26:15.313753 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.313756    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-dshm\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:26:15.313873 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.313765    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg28g\" (UniqueName: \"kubernetes.io/projected/e292a9bb-60a2-4587-8dd7-db0fc78e6e68-kube-api-access-rg28g\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:26:15.921237 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:15.921202    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e292a9bb-60a2-4587-8dd7-db0fc78e6e68" path="/var/lib/kubelet/pods/e292a9bb-60a2-4587-8dd7-db0fc78e6e68/volumes"
Jul 28 18:26:27.299198 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.299155    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"]
Jul 28 18:26:27.299661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.299647    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e292a9bb-60a2-4587-8dd7-db0fc78e6e68" containerName="main"
Jul 28 18:26:27.299661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.299662    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e292a9bb-60a2-4587-8dd7-db0fc78e6e68" containerName="main"
Jul 28 18:26:27.299859 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.299791    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e292a9bb-60a2-4587-8dd7-db0fc78e6e68" containerName="main"
Jul 28 18:26:27.304612 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.304587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.308438 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.308413    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c73c1e\"/\"default-dockercfg-w24mz\""
Jul 28 18:26:27.308594 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.308451    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c73c1e\"/\"kube-root-ca.crt\""
Jul 28 18:26:27.308594 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.308511    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c73c1e\"/\"openshift-service-ca.crt\""
Jul 28 18:26:27.308594 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.308516    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c73c1e\"/\"rate-test-model-c73c1e-kserve-self-signed-certs\""
Jul 28 18:26:27.313773 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.313743    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"]
Jul 28 18:26:27.429530 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.429491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzq25\" (UniqueName: \"kubernetes.io/projected/5a410773-bf6c-46fc-be15-e6b8b989329a-kube-api-access-dzq25\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.429731 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.429537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-dshm\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.430053 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.429590    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-tmp-dir\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.430336 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.430313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-model-cache\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.430514 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.430498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-home\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.430640 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.430626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a410773-bf6c-46fc-be15-e6b8b989329a-tls-certs\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.531711 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.531660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzq25\" (UniqueName: \"kubernetes.io/projected/5a410773-bf6c-46fc-be15-e6b8b989329a-kube-api-access-dzq25\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.531711 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.531711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-dshm\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.531956 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.531737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-tmp-dir\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.531956 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.531801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-model-cache\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.531956 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.531857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-home\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.531956 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.531895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a410773-bf6c-46fc-be15-e6b8b989329a-tls-certs\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.532310 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.532286    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-tmp-dir\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.532383 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.532357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-model-cache\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.532383 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.532371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-home\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.534190 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.534163    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-dshm\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.534449 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.534431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a410773-bf6c-46fc-be15-e6b8b989329a-tls-certs\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.541053 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.541027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzq25\" (UniqueName: \"kubernetes.io/projected/5a410773-bf6c-46fc-be15-e6b8b989329a-kube-api-access-dzq25\") pod \"rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") " pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.615227 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.615130    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:27.768371 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:27.768343    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"]
Jul 28 18:26:27.771060 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:26:27.771029    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a410773_bf6c_46fc_be15_e6b8b989329a.slice/crio-afde99e157058c8ed8941c1694586388606fabeaf5408cb1b3366843934acbc3 WatchSource:0}: Error finding container afde99e157058c8ed8941c1694586388606fabeaf5408cb1b3366843934acbc3: Status 404 returned error can't find the container with id afde99e157058c8ed8941c1694586388606fabeaf5408cb1b3366843934acbc3
Jul 28 18:26:28.332428 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:28.332387    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8" event={"ID":"5a410773-bf6c-46fc-be15-e6b8b989329a","Type":"ContainerStarted","Data":"29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4"}
Jul 28 18:26:28.332428 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:28.332435    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8" event={"ID":"5a410773-bf6c-46fc-be15-e6b8b989329a","Type":"ContainerStarted","Data":"afde99e157058c8ed8941c1694586388606fabeaf5408cb1b3366843934acbc3"}
Jul 28 18:26:28.353634 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:28.353575    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8" podStartSLOduration=1.35355736 podStartE2EDuration="1.35355736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:26:28.351438678 +0000 UTC m=+3128.952035547" watchObservedRunningTime="2026-07-28 18:26:28.35355736 +0000 UTC m=+3128.954154193"
Jul 28 18:26:37.615992 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:37.615946    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:37.616543 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:37.616021    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:37.629186 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:37.629148    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:26:38.393890 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:26:38.393854    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:27:49.895735 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:27:49.895693    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"]
Jul 28 18:28:04.914717 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:04.914672    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8" podUID="5a410773-bf6c-46fc-be15-e6b8b989329a" containerName="main" containerID="cri-o://29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4" gracePeriod=45
Jul 28 18:28:05.157159 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.157136    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:28:05.211611 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.211551    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a410773-bf6c-46fc-be15-e6b8b989329a-tls-certs\") pod \"5a410773-bf6c-46fc-be15-e6b8b989329a\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") "
Jul 28 18:28:05.211611 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.211592    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-model-cache\") pod \"5a410773-bf6c-46fc-be15-e6b8b989329a\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") "
Jul 28 18:28:05.211785 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.211616    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-home\") pod \"5a410773-bf6c-46fc-be15-e6b8b989329a\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") "
Jul 28 18:28:05.211785 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.211679    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzq25\" (UniqueName: \"kubernetes.io/projected/5a410773-bf6c-46fc-be15-e6b8b989329a-kube-api-access-dzq25\") pod \"5a410773-bf6c-46fc-be15-e6b8b989329a\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") "
Jul 28 18:28:05.211785 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.211702    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-tmp-dir\") pod \"5a410773-bf6c-46fc-be15-e6b8b989329a\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") "
Jul 28 18:28:05.211785 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.211739    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-dshm\") pod \"5a410773-bf6c-46fc-be15-e6b8b989329a\" (UID: \"5a410773-bf6c-46fc-be15-e6b8b989329a\") "
Jul 28 18:28:05.211989 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.211813    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a410773-bf6c-46fc-be15-e6b8b989329a" (UID: "5a410773-bf6c-46fc-be15-e6b8b989329a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:28:05.211989 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.211878    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-home" (OuterVolumeSpecName: "home") pod "5a410773-bf6c-46fc-be15-e6b8b989329a" (UID: "5a410773-bf6c-46fc-be15-e6b8b989329a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:28:05.212119 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.212024    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a410773-bf6c-46fc-be15-e6b8b989329a" (UID: "5a410773-bf6c-46fc-be15-e6b8b989329a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:28:05.212119 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.212065    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-model-cache\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:28:05.212119 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.212082    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-home\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:28:05.213611 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.213582    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a410773-bf6c-46fc-be15-e6b8b989329a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a410773-bf6c-46fc-be15-e6b8b989329a" (UID: "5a410773-bf6c-46fc-be15-e6b8b989329a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:28:05.213788 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.213768    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a410773-bf6c-46fc-be15-e6b8b989329a-kube-api-access-dzq25" (OuterVolumeSpecName: "kube-api-access-dzq25") pod "5a410773-bf6c-46fc-be15-e6b8b989329a" (UID: "5a410773-bf6c-46fc-be15-e6b8b989329a"). InnerVolumeSpecName "kube-api-access-dzq25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:28:05.213850 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.213783    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-dshm" (OuterVolumeSpecName: "dshm") pod "5a410773-bf6c-46fc-be15-e6b8b989329a" (UID: "5a410773-bf6c-46fc-be15-e6b8b989329a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:28:05.312720 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.312692    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzq25\" (UniqueName: \"kubernetes.io/projected/5a410773-bf6c-46fc-be15-e6b8b989329a-kube-api-access-dzq25\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:28:05.312818 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.312719    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-tmp-dir\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:28:05.312818 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.312735    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a410773-bf6c-46fc-be15-e6b8b989329a-dshm\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:28:05.312818 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.312747    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a410773-bf6c-46fc-be15-e6b8b989329a-tls-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:28:05.819719 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.819686    2561 generic.go:356] "Generic (PLEG): container finished" podID="5a410773-bf6c-46fc-be15-e6b8b989329a" containerID="29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4" exitCode=0
Jul 28 18:28:05.819867 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.819729    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"
Jul 28 18:28:05.819867 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.819774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8" event={"ID":"5a410773-bf6c-46fc-be15-e6b8b989329a","Type":"ContainerDied","Data":"29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4"}
Jul 28 18:28:05.819867 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.819819    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8" event={"ID":"5a410773-bf6c-46fc-be15-e6b8b989329a","Type":"ContainerDied","Data":"afde99e157058c8ed8941c1694586388606fabeaf5408cb1b3366843934acbc3"}
Jul 28 18:28:05.819867 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.819843    2561 scope.go:117] "RemoveContainer" containerID="29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4"
Jul 28 18:28:05.829001 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.828984    2561 scope.go:117] "RemoveContainer" containerID="29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4"
Jul 28 18:28:05.829284 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:28:05.829267    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4\": container with ID starting with 29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4 not found: ID does not exist" containerID="29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4"
Jul 28 18:28:05.829360 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.829297    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4"} err="failed to get container status \"29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4\": rpc error: code = NotFound desc = could not find container \"29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4\": container with ID starting with 29605260676c76bf86d70205de8da391948085a61f2d77586edafe64b205e3f4 not found: ID does not exist"
Jul 28 18:28:05.843106 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.843079    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"]
Jul 28 18:28:05.844830 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.844813    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c73c1e/rate-test-model-c73c1e-kserve-5d4f7df699-mqsk8"]
Jul 28 18:28:05.920978 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:05.920954    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a410773-bf6c-46fc-be15-e6b8b989329a" path="/var/lib/kubelet/pods/5a410773-bf6c-46fc-be15-e6b8b989329a/volumes"
Jul 28 18:28:09.326957 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.326923    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"]
Jul 28 18:28:09.327353 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.327316    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a410773-bf6c-46fc-be15-e6b8b989329a" containerName="main"
Jul 28 18:28:09.327353 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.327329    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a410773-bf6c-46fc-be15-e6b8b989329a" containerName="main"
Jul 28 18:28:09.327434 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.327407    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a410773-bf6c-46fc-be15-e6b8b989329a" containerName="main"
Jul 28 18:28:09.331508 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.331490    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.334385 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.334362    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-faea92-openshift-default-dockercfg-6qttn\""
Jul 28 18:28:09.342225 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.342198    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"]
Jul 28 18:28:09.446781 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.446741    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-certs\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.446781 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.446783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcjmz\" (UniqueName: \"kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-kube-api-access-wcjmz\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.447014 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.446811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-token\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.447014 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.446923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-podinfo\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.447014 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.446954    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-data\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.447014 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.446971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39582a9d-83cd-4429-8395-4d7d5361b7a3-istiod-ca-cert\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.447266 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.447064    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-envoy\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.447266 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.447132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-socket\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.447266 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.447172    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-credential-socket\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.547882 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.547849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-podinfo\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548057 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.547893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-data\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548057 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.547911    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39582a9d-83cd-4429-8395-4d7d5361b7a3-istiod-ca-cert\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548057 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.547960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-envoy\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548057 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.548002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-socket\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548057 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.548034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-credential-socket\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548350 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.548082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-certs\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548350 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.548139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcjmz\" (UniqueName: \"kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-kube-api-access-wcjmz\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548350 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.548172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-token\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548350 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.548338    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-data\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548568 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.548471    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-credential-socket\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548568 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.548535    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-socket\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548672 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.548574    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-certs\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.548879 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.548862    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39582a9d-83cd-4429-8395-4d7d5361b7a3-istiod-ca-cert\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.550340 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.550319    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-envoy\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.550566 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.550548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-podinfo\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.557669 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.557648    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-token\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.558651 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.558628    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcjmz\" (UniqueName: \"kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-kube-api-access-wcjmz\") pod \"e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") " pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.644405 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.644353    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:09.781892 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.781862    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"]
Jul 28 18:28:09.783942 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:28:09.783916    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39582a9d_83cd_4429_8395_4d7d5361b7a3.slice/crio-aaeada1c2787e9f8abb350b115653e756c05db349c57e3ea151b763388b82030 WatchSource:0}: Error finding container aaeada1c2787e9f8abb350b115653e756c05db349c57e3ea151b763388b82030: Status 404 returned error can't find the container with id aaeada1c2787e9f8abb350b115653e756c05db349c57e3ea151b763388b82030
Jul 28 18:28:09.786216 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.786179    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:28:09.786296 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.786247    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:28:09.786345 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.786307    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:28:09.841791 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:09.841762    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" event={"ID":"39582a9d-83cd-4429-8395-4d7d5361b7a3","Type":"ContainerStarted","Data":"aaeada1c2787e9f8abb350b115653e756c05db349c57e3ea151b763388b82030"}
Jul 28 18:28:10.847925 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:10.847890    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" event={"ID":"39582a9d-83cd-4429-8395-4d7d5361b7a3","Type":"ContainerStarted","Data":"b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2"}
Jul 28 18:28:10.870722 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:10.870672    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" podStartSLOduration=1.870656168 podStartE2EDuration="1.870656168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:28:10.870005525 +0000 UTC m=+3231.470602360" watchObservedRunningTime="2026-07-28 18:28:10.870656168 +0000 UTC m=+3231.471253000"
Jul 28 18:28:11.644532 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:11.644504    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:11.649308 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:11.649283    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:11.858841 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:11.858764    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:11.859710 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:11.859691    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:13.687725 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.687693    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"]
Jul 28 18:28:13.691943 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.691923    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:28:13.694730 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.694706    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-faea92\""
Jul 28 18:28:13.694730 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.694730    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-faea92-dockercfg-csvlf\""
Jul 28 18:28:13.700419 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.700284    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"]
Jul 28 18:28:13.781037 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.780999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aaaf107-26fb-4d4a-9734-f068c9e8e528-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf\" (UID: \"5aaaf107-26fb-4d4a-9734-f068c9e8e528\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:28:13.781240 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.781196    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6xt7\" (UniqueName: \"kubernetes.io/projected/5aaaf107-26fb-4d4a-9734-f068c9e8e528-kube-api-access-v6xt7\") pod \"payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf\" (UID: \"5aaaf107-26fb-4d4a-9734-f068c9e8e528\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:28:13.882424 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.882390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6xt7\" (UniqueName: \"kubernetes.io/projected/5aaaf107-26fb-4d4a-9734-f068c9e8e528-kube-api-access-v6xt7\") pod \"payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf\" (UID: \"5aaaf107-26fb-4d4a-9734-f068c9e8e528\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:28:13.882627 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.882458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aaaf107-26fb-4d4a-9734-f068c9e8e528-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf\" (UID: \"5aaaf107-26fb-4d4a-9734-f068c9e8e528\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:28:13.883195 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.883165    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aaaf107-26fb-4d4a-9734-f068c9e8e528-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf\" (UID: \"5aaaf107-26fb-4d4a-9734-f068c9e8e528\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:28:13.891406 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:13.891381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6xt7\" (UniqueName: \"kubernetes.io/projected/5aaaf107-26fb-4d4a-9734-f068c9e8e528-kube-api-access-v6xt7\") pod \"payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf\" (UID: \"5aaaf107-26fb-4d4a-9734-f068c9e8e528\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:28:14.004493 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:14.004467    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:28:14.145167 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:14.145143    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"]
Jul 28 18:28:14.146944 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:28:14.146911    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aaaf107_26fb_4d4a_9734_f068c9e8e528.slice/crio-53aacb8588df6b2369056e55f823b3ba48d65fd40a3f3f323a467cf14a0cefb1 WatchSource:0}: Error finding container 53aacb8588df6b2369056e55f823b3ba48d65fd40a3f3f323a467cf14a0cefb1: Status 404 returned error can't find the container with id 53aacb8588df6b2369056e55f823b3ba48d65fd40a3f3f323a467cf14a0cefb1
Jul 28 18:28:14.874950 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:14.874918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf" event={"ID":"5aaaf107-26fb-4d4a-9734-f068c9e8e528","Type":"ContainerStarted","Data":"33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46"}
Jul 28 18:28:14.875371 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:14.874979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf" event={"ID":"5aaaf107-26fb-4d4a-9734-f068c9e8e528","Type":"ContainerStarted","Data":"53aacb8588df6b2369056e55f823b3ba48d65fd40a3f3f323a467cf14a0cefb1"}
Jul 28 18:28:14.875371 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:14.875073    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:28:14.891320 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:14.891266    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf" podStartSLOduration=1.891253545 podStartE2EDuration="1.891253545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:28:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:28:14.890602583 +0000 UTC m=+3235.491199421" watchObservedRunningTime="2026-07-28 18:28:14.891253545 +0000 UTC m=+3235.491850376"
Jul 28 18:28:25.881969 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:25.881936    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:28:27.900277 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:27.900237    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 18:28:27.900699 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:27.900298    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 18:28:29.958314 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:29.958280    2561 generic.go:356] "Generic (PLEG): container finished" podID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerID="b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2" exitCode=0
Jul 28 18:28:29.958738 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:29.958329    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" event={"ID":"39582a9d-83cd-4429-8395-4d7d5361b7a3","Type":"ContainerDied","Data":"b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2"}
Jul 28 18:28:29.958738 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:29.958658    2561 scope.go:117] "RemoveContainer" containerID="b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2"
Jul 28 18:28:29.959820 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:29.959782    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:28:29.959897 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:29.959881    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:28:29.959952 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:29.959936    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:28:30.965936 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:30.965897    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" event={"ID":"39582a9d-83cd-4429-8395-4d7d5361b7a3","Type":"ContainerStarted","Data":"d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d"}
Jul 28 18:28:31.644779 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:31.644748    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:31.644941 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:31.644904    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 28 18:28:31.644987 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:31.644957    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 28 18:28:32.644710 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:32.644609    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 28 18:28:32.644710 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:32.644681    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 28 18:28:33.644655 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:33.644619    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 28 18:28:33.644840 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:33.644684    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 28 18:28:34.644635 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:34.644599    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 28 18:28:34.644814 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:34.644664    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 28 18:28:35.648791 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:35.648760    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:35.649269 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:35.649044    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:35.649802 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:35.649783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:28:38.897861 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:38.897831    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"]
Jul 28 18:28:38.900509 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:38.900485    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:38.903234 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:38.903209    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-d53588-openshift-default-dockercfg-h8pwr\""
Jul 28 18:28:38.913910 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:38.913888    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"]
Jul 28 18:28:38.999951 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:38.999915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-token\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.000177 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:38.999968    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-data\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.000177 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.000002    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-credential-socket\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.000177 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.000054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-socket\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.000177 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.000115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95ab2be5-55d1-49ad-848a-df2fda98948d-istiod-ca-cert\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.000177 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.000148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-envoy\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.000473 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.000201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbdx9\" (UniqueName: \"kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-kube-api-access-cbdx9\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.000473 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.000229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-podinfo\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.000473 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.000303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-certs\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.100836 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.100805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-token\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.100836 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.100838    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-data\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101078 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.100857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-credential-socket\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101078 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.100890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-socket\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101078 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.101022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95ab2be5-55d1-49ad-848a-df2fda98948d-istiod-ca-cert\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101078 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.101070    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-envoy\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101345 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.101136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbdx9\" (UniqueName: \"kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-kube-api-access-cbdx9\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101345 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.101161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-podinfo\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101345 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.101245    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-certs\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101345 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.101272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-socket\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101520 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.101353    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-credential-socket\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101520 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.101437    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-data\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101614 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.101593    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-certs\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.101767 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.101749    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95ab2be5-55d1-49ad-848a-df2fda98948d-istiod-ca-cert\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.103230 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.103204    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-envoy\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.103609 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.103590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-podinfo\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.110154 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.110133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-token\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.110541 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.110522    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbdx9\" (UniqueName: \"kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-kube-api-access-cbdx9\") pod \"e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") " pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.211715 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.211639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:39.351083 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.351053    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"]
Jul 28 18:28:39.352995 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:28:39.352954    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ab2be5_55d1_49ad_848a_df2fda98948d.slice/crio-f29dfd730da794e1780948608c6d861fe917b208ae39cd63642707894ba71ab4 WatchSource:0}: Error finding container f29dfd730da794e1780948608c6d861fe917b208ae39cd63642707894ba71ab4: Status 404 returned error can't find the container with id f29dfd730da794e1780948608c6d861fe917b208ae39cd63642707894ba71ab4
Jul 28 18:28:39.355166 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.355129    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:28:39.355267 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.355196    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:28:39.355267 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:39.355222    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:28:40.025514 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:40.025483    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" event={"ID":"95ab2be5-55d1-49ad-848a-df2fda98948d","Type":"ContainerStarted","Data":"fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74"}
Jul 28 18:28:40.025887 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:40.025531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" event={"ID":"95ab2be5-55d1-49ad-848a-df2fda98948d","Type":"ContainerStarted","Data":"f29dfd730da794e1780948608c6d861fe917b208ae39cd63642707894ba71ab4"}
Jul 28 18:28:40.046752 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:40.046709    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" podStartSLOduration=2.046695161 podStartE2EDuration="2.046695161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:28:40.045257368 +0000 UTC m=+3260.645854225" watchObservedRunningTime="2026-07-28 18:28:40.046695161 +0000 UTC m=+3260.647291994"
Jul 28 18:28:40.211992 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:40.211957    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:40.216950 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:40.216922    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:41.030034 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:41.030005    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:28:41.030934 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:28:41.030913    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:29:01.134498 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:01.134463    2561 generic.go:356] "Generic (PLEG): container finished" podID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerID="fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74" exitCode=0
Jul 28 18:29:01.134960 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:01.134537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" event={"ID":"95ab2be5-55d1-49ad-848a-df2fda98948d","Type":"ContainerDied","Data":"fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74"}
Jul 28 18:29:01.135007 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:01.134965    2561 scope.go:117] "RemoveContainer" containerID="fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74"
Jul 28 18:29:01.136064 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:01.136038    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:29:01.136157 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:01.136126    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:29:01.136199 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:01.136159    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:29:02.141301 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:02.141263    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" event={"ID":"95ab2be5-55d1-49ad-848a-df2fda98948d","Type":"ContainerStarted","Data":"8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d"}
Jul 28 18:29:02.211978 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:02.211943    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:29:02.212300 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:02.212270    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 18:29:02.212420 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:02.212320    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 18:29:03.212296 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:03.212255    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 18:29:03.212698 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:03.212331    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 18:29:04.212869 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:04.212834    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 18:29:04.213313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:04.212887    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 18:29:05.212043 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:05.212001    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 18:29:05.212286 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:05.212072    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 18:29:06.215865 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:06.215837    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:29:06.216320 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:06.216111    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:29:06.216844 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:06.216823    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:29:14.194246 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:14.194206    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-265dr_f09fd716-542d-4aa0-93e3-688e2617c874/payload-processing/0.log"
Jul 28 18:29:20.087014 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:20.086976    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:29:20.095272 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:20.095243    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:29:59.282175 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:59.282087    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf_5aaaf107-26fb-4d4a-9734-f068c9e8e528/payload-processing/0.log"
Jul 28 18:29:59.415872 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:29:59.415842    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-265dr_f09fd716-542d-4aa0-93e3-688e2617c874/payload-processing/0.log"
Jul 28 18:30:00.249870 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.249832    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"]
Jul 28 18:30:00.252987 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.252962    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.255636 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.255615    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-b2ad79-openshift-default-dockercfg-hn2z4\""
Jul 28 18:30:00.264235 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.264210    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"]
Jul 28 18:30:00.369532 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.369495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-socket\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.369949 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.369570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-token\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.369949 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.369601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-envoy\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.369949 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.369630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.369949 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.369716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-certs\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.369949 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.369812    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-data\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.369949 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.369842    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-podinfo\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.369949 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.369899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-credential-socket\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.369949 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.369949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-427ct\" (UniqueName: \"kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-kube-api-access-427ct\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471137 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-data\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471320 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-podinfo\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471320 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-credential-socket\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471320 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-427ct\" (UniqueName: \"kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-kube-api-access-427ct\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471320 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-socket\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471561 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-token\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471561 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-envoy\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471561 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471407    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471561 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-certs\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471561 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-data\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471840 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-credential-socket\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471840 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471710    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-socket\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.471840 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.471807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-certs\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.472220 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.472199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.473603 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.473585    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-envoy\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.473734 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.473715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-podinfo\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.479985 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.479952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-token\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.480206 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.480188    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-427ct\" (UniqueName: \"kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-kube-api-access-427ct\") pod \"e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") " pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.565827 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.565759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:00.714323 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.714289    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"]
Jul 28 18:30:00.716496 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:30:00.716465    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8aea9b_4469_4a95_bae5_6ba06c079e03.slice/crio-b9b161dc96832c284ebb46fc807fc46e49f8aad0c18e9c8fe0d3bd0147e0491e WatchSource:0}: Error finding container b9b161dc96832c284ebb46fc807fc46e49f8aad0c18e9c8fe0d3bd0147e0491e: Status 404 returned error can't find the container with id b9b161dc96832c284ebb46fc807fc46e49f8aad0c18e9c8fe0d3bd0147e0491e
Jul 28 18:30:00.718822 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.718782    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:30:00.718951 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.718865    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:30:00.718951 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:00.718904    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:30:01.437593 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:01.437560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" event={"ID":"6f8aea9b-4469-4a95-bae5-6ba06c079e03","Type":"ContainerStarted","Data":"44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89"}
Jul 28 18:30:01.437969 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:01.437611    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" event={"ID":"6f8aea9b-4469-4a95-bae5-6ba06c079e03","Type":"ContainerStarted","Data":"b9b161dc96832c284ebb46fc807fc46e49f8aad0c18e9c8fe0d3bd0147e0491e"}
Jul 28 18:30:01.459806 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:01.459758    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" podStartSLOduration=1.459744037 podStartE2EDuration="1.459744037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:30:01.458499549 +0000 UTC m=+3342.059096384" watchObservedRunningTime="2026-07-28 18:30:01.459744037 +0000 UTC m=+3342.060340869"
Jul 28 18:30:01.566294 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:01.566262    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:01.579252 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:01.579217    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:02.443148 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:02.443120    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:02.444001 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:02.443979    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:16.521048 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:16.521011    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerID="44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89" exitCode=0
Jul 28 18:30:16.521470 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:16.521069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" event={"ID":"6f8aea9b-4469-4a95-bae5-6ba06c079e03","Type":"ContainerDied","Data":"44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89"}
Jul 28 18:30:16.521514 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:16.521481    2561 scope.go:117] "RemoveContainer" containerID="44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89"
Jul 28 18:30:16.522655 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:16.522626    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:30:16.522716 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:16.522698    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:30:16.522757 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:16.522731    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 28 18:30:17.443447 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:17.443386    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:17.527605 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:17.527570    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" event={"ID":"6f8aea9b-4469-4a95-bae5-6ba06c079e03","Type":"ContainerStarted","Data":"01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f"}
Jul 28 18:30:17.566426 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:17.566380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:17.567557 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:17.567528    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 18:30:17.567697 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:17.567615    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 18:30:18.566534 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:18.566503    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 18:30:18.567209 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:18.567171    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 18:30:19.567074 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:19.566618    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 18:30:19.567074 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:19.566693    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 18:30:20.566561 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:20.566526    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 18:30:20.566858 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:20.566824    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 18:30:21.569996 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:21.569969    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:21.570462 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:21.570269    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:21.571082 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:21.571063    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:33.758198 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:33.758163    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"]
Jul 28 18:30:33.758750 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:33.758406    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy" containerID="cri-o://01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f" gracePeriod=30
Jul 28 18:30:36.572868 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:36.572838    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 18:30:36.573264 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:36.572892    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 18:30:39.021914 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.021851    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:39.157204 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157176    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-token\") pod \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") "
Jul 28 18:30:39.157392 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157213    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-envoy\") pod \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") "
Jul 28 18:30:39.157392 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157240    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-data\") pod \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") "
Jul 28 18:30:39.157392 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157262    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istiod-ca-cert\") pod \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") "
Jul 28 18:30:39.157392 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157299    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-credential-socket\") pod \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") "
Jul 28 18:30:39.157392 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157341    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-podinfo\") pod \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") "
Jul 28 18:30:39.157668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157405    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-certs\") pod \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") "
Jul 28 18:30:39.157668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157443    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-socket\") pod \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") "
Jul 28 18:30:39.157668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157485    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-427ct\" (UniqueName: \"kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-kube-api-access-427ct\") pod \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\" (UID: \"6f8aea9b-4469-4a95-bae5-6ba06c079e03\") "
Jul 28 18:30:39.157820 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157679    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f8aea9b-4469-4a95-bae5-6ba06c079e03" (UID: "6f8aea9b-4469-4a95-bae5-6ba06c079e03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:30:39.157820 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157795    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:39.158114 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.157997    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f8aea9b-4469-4a95-bae5-6ba06c079e03" (UID: "6f8aea9b-4469-4a95-bae5-6ba06c079e03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:30:39.158114 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.158007    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f8aea9b-4469-4a95-bae5-6ba06c079e03" (UID: "6f8aea9b-4469-4a95-bae5-6ba06c079e03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:30:39.158280 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.158185    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f8aea9b-4469-4a95-bae5-6ba06c079e03" (UID: "6f8aea9b-4469-4a95-bae5-6ba06c079e03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:30:39.158431 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.158404    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f8aea9b-4469-4a95-bae5-6ba06c079e03" (UID: "6f8aea9b-4469-4a95-bae5-6ba06c079e03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:30:39.159850 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.159818    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f8aea9b-4469-4a95-bae5-6ba06c079e03" (UID: "6f8aea9b-4469-4a95-bae5-6ba06c079e03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:30:39.159950 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.159863    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f8aea9b-4469-4a95-bae5-6ba06c079e03" (UID: "6f8aea9b-4469-4a95-bae5-6ba06c079e03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:30:39.160084 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.160063    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f8aea9b-4469-4a95-bae5-6ba06c079e03" (UID: "6f8aea9b-4469-4a95-bae5-6ba06c079e03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:30:39.160084 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.160074    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-kube-api-access-427ct" (OuterVolumeSpecName: "kube-api-access-427ct") pod "6f8aea9b-4469-4a95-bae5-6ba06c079e03" (UID: "6f8aea9b-4469-4a95-bae5-6ba06c079e03"). InnerVolumeSpecName "kube-api-access-427ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:30:39.259035 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.259012    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:39.259035 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.259034    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:39.259228 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.259043    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-427ct\" (UniqueName: \"kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-kube-api-access-427ct\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:39.259228 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.259052    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:39.259228 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.259063    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:39.259228 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.259071    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:39.259228 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.259078    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f8aea9b-4469-4a95-bae5-6ba06c079e03-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:39.259228 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.259086    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f8aea9b-4469-4a95-bae5-6ba06c079e03-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:39.651623 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.651587    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerID="01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f" exitCode=0
Jul 28 18:30:39.651778 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.651645    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"
Jul 28 18:30:39.651778 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.651640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" event={"ID":"6f8aea9b-4469-4a95-bae5-6ba06c079e03","Type":"ContainerDied","Data":"01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f"}
Jul 28 18:30:39.651778 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.651772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4" event={"ID":"6f8aea9b-4469-4a95-bae5-6ba06c079e03","Type":"ContainerDied","Data":"b9b161dc96832c284ebb46fc807fc46e49f8aad0c18e9c8fe0d3bd0147e0491e"}
Jul 28 18:30:39.651905 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.651804    2561 scope.go:117] "RemoveContainer" containerID="01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f"
Jul 28 18:30:39.661475 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.661460    2561 scope.go:117] "RemoveContainer" containerID="44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89"
Jul 28 18:30:39.669568 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.669550    2561 scope.go:117] "RemoveContainer" containerID="01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f"
Jul 28 18:30:39.669810 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:30:39.669787    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f\": container with ID starting with 01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f not found: ID does not exist" containerID="01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f"
Jul 28 18:30:39.669861 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.669821    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f"} err="failed to get container status \"01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f\": rpc error: code = NotFound desc = could not find container \"01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f\": container with ID starting with 01b89ba2dfed93a8fe72c2f5081bcda9f380dd257e390e980bfc44bd9be1c34f not found: ID does not exist"
Jul 28 18:30:39.669861 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.669843    2561 scope.go:117] "RemoveContainer" containerID="44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89"
Jul 28 18:30:39.670059 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:30:39.670043    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89\": container with ID starting with 44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89 not found: ID does not exist" containerID="44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89"
Jul 28 18:30:39.670123 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.670063    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89"} err="failed to get container status \"44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89\": rpc error: code = NotFound desc = could not find container \"44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89\": container with ID starting with 44656ed65374854918f769c7f48e566efbaddd904aeb6688213884a037e8ae89 not found: ID does not exist"
Jul 28 18:30:39.675942 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.675917    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"]
Jul 28 18:30:39.680148 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.680127    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2ad79-openshift-default-55dbf88d54-qmww4"]
Jul 28 18:30:39.921645 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:39.921557    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" path="/var/lib/kubelet/pods/6f8aea9b-4469-4a95-bae5-6ba06c079e03/volumes"
Jul 28 18:30:52.967376 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:52.967345    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"]
Jul 28 18:30:52.967847 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:52.967599    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf" podUID="5aaaf107-26fb-4d4a-9734-f068c9e8e528" containerName="payload-processing" containerID="cri-o://33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46" gracePeriod=30
Jul 28 18:30:53.234568 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.234545    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:30:53.281170 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.281144    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aaaf107-26fb-4d4a-9734-f068c9e8e528-plugins-config-volume\") pod \"5aaaf107-26fb-4d4a-9734-f068c9e8e528\" (UID: \"5aaaf107-26fb-4d4a-9734-f068c9e8e528\") "
Jul 28 18:30:53.281289 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.281247    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6xt7\" (UniqueName: \"kubernetes.io/projected/5aaaf107-26fb-4d4a-9734-f068c9e8e528-kube-api-access-v6xt7\") pod \"5aaaf107-26fb-4d4a-9734-f068c9e8e528\" (UID: \"5aaaf107-26fb-4d4a-9734-f068c9e8e528\") "
Jul 28 18:30:53.281495 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.281470    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aaaf107-26fb-4d4a-9734-f068c9e8e528-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5aaaf107-26fb-4d4a-9734-f068c9e8e528" (UID: "5aaaf107-26fb-4d4a-9734-f068c9e8e528"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:30:53.283367 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.283344    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aaaf107-26fb-4d4a-9734-f068c9e8e528-kube-api-access-v6xt7" (OuterVolumeSpecName: "kube-api-access-v6xt7") pod "5aaaf107-26fb-4d4a-9734-f068c9e8e528" (UID: "5aaaf107-26fb-4d4a-9734-f068c9e8e528"). InnerVolumeSpecName "kube-api-access-v6xt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:30:53.382145 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.382117    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6xt7\" (UniqueName: \"kubernetes.io/projected/5aaaf107-26fb-4d4a-9734-f068c9e8e528-kube-api-access-v6xt7\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:53.382145 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.382142    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aaaf107-26fb-4d4a-9734-f068c9e8e528-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:30:53.725404 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.725375    2561 generic.go:356] "Generic (PLEG): container finished" podID="5aaaf107-26fb-4d4a-9734-f068c9e8e528" containerID="33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46" exitCode=0
Jul 28 18:30:53.725517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.725420    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"
Jul 28 18:30:53.725517 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.725459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf" event={"ID":"5aaaf107-26fb-4d4a-9734-f068c9e8e528","Type":"ContainerDied","Data":"33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46"}
Jul 28 18:30:53.725593 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.725515    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf" event={"ID":"5aaaf107-26fb-4d4a-9734-f068c9e8e528","Type":"ContainerDied","Data":"53aacb8588df6b2369056e55f823b3ba48d65fd40a3f3f323a467cf14a0cefb1"}
Jul 28 18:30:53.725593 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.725542    2561 scope.go:117] "RemoveContainer" containerID="33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46"
Jul 28 18:30:53.734473 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.734458    2561 scope.go:117] "RemoveContainer" containerID="33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46"
Jul 28 18:30:53.734748 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:30:53.734710    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46\": container with ID starting with 33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46 not found: ID does not exist" containerID="33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46"
Jul 28 18:30:53.734806 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.734755    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46"} err="failed to get container status \"33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46\": rpc error: code = NotFound desc = could not find container \"33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46\": container with ID starting with 33c84f6850b6bfc46aa989a791a2ef8f636245a00ceba29653b61526550d9a46 not found: ID does not exist"
Jul 28 18:30:53.747963 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.747939    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"]
Jul 28 18:30:53.752653 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.752633    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-faea92-57966cb886-qw7jf"]
Jul 28 18:30:53.921237 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:30:53.921213    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aaaf107-26fb-4d4a-9734-f068c9e8e528" path="/var/lib/kubelet/pods/5aaaf107-26fb-4d4a-9734-f068c9e8e528/volumes"
Jul 28 18:31:43.575143 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:43.575110    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"]
Jul 28 18:31:43.575635 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:43.575430    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy" containerID="cri-o://d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d" gracePeriod=30
Jul 28 18:31:48.830020 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.829996    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:31:48.852340 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.852248    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcjmz\" (UniqueName: \"kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-kube-api-access-wcjmz\") pod \"39582a9d-83cd-4429-8395-4d7d5361b7a3\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") "
Jul 28 18:31:48.852340 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.852297    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-envoy\") pod \"39582a9d-83cd-4429-8395-4d7d5361b7a3\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") "
Jul 28 18:31:48.852534 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.852353    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39582a9d-83cd-4429-8395-4d7d5361b7a3-istiod-ca-cert\") pod \"39582a9d-83cd-4429-8395-4d7d5361b7a3\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") "
Jul 28 18:31:48.852534 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.852485    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-data\") pod \"39582a9d-83cd-4429-8395-4d7d5361b7a3\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") "
Jul 28 18:31:48.852534 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.852527    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-podinfo\") pod \"39582a9d-83cd-4429-8395-4d7d5361b7a3\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") "
Jul 28 18:31:48.853707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.852788    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-credential-socket\") pod \"39582a9d-83cd-4429-8395-4d7d5361b7a3\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") "
Jul 28 18:31:48.853707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.852854    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-token\") pod \"39582a9d-83cd-4429-8395-4d7d5361b7a3\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") "
Jul 28 18:31:48.853707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.852884    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-certs\") pod \"39582a9d-83cd-4429-8395-4d7d5361b7a3\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") "
Jul 28 18:31:48.853707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.852923    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-socket\") pod \"39582a9d-83cd-4429-8395-4d7d5361b7a3\" (UID: \"39582a9d-83cd-4429-8395-4d7d5361b7a3\") "
Jul 28 18:31:48.853707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.853063    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39582a9d-83cd-4429-8395-4d7d5361b7a3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "39582a9d-83cd-4429-8395-4d7d5361b7a3" (UID: "39582a9d-83cd-4429-8395-4d7d5361b7a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:31:48.853707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.853348    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "39582a9d-83cd-4429-8395-4d7d5361b7a3" (UID: "39582a9d-83cd-4429-8395-4d7d5361b7a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:31:48.853707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.853415    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39582a9d-83cd-4429-8395-4d7d5361b7a3-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:31:48.853707 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.853655    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "39582a9d-83cd-4429-8395-4d7d5361b7a3" (UID: "39582a9d-83cd-4429-8395-4d7d5361b7a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:31:48.854427 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.854381    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-data" (OuterVolumeSpecName: "istio-data") pod "39582a9d-83cd-4429-8395-4d7d5361b7a3" (UID: "39582a9d-83cd-4429-8395-4d7d5361b7a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:31:48.854637 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.854599    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "39582a9d-83cd-4429-8395-4d7d5361b7a3" (UID: "39582a9d-83cd-4429-8395-4d7d5361b7a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:31:48.854890 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.854863    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-kube-api-access-wcjmz" (OuterVolumeSpecName: "kube-api-access-wcjmz") pod "39582a9d-83cd-4429-8395-4d7d5361b7a3" (UID: "39582a9d-83cd-4429-8395-4d7d5361b7a3"). InnerVolumeSpecName "kube-api-access-wcjmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:31:48.855441 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.855413    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "39582a9d-83cd-4429-8395-4d7d5361b7a3" (UID: "39582a9d-83cd-4429-8395-4d7d5361b7a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:31:48.856595 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.856563    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "39582a9d-83cd-4429-8395-4d7d5361b7a3" (UID: "39582a9d-83cd-4429-8395-4d7d5361b7a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:31:48.856825 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.856798    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-token" (OuterVolumeSpecName: "istio-token") pod "39582a9d-83cd-4429-8395-4d7d5361b7a3" (UID: "39582a9d-83cd-4429-8395-4d7d5361b7a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:31:48.954336 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.954313    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcjmz\" (UniqueName: \"kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-kube-api-access-wcjmz\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:31:48.954336 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.954334    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:31:48.954503 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.954343    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:31:48.954503 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.954351    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:31:48.954503 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.954359    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:31:48.954503 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.954367    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39582a9d-83cd-4429-8395-4d7d5361b7a3-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:31:48.954503 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.954375    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:31:48.954503 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.954382    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39582a9d-83cd-4429-8395-4d7d5361b7a3-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:31:48.998022 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.997996    2561 generic.go:356] "Generic (PLEG): container finished" podID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerID="d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d" exitCode=0
Jul 28 18:31:48.998166 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.998041    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"
Jul 28 18:31:48.998166 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.998084    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" event={"ID":"39582a9d-83cd-4429-8395-4d7d5361b7a3","Type":"ContainerDied","Data":"d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d"}
Jul 28 18:31:48.998166 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.998151    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss" event={"ID":"39582a9d-83cd-4429-8395-4d7d5361b7a3","Type":"ContainerDied","Data":"aaeada1c2787e9f8abb350b115653e756c05db349c57e3ea151b763388b82030"}
Jul 28 18:31:48.998280 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:48.998173    2561 scope.go:117] "RemoveContainer" containerID="d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d"
Jul 28 18:31:49.007849 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:49.007825    2561 scope.go:117] "RemoveContainer" containerID="b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2"
Jul 28 18:31:49.017253 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:49.017233    2561 scope.go:117] "RemoveContainer" containerID="d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d"
Jul 28 18:31:49.017537 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:31:49.017509    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d\": container with ID starting with d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d not found: ID does not exist" containerID="d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d"
Jul 28 18:31:49.017652 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:49.017543    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d"} err="failed to get container status \"d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d\": rpc error: code = NotFound desc = could not find container \"d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d\": container with ID starting with d1896d09563bb1ef2345e515c4e424d11200757731ca2d7d50a82b1b6972608d not found: ID does not exist"
Jul 28 18:31:49.017652 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:49.017564    2561 scope.go:117] "RemoveContainer" containerID="b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2"
Jul 28 18:31:49.017813 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:31:49.017792    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2\": container with ID starting with b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2 not found: ID does not exist" containerID="b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2"
Jul 28 18:31:49.017891 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:49.017816    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2"} err="failed to get container status \"b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2\": rpc error: code = NotFound desc = could not find container \"b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2\": container with ID starting with b09dc5530026860b50dc04e7793285a97be58ecd3a7da7a5185dd0412985c0c2 not found: ID does not exist"
Jul 28 18:31:49.026825 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:49.024510    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"]
Jul 28 18:31:49.033790 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:49.033723    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-faea92-openshift-default-6c86d8bbdb-bw8ss"]
Jul 28 18:31:49.920501 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:49.920466    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" path="/var/lib/kubelet/pods/39582a9d-83cd-4429-8395-4d7d5361b7a3/volumes"
Jul 28 18:31:59.191931 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:59.191896    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"]
Jul 28 18:31:59.192523 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:31:59.192183    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy" containerID="cri-o://8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d" gracePeriod=30
Jul 28 18:32:04.463326 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.463261    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:32:04.585108 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585076    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-socket\") pod \"95ab2be5-55d1-49ad-848a-df2fda98948d\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") "
Jul 28 18:32:04.585240 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585159    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-credential-socket\") pod \"95ab2be5-55d1-49ad-848a-df2fda98948d\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") "
Jul 28 18:32:04.585240 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585180    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-data\") pod \"95ab2be5-55d1-49ad-848a-df2fda98948d\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") "
Jul 28 18:32:04.585240 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585203    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-certs\") pod \"95ab2be5-55d1-49ad-848a-df2fda98948d\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") "
Jul 28 18:32:04.585240 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585218    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95ab2be5-55d1-49ad-848a-df2fda98948d-istiod-ca-cert\") pod \"95ab2be5-55d1-49ad-848a-df2fda98948d\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") "
Jul 28 18:32:04.585441 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585242    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-envoy\") pod \"95ab2be5-55d1-49ad-848a-df2fda98948d\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") "
Jul 28 18:32:04.585441 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585289    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbdx9\" (UniqueName: \"kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-kube-api-access-cbdx9\") pod \"95ab2be5-55d1-49ad-848a-df2fda98948d\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") "
Jul 28 18:32:04.585441 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585317    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-podinfo\") pod \"95ab2be5-55d1-49ad-848a-df2fda98948d\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") "
Jul 28 18:32:04.585441 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585344    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-token\") pod \"95ab2be5-55d1-49ad-848a-df2fda98948d\" (UID: \"95ab2be5-55d1-49ad-848a-df2fda98948d\") "
Jul 28 18:32:04.585441 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585355    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95ab2be5-55d1-49ad-848a-df2fda98948d" (UID: "95ab2be5-55d1-49ad-848a-df2fda98948d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:04.585712 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585515    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95ab2be5-55d1-49ad-848a-df2fda98948d" (UID: "95ab2be5-55d1-49ad-848a-df2fda98948d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:04.585849 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585808    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95ab2be5-55d1-49ad-848a-df2fda98948d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95ab2be5-55d1-49ad-848a-df2fda98948d" (UID: "95ab2be5-55d1-49ad-848a-df2fda98948d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:32:04.585849 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585829    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95ab2be5-55d1-49ad-848a-df2fda98948d" (UID: "95ab2be5-55d1-49ad-848a-df2fda98948d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:04.585849 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585821    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:04.586032 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.585867    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:04.586120 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.586084    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-data" (OuterVolumeSpecName: "istio-data") pod "95ab2be5-55d1-49ad-848a-df2fda98948d" (UID: "95ab2be5-55d1-49ad-848a-df2fda98948d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:04.587526 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.587503    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95ab2be5-55d1-49ad-848a-df2fda98948d" (UID: "95ab2be5-55d1-49ad-848a-df2fda98948d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:04.587659 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.587545    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-kube-api-access-cbdx9" (OuterVolumeSpecName: "kube-api-access-cbdx9") pod "95ab2be5-55d1-49ad-848a-df2fda98948d" (UID: "95ab2be5-55d1-49ad-848a-df2fda98948d"). InnerVolumeSpecName "kube-api-access-cbdx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:32:04.587898 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.587874    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95ab2be5-55d1-49ad-848a-df2fda98948d" (UID: "95ab2be5-55d1-49ad-848a-df2fda98948d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:32:04.587999 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.587904    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-token" (OuterVolumeSpecName: "istio-token") pod "95ab2be5-55d1-49ad-848a-df2fda98948d" (UID: "95ab2be5-55d1-49ad-848a-df2fda98948d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:32:04.686527 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.686496    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:04.686527 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.686517    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:04.686527 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.686528    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95ab2be5-55d1-49ad-848a-df2fda98948d-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:04.686527 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.686536    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:04.686853 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.686543    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbdx9\" (UniqueName: \"kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-kube-api-access-cbdx9\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:04.686853 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.686553    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:04.686853 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:04.686560    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95ab2be5-55d1-49ad-848a-df2fda98948d-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:05.075297 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.075260    2561 generic.go:356] "Generic (PLEG): container finished" podID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerID="8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d" exitCode=0
Jul 28 18:32:05.075297 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.075292    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" event={"ID":"95ab2be5-55d1-49ad-848a-df2fda98948d","Type":"ContainerDied","Data":"8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d"}
Jul 28 18:32:05.075565 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.075314    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"
Jul 28 18:32:05.075565 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.075344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf" event={"ID":"95ab2be5-55d1-49ad-848a-df2fda98948d","Type":"ContainerDied","Data":"f29dfd730da794e1780948608c6d861fe917b208ae39cd63642707894ba71ab4"}
Jul 28 18:32:05.075565 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.075366    2561 scope.go:117] "RemoveContainer" containerID="8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d"
Jul 28 18:32:05.085009 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.084992    2561 scope.go:117] "RemoveContainer" containerID="fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74"
Jul 28 18:32:05.092859 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.092844    2561 scope.go:117] "RemoveContainer" containerID="8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d"
Jul 28 18:32:05.093128 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:32:05.093112    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d\": container with ID starting with 8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d not found: ID does not exist" containerID="8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d"
Jul 28 18:32:05.093174 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.093135    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d"} err="failed to get container status \"8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d\": rpc error: code = NotFound desc = could not find container \"8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d\": container with ID starting with 8ab491df10356cad165ce06b8c52fe7db712b64647a5b8b9a0d06afd24eb7d0d not found: ID does not exist"
Jul 28 18:32:05.093174 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.093151    2561 scope.go:117] "RemoveContainer" containerID="fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74"
Jul 28 18:32:05.093364 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:32:05.093348    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74\": container with ID starting with fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74 not found: ID does not exist" containerID="fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74"
Jul 28 18:32:05.093405 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.093372    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74"} err="failed to get container status \"fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74\": rpc error: code = NotFound desc = could not find container \"fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74\": container with ID starting with fa6d58a4d368e462a53d2a7748a2db7a0cb4891301d24d9591d6834fac039d74 not found: ID does not exist"
Jul 28 18:32:05.098359 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.098340    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"]
Jul 28 18:32:05.103007 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.102987    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-d53588-openshift-default-57955b8cdb-6bhsf"]
Jul 28 18:32:05.926007 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:05.925972    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" path="/var/lib/kubelet/pods/95ab2be5-55d1-49ad-848a-df2fda98948d/volumes"
Jul 28 18:32:07.925455 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:07.925426    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"]
Jul 28 18:32:07.925860 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:07.925630    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f" podUID="053a4136-134f-48a1-bc30-ab503d2aaf81" containerName="payload-processing" containerID="cri-o://09c1df7d1a8e41057df0f3279d19bc8d29e1e3d92250d5cdc7c6e87f9058c778" gracePeriod=30
Jul 28 18:32:07.983947 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:07.983899    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"]
Jul 28 18:32:07.984506 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:07.984447    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq" podUID="99bdc937-fa93-4693-953d-0fad572e1e35" containerName="payload-pre-processing" containerID="cri-o://ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b" gracePeriod=30
Jul 28 18:32:08.091486 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.091461    2561 generic.go:356] "Generic (PLEG): container finished" podID="053a4136-134f-48a1-bc30-ab503d2aaf81" containerID="09c1df7d1a8e41057df0f3279d19bc8d29e1e3d92250d5cdc7c6e87f9058c778" exitCode=0
Jul 28 18:32:08.091577 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.091510    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f" event={"ID":"053a4136-134f-48a1-bc30-ab503d2aaf81","Type":"ContainerDied","Data":"09c1df7d1a8e41057df0f3279d19bc8d29e1e3d92250d5cdc7c6e87f9058c778"}
Jul 28 18:32:08.264562 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.264536    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:32:08.267299 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.267279    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:32:08.420040 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.420006    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnctw\" (UniqueName: \"kubernetes.io/projected/99bdc937-fa93-4693-953d-0fad572e1e35-kube-api-access-gnctw\") pod \"99bdc937-fa93-4693-953d-0fad572e1e35\" (UID: \"99bdc937-fa93-4693-953d-0fad572e1e35\") "
Jul 28 18:32:08.420040 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.420043    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99bdc937-fa93-4693-953d-0fad572e1e35-plugins-config-volume\") pod \"99bdc937-fa93-4693-953d-0fad572e1e35\" (UID: \"99bdc937-fa93-4693-953d-0fad572e1e35\") "
Jul 28 18:32:08.420290 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.420110    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/053a4136-134f-48a1-bc30-ab503d2aaf81-plugins-config-volume\") pod \"053a4136-134f-48a1-bc30-ab503d2aaf81\" (UID: \"053a4136-134f-48a1-bc30-ab503d2aaf81\") "
Jul 28 18:32:08.420290 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.420127    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j5js\" (UniqueName: \"kubernetes.io/projected/053a4136-134f-48a1-bc30-ab503d2aaf81-kube-api-access-2j5js\") pod \"053a4136-134f-48a1-bc30-ab503d2aaf81\" (UID: \"053a4136-134f-48a1-bc30-ab503d2aaf81\") "
Jul 28 18:32:08.420533 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.420505    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/053a4136-134f-48a1-bc30-ab503d2aaf81-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "053a4136-134f-48a1-bc30-ab503d2aaf81" (UID: "053a4136-134f-48a1-bc30-ab503d2aaf81"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:32:08.420668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.420534    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99bdc937-fa93-4693-953d-0fad572e1e35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "99bdc937-fa93-4693-953d-0fad572e1e35" (UID: "99bdc937-fa93-4693-953d-0fad572e1e35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:32:08.422192 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.422169    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99bdc937-fa93-4693-953d-0fad572e1e35-kube-api-access-gnctw" (OuterVolumeSpecName: "kube-api-access-gnctw") pod "99bdc937-fa93-4693-953d-0fad572e1e35" (UID: "99bdc937-fa93-4693-953d-0fad572e1e35"). InnerVolumeSpecName "kube-api-access-gnctw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:32:08.422279 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.422177    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053a4136-134f-48a1-bc30-ab503d2aaf81-kube-api-access-2j5js" (OuterVolumeSpecName: "kube-api-access-2j5js") pod "053a4136-134f-48a1-bc30-ab503d2aaf81" (UID: "053a4136-134f-48a1-bc30-ab503d2aaf81"). InnerVolumeSpecName "kube-api-access-2j5js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:32:08.521464 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.521434    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnctw\" (UniqueName: \"kubernetes.io/projected/99bdc937-fa93-4693-953d-0fad572e1e35-kube-api-access-gnctw\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:08.521464 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.521460    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99bdc937-fa93-4693-953d-0fad572e1e35-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:08.521686 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.521471    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/053a4136-134f-48a1-bc30-ab503d2aaf81-plugins-config-volume\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:08.521686 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:08.521480    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j5js\" (UniqueName: \"kubernetes.io/projected/053a4136-134f-48a1-bc30-ab503d2aaf81-kube-api-access-2j5js\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:09.097151 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.097116    2561 generic.go:356] "Generic (PLEG): container finished" podID="99bdc937-fa93-4693-953d-0fad572e1e35" containerID="ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b" exitCode=0
Jul 28 18:32:09.097638 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.097165    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"
Jul 28 18:32:09.097638 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.097176    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq" event={"ID":"99bdc937-fa93-4693-953d-0fad572e1e35","Type":"ContainerDied","Data":"ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b"}
Jul 28 18:32:09.097638 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.097236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq" event={"ID":"99bdc937-fa93-4693-953d-0fad572e1e35","Type":"ContainerDied","Data":"f1969952a780415931a5b61455f68112c0b15a6b522c2cd79285ed7651a08ce1"}
Jul 28 18:32:09.097638 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.097265    2561 scope.go:117] "RemoveContainer" containerID="ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b"
Jul 28 18:32:09.098668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.098499    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"
Jul 28 18:32:09.098668 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.098526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f" event={"ID":"053a4136-134f-48a1-bc30-ab503d2aaf81","Type":"ContainerDied","Data":"02ee46f05cd43844b21d21724a920a26095a0dac82c575240166940e0e479ef7"}
Jul 28 18:32:09.107559 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.107540    2561 scope.go:117] "RemoveContainer" containerID="ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b"
Jul 28 18:32:09.107855 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:32:09.107836    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b\": container with ID starting with ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b not found: ID does not exist" containerID="ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b"
Jul 28 18:32:09.107930 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.107863    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b"} err="failed to get container status \"ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b\": rpc error: code = NotFound desc = could not find container \"ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b\": container with ID starting with ee02a976d75e88752496dae3b7cc022ac54e5a6f505239ffe2aeb63eac128c5b not found: ID does not exist"
Jul 28 18:32:09.107930 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.107883    2561 scope.go:117] "RemoveContainer" containerID="09c1df7d1a8e41057df0f3279d19bc8d29e1e3d92250d5cdc7c6e87f9058c778"
Jul 28 18:32:09.121964 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.121942    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"]
Jul 28 18:32:09.127794 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.127774    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9b5b66-695865cf56-pzxdq"]
Jul 28 18:32:09.139343 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.139312    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"]
Jul 28 18:32:09.143904 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.143886    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9b5b66-75bfb5dc74-zvs9f"]
Jul 28 18:32:09.921134 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.921088    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="053a4136-134f-48a1-bc30-ab503d2aaf81" path="/var/lib/kubelet/pods/053a4136-134f-48a1-bc30-ab503d2aaf81/volumes"
Jul 28 18:32:09.921479 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:09.921465    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99bdc937-fa93-4693-953d-0fad572e1e35" path="/var/lib/kubelet/pods/99bdc937-fa93-4693-953d-0fad572e1e35/volumes"
Jul 28 18:32:16.130245 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:16.130211    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"]
Jul 28 18:32:16.130750 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:16.130424    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy" containerID="cri-o://4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5" gracePeriod=30
Jul 28 18:32:21.396563 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.396492    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:32:21.534740 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.534712    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c760866f-27dd-4ccf-9816-d5dc0fa21161-istiod-ca-cert\") pod \"c760866f-27dd-4ccf-9816-d5dc0fa21161\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") "
Jul 28 18:32:21.534740 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.534745    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-podinfo\") pod \"c760866f-27dd-4ccf-9816-d5dc0fa21161\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") "
Jul 28 18:32:21.534989 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.534801    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-credential-socket\") pod \"c760866f-27dd-4ccf-9816-d5dc0fa21161\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") "
Jul 28 18:32:21.534989 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.534847    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-data\") pod \"c760866f-27dd-4ccf-9816-d5dc0fa21161\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") "
Jul 28 18:32:21.534989 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.534901    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-certs\") pod \"c760866f-27dd-4ccf-9816-d5dc0fa21161\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") "
Jul 28 18:32:21.534989 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.534928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr68c\" (UniqueName: \"kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-kube-api-access-nr68c\") pod \"c760866f-27dd-4ccf-9816-d5dc0fa21161\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") "
Jul 28 18:32:21.534989 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.534982    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-socket\") pod \"c760866f-27dd-4ccf-9816-d5dc0fa21161\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") "
Jul 28 18:32:21.535297 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.535012    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-envoy\") pod \"c760866f-27dd-4ccf-9816-d5dc0fa21161\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") "
Jul 28 18:32:21.535297 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.535045    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-token\") pod \"c760866f-27dd-4ccf-9816-d5dc0fa21161\" (UID: \"c760866f-27dd-4ccf-9816-d5dc0fa21161\") "
Jul 28 18:32:21.535297 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.535165    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c760866f-27dd-4ccf-9816-d5dc0fa21161-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c760866f-27dd-4ccf-9816-d5dc0fa21161" (UID: "c760866f-27dd-4ccf-9816-d5dc0fa21161"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:32:21.535297 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.535165    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c760866f-27dd-4ccf-9816-d5dc0fa21161" (UID: "c760866f-27dd-4ccf-9816-d5dc0fa21161"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:21.535512 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.535322    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c760866f-27dd-4ccf-9816-d5dc0fa21161" (UID: "c760866f-27dd-4ccf-9816-d5dc0fa21161"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:21.535512 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.535353    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c760866f-27dd-4ccf-9816-d5dc0fa21161-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:21.535512 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.535369    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:21.535675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.535528    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c760866f-27dd-4ccf-9816-d5dc0fa21161" (UID: "c760866f-27dd-4ccf-9816-d5dc0fa21161"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:21.535953 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.535925    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-data" (OuterVolumeSpecName: "istio-data") pod "c760866f-27dd-4ccf-9816-d5dc0fa21161" (UID: "c760866f-27dd-4ccf-9816-d5dc0fa21161"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:21.537059 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.537030    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c760866f-27dd-4ccf-9816-d5dc0fa21161" (UID: "c760866f-27dd-4ccf-9816-d5dc0fa21161"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:32:21.537294 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.537274    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c760866f-27dd-4ccf-9816-d5dc0fa21161" (UID: "c760866f-27dd-4ccf-9816-d5dc0fa21161"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:21.537357 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.537287    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-token" (OuterVolumeSpecName: "istio-token") pod "c760866f-27dd-4ccf-9816-d5dc0fa21161" (UID: "c760866f-27dd-4ccf-9816-d5dc0fa21161"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:32:21.537357 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.537302    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-kube-api-access-nr68c" (OuterVolumeSpecName: "kube-api-access-nr68c") pod "c760866f-27dd-4ccf-9816-d5dc0fa21161" (UID: "c760866f-27dd-4ccf-9816-d5dc0fa21161"). InnerVolumeSpecName "kube-api-access-nr68c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:32:21.636485 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.636456    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:21.636485 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.636483    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr68c\" (UniqueName: \"kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-kube-api-access-nr68c\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:21.636661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.636493    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:21.636661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.636502    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:21.636661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.636510    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:21.636661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.636517    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:21.636661 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:21.636525    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c760866f-27dd-4ccf-9816-d5dc0fa21161-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:22.164550 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.164515    2561 generic.go:356] "Generic (PLEG): container finished" podID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerID="4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5" exitCode=0
Jul 28 18:32:22.164550 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.164551    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"
Jul 28 18:32:22.164770 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.164561    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" event={"ID":"c760866f-27dd-4ccf-9816-d5dc0fa21161","Type":"ContainerDied","Data":"4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5"}
Jul 28 18:32:22.164770 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.164609    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d" event={"ID":"c760866f-27dd-4ccf-9816-d5dc0fa21161","Type":"ContainerDied","Data":"a0b46a96f717e3683f3cd4fe434b85a40fd163c115f6b7bac0c4ce93a404f5df"}
Jul 28 18:32:22.164770 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.164631    2561 scope.go:117] "RemoveContainer" containerID="4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5"
Jul 28 18:32:22.173130 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.173114    2561 scope.go:117] "RemoveContainer" containerID="97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d"
Jul 28 18:32:22.180889 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.180874    2561 scope.go:117] "RemoveContainer" containerID="4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5"
Jul 28 18:32:22.181123 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:32:22.181106    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5\": container with ID starting with 4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5 not found: ID does not exist" containerID="4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5"
Jul 28 18:32:22.181186 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.181128    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5"} err="failed to get container status \"4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5\": rpc error: code = NotFound desc = could not find container \"4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5\": container with ID starting with 4938c9a3c78190eed859fbe3e0f7d3b9721a33f98c1904d7e6362512033432e5 not found: ID does not exist"
Jul 28 18:32:22.181186 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.181144    2561 scope.go:117] "RemoveContainer" containerID="97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d"
Jul 28 18:32:22.181377 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:32:22.181357    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d\": container with ID starting with 97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d not found: ID does not exist" containerID="97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d"
Jul 28 18:32:22.181421 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.181383    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d"} err="failed to get container status \"97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d\": rpc error: code = NotFound desc = could not find container \"97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d\": container with ID starting with 97ea1064d92f077471dc0f73d81587ee519ba151a02240839bd861386ea3980d not found: ID does not exist"
Jul 28 18:32:22.186737 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.186714    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"]
Jul 28 18:32:22.191573 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:22.191548    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9b5b66-openshift-default-c5bb9b444-vs26d"]
Jul 28 18:32:23.920313 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:23.920274    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" path="/var/lib/kubelet/pods/c760866f-27dd-4ccf-9816-d5dc0fa21161/volumes"
Jul 28 18:32:28.908153 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:28.908084    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"]
Jul 28 18:32:28.908604 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:28.908418    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy" containerID="cri-o://2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b" gracePeriod=30
Jul 28 18:32:34.162480 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.162459    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:32:34.219082 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.219022    2561 generic.go:356] "Generic (PLEG): container finished" podID="923713c2-299e-46af-9e23-054abf3e130b" containerID="2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b" exitCode=0
Jul 28 18:32:34.219082 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.219066    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"
Jul 28 18:32:34.219254 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.219119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" event={"ID":"923713c2-299e-46af-9e23-054abf3e130b","Type":"ContainerDied","Data":"2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b"}
Jul 28 18:32:34.219254 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.219167    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4" event={"ID":"923713c2-299e-46af-9e23-054abf3e130b","Type":"ContainerDied","Data":"e02e7edd27e36c0af0ead80e0a264dd6b950d92495ecf739d0076d00b0e205be"}
Jul 28 18:32:34.219254 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.219190    2561 scope.go:117] "RemoveContainer" containerID="2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b"
Jul 28 18:32:34.227128 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.227109    2561 scope.go:117] "RemoveContainer" containerID="e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af"
Jul 28 18:32:34.234473 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.234457    2561 scope.go:117] "RemoveContainer" containerID="2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b"
Jul 28 18:32:34.234681 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:32:34.234665    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b\": container with ID starting with 2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b not found: ID does not exist" containerID="2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b"
Jul 28 18:32:34.234744 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.234689    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b"} err="failed to get container status \"2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b\": rpc error: code = NotFound desc = could not find container \"2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b\": container with ID starting with 2a833d80c85cd1fdbc5adf80fa5c1b72ec98c2bbdb51a4fecc18dff414f7f88b not found: ID does not exist"
Jul 28 18:32:34.234744 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.234703    2561 scope.go:117] "RemoveContainer" containerID="e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af"
Jul 28 18:32:34.234950 ip-10-0-142-195 kubenswrapper[2561]: E0728 18:32:34.234930    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af\": container with ID starting with e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af not found: ID does not exist" containerID="e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af"
Jul 28 18:32:34.235006 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.234956    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af"} err="failed to get container status \"e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af\": rpc error: code = NotFound desc = could not find container \"e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af\": container with ID starting with e81fb177bc3fea2594588dd6ea145ee812d11827845ad06297155fc102e9e7af not found: ID does not exist"
Jul 28 18:32:34.251378 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251360    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-data\") pod \"923713c2-299e-46af-9e23-054abf3e130b\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") "
Jul 28 18:32:34.251468 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251399    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/923713c2-299e-46af-9e23-054abf3e130b-istio-podinfo\") pod \"923713c2-299e-46af-9e23-054abf3e130b\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") "
Jul 28 18:32:34.251468 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251425    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-certs\") pod \"923713c2-299e-46af-9e23-054abf3e130b\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") "
Jul 28 18:32:34.251468 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251456    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-credential-socket\") pod \"923713c2-299e-46af-9e23-054abf3e130b\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") "
Jul 28 18:32:34.251630 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251481    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q75jz\" (UniqueName: \"kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-kube-api-access-q75jz\") pod \"923713c2-299e-46af-9e23-054abf3e130b\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") "
Jul 28 18:32:34.251630 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251505    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/923713c2-299e-46af-9e23-054abf3e130b-istiod-ca-cert\") pod \"923713c2-299e-46af-9e23-054abf3e130b\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") "
Jul 28 18:32:34.251630 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251535    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-envoy\") pod \"923713c2-299e-46af-9e23-054abf3e130b\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") "
Jul 28 18:32:34.251630 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251557    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-istio-token\") pod \"923713c2-299e-46af-9e23-054abf3e130b\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") "
Jul 28 18:32:34.251630 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251584    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-socket\") pod \"923713c2-299e-46af-9e23-054abf3e130b\" (UID: \"923713c2-299e-46af-9e23-054abf3e130b\") "
Jul 28 18:32:34.251881 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251740    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "923713c2-299e-46af-9e23-054abf3e130b" (UID: "923713c2-299e-46af-9e23-054abf3e130b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:34.251881 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251761    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "923713c2-299e-46af-9e23-054abf3e130b" (UID: "923713c2-299e-46af-9e23-054abf3e130b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:34.252051 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251900    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-credential-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:34.252051 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251932    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-certs\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:34.252051 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.251936    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "923713c2-299e-46af-9e23-054abf3e130b" (UID: "923713c2-299e-46af-9e23-054abf3e130b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:34.252241 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.252075    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/923713c2-299e-46af-9e23-054abf3e130b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "923713c2-299e-46af-9e23-054abf3e130b" (UID: "923713c2-299e-46af-9e23-054abf3e130b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:32:34.252303 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.252268    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-data" (OuterVolumeSpecName: "istio-data") pod "923713c2-299e-46af-9e23-054abf3e130b" (UID: "923713c2-299e-46af-9e23-054abf3e130b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:34.253437 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.253417    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/923713c2-299e-46af-9e23-054abf3e130b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "923713c2-299e-46af-9e23-054abf3e130b" (UID: "923713c2-299e-46af-9e23-054abf3e130b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 18:32:34.253685 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.253671    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "923713c2-299e-46af-9e23-054abf3e130b" (UID: "923713c2-299e-46af-9e23-054abf3e130b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:32:34.254068 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.254044    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-istio-token" (OuterVolumeSpecName: "istio-token") pod "923713c2-299e-46af-9e23-054abf3e130b" (UID: "923713c2-299e-46af-9e23-054abf3e130b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:32:34.254140 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.254080    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-kube-api-access-q75jz" (OuterVolumeSpecName: "kube-api-access-q75jz") pod "923713c2-299e-46af-9e23-054abf3e130b" (UID: "923713c2-299e-46af-9e23-054abf3e130b"). InnerVolumeSpecName "kube-api-access-q75jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:32:34.352959 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.352938    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q75jz\" (UniqueName: \"kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-kube-api-access-q75jz\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:34.352959 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.352958    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/923713c2-299e-46af-9e23-054abf3e130b-istiod-ca-cert\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:34.353111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.352968    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-envoy\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:34.353111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.352976    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/923713c2-299e-46af-9e23-054abf3e130b-istio-token\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:34.353111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.352984    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-workload-socket\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:34.353111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.352991    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/923713c2-299e-46af-9e23-054abf3e130b-istio-data\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:34.353111 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.352999    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/923713c2-299e-46af-9e23-054abf3e130b-istio-podinfo\") on node \"ip-10-0-142-195.ec2.internal\" DevicePath \"\""
Jul 28 18:32:34.542678 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.542654    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"]
Jul 28 18:32:34.546880 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:34.546855    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c73c1e-openshift-default-66557f49c6-rcwq4"]
Jul 28 18:32:35.542405 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:35.542373    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5fdf77d766-tsrc7_080af2ac-3e19-4afb-afbd-a0e77b4e9c42/manager/0.log"
Jul 28 18:32:35.920628 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:35.920550    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="923713c2-299e-46af-9e23-054abf3e130b" path="/var/lib/kubelet/pods/923713c2-299e-46af-9e23-054abf3e130b/volumes"
Jul 28 18:32:36.031770 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:36.031741    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c7c5665b5-fr8dz_9a64e393-3b41-4e30-9481-beca23a922f8/copy-manifests/0.log"
Jul 28 18:32:36.039241 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:36.039218    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c7c5665b5-fr8dz_9a64e393-3b41-4e30-9481-beca23a922f8/manager/0.log"
Jul 28 18:32:36.993736 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:36.993698    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ccld6_5c0f01cc-7e11-473d-a9d9-c3ed28e22e1b/postgres/0.log"
Jul 28 18:32:38.558305 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:38.558272    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-88brq_2b51f0a9-c131-463f-a860-f4bb81948f22/manager/0.log"
Jul 28 18:32:38.940564 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:38.940487    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fvps8_6d5196e9-e886-469a-8b34-d0605c4bc947/registry-server/0.log"
Jul 28 18:32:39.703777 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:39.703749    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cf8frj_725b8dbe-d66c-4ff7-841d-b9ee89319cf2/istio-proxy/0.log"
Jul 28 18:32:40.225378 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:40.225348    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7gcxx_bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f/istio-proxy/1.log"
Jul 28 18:32:40.359070 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:40.359036    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tgh68_e2229acb-e2b4-4af4-b01f-a9537c2a7776/payload-pre-processing/0.log"
Jul 28 18:32:40.497600 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:40.497568    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-265dr_f09fd716-542d-4aa0-93e3-688e2617c874/payload-processing/0.log"
Jul 28 18:32:41.132899 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:41.132868    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-9l2z7_23409785-2647-4616-9591-a91b72dc98d9/main/0.log"
Jul 28 18:32:41.375182 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:41.375152    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz6r5l_d36d5480-c71c-4bdd-b7ec-10f0e0e12213/main/0.log"
Jul 28 18:32:47.661303 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661227    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sx94q/must-gather-xp4p8"]
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661573    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661586    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661602    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661610    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661625    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053a4136-134f-48a1-bc30-ab503d2aaf81" containerName="payload-processing"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661631    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="053a4136-134f-48a1-bc30-ab503d2aaf81" containerName="payload-processing"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661640    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661647    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661654    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661659    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661665    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aaaf107-26fb-4d4a-9734-f068c9e8e528" containerName="payload-processing"
Jul 28 18:32:47.661675 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661672    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aaaf107-26fb-4d4a-9734-f068c9e8e528" containerName="payload-processing"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661682    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661688    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661696    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99bdc937-fa93-4693-953d-0fad572e1e35" containerName="payload-pre-processing"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661702    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="99bdc937-fa93-4693-953d-0fad572e1e35" containerName="payload-pre-processing"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661710    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661715    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661720    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661724    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661730    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661735    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661792    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661800    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661806    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aaaf107-26fb-4d4a-9734-f068c9e8e528" containerName="payload-processing"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661812    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661817    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661824    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661832    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="39582a9d-83cd-4429-8395-4d7d5361b7a3" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661840    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="053a4136-134f-48a1-bc30-ab503d2aaf81" containerName="payload-processing"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661846    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661853    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661858    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="99bdc937-fa93-4693-953d-0fad572e1e35" containerName="payload-pre-processing"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661919    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661926    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="923713c2-299e-46af-9e23-054abf3e130b" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661941    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661946    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8aea9b-4469-4a95-bae5-6ba06c079e03" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.661992    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="95ab2be5-55d1-49ad-848a-df2fda98948d" containerName="istio-proxy"
Jul 28 18:32:47.662049 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.662003    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c760866f-27dd-4ccf-9816-d5dc0fa21161" containerName="istio-proxy"
Jul 28 18:32:47.665187 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.665169    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sx94q/must-gather-xp4p8"
Jul 28 18:32:47.667800 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.667775    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sx94q\"/\"kube-root-ca.crt\""
Jul 28 18:32:47.667975 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.667958    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sx94q\"/\"openshift-service-ca.crt\""
Jul 28 18:32:47.668146 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.668124    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sx94q\"/\"default-dockercfg-t679m\""
Jul 28 18:32:47.673265 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.673243    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sx94q/must-gather-xp4p8"]
Jul 28 18:32:47.766740 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.766715    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a91b8b0b-ee73-45db-9bc9-2229a34c0160-must-gather-output\") pod \"must-gather-xp4p8\" (UID: \"a91b8b0b-ee73-45db-9bc9-2229a34c0160\") " pod="openshift-must-gather-sx94q/must-gather-xp4p8"
Jul 28 18:32:47.766896 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.766755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttb25\" (UniqueName: \"kubernetes.io/projected/a91b8b0b-ee73-45db-9bc9-2229a34c0160-kube-api-access-ttb25\") pod \"must-gather-xp4p8\" (UID: \"a91b8b0b-ee73-45db-9bc9-2229a34c0160\") " pod="openshift-must-gather-sx94q/must-gather-xp4p8"
Jul 28 18:32:47.867684 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.867652    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a91b8b0b-ee73-45db-9bc9-2229a34c0160-must-gather-output\") pod \"must-gather-xp4p8\" (UID: \"a91b8b0b-ee73-45db-9bc9-2229a34c0160\") " pod="openshift-must-gather-sx94q/must-gather-xp4p8"
Jul 28 18:32:47.867856 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.867693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttb25\" (UniqueName: \"kubernetes.io/projected/a91b8b0b-ee73-45db-9bc9-2229a34c0160-kube-api-access-ttb25\") pod \"must-gather-xp4p8\" (UID: \"a91b8b0b-ee73-45db-9bc9-2229a34c0160\") " pod="openshift-must-gather-sx94q/must-gather-xp4p8"
Jul 28 18:32:47.868037 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.868015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a91b8b0b-ee73-45db-9bc9-2229a34c0160-must-gather-output\") pod \"must-gather-xp4p8\" (UID: \"a91b8b0b-ee73-45db-9bc9-2229a34c0160\") " pod="openshift-must-gather-sx94q/must-gather-xp4p8"
Jul 28 18:32:47.876490 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.876469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttb25\" (UniqueName: \"kubernetes.io/projected/a91b8b0b-ee73-45db-9bc9-2229a34c0160-kube-api-access-ttb25\") pod \"must-gather-xp4p8\" (UID: \"a91b8b0b-ee73-45db-9bc9-2229a34c0160\") " pod="openshift-must-gather-sx94q/must-gather-xp4p8"
Jul 28 18:32:47.975823 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:47.975758    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sx94q/must-gather-xp4p8"
Jul 28 18:32:48.105554 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:48.105528    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sx94q/must-gather-xp4p8"]
Jul 28 18:32:48.107933 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:32:48.107907    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda91b8b0b_ee73_45db_9bc9_2229a34c0160.slice/crio-63debc68eed5ece2dfe1d263ca4be20d9dad371051864aaf5114b4b98a6c53ea WatchSource:0}: Error finding container 63debc68eed5ece2dfe1d263ca4be20d9dad371051864aaf5114b4b98a6c53ea: Status 404 returned error can't find the container with id 63debc68eed5ece2dfe1d263ca4be20d9dad371051864aaf5114b4b98a6c53ea
Jul 28 18:32:48.110213 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:48.110196    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 18:32:48.283970 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:48.283937    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sx94q/must-gather-xp4p8" event={"ID":"a91b8b0b-ee73-45db-9bc9-2229a34c0160","Type":"ContainerStarted","Data":"63debc68eed5ece2dfe1d263ca4be20d9dad371051864aaf5114b4b98a6c53ea"}
Jul 28 18:32:49.292231 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:49.292125    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sx94q/must-gather-xp4p8" event={"ID":"a91b8b0b-ee73-45db-9bc9-2229a34c0160","Type":"ContainerStarted","Data":"976e74f6d8f50ad0a479c1b5e53ed410278e0a43934ea6a1697ede35c189e115"}
Jul 28 18:32:49.292231 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:49.292178    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sx94q/must-gather-xp4p8" event={"ID":"a91b8b0b-ee73-45db-9bc9-2229a34c0160","Type":"ContainerStarted","Data":"452e1cbbfcc5d90845a0ba23388e15966d7ca8c067ec8145f92ba150ee6556f9"}
Jul 28 18:32:49.310771 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:49.310720    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sx94q/must-gather-xp4p8" podStartSLOduration=1.416889776 podStartE2EDuration="2.310705014s" totalImagesPullingTime="893.815238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:32:49.30962791 +0000 UTC m=+3509.910224747" watchObservedRunningTime="2026-07-28 18:32:49.310705014 +0000 UTC m=+3509.911301879"
Jul 28 18:32:50.661406 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:50.661356    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2fb74_e90f86d2-419b-4d0e-adf0-ffb6bb39aab4/global-pull-secret-syncer/0.log"
Jul 28 18:32:50.873059 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:50.873031    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m5fxb_75e89921-c386-4800-9960-c394f55f715a/konnectivity-agent/0.log"
Jul 28 18:32:50.954625 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:50.954534    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-195.ec2.internal_49081ef257dd473af8f28ab50c3a3bc9/haproxy/0.log"
Jul 28 18:32:56.260697 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:56.260666    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-88brq_2b51f0a9-c131-463f-a860-f4bb81948f22/manager/0.log"
Jul 28 18:32:56.400117 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:56.399374    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fvps8_6d5196e9-e886-469a-8b34-d0605c4bc947/registry-server/0.log"
Jul 28 18:32:59.023768 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:59.023736    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vvld_96fc0659-8ae2-462e-8765-eea74a43b1f7/node-exporter/0.log"
Jul 28 18:32:59.049452 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:59.049418    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vvld_96fc0659-8ae2-462e-8765-eea74a43b1f7/kube-rbac-proxy/0.log"
Jul 28 18:32:59.076822 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:32:59.076786    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vvld_96fc0659-8ae2-462e-8765-eea74a43b1f7/init-textfile/0.log"
Jul 28 18:33:00.533281 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.533239    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"]
Jul 28 18:33:00.539172 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.539142    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.548914 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.548886    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"]
Jul 28 18:33:00.714448 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.714398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-sys\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.714649 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.714463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-lib-modules\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.714649 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.714531    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpknt\" (UniqueName: \"kubernetes.io/projected/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-kube-api-access-xpknt\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.714649 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.714563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-proc\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.714649 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.714634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-podres\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.816086 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.815999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-podres\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.816086 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.816064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-sys\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.816332 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.816106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-lib-modules\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.816332 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.816158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpknt\" (UniqueName: \"kubernetes.io/projected/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-kube-api-access-xpknt\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.816332 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.816187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-proc\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.816332 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.816217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-podres\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.816546 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.816344    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-sys\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.816546 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.816419    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-proc\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.816546 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.816512    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-lib-modules\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.826367 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.826334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpknt\" (UniqueName: \"kubernetes.io/projected/43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3-kube-api-access-xpknt\") pod \"perf-node-gather-daemonset-r7v7n\" (UID: \"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3\") " pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.857418 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.857378    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:00.941201 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:00.941171    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-cgbdb_c15e565f-1151-4447-992b-c9a6c5d80fef/networking-console-plugin/0.log"
Jul 28 18:33:01.049882 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:01.049851    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"]
Jul 28 18:33:01.053796 ip-10-0-142-195 kubenswrapper[2561]: W0728 18:33:01.053768    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod43e3e0cd_a0cc_4b21_ab4d_5594fa656ae3.slice/crio-1aee33b1e8d9bc1484f03c85cd223e70f288281a120e3c02959147fd6ce2d0fc WatchSource:0}: Error finding container 1aee33b1e8d9bc1484f03c85cd223e70f288281a120e3c02959147fd6ce2d0fc: Status 404 returned error can't find the container with id 1aee33b1e8d9bc1484f03c85cd223e70f288281a120e3c02959147fd6ce2d0fc
Jul 28 18:33:01.386218 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:01.386117    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n" event={"ID":"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3","Type":"ContainerStarted","Data":"6ff4c39bdee8c73870578cce91befbf10c8659af67afcb61abc1b9737c833fdb"}
Jul 28 18:33:01.386218 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:01.386192    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n" event={"ID":"43e3e0cd-a0cc-4b21-ab4d-5594fa656ae3","Type":"ContainerStarted","Data":"1aee33b1e8d9bc1484f03c85cd223e70f288281a120e3c02959147fd6ce2d0fc"}
Jul 28 18:33:01.386412 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:01.386223    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:01.406000 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:01.405922    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n" podStartSLOduration=1.405897925 podStartE2EDuration="1.405897925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:33:01.405602139 +0000 UTC m=+3522.006198973" watchObservedRunningTime="2026-07-28 18:33:01.405897925 +0000 UTC m=+3522.006494754"
Jul 28 18:33:01.580303 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:01.580269    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/2.log"
Jul 28 18:33:01.591288 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:01.591252    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cbrrn_021de76a-5c1f-4d8b-9fdc-3daaf3c65cb8/console-operator/3.log"
Jul 28 18:33:02.712178 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:02.712150    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-kl7ns_9ed8b99d-180d-426f-8820-6f5ae7a52a4c/volume-data-source-validator/0.log"
Jul 28 18:33:03.810548 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:03.810514    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bln5h_23bc825a-ecbd-43d1-8975-1b4c8877a57a/dns/0.log"
Jul 28 18:33:03.835646 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:03.835620    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bln5h_23bc825a-ecbd-43d1-8975-1b4c8877a57a/kube-rbac-proxy/0.log"
Jul 28 18:33:03.971627 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:03.971589    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2m9zc_1b94a8c0-d42f-47a0-b67c-7fde407b12ac/dns-node-resolver/0.log"
Jul 28 18:33:04.658041 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:04.658006    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k58z5_c71f9d00-2131-426f-9461-555c7f32b213/node-ca/0.log"
Jul 28 18:33:05.646844 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:05.646818    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cf8frj_725b8dbe-d66c-4ff7-841d-b9ee89319cf2/istio-proxy/0.log"
Jul 28 18:33:05.875389 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:05.875353    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7gcxx_bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f/istio-proxy/0.log"
Jul 28 18:33:05.936441 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:05.936358    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7gcxx_bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f/istio-proxy/1.log"
Jul 28 18:33:05.978658 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:05.978625    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tgh68_e2229acb-e2b4-4af4-b01f-a9537c2a7776/payload-pre-processing/0.log"
Jul 28 18:33:06.019763 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:06.019708    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-265dr_f09fd716-542d-4aa0-93e3-688e2617c874/payload-processing/0.log"
Jul 28 18:33:06.875973 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:06.875933    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-flctc_895a724c-ab30-4e82-91b9-c71aaa41e7f5/serve-healthcheck-canary/0.log"
Jul 28 18:33:07.402123 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:07.402070    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sx94q/perf-node-gather-daemonset-r7v7n"
Jul 28 18:33:07.455113 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:07.454253    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-wdx84_2383fc0a-e439-463b-b5ca-a8803d864945/insights-operator/0.log"
Jul 28 18:33:07.455469 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:07.455452    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-wdx84_2383fc0a-e439-463b-b5ca-a8803d864945/insights-operator/1.log"
Jul 28 18:33:07.477847 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:07.477825    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5rkdl_aecd2a92-b706-4ba2-96b5-93314f768397/kube-rbac-proxy/0.log"
Jul 28 18:33:07.500723 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:07.500690    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5rkdl_aecd2a92-b706-4ba2-96b5-93314f768397/exporter/0.log"
Jul 28 18:33:07.524284 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:07.524251    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5rkdl_aecd2a92-b706-4ba2-96b5-93314f768397/extractor/0.log"
Jul 28 18:33:10.546886 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:10.546837    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5fdf77d766-tsrc7_080af2ac-3e19-4afb-afbd-a0e77b4e9c42/manager/0.log"
Jul 28 18:33:10.790222 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:10.790188    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c7c5665b5-fr8dz_9a64e393-3b41-4e30-9481-beca23a922f8/manager/0.log"
Jul 28 18:33:10.811084 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:10.811011    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c7c5665b5-fr8dz_9a64e393-3b41-4e30-9481-beca23a922f8/copy-manifests/0.log"
Jul 28 18:33:10.894902 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:10.894865    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cf8frj_725b8dbe-d66c-4ff7-841d-b9ee89319cf2/istio-proxy/0.log"
Jul 28 18:33:11.082807 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:11.082721    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7gcxx_bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f/istio-proxy/0.log"
Jul 28 18:33:11.143470 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:11.143437    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7gcxx_bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f/istio-proxy/1.log"
Jul 28 18:33:11.182609 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:11.182574    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tgh68_e2229acb-e2b4-4af4-b01f-a9537c2a7776/payload-pre-processing/0.log"
Jul 28 18:33:11.214773 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:11.214736    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-265dr_f09fd716-542d-4aa0-93e3-688e2617c874/payload-processing/0.log"
Jul 28 18:33:12.197626 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:12.197547    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8c847c87f-b6k9p_8e32e97e-2aeb-42cb-9537-f04305fd24eb/manager/0.log"
Jul 28 18:33:12.251400 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:12.251365    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mwskh_1a1c6020-3cef-4138-816b-43c33d0a62c1/openshift-lws-operator/0.log"
Jul 28 18:33:12.677232 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:12.677206    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cf8frj_725b8dbe-d66c-4ff7-841d-b9ee89319cf2/istio-proxy/0.log"
Jul 28 18:33:12.881444 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:12.881408    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7gcxx_bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f/istio-proxy/0.log"
Jul 28 18:33:12.937974 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:12.937908    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7gcxx_bc11ce8e-7b9c-4eda-9d1a-c4051ca3644f/istio-proxy/1.log"
Jul 28 18:33:12.981367 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:12.981340    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tgh68_e2229acb-e2b4-4af4-b01f-a9537c2a7776/payload-pre-processing/0.log"
Jul 28 18:33:13.014039 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:13.014000    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-265dr_f09fd716-542d-4aa0-93e3-688e2617c874/payload-processing/0.log"
Jul 28 18:33:17.246043 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:17.246019    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-767g4_151361e3-6472-4146-8bcc-a07642a27801/migrator/0.log"
Jul 28 18:33:17.267435 ip-10-0-142-195 kubenswrapper[2561]: I0728 18:33:17.267410    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-767g4_151361e3-6472-4146-8bcc-a07642a27801/graceful-termination/0.log"